NCSA - SAN Fibre Channel Infrastructure

Quick links:
	SAN Architecture
	SAN Monitoring
	White Papers
	Scripts and Source Code

SAN Architecture

Copper	Infrastructure	Visio Topology	Performance Graphs
Cobalt 1	Infrastructure	Visio Topology	MRTG Unavailable
Cobalt 2	Infrastructure	Visio Topology	MRTG Unavailable
Mercury	Infrastructure	Visio Topology	MRTG Unavailable
Infrastructure 1	Infrastructure	Visio Topology	MRTG Unavailable
Infrastructure 2	Infrastructure	Visio Topology	MRTG Unavailable

SAN Monitoring

White Papers

Apr 2007

SAN Persistent Binding and Multipathing in the 2.6 Kernel

Tutorial slides from presentation at the LCI 2007 Conference covering: Persistent naming of devices using UDEV on RedHat 4 Linux multipathing using tools builtin to the 2.6 kernel. Samples and references based on RedHat 4

Mar 2007

SAN Lessons Learned (white paper)

Presentation Slides

A collection of knowledge and tools based on designing, installing and running Storage Area Networks for infrastructure and supercomputing over the past 5 years.

The slides are from a short presentation of the paper at the LCI 2007 Conference.

Oct 2006

Cutting Teeth on iSCSI

Test of iSCSI on Windows and Linux comparing setup and performance of a software initiator versus and HBA (QLA4050c).

Scripts and Source Code

File	Description
NCSA::Brocade	Perl Module extending the BrocadeSTK
San Backup & Profile	san_profile.pl Generates map of SAN showing what switch & port each device (by alias name) is connected to. cfgupload.pl Get config from switch, save to a local file. File is suitable format to dowload directly to switch. get_san_backup KSH wrapper script, calls san_profile and cfgupload on specified switches and fabrics. Saves all files in a directory named with curennt datetime. Old backups are tar-gzip'd. Suitable to be called by cron. NOTE: Requires NCSA::Brocade module.
Fastt Monitor	Pull logs from Engenio (formerly LSI) disks and send one line summary to local syslogd process. Also saves local copy of all disk logs. Runs as a daemon, pulls logs on a 5 minute (customizable) cycle.
Custom Nagios checks & actions	Nagios checks and actions for Fastt Monitor and Logsurfer.
Logsurfer sample configs	Sample logsurfer configs, rc-style startup script and supporting files. Sample configs are for Brocade silkworm switches, Engenio (LSI) disks and DataDirect disks.
Multi-port-mon	Show throughput on any switch port (even ports from different switches). Requires Perl, Net::SNMP and Term::Screen. Tested on Linux with Brocade switches. Other switch types will work, but OID's will have to be updated in the code.
Set Port State	Script to change (enable/disable) or show state of a switch port. Useful in conjunction with the above multi-port-mon for disabling switch ports in testing failover solutions. Uses SNMP to communicate with the switch. Tested on RedHat Linux with Brocade switches. Other switches should work by setting the appropriate OID in the code. Requires ksh and net-snmp (http://www.net-snmp.org/).
Sysfs Fibre Channel Tools	Scripts to simplify attaching, displaying, deleting fibre channel luns using 2.6 kernel sysfs features. Includes: lip_fc_hosts Send lip to all local FC HBAs. scan_fc_luns Scan all local FC HBAs for new luns and present them to the kernel. ls_fc_luns List HBA WWPN, target WWPN, kernel device name, scsi H:B:T:L tuple and scsi_id for all fibre channel luns. delete_fc_luns Delete (detach) all fibre channel luns from the system. path_prio.sh Return priority value for a given device. Make sure variable FILE_PRIMARY_PATHS resolves to a real file with appropriate data (host wwpn, target wwpn, scsi_id and priority value) for each lun. Requires Linux 2.6 Kernel and sysfs pseudo-filesystem (sysfsutils).