JNI Sun Fibre Channel

Sun Fibre Channel

Sun Fibre ChannelTroubleshooting

Guide for JNI FC64-1063 HBA’s

By Gary Gresser TS2 Asia/Pacific Version 1.0 (7/25)Contributions by Martin Bowesman and Les Ibrahim

1

Sun Fibre Channel

Troubleshooting Connectivity Problems (FC-SW only).

1) Collect the following logs/outputs:

/kernel/drv/fcaw.conf/kernel/drv/sd.conf/var/adm/messages*showrev –p

2) Check OS patch and HBA Fcode/Driver revision levels as per the latest ESM http://www.lss.emc.com/opensymm/hostmatrix/support.htm. For HBA revision levels refer to the “Fcode and Driver Revision Levels” section 3. (Recommend updating to the latest levels).

3) Check configuration of /kernel/drv/fcaw.conf and /kernel/drv/sd.conf as per the “EMC Symmetrix Fibre Channel with JNI Tachyon Host Bus Adapters in the Solaris Environment” PDF document at http://www.jni.com.

4) Confirm link initialisation between the HBA to the Switch. Refer to the “Link Initialisation” section 6.

5) Is the HBA logging into the correct FA?

Refer to the “World Wide Names” section 7 and the “Persistent Binding” section 9. Refer to the “Symmetrix Fibre Channel Troubleshooting” document on how to check this from the Symmetrix.

6) Is the HBA discovering devices?

Refer to the “Persistent Binding” section 9, the “Device Discovery” section 13 and the “Hardware Paths” section 14. Refer to the “Symmetrix Fibre Channel Troubleshooting” document on how to check the VCMDB for device access. NOTE: LUN values from the Symmetrix are in hexadecimal while entries in the /kernel/drv/sd.conf are in decimal.

7) For the description of diagnostic messages, logged by the HBA, refer to the “Diagnostic” section 17, the fcaw driver man pages and the /opt/JNIfcaw/diagnostics text file.


2

http://www.jni.com/

http://www.lss.emc.com/opensymm/hostmatrix/support.htm

Sun Fibre Channel

Fcode and Driver Revision Levels.

Determine Fcode Revision Level:

Determining Fcode from the “prtconf” command:

sun8:/ # prtconf -vp > /tmp/prtconf.txtsun8:/ # more /tmp/prtconf.txtSystem Configuration: Sun Microsystems sun4uMemory size: 256 MegabytesSystem Peripherals (PROM Nodes):

Node 0xf002a594 clock-frequency: 04e33880 previous-reset-reason: 'S-POR' reset-reason: 'S-POR' fatal-reset-info: 00006000 banner-name: '4-slot Sun Enterprise 3000' idprom: 01800800.208df700.00000000.8df700a9.00000000.00000000.00000000.00000000 breakpoint-trap: 0000007f #size-cells: 00000002 name: 'SUNW,Ultra-Enterprise'

Node 0xf002d8d4 name: 'packages'

Node 0xf0036f6c iso6429-1983-colors: name: 'terminal-emulator'/fcaw...skipping Node 0xf00ec278 device_type: 'scsi' name: 'fcaw' current-wwpn: 200000e0.694048b4 sbus_slot: 00000001 intr: 00000003.00000000 interrupts: 00000003 sbus_irq: 00000003 scsi-initiator-id: 0000007d fcode_cksum: 001a5e9b current-wwn-lo: 694048b4 current-wwn-hi: 100000e0 default-wwn-lo: 694048b4 default-wwn-hi: 100000e0 cpld_revision: 00000004 reg: 00000001.00000000.00008000.00000001.00008000.00008000.00000001.00010000.00000002.00000001.00018000.00000002.00000001.00020000.00000004.00000001.00030000.00000200 copyright: 'Copyright (c) 1999 by JNI.' fcode_version: 'Version 13.5.7' fcode_revision: 'Version 13.5.7' model: 'FCW' manufacturer: 'JNI'

OR

sun8:/ # prtconf -vp | grep fcode fcode-debug?: 'false' soc-fcode: '1.3 95/09/28' fcode_cksum: 001a5e9b fcode_version: 'Version 13.5.7' fcode_revision: 'Version 13.5.7' fcode_cksum: 001a5e9b fcode_version: 'Version 13.5.7' fcode_revision: 'Version 13.5.7'


Separate entry for each HBA installed.

Fcode revision level.

1st HBA

2nd HBA

3

Sun Fibre Channel

From the /var/adm/messages* file, depending on when the last reboot took place:

Jul 4 15:16:07 sun8 genunix: [ID 936769 kern.info] fas1 is /sbus@3,0/SUNW,fas@0,8800000Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 4 15:16:08 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)Jul 4 15:16:09 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 4 15:16:10 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011000 (50060482C3A16002:50060482C3A16002) available.Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCWJul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: 64-bit SBus 2: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E069404AE6Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: All Rights Reserved.Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total DMA space used: 5312541 bytes >Jul 4 15:16:43 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...

Notes.

Fcode is always loaded. Refer to the ‘EMC Symmetrix Fibre Channel with JNI Tachyon Host Bus Adapters in the Solaris

Environment’ PDF document and Fcode ‘readme.txt’ on how to upgrade. As the ‘prtconf –vp’ command does not collect hardware paths, correlating the fcode revision

levels to HBA instance numbers is not possible. The ‘prtconf –vp | grep fcode’ command may display fcode revision levels for other adapters.


HBA 0

HBA 1

Fcode revision level for HBA 0.

Fcode revision level for HBA 1.

4

Sun Fibre Channel

Determining Driver Revision Levels:


Jul 4 15:16:07 sun8 genunix: [ID 936769 kern.info] fas1 is /sbus@3,0/SUNW,fas@0,8800000Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 4 15:16:08 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)Jul 4 15:16:09 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 4 15:16:10 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011000 (50060482C3A16002:50060482C3A16002) available.Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCWJul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: 64-bit SBus 2: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E069404AE6Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: All Rights Reserved.Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total DMA space used: 5312541 bytes >Jul 4 15:16:43 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...

Running the following command:

sun8:/ # pkginfo -l JNIfcaw PKGINST: JNIfcaw NAME: JNI Fibre Channel SCSI/IP HBA Driver CATEGORY: system,scsi ARCH: sparc VERSION: 2.6.10, March 4, 2002 VENDOR: JNI Corp. PSTAMP: JNIC,HBA INSTDATE: Apr 05 2002 16:33 STATUS: completely installed FILES: 8 installed pathnames 1 shared pathnames 2 directories 2 executables 2636 blocks used (approx)

Notes.

Refer to the ‘EMC Symmetrix Fibre Channel with JNI Tachyon Host Bus Adapters in the Solaris Environment’ PDF document on how to upgrade.



HBA 0

HBA 1

Driver revision for all HBA’s.

Driver revision for all HBA’s.

5

Sun Fibre Channel

Link Initialisation.


Jul 4 15:16:07 sun8 genunix: [ID 936769 kern.info] fas1 is /sbus@3,0/SUNW,fas@0,8800000Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 4 15:16:08 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)

Jul 4 15:16:09 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 4 15:16:10 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011000 (50060482C3A16002:50060482C3A16002) available.Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCWJul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: 64-bit SBus 2: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E069404AE6Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: All Rights Reserved.Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total DMA space used: 5312541 bytes >Jul 4 15:16:43 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...Jul 4 15:16:48 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 4 15:16:48 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0



HBA 0 has successfully logged into the switch.

Possible cable, HBA or switch problem for HBA 1.

HBA 0

HBA 1

Link has initialised for HBA 0.

6

Sun Fibre Channel

World Wide Names.


Jul 4 15:16:07 sun8 genunix: [ID 936769 kern.info] fas1 is /sbus@3,0/SUNW,fas@0,8800000Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 4 15:16:08 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)Jul 4 15:16:09 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 4 15:16:10 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011000 (50060482C3A16002:50060482C3A16002) available.Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCWJul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: 64-bit SBus 2: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E069404AE6Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: All Rights Reserved.Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total DMA space used: 5312541 bytes >Jul 4 15:16:43 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...Jul 4 15:16:48 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 4 15:16:48 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 4 15:16:48 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.

Login Table information from the 8F utility:

UTILITY 8F -- SCSI Adapter utility : TIME: JUL/03/02 23:04:08------------------------------------

PORT : 00LOOP ID : NONE LINK STATE : ONLINE: N-PORT: S-ID 011000...

HOST SID PORT NAME (WWN) NODE NAME RCV BUF CREDIT CLASS-----------------------------------------------------------------------------FFFFFE 2000006069102282 1000006069102282 2112 BB 16 3 BROCADEFFFFFC 20FC006069102282 1000006069102282 2112 BB 16 3 N-PORT: 011000 N-PORT: 011D00011D00 200000E0694048B4 100000E0694048B4 2048 EE 4 3 JNI PRLI REQ: IFN RXD


WWPN of the FA that HBA 0 has logged into.

HBA 0

HBA 1

N_Port ID of the FA that HBA 0 has logged into.

WWPN for HBA 0. N_Port ID for HBA 0.

7

Sun Fibre Channel


Jul 4 15:16:07 sun8 genunix: [ID 936769 kern.info] fas1 is /sbus@3,0/SUNW,fas@0,8800000Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 4 15:16:08 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)Jul 4 15:16:09 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 4 15:16:10 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011000 (50060482C3A16002:50060482C3A16002) available.Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCWJul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: 64-bit SBus 2: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E069404AE6Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: All Rights Reserved.Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total DMA space used: 5312541 bytes >Jul 4 15:16:43 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...Jul 4 15:16:48 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 4 15:16:48 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 4 15:16:48 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.Jul 4 15:16:48 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>

Notes.

fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.

Zoning and Persistent Binding settings must be correct for this event to be logged. Refer to “Additional Information” 16 to determine how to obtain the WWPN of the HBA if none of

/var/adm/messages* files contain a reboot.



HBA 0

HBA 1

N_Port ID and WWPN information obtained from the switch’s Name Server. If this event is missing then HBA is not zoned to any FA’s.

This event indicates that the HBA has successfully logged into the FA.

8

Sun Fibre Channel

Persistent Binding.

Implemented through the /kernel/drv/sd.conf file.


Jul 4 15:16:07 sun8 genunix: [ID 936769 kern.info] fas1 is /sbus@3,0/SUNW,fas@0,8800000Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 4 15:16:07 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 4 15:16:08 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 4 15:16:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)Jul 4 15:16:09 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 4 15:16:10 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011000 (50060482C3A16002:50060482C3A16002) available.Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCWJul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: 64-bit SBus 2: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E069404AE6Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 4 15:16:12 sun8 fcaw: [ID 451854 kern.notice] fcaw1: All Rights Reserved.Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total IOPB space used: 1144256 bytes >Jul 4 15:16:13 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total DMA space used: 5312541 bytes >Jul 4 15:16:43 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...Jul 4 15:16:48 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 4 15:16:48 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 4 15:16:48 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.Jul 4 15:16:48 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>

From the /kernel/drv/fcaw.conf file:

def_hba_binding = "fas";

From the /kernel/drv/sd.conf file:

name="sd" class="scsi" target=9 lun=0 hba="fcaw0" wwn="50060482c3a16002";name="sd" class="scsi" target=9 lun=1 hba="fcaw0" wwn="50060482c3a16002";name="sd" class="scsi" target=9 lun=16 hba="fcaw0" wwn="50060482c3a16002";


N_Port ID and WWN information obtained from the switch’s Name Server. As the WWN from the Name Server matches the WWN entry in the /kernel/drv/sd.conf file, the HBA should now log into this FA.

Indicates that the HBA has logged into the correct FA and will bind (acquire) any devices discovered to Target 9. LUN’s are discovered based on the /kernel/drv/sd.conf file.

9

Sun Fibre Channel

Examples of Problems.

Example 1:


Jul 8 14:26:15 sun8 genunix: [ID 936769 kern.info] fas1 is /sbus@3,0/SUNW,fas@0,8800000Jul 8 14:26:15 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 8 14:26:15 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 8 14:26:15 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 8 14:26:15 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 8 14:26:15 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 8 14:26:15 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 8 14:26:15 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 8 14:26:16 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 8 14:26:17 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 8 14:26:17 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 8 14:26:17 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 8 14:26:17 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)Jul 8 14:26:18 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 8 14:26:18 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011100 (50060482C3A16022:50060482C3A16022) available.Jul 8 14:26:18 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011200 (50060482C3A16012:50060482C3A16012) available.Jul 8 14:26:18 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011300 (50060482C3A16032:50060482C3A16032) available.Jul 8 14:26:21 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCWJul 8 14:26:21 sun8 fcaw: [ID 451854 kern.notice] fcaw1: 64-bit SBus 2: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 8 14:26:21 sun8 fcaw: [ID 451854 kern.notice] fcaw1: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E069404AE6Jul 8 14:26:21 sun8 fcaw: [ID 451854 kern.notice] fcaw1: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 8 14:26:21 sun8 fcaw: [ID 451854 kern.notice] fcaw1: All Rights Reserved.Jul 8 14:26:21 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total IOPB space used: 1144256 bytes >Jul 8 14:26:21 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total DMA space used: 5312541 bytes >Jul 8 14:26:51 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...Jul 8 14:26:56 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 8 14:26:56 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 8 14:26:56 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>






WWN information obtained from the Name Server does not match WWN binding entry in /kernel/drv/sd.conf file. Either HBA zoned to incorrect FA’s or WWN binding entry incorrect.

Missing “fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.” event, as seen on previous page. HBA not logging into any FA.

10

Sun Fibre Channel

Example 2:


Jul 8 15:44:03 sun8 genunix: [ID 936769 kern.info] fas1 is /sbus@3,0/SUNW,fas@0,8800000Jul 8 15:44:03 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 8 15:44:03 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 8 15:44:03 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 8 15:44:03 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 8 15:44:03 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 8 15:44:03 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 8 15:44:03 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 8 15:44:03 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 8 15:44:04 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 8 15:44:04 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 8 15:44:04 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 8 15:44:04 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)Jul 8 15:44:05 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 8 15:44:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011000 (50060482C3A16002:50060482C3A16002) available.Jul 8 15:44:08 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCWJul 8 15:44:08 sun8 fcaw: [ID 451854 kern.notice] fcaw1: 64-bit SBus 2: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 8 15:44:08 sun8 fcaw: [ID 451854 kern.notice] fcaw1: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E069404AE6Jul 8 15:44:08 sun8 fcaw: [ID 451854 kern.notice] fcaw1: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 8 15:44:09 sun8 fcaw: [ID 451854 kern.notice] fcaw1: All Rights Reserved.Jul 8 15:44:09 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total IOPB space used: 1144256 bytes >Jul 8 15:44:09 sun8 fcaw: [ID 580805 kern.info] fcaw1: < Total DMA space used: 5312541 bytes >Jul 8 15:44:39 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...Jul 8 15:44:44 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 8 15:44:44 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 8 15:44:44 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>






Missing “fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.” event, as seen on page 9. HBA not logging into any FA.

WWN information obtained from the Name Server matches WWN binding entry in /kernel/drv/sd.conf file. HBA zoned to correct FA.

Incorrect instance numbers in /kernel/drv/sd.conf file.

11

Sun Fibre Channel

Example 3:


Jul 9 10:22:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: JNI Fibre Channel Adapter model FCWJul 9 10:22:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: 64-bit SBus 1: IRQ 3: FCODE Version 13.5.7 [1a5e9b]: SCSI ID 125: AL_PA 01Jul 9 10:22:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Fibre Channel WWNN: 100000E0694048B4 WWPN: 200000E0694048B4Jul 9 10:22:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: FCA SCSI/IP Driver Version 2.6.10, March 4, 2002 for Solaris 7Jul 9 10:22:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: All Rights Reserved.Jul 9 10:22:06 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total IOPB space used: 1144256 bytes >Jul 9 10:22:06 sun8 fcaw: [ID 580805 kern.info] fcaw0: < Total DMA space used: 5312541 bytes >Jul 9 10:22:06 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 9 10:22:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: New Fabric Parameters Received. Resetting...Jul 9 10:22:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWNJul 9 10:22:07 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 9 10:22:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180002FF)Jul 9 10:22:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 9 10:22:08 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011000 (50060482C3A16002:50060482C3A16002) available.Jul 9 10:22:11 sun8 fcaw: [ID 451854 kern.notice] fcaw1: JNI Fibre Channel Adapter model FCW...Jul 9 10:22:41 sun8 fcaw: [ID 451854 kern.notice] fcaw1: LINK DOWN: Check Connections...Jul 9 10:22:47 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 9 10:22:47 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 9 10:22:47 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 0: Port 011000 (50060482C3A16002:50060482C3A16002) online.Jul 9 10:22:47 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>Jul 9 10:22:47 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 0 Lun 0: Port 011000 (50060482C3A16002:50060482C3A16002) present.Jul 9 10:22:47 sun8 scsi: [ID 193665 kern.info] sd105 at fcaw0: target 0 lun 0Jul 9 10:22:47 sun8 genunix: [ID 936769 kern.info] sd105 is /sbus@2,0/fcaw@1,0/sd@0,0Jul 9 10:22:47 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@0,0 (sd105):Jul 9 10:22:47 sun8 corrupt label - wrong magic numberJul 9 10:22:47 sun8 scsi: [ID 365881 kern.info] Vendor 'EMC', product 'SYMMETRIX', 15360 512 byte blocksJul 9 10:22:47 sun8 scsi: [ID 193665 kern.info] sd16 at fas0: target 1 lun 0


def_hba_binding = "fcaw*";


name="sd" class="scsi" target=0 lun=0;


...





WWN’s match. HBA logging into correct FA.

Default binding enabled. The first FA the HBA logs into will be assigned to Target 0, the next to Target 1, etc…

Target 0 entries will now be used for device discovery.

12

Sun Fibre Channel

Device Discovery.


Jul 8 09:21:06 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 8 09:21:06 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 8 09:21:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.Jul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>Jul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 0: Port 011000 (50060482C3A16002:50060482C3A16002) present.Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd113 at fcaw0: target 9 lun 0Jul 8 09:21:07 sun8 genunix: [ID 936769 kern.info] sd113 is /sbus@2,0/fcaw@1,0/sd@9,0Jul 8 09:21:07 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,0 (sd113):Jul 8 09:21:07 sun8 corrupt label - wrong magic numberJul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] Vendor 'EMC', product 'SYMMETRIX', 15360 512 byte blocksJul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 1: Port 011000 (50060482C3A16002:50060482C3A16002) not present.Jul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 16: Port 011000 (50060482C3A16002:50060482C3A16002) present.Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd855 at fcaw0: target 9 lun 10Jul 8 09:21:07 sun8 genunix: [ID 936769 kern.info] sd855 is /sbus@2,0/fcaw@1,0/sd@9,10Jul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] <EMC-SYMMETRIX-5567 cyl 2183 alt 2 hd 15 sec 64>Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd16 at fas0: target 1 lun 0Jul 8 09:21:07 sun8 genunix: [ID 936769 kern.info] sd16 is /sbus@3,0/SUNW,fas@3,8800000/sd@1,0Jul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>Jul 8 09:21:08 sun8 scsi: [ID 193665 kern.info] sd21 at fas0: target 6 lun 0Jul 8 09:21:08 sun8 genunix: [ID 936769 kern.info] sd21 is /sbus@3,0/SUNW,fas@3,8800000/sd@6,0




sun8:/ # inqInquiry utility, Version V7.3-169 (Rev 0.0) (SIL Version V4.3.0.0 (Edit Level 169)Copyright (C) by EMC Corporation, all rights reserved.For help type inq -h.

.............

-----------------------------------------------------------------------------DEVICE :VEND :PROD :REV :SER NUM :CAP(kb)-----------------------------------------------------------------------------/dev/rdsk/c0t0d0s2 :SEAGATE :ST34371W SUN4.2G:7462 :9806W296 :4192560 /dev/rdsk/c0t1d0s2 :SEAGATE :ST34371W SUN4.2G:7462 :9807W869 :4192560 /dev/rdsk/c2t9d0s2 :EMC :SYMMETRIX :5567 :56000000 : 7680 /dev/rdsk/c2t9d16s2 :EMC :SYMMETRIX :5567 :56010000 :1048800

Notes.

HBA only supports ‘probe-scsi-all’ in Arbitrated Loop environments.



Actual devices found at LUN’s 0 & 10 (Hex). LUN’s probed based on entries defined in the /kernel/drv/sd.conf file. LUN 1 is either not mapped to this FA or access has not been granted via Volume Logix. Note: Event ‘not present’ is logged for LUN 1.

HBA has successfully logged into the correct FA. Based on binding entries in the /kernel/drv/sd.conf file, discovered devices will be bound to Target 9.

13

Sun Fibre Channel

Hardware Paths.

At the Open Boot prompt:

ok show-devs.../fhc@2,f8800000/ac@0,1000000

/sbus@2,0/fcaw@2,0

/sbus@2,0/fcaw@1,0

/sbus@2,0/SUNW,soc@d,10000/sbus@2,0/fcaw@2,0/sd/sbus@2,0/fcaw@1,0/sd...ok


Jul 8 09:21:06 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 8 09:21:06 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 8 09:21:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.Jul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>Jul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 0: Port 011000 (50060482C3A16002:50060482C3A16002) present.Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd113 at fcaw0: target 9 lun 0Jul 8 09:21:07 sun8 genunix: [ID 936769 kern.info] sd113 is /sbus@2,0/fcaw@1,0/sd@9,0Jul 8 09:21:07 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,0 (sd113):Jul 8 09:21:07 sun8 corrupt label - wrong magic numberJul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] Vendor 'EMC', product 'SYMMETRIX', 15360 512 byte blocksJul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 1: Port 011000 (50060482C3A16002:50060482C3A16002) not present.Jul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 16: Port 011000 (50060482C3A16002:50060482C3A16002) present.Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd855 at fcaw0: target 9 lun 10Jul 8 09:21:07 sun8 genunix: [ID 936769 kern.info] sd855 is /sbus@2,0/fcaw@1,0/sd@9,10Jul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] <EMC-SYMMETRIX-5567 cyl 2183 alt 2 hd 15 sec 64>Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd16 at fas0: target 1 lun 0Jul 8 09:21:07 sun8 genunix: [ID 936769 kern.info] sd16 is /sbus@3,0/SUNW,fas@3,8800000/sd@1,0Jul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>Jul 8 09:21:08 sun8 scsi: [ID 193665 kern.info] sd21 at fas0: target 6 lun 0Jul 8 09:21:08 sun8 genunix: [ID 936769 kern.info] sd21 is /sbus@3,0/SUNW,fas@3,8800000/sd@6,0

From the /etc/path_to_inst file:

sun8:/ # grep /sbus@2,0/fcaw@1,0 /etc/path_to_inst"/sbus@2,0/fcaw@1,0" 0 "fcaw"..."/sbus@2,0/fcaw@1,0/sd@9,0" 113 "sd""/sbus@2,0/fcaw@1,0/sd@8,1" 372 "sd"...

From the /devices/sbus@2,0 directory:

sun8:/ # ls -l /devices/sbus@2,0/total 90drwxr-xr-x 2 root sys 46080 Jul 5 15:37 fcaw@1,0crw-rw-rw- 1 root sys 227, 0 Apr 5 16:34 fcaw@1,0:a,rawcrw-rw-rw- 1 root sys 227, 1 Apr 5 16:34 fcaw@2,0:b,rawcrw------- 1 root sys 69, 0 Apr 5 14:46 sbusmem@1,0:slot1crw------- 1 root sys 69, 1 Apr 5 14:46 sbusmem@2,0:slot2crw------- 1 root sys 69, 2 Apr 5 14:46 sbusmem@d,0:slotd


Hardware path of HBA. Events only logged in the /var/adm/messages* file when devices are discovered.

Discovered devices are created in this directory.

Missing ‘fcaw@2,0’ directory as it has not discovered any

devices.

Instance number of HBA 0.

Hardware path of HBA 0.

Hardware path of HBA.

14

Sun Fibre Channel


Jul 8 09:21:06 sun8 scsi: [ID 193665 kern.info] sd15 at fas0: target 0 lun 0Jul 8 09:21:06 sun8 genunix: [ID 936769 kern.info] sd15 is /sbus@3,0/SUNW,fas@3,8800000/sd@0,0Jul 8 09:21:06 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.Jul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] <SUN4.2G cyl 3880 alt 2 hd 16 sec 135>Jul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 0: Port 011000 (50060482C3A16002:50060482C3A16002) present.Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd113 at fcaw0: target 9 lun 0Jul 8 09:21:07 sun8 genunix: [ID 936769 kern.info] sd113 is /sbus@2,0/fcaw@1,0/sd@9,0Jul 8 09:21:07 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,0 (sd113):Jul 8 09:21:07 sun8 corrupt label - wrong magic numberJul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] Vendor 'EMC', product 'SYMMETRIX', 15360 512 byte blocksJul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 1: Port 011000 (50060482C3A16002:50060482C3A16002) not present.Jul 8 09:21:07 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9 Lun 16: Port 011000 (50060482C3A16002:50060482C3A16002) present.Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd855 at fcaw0: target 9 lun 10Jul 8 09:21:07 sun8 genunix: [ID 936769 kern.info] sd855 is /sbus@2,0/fcaw@1,0/sd@9,10Jul 8 09:21:07 sun8 scsi: [ID 365881 kern.info] <EMC-SYMMETRIX-5567 cyl 2183 alt 2 hd 15 sec 64>Jul 8 09:21:07 sun8 scsi: [ID 193665 kern.info] sd16 at fas0: target 1 lun 0

From the /etc/path_to_inst file:

sun8:/ # grep /sbus@2,0/fcaw@1,0/sd@9,0 /etc/path_to_inst"/sbus@2,0/fcaw@1,0/sd@9,0" 113 "sd"

From the /devices/sbus@2,0/fcaw@1,0 directory:

sun8:/ # ls -l /devices/sbus@2,0/fcaw@1,0total 0brw-r----- 1 root sys 32,840 Jul 5 15:37 sd@9,0:acrw-r----- 1 root sys 32,840 Jul 5 15:37 sd@9,0:a,rawbrw-r----- 1 root sys 32,841 Jul 5 15:37 sd@9,0:bcrw-r----- 1 root sys 32,841 Jul 5 15:37 sd@9,0:b,rawbrw-r----- 1 root sys 32,842 Jul 5 15:37 sd@9,0:ccrw-r----- 1 root sys 32,842 Jul 5 15:37 sd@9,0:c,rawbrw-r----- 1 root sys 32,843 Jul 5 15:37 sd@9,0:dcrw-r----- 1 root sys 32,843 Jul 5 15:37 sd@9,0:d,raw...

From the /dev/rdsk or /dev/dsk directory:

sun8:/ # ls -l /dev/rdsk |grep /sbus@2,0/fcaw@1,0/sd@9,0lrwxrwxrwx 1 root root 44 Jul 4 12:11 c2t9d0s0 -> ../../devices/sbus@2,0/fcaw@1,0/sd@9,0:a,rawlrwxrwxrwx 1 root root 44 Jul 4 12:11 c2t9d0s1 -> ../../devices/sbus@2,0/fcaw@1,0/sd@9,0:b,rawlrwxrwxrwx 1 root root 44 Jul 4 12:11 c2t9d0s2 -> ../../devices/sbus@2,0/fcaw@1,0/sd@9,0:c,rawlrwxrwxrwx 1 root root 44 Jul 4 12:11 c2t9d0s3 -> ../../devices/sbus@2,0/fcaw@1,0/sd@9,0:d,rawlrwxrwxrwx 1 root root 44 Jul 4 12:11 c2t9d0s4 -> ../../devices/sbus@2,0/fcaw@1,0/sd@9,0:e,raw...

Notes.

‘/etc/path_to_inst’ contains historical information. (Every device ever seen by the host). For Solaris 8, command ‘devfsadm -C -c disk’ can be used to clean up dangling symbolic

links under the /dev directory and the block/character files under the /devices directory.



‘ctd’ number.

Hardware path under the /devices directory. sd@<target>,<lun> (hex).

Symbolic link to the ‘/devices/<hardware path>’ directory.

‘sd’ instance number.

15

Sun Fibre Channel

Additional Information.

Determining WWN’s from the “prtconf –vp” command:

Node 0xf00ec278 device_type: 'scsi' name: 'fcaw' current-wwpn: 200000e0.694048b4 sbus_slot: 00000001 intr: 00000003.00000000 interrupts: 00000003 sbus_irq: 00000003 scsi-initiator-id: 0000007d fcode_cksum: 001a5e9b current-wwn-lo: 694048b4 current-wwn-hi: 100000e0 default-wwn-lo: 694048b4 default-wwn-hi: 100000e0 cpld_revision: 00000004 reg: 00000001.00000000.00008000.00000001.00008000.00008000.00000001.00010000.00000002.00000001.00018000.00000002.00000001.00020000.00000004.00000001.00030000.00000200 copyright: 'Copyright (c) 1999 by JNI.' fcode_version: 'Version 13.5.7' fcode_revision: 'Version 13.5.7' model: 'FCW' manufacturer: 'JNI'

Node 0xf00f755c device_type: 'block' name: 'sd'

Node 0xf00f7f68 device_type: 'scsi' name: 'fcaw' current-wwpn: 200000e0.69404ae6 sbus_slot: 00000002 intr: 00000003.00000000 interrupts: 00000003 sbus_irq: 00000003 scsi-initiator-id: 0000007d fcode_cksum: 001a5e9b current-wwn-lo: 69404ae6 current-wwn-hi: 100000e0 default-wwn-lo: 69404ae6 default-wwn-hi: 100000e0 cpld_revision: 00000004 reg: 00000002.00000000.00008000.00000002.00008000.00008000.00000002.00010000.00000002.00000002.00018000.00000002.00000002.00020000.00000004.00000002.00030000.00000200 copyright: 'Copyright (c) 1999 by JNI.' fcode_version: 'Version 13.5.7' fcode_revision: 'Version 13.5.7' model: 'FCW' manufacturer: 'JNI'

Node 0xf010324c device_type: 'block' name: 'sd'

Notes.

As this command does not collect hardware paths, correlating the WWN's to HBA instance numbers is not possible.



WWPN(200000e069404ae6)

WWPN(200000e0694048b4)

16

Sun Fibre Channel

Diagnostics.

Link Problems Between the HBA and the Switch:

Jul 9 11:29:32 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK DOWN (180811F9)Jul 9 11:29:32 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) offline.Jul 9 11:30:33 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) failed.Jul 9 11:30:33 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855):Jul 9 11:30:33 sun8 SCSI transport failed: reason 'tran_err': retrying commandJul 9 11:30:33 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855):Jul 9 11:30:33 sun8 requeue of command fails (fffffffe)Jul 9 11:31:46 sun8 fcaw: [ID 585631 kern.notice] NOTICE: fcaw0 NPORT Initialization Complete, SID=4048B4Jul 9 11:31:46 sun8 fcaw: [ID 451854 kern.notice] fcaw0: LINK UP (180802FF)Jul 9 11:31:48 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)Jul 9 11:31:48 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.

fcaw0: LINK DOWN

Link between the HBA and the switch has gone down. Bad cable, HBA, or switch port.

fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) offline.

Target (FA) taken ‘offline’ as a result of the ‘LINK DOWN’.

fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) failed.

As the link has not recovered, after 60 seconds, the HBA will now ‘fail’ the Target (FA) and report this failure to the higher driver levels (e.g. PowerPath, DMP, etc). This wait time is based on the ‘failover’ value in the /kernel/drv/fcaw.conf file.

WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855): requeue of command fails (fffffffe)

I/O has failed.

fcaw0: LINK UP

Link between the HBA and the switch has re-initialised.

fcaw0: Host: Port 011D00 (100000E0694048B4:200000E0694048B4)

HBA has logged back into the fabric


HBA has successfully logged back into the Target (FA).


17

Sun Fibre Channel

Link Problems Between the Switch and the FA:

Jul 9 13:41:51 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) offline.Jul 9 13:42:53 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) failed.Jul 9 13:42:53 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855):Jul 9 13:42:53 sun8 SCSI transport failed: reason 'tran_err': retrying commandJul 9 13:42:53 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855):Jul 9 13:42:53 sun8 requeue of command fails (fffffffe)Jul 9 13:43:25 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.


Target (FA) taken ‘offline’ when an RSCN is received from the switch. HBA queries the Name Server to determine if the Target (FA) is still logged into the Fabric.


Name Server query indicated that the Target (FA) was no longer logged into the Fabric. As this condition has not changed (via another RSCN), after 60 seconds, the HBA will now ‘fail’ the Target (FA) and report this failure to the higher driver levels (e.g. PowerPath, DMP, etc). This wait time is based on the ‘failover’ value in the /kernel/drv/fcaw.conf file.


I/O has failed.


HBA has received another RSCN from the switch. On querying the Name Server, the HBA discovers that the Target (FA) has logged back into the Fabric. Target (FA) will now be brought ‘online’ after logging back into the FA.

Notes.

Removing the FA from the HBA’s zone will also log similar events.


18

Sun Fibre Channel

Re-activating the Same ZoneSet on a Fabric:

Jul 9 13:51:53 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) offline.Jul 9 13:51:53 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.Jul 9 13:51:53 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855):Jul 9 13:51:53 sun8 SCSI transport failed: reason 'tran_err': retrying command


Target (FA) taken ‘offline’ when an RSCN is received from the switch. HBA queries the Name Server to determine if the Target (FA) is currently zoned to this HBA .


On querying the Name Server, the HBA discovers that the Target (FA) is still zoned to this HBA. Target (FA) will now be brought ‘online’ after logging back into the FA.

WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855):SCSI transport failed: reason 'tran_err': retrying command

HBA aborts all open exchanges after logging back into the FA. This event indicates that the aborted I/O has been re-sent.

Notes.

The following will also cause these events to be logged: Adding an ISL to the fabric. Removing an ISL from the fabric. A faulty ISL link in the fabric causing the ISL to go up and down. Disconnecting and then reconnecting the FA within the ‘failover’ time.


19

Sun Fibre Channel

Activating the Wrong ZoneSet on a Fabric:

Jul 9 14:02:51 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) offline.Jul 9 14:02:51 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011100 (50060482C3A16022:50060482C3A16022) available.Jul 9 14:02:51 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011200 (50060482C3A16012:50060482C3A16012) available.Jul 9 14:02:51 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011300 (50060482C3A16032:50060482C3A16032) available.Jul 9 14:03:53 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) failed.Jul 9 14:03:53 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855):Jul 9 14:03:53 sun8 SCSI transport failed: reason 'tran_err': retrying commandJul 9 14:03:53 sun8 scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/fcaw@1,0/sd@9,10 (sd855):Jul 9 14:03:53 sun8 requeue of command fails (fffffffe)Jul 9 14:05:01 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011100 (50060482C3A16022:50060482C3A16022) removed.Jul 9 14:05:01 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011200 (50060482C3A16012:50060482C3A16012) removed.Jul 9 14:05:01 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Port 011300 (50060482C3A16032:50060482C3A16032) removed.Jul 9 14:05:01 sun8 fcaw: [ID 451854 kern.notice] fcaw0: Target 9: Port 011000 (50060482C3A16002:50060482C3A16002) online.


Target (FA) taken ‘offline’ when an RSCN is received from the switch. HBA queries the Name Server to determine if the Target (FA) is still zoned to this HBA.

fcaw0: Port 011100 (50060482C3A16022:50060482C3A16022) available.fcaw0: Port 011200 (50060482C3A16012:50060482C3A16012) available.fcaw0: Port 011300 (50060482C3A16032:50060482C3A16032) available.

Name Server query indicates that 3 non-bound FA’s have been discovered. As these FA’s are not persistently bound to a Target, the HBA will ignore these FA’s and not log into them. Hence no ‘online’ events for these FA’s.


Name Server query also indicated that the Target (FA) was no longer zoned to this HBA. As this condition has not changed (via another RSCN), after 60 seconds, the HBA will now ‘fail’ the Target (FA) and report this failure to the higher driver levels (e.g. PowerPath, DMP, etc). This wait time is based on the ‘failover’ value in the /kernel/drv/fcaw.conf file.


I/O has failed.

fcaw0: Port 011100 (50060482C3A16022:50060482C3A16022) removed.fcaw0: Port 011200 (50060482C3A16012:50060482C3A16012) removed.fcaw0: Port 011300 (50060482C3A16032:50060482C3A16032) removed.

Another RSCN received by the HBA. Name Server query indicates that the 3 non-bound FA’s are no longer zoned to this HBA.


Name Server query also indicated that the Target (FA) has been zoned back to this HBA. Target (FA) will now be brought ‘online’ after logging back into the FA.



20

Sun Fibre Channel

Configuration Used to Create Document.

Host: Sun Ultra Enterprise 3000OS: Solaris 8HBA: 2 x FC64-1063-EMCFcode: 13.5.7Driver: 2.6.10

Software: ESN Manager 2.0.20 (Volume Logix 3.0.12)

Symmetrix: 8530Ucode: 5567.28.22AFA Type: 563 (4 port)

Switch: DS-16BFirmware: v2.5.0d


21

JNI Sun Fibre Channel

Documents

001a5e9b fcode

fcode revision level

d fcode

symmetrix fibre channel

hba revision levels

driver revision levels

false socfcode

diagnostic section