Sun System Handbook - ISO 3.4 June 2011 Internal/Partner Edition | |||
|
|
Solution Type Technical Instruction Sure Solution 1005034.1 : Understanding the "show loop-map" output for the Sun StorEdge[TM] 3510
PreviouslyPublishedAs 207084 Description The show loop-map command can be used to examine the health of any back end disk loop on the Sun StorEdge[TM] 3510. Disk loops can be examined individually and compared against each other to discover problems. In addition, the location (top slot vs. bottom slot) of the Primary RAID Controller, the Chassis ID setting of the RAID chassis (and all JBOD chassis'), and the exact cabling configuration can be determined using the "show loop-map" output. Steps to Follow Several things must be understood before an accurate analysis can be made: 1. The show loop-map command output is always displayed from the perspective of the Primary RAID Controller, whether it's in the top or bottom slot. 2. When the RAID Controller in the top slot examines the loop map for channel 2 (also in the top slot), the listed devices will be in a different order than when it examines channel 3 (which is in the bottom slot). -- The same is true for the RAID Controller in the bottom slot. 3. When the loop map output reaches an SFP port connection, and no connection exists (or is not functioning), nothing will be shown in the output for that SFP port. 4. When the loop map output reaches an SFP port connection, and a connection to an expansion JBOD exists, the loop map jumps to the JBOD at that point in the output. -- If another JBOD is connected to the first JBOD, when the loop map reaches that SFP port connection it jumps to the second JBOD. -- Once the last expansion JBOD is reached, the loop map shows that entire chassis, then completes the previous JBODs, in reverse order, until it returns to the original SFP port connection in the RAID chassis. 5. If Chassis IDs are duplicated on any chassis in the configuration, the show loop-map is nearly useless because some loop IDs will be assigned correctly and some will be assigned randomly and every time the array is power cycled, the loop ID assignments will likely change. 6. NEVER, EVER assume the RAID chassis is set to Chassis ID 0! Some of the many things that can be determined using the show loop-map command: 1. Location of the Primary RAID Controller: -- If the Primary RAID Controller is in the top slot, the first RAID Controller listed in the output will show 14 in the SEL_ID column. -- If the Primary RAID Controller is in the bottom slot, the first RAID Controller listed in the output will show 15 in the SEL_ID column. 2. The Chassis ID setting for the RAID chassis: -- If the Primary RAID Controller is in the top slot and show loop-map channel 2 is run - or - -- if the Primary RAID Controller is in the bottom slot and show loop-map channel 3 is run: -- Then the ENCL_ID listed for the very last SES device in the output is the Chassis ID setting for the RAID chassis . 3. The exact cabling configuration of a loop, including which SFP ports (left vs. right) are being used on each chassis. 4. A generalized initial analysis can be made by comparing the number of devices found in loop map on each channel as well as the number of devices actually installed (total number of disks + one or two RAID Controllers + an SES device for every chassis on the loop). NOTE : Before analyzing the show loop-map command output, first determine which slot the Primary RAID Controller is in using the guidelines in item 1. above. There are two different orders in which the devices in the RAID chassis will appear: 1. If: -- the Primary RAID Controller is in the top slot and show loop-map channel 2 is run - or - -- the Primary RAID Controller is in the bottom slot and show loop-map channel 3 is run: The order the devices should appear in is:
Primary RAID Controller
(which is in same slot as the channel specified in the command)
Right SFP port
(one or more devices may be listed if JBODs are attached. See the JBOD loop maps below.)
Disk in RAID chassis,
slot 1
Disk in RAID chassis, s
lot 4
Disk in RAID chassis,
slot 2
Disk in RAID chassis,
slot 3
Disk in RAID chassis,
slot 5
Disk in RAID chassis,
slot 0
Disk in RAID chassis,
slot 8
Disk in RAID chassis,
slot 9
Secondary RAID Controller
(which is in opposite slot as the channel specified in the command).
Left SFP port
(one or more devices may be listed if JBODs are attached. See the JBOD loop maps below.)
Disk in RAID chassis,
slot 11
Disk in RAID chassis,
slot 6
Disk in RAID chassis,
slot 10
Disk in RAID chassis,
slot 7
RAID chassis
SES device
2.If: -- the Primary RAID Controller is in the top slot and show loop-map channel 3 is run - or - -- the Primary RAID Controller is in the bottom slot and show loop-map channel 2 is run: The order the devices should appear in is:
Primary RAID Controller
(which is in opposite slot as the channel specified in the command).
Left SFP port
(one or more devices may be listed if JBODs are attached. See the JBOD loop maps below.)
Disk in RAID chassis,
slot 11
Disk in RAID chassis,
slot 6
Disk in RAID chassis,
slot 10
Disk in RAID chassis,
slot 7
RAID chassis
SES device
Secondary RAID Controller
(which is in same slot as the channel specified in the command).
Right SFP port
(one or more devices may be listed if JBODs are attached. See the JBOD loop maps below.)
Disk in RAID chassis,
slot 1
Disk in RAID chassis,
slot 4
Disk in RAID chassis,
slot 2
Disk in RAID chassis,
slot 3
Disk in RAID chassis,
slot 5
Disk in RAID chassis,
slot 0
Disk in RAID chassis,
slot 8
Disk in RAID chassis,
slot 9
There are two different orders in which devices in the JBOD chassis will appear: They are governed by which of the JBOD's SFP ports (Left or Right) the RAID chassis (or any intermediary JBODs which are eventually connected to the RAID chassis) is connected to. 1. If this JBOD is connected to the RAID chassis (or any intermediary JBODs) via it's Left SFP port, the loop map order will be: Disk in JBOD chassis,
slot 11
Disk in JBOD chassis,
slot 6
Disk in JBOD chassis,
slot 10
Disk in JBOD chassis,
slot 7
JBOD chassis
SES device
Right SFP port
(one or more devices may be listed if any additional JBODs are attached at this port.)
Disk in JBOD chassis,
slot 1
Disk in JBOD chassis,
slot 4
Disk in JBOD chassis,
slot 2
Disk in JBOD chassis,
slot 3
Disk in JBOD chassis,
slot 5
Disk in JBOD chassis,
slot 0
Disk in JBOD chassis,
slot 8
Disk in JBOD chassis,
slot 9
2. If the JBOD is connected to the RAID chassis (or any intermediary JBODs) via it's Right SFP port, the loop map order will be: Disk in JBOD chassis,
slot 1
Disk in JBOD chassis,
slot 4
Disk in JBOD chassis,
slot 2
Disk in JBOD chassis,
slot 3
Disk in JBOD chassis,
slot 5
Disk in JBOD chassis,
slot 0
Disk in JBOD chassis,
slot 8
Disk in JBOD chassis,
slot 9
Left SFP port
(one or more devices may be listed if any additional JBODs are attached at this port.)
Disk in JBOD chassis,
slot 11
Disk in JBOD chassis,
slot 6
Disk in JBOD chassis,
slot 10
Disk in JBOD chassis,
slot 7
JBOD chassis
SES device
The following two examples show a fully populated RAID chassis connected to a fully populated JBOD. sccli> show loop-map channel 2 28 devices found in loop map === Channel Loop Map retrieved from CH 2 ID 12 === AL_PA SEL_ID SEL_ID TYPE ENCL_ID SLOT (hex) (hex) (dec) ----- ----- ----- ---- ------ ---- D1 0E 14 RAID N/A N/A SEL_ID(dec) 14 = Primary RAID Controller in top slot. E8 01 1 DISK 0 1 RAID Right-SFP not connected to anything (ENCL_ID is 0 for the E1 04 4 DISK 0 4 RAID chassis, as per output above). E4 02 2 DISK 0 2 E2 03 3 DISK 0 3 E0 05 5 DISK 0 5 EF 00 0 DISK 0 0 D9 08 8 DISK 0 8 D6 09 9 DISK 0 9 CE 0F 15 RAID N/A N/A B9 1B 27 DISK 1 11
RAID Left-SFP connected to JBOD Left-SFP (ENCL_ID 1 is
C6 16 22 DISK 1 6 JBOD chassis, see JBOD device ordering). BA 1A 26 DISK 1 10 C5 17 23 DISK 1 7 B6 1C 28 SES 1 N/A CC 11 17 DISK 1 1
JBOD Right-SFP not connected to anything (ENCL_ID remains the same).
C9 14 20 DISK 1 4
CB 12 18 DISK 1 2 CA 13 19 DISK 1 3 C7 15 21 DISK 1 5 CD 10 16 DISK 1 0 C3 18 24 DISK 1 8 BC 19 25 DISK 1 9 D4 0B 11 DISK 0 11
All attached JBODs completed, returns to RAID chassis.
DC 06 6 DISK 0 6 D5 0A 10 DISK 0 10 DA 07 7 DISK 0 7 D3 0C 12 SES 0 N/A
This SES indicates ENCL_ID is 0 for the RAID chassis.
sccli> show loop-map channel 3 28 devices found in loop map === Channel Loop Map retrieved from CH 3 ID 12 === AL_PA SEL_ID SEL_ID TYPE ENCL_ID SLOT (hex) (hex) (dec) ----- ----- ----- ---- ------ ---- D1 0E 14 RAID N/A N/A
SEL_ID(dec) 14 = Primary RAID Controller in top slot.
D4 0B 11 DISK 0 11 RAID Left-SFP not connected to anything (ENCL_ID is 0 for the DC 06 6 DISK 0 6
RAID chassis, as per output above).
D5 0A 10 DISK 0 10 DA 07 7 DISK 0 7 D3 0C 12 SES 0 N/A CE 0F 15 RAID N/A N/A CC 11 17 DISK 1 1
RAID Right-SFP connected to JBOD Right-SFP (ENCL_ID 1 is
C9 14 20 DISK 1 4 JBOD chassis, see JBOD device ordering). CB 12 18 DISK 1 2 CA 13 19 DISK 1 3 C7 15 21 DISK 1 5 CD 10 16 DISK 1 0 C3 18 24 DISK 1 8 BC 19 25 DISK 1 9 B9 1B 27 DISK 1 11 JBOD Left-SFP not connected to anything (ENCL_ID remains the same). C6 16 22 DISK 1 6 BA 1A 26 DISK 1 10 C5 17 23 DISK 1 7 B6 1C 28 SES 1 N/A E8 01 1 DISK 0 1
All attached JBODs completed, returns to RAID chassis.
E1 04 4 DISK 0 4 E4 02 2 DISK 0 2 E2 03 3 DISK 0 3 E0 05 5 DISK 0 5 EF 00 0 DISK 0 0 D9 08 8 DISK 0 8 D6 09 9 DISK 0 9 Product Sun StorageTek 3510 FC Array Internal Comments This entire document is intended for internal audiences. loop map, loop-map, 3510, fibre loop, minnow, StorEdge 3510 Previously Published As 76756 Change History Date: 2007-12-11 User Name: 7058 Action: Approved Comment: See previous comments. Version: 8 Date: 2007-12-11 Attachments This solution has no attachment |
||||||||||||
|