Sun Microsystems, Inc.  Sun System Handbook - ISO 3.4 June 2011 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1012472.1
Update Date:2009-09-23
Keywords:

Solution Type  Technical Instruction Sure

Solution  1012472.1 :   Effects of the sccli set inter-controller-link / icl command on Sun StorEdge[TM] 3511  


Related Items
  • Sun Storage 3511 SATA Array
  •  
Related Categories
  • GCS>Sun Microsystems>Storage - Disk>Modular Disk - 3xxx Arrays
  •  

PreviouslyPublishedAs
217185


Description
This article shows the effects of the set icl command on a Sun StorEdge[TM] 3511 (SE3511). The effects are shown for both FC-Loop connections and Point-To-Point connections.
HW used:
SE3511, V880 with 2 HBA's, Brocade 3850
Commands used:
sccli, luxadm

Steps to Follow
1. HW configuration:
====================
1.1 FC Loop Configuration
=========================
SE3511 channel 4 upper connected to HBA1 host1
SE3511 channel 4 lower connected to HBA2 host1
SE3511 channel 4 PID[Lower] 44 and SID [Upper] 45
Effects of the set icl command to the HBA's on the loop.
========================================================
sccli> show redu
Primary controller serial number: 8023714
Primary controller location: Lower
Redundancy mode: Active-Active
Redundancy status: Enabled
Secondary controller serial number: 8023559
sccli> show chan
Ch  Type    Media   Speed   Width  PID / SID
--------------------------------------------
0  Host    FC(P)   2G      Serial  44 / N/A
1  Host    FC(P)   N/A     Serial  N/A / 42
2  Drive   FC(L)   2G      Serial  14 / 15
3  Drive   FC(L)   2G      Serial  14 / 15
4  Host    FC(P)   2G      Serial  44 / 45
5  Host    FC(P)   N/A     Serial  N/A / 46
6  Host    LAN     N/A     Serial  N/A / N/A
sccli> show lun-maps
Ch Tgt LUN   ld/lv   ID-Partition  Assigned  Filter Map
---------------------------------------------------------------------
0  44   0   ld0     1AE0FCA4-02   Primary
1  42   0   ld1     377EA15F-00   Secondary
4  44   0   ld0     1AE0FCA4-02   Primary
4  45   0   ld1     377EA15F-00   Secondary
5  46   0   ld1     377EA15F-00   Secondary
All channels connected:
-----------------------
sccli> show inter
inter-controller-link upper channel 0: connected
inter-controller-link lower channel 0: connected
inter-controller-link upper channel 1: connected
inter-controller-link lower channel 1: connected
inter-controller-link upper channel 4: connected
inter-controller-link lower channel 4: connected
inter-controller-link upper channel 5: connected
inter-controller-link lower channel 5: connected
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
Pos AL_PA ID Hard_Addr Port WWN         Node WWN         Type
0     1   7d    0      210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter)
1     9f  2c    9f     256000c0ffc0660d 206000c0ff00660d 0x0  (Disk device)  [lower]
2     2   7c    0      210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type)
3     9e  2d    9e     256000c0ffd0660d 206000c0ff00660d 0x0  (Disk device)  [upper]
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
Pos AL_PA ID Hard_Addr Port WWN         Node WWN         Type
0     1   7d    0      210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type)
1     9f  2c    9f     256000c0ffc0660d 206000c0ff00660d 0x0  (Disk device)
2     2   7c    0      210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter)
3     9e  2d    9e     256000c0ffd0660d 206000c0ff00660d 0x0  (Disk device)
==> with icl chan 4 upper and lower connected one FC-Loop with 4 nodes is
formed. The HBA's see each other and the 2 mapped lun's.
Upper Channel 4 disconnected:
-----------------------------
sccli> show inter
inter-controller-link upper channel 0: connected
inter-controller-link lower channel 0: connected
inter-controller-link upper channel 1: connected
inter-controller-link lower channel 1: connected
inter-controller-link upper channel 4: disconnected
inter-controller-link lower channel 4: connected
inter-controller-link upper channel 5: connected
inter-controller-link lower channel 5: connected
# luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
# luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
Pos AL_PA ID Hard_Addr Port WWN         Node WWN         Type
0     1   7d    0      210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter)
1     9e  2d    9e     256000c0ffd0660d 206000c0ff00660d 0x0  (Disk device) [upper]
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
No devices are found on /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl.
==> with icl chan 4 upper disconnected only one FC-Loop with 2 nodes has been
formed for the upper controller.
The HBA connected to the upper SFP has access to the lun mapped to the upper
controller.
Upper and lower Channel 4 disconnected:
---------------------------------------
sccli> show inter
inter-controller-link upper channel 0: connected
inter-controller-link lower channel 0: connected
inter-controller-link upper channel 1: connected
inter-controller-link lower channel 1: connected
inter-controller-link upper channel 4: disconnected
inter-controller-link lower channel 4: disconnected
inter-controller-link upper channel 5: connected
inter-controller-link lower channel 5: connected
# luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
# luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
Pos AL_PA ID Hard_Addr Port WWN         Node WWN         Type
0     1   7d    0      210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter)
1     9e  2d    9e     256000c0ffd0660d 206000c0ff00660d 0x0  (Disk device)  [upper]
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
Pos AL_PA ID Hard_Addr Port WWN         Node WWN         Type
0     1   7d    0      210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter)
1     9f  2c    9f     256000c0ffc0660d 206000c0ff00660d 0x0  (Disk device)  [lower]
==> with icl chan 4 upper and lower disconnected 2 independent FC-Loops with
2 nodes each have been formed.
The HBA connected to the upper SFP has access to the lun mapped to the upper
controller.
The HBA connected to the lower SFP has access to the lun mapped to the lower
controller.
Lower Channel 4 disconnected:
-----------------------------
sccli> show inter
inter-controller-link upper channel 0: connected
inter-controller-link lower channel 0: connected
inter-controller-link upper channel 1: connected
inter-controller-link lower channel 1: connected
inter-controller-link upper channel 4: connected
inter-controller-link lower channel 4: disconnected
inter-controller-link upper channel 5: connected
inter-controller-link lower channel 5: connected
# luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
# luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
No devices are found on /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl.
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
Pos AL_PA ID Hard_Addr Port WWN         Node WWN         Type
0     1   7d    0      210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter)
1     9f  2c    9f     256000c0ffc0660d 206000c0ff00660d 0x0  (Disk device)  [lower]
==> with icl chan 4 lower disconnected only one FC-Loop with 2 nodes has been
formed for the lower controller.
The HBA connected to the lower SFP has access to the lun mapped to the lower
controller.
1.2 Switch Configuration
========================
Brocade 3850 switch
Zone A:
port 0  : SE3511 channlel 4 upper, p2p
port 3  : hba1, p2p
Zone B:
port 8  : SE3511 channlel 4 lower, p2p
port 0xb: hba2, p2p
sccli> show redu
Primary controller serial number: 8023714
Primary controller location: Lower
Redundancy mode: Active-Active
Redundancy status: Enabled
Secondary controller serial number: 8023559
sccli> show chan
Ch  Type    Media   Speed   Width  PID / SID
--------------------------------------------
0  Host    FC(P)   N/A     Serial  44 / N/A
1  Host    FC(P)   N/A     Serial  N/A / 42
2  Drive   FC(L)   2G      Serial  14 / 15
3  Drive   FC(L)   2G      Serial  14 / 15
4  Host    FC(P)   2G      Serial  44 / 45
5  Host    FC(P)   N/A     Serial  N/A / 46
6  Host    LAN     N/A     Serial  N/A / N/A
sccli> show host
max-luns-per-id: 32
queue-depth: 1024
fibre-connection-mode: point-to-point
inband-management: enabled
Upper and lower channel 4 disconnected:
---------------------------------------
sccli> show inter
inter-controller-link upper channel 0: connected
inter-controller-link lower channel 0: connected
inter-controller-link upper channel 1: connected
inter-controller-link lower channel 1: connected
inter-controller-link upper channel 4: disconnected
inter-controller-link lower channel 4: disconnected
inter-controller-link upper channel 5: connected
inter-controller-link lower channel 5: connected
# luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
# luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
Pos  Port_ID Hard_Addr Port WWN         Node WWN         Type
0    10000   0         256000c0ffd0660d 206000c0ff00660d 0x0  (Disk device)
1    10300   0         210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter)
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
Pos  Port_ID Hard_Addr Port WWN         Node WWN         Type
0    10800   0         256000c0ffc0660d 206000c0ff00660d 0x0  (Disk device)
1    10b00   0         210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter)
==> with both icl's disconnected both controllers establish a p2p connection to
the switch.
Each HBA can access the lun in its zone.
Lower Channel 4 disconnected:
-----------------------------
sccli> show inter
inter-controller-link upper channel 0: connected
inter-controller-link lower channel 0: connected
inter-controller-link upper channel 1: connected
inter-controller-link lower channel 1: connected
inter-controller-link upper channel 4: connected
inter-controller-link lower channel 4: disconnected
inter-controller-link upper channel 5: connected
inter-controller-link lower channel 5: connected
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
No devices are found on /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl.
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
Pos  Port_ID Hard_Addr Port WWN         Node WWN         Type
0    10800   0         256000c0ffc0660d 206000c0ff00660d 0x0  (Disk device)
1    10b00   0         210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter)
==> with icl channel 4 lower disconnected only the lower controller is able to
establish a p2p connection to the switch.
Only the HBA in the same zone as the lower controller has access to the lun
mapped to the lower controller
All channels connected:
-----------------------
sccli> show inter
inter-controller-link upper channel 0: connected
inter-controller-link lower channel 0: connected
inter-controller-link upper channel 1: connected
inter-controller-link lower channel 1: connected
inter-controller-link upper channel 4: connected
inter-controller-link lower channel 4: connected
inter-controller-link upper channel 5: connected
inter-controller-link lower channel 5: connected
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
No devices are found on /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl.
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
No devices are found on /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl.
==> with channel 4 upper and lower connected none of the controllers is able to
establish a p2p connection to the switch.
Both HBA's are unable to access a lun.
Upper channel 4 disconnected:
-----------------------------
sccli> show inter
inter-controller-link upper channel 0: connected
inter-controller-link lower channel 0: connected
inter-controller-link upper channel 1: connected
inter-controller-link lower channel 1: connected
inter-controller-link upper channel 4: disconnected
inter-controller-link lower channel 4: connected
inter-controller-link upper channel 5: connected
inter-controller-link lower channel 5: connected
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl
Pos  Port_ID Hard_Addr Port WWN         Node WWN         Type
0    10000   0         256000c0ffd0660d 206000c0ff00660d 0x0  (Disk device)
1    10300   0         210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter)
# luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl
No devices are found on /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl.
==> with icl channel 4 upper disconnected only the upper controller is able to
establish a p2p connection to the switch.
Only the HBA in the same zone as the upper controller has access to the lun
mapped to the upper controller
Conclusion:
-----------
In a loop configuration we can have following configurations:
* common loop with both controllers on the same loop
* two independant loops if both icl disconnected for a channel
* one loop with one controller active which has the icl disconnected
In p2p configuration we can have following configurations:
* two independant controllers both with disconnected icl
* one active controller with icl disconnected
Note:
With both icl connected and p2p no controller will connect to the switch as only two devices are allowed in a p2p configuration.


Product
Sun StorageTek 3511 SATA Array

SE3511, FC-Loop, Point-To-Ppoint, SAN, switch, FC-Topology, ICL, inter-controller-link, minnow
Previously Published As
83411

Change History
Date: 2005-12-22
User Name: 71396
Action: Approved
Comment: Performed final review of article.

Updated product name.

Updated trademarking.

Changed audience from free to contract per fvf.

Publishing.
Version: 3
Date: 2005-12-22
User Name: 71396
Action: Accept
Comment:
Version: 0
Product_uuid
9fdbb196-73a6-11d8-9e3a-080020a9ed93|Sun StorageTek 3511 SATA Array

Attachments
This solution has no attachment
  Copyright © 2011 Sun Microsystems, Inc.  All rights reserved.
 Feedback