Sun Storage 7000 Unified Storage System: Default route vanishes on one cluster node when network configuration is changed on other node.

Asset ID:	1-72-1321373.1
Update Date:	2012-10-10
Keywords:

Solution Type Problem Resolution Sure

Solution 1321373.1 : Sun Storage 7000 Unified Storage System: Default route vanishes on one cluster node when network configuration is changed on other node.

Applies to:

Sun Storage 7410 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun ZFS Storage 7420 - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7310 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun ZFS Storage 7320 - Version Not Applicable to Not Applicable [Release N/A]
7000 Appliance OS (Fishworks)
NAS head revision : [2010.Q3 and below]
BIOS revision : [not dependent]
ILOM revision : [not dependent]
Cluster Issue : [yes]

Symptoms

Changing network configuration "Allow Administration" on one node, the default route setting vanshes on other node. It causes loads of network problem including imapd, ldap, httpd.

Before changing the network config on one node, other node config is as follows:

Appliance:> configuration net routing show

Properties:

multihoming = loose



Routes:



ROUTE     DESTINATION      GATEWAY          INTERFACE    TYPE

route-000 0.0.0.0/0        134.178.144.238   ipmp2      static

route-001 134.178.144.224  134.178.144.227   ipmp2      system

route-002 134.178.144.224  134.178.144.225   nxge251000 system

route-003 134.178.144.224  134.178.144.226   nxge251001 system

route-004 172.16.0.0       172.16.151.250    nge1       system

route-005 172.16.151.0     172.16.151.16     nge1       system

But after changing, the default route is lost.

Appliance:> configuration net routing show

Properties:

multihoming = loose



Routes:



ROUTE     DESTINATION      GATEWAY          INTERFACE    TYPE

route-000 134.178.144.224  134.178.144.227   ipmp2      system

route-001 134.178.144.224  134.178.144.225   nxge251000 system

route-002 134.178.144.224  134.178.144.226   nxge251001 system

route-003 172.16.0.0       172.16.151.250    nge1       system

route-004 172.16.151.0     172.16.151.16     nge1       system

The routing table can also be seen from the OS shell using:

# netstat -rn

or from the support bundle in the net/netstat-rn.out file.

The output before changing the network config looks like:

Routing Table: IPv4 Destination Gateway Flags Ref Use Interface -------------------- -------------------- ----- ----- ---------- --------- default 134.178.144.238 UG 5 45717 ipmp2 127.0.0.1 127.0.0.1 UH 4 76494 lo0 134.178.144.224 134.178.144.227 U 3 0 ipmp2 134.178.144.224 134.178.144.225 U 3 38536 nxge251000 134.178.144.224 134.178.144.226 U 3 38536 nxge251001 172.16.0.0 172.16.151.250 UG 1 0 nge1 172.16.151.0 172.16.151.16 U 3 6359 nge1

But after changing, the default route is lost.

Routing Table: IPv4 Destination Gateway Flags Ref Use Interface -------------------- -------------------- ----- ----- ---------- --------- 127.0.0.1 127.0.0.1 UH 4 757724 lo0 134.178.144.224 134.178.144.227 U 2 0 ipmp2 134.178.144.224 134.178.144.225 U 4 351 nxge251000 134.178.144.224 134.178.144.226 U 4 351 nxge251001 172.16.0.0 172.16.151.250 UG 1 0 nge1 172.16.151.0 172.16.151.16 U 3 3095 nge1

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - 7000 Series ZFS Appliances

Changes

Changing network interface configuration "Allow Administration" on one node may trigger this problem.

Cause

The cause is a known problem in appliance software code prior to 2011.1.1.0.

CR 7003656: default route vanishes on one node when network configuration is changed on other node.

Solution

Update to appliance software release 2011.1.1.0 or later.

For 7x10 Systems with SAS-1 Disk Trays update to 2011.1.2.1 or later.

Back to <Document 1392086.1> Sun Stroage 7000 Unified Storage System: How to Troubleshoot Network Problems.

References

<NOTE:1392086.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot Network Problems
@ <BUG:7003656> - RFI BACKPORT OF BUG 6882551 FOR INCLUSION IN 10.1.3.3.3 (RFI #81541)

Attachments

This solution has no attachment