Exadata Database Machine X2-2 Half Rack
 
Sun Datacenter InfiniBand Switch 36
 
Exadata Database Machine X2-2 Full Rack
 
Exadata Database Machine X2-2 Hardware
 
Exadata Database Machine X2-8
 
Exadata Database Machine X2-2 Qtr Rack
 
Exadata Database Machine V2
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
 

In this Document

Goal

Fix

Applies to:

Goal

Backing Up and Restoring Switch Settings for Sun Datacenter InfiniBand Switch 36

Fix

DISPATCH INSTRUCTIONS
- WHAT SKILLS DOES THE ENGINEER NEED:
Familiarity with the InfiniBand switch.

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 0

FIELD ENGINEER INSTRUCTIONS:
- PROBLEM OVERVIEW
Collect backup configuration of the switch for later restoration of the configuration when required.

- WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?
The InfiniBand switch will need to be up, running and reachable.  For restoring the configuration to the switch, the firmware should be at the same level as when the backup configuration was collected.

- WHAT ACTION DOES THE ENGINEER NEED TO TAKE:

Backing Up and Restoring Switch Settings

The procedure for backing up and restoring switch settings depends on the firmware on the switch. The 1.1.3-2 firmware has Integrated Lights Out Manager (ILOM) which provides back up and restore capability. The 1.0.1 firmware does not have ILOM. You can either upgrade to the 1.1.3-2 firmware and then use the procedure in "Backing Up Settings on a Switch with 1.1.3-2 and Later Firmware", or you can perform the backup and restore of individual files manually.

Backing Up Settings on a Switch with 1.1.3-2 and Later Firmware

The following procedure describes how to back up a switch with 1.1.3-2 firmware, and later. The backup only needs to be done once after the switch has been initially configured with the right settings.

1. Navigate to the switch ILOM URL in a browser. For example: http://dbm002-i1.us.example.com.
2. Log in as the ilom-admin user. The default password is ilom-admin.
3. Select the Maintenance tab.
4. Select the Backup/Restore tab.
5. Select the Backup operation and the Browser method.
6. Type in a passphrase. This is used to encrypt sensitive information, such as user passwords, in the backup.
7. Click Run, and save the resulting XML file in a secure location.
8. (1.1.3.2 firmware only) Do the following steps to back up the opensm.conf file:
• Log in to the Sun Datacenter InfiniBand Switch 36 switch as the root user.
• Use the scp command to copy the /etc/opensm/opensm.conf file, and save it with the backup XML file. This is necessary because the backup does not save the Subnet Manager configuration.
9. Save the output from the nm2version command.
10. Review output from ps -ef | grep open to determine if OpenSM subnet manager daemon is already running on this switch. It may be intentionally disabled and not be running if this is a multi-rack of 4 or more full-racks, or if its connected to an Exalogic.

Backing Up Settings on a Switch with 1.0.1 Firmware

The following procedure describes how to back up the settings on a switch with 1.0.1 firmware:

1. Log in to the switch as the root user. The default password is welcome1 or changeme.
2. Make copies of the following files:
• /etc/sysconfig/network-scripts/ifcfg-eth0 (network configuration)
• /etc/resolv.conf (DNS information)
• /etc/ntp.conf (NTP information)
• /etc/localtime (time zone information)
• /etc/opensm/opensm.conf (openSM settings)
• /etc/sysconfig/network (host name)
• /etc/hosts (hosts file information)
3. Run the hostname command and save the output, in case the host name is not set in the /etc/sysconfig/network file.
4. Save the passwords for the root and nm2user accounts.
5. Run the nm2version command and save the output.
6. Review output from ps -ef | grep open to determine if OpenSM subnet manager daemon is already running on this switch. It may be intentionally disabled and not be running if this is a multi-rack of 4 or more  full-racks, or if its connected to an Exalogic.

Restoring Settings on a Switch with 1.1.3-2 and Later Firmware

The following procedure describes how to restore the settings on a switch with 1.1.3-2 firmware, and later firmware:

1. Run the version command, and ensure that the switch is at the right firmware level. If not, then upgrade the switch to the correct firmware level.
2. Navigate to the switch ILOM URL in a browser. For example: http://dbm002-i1.us.example.com.
3. Log in as the ilom-admin user. The default password is ilom-admin.
4. Select the Maintenance tab.
5. Select the Backup/Restore tab.
6. Select the Restore operation and the Browser method.
7. Click Browse, and select the XML file that contains the switch configuration backup.
8. Type in the passphrase that was used during the backup.
9. Click Run to restore the configuration.
10. (1.1.3.2 firmware only) Do the following steps to copy the opensm.conf file:
• Log in to the Sun Datacenter InfiniBand Switch 36 switch as the root user.
• Use the scp command to copy the opensm.conf file to the /etc/opensm/opensm.conf location on the switch. The opensm.conf file was the file that was created during the backup.
11. If OpenSM was previously running prior to restore, then restart OpenSM from the switch CLI using the following commands:
• disablesm
• enablesm

Restoring Settings on a Switch with 1.0.1 Firmware

The following procedure describes how to restore the settings to a switch with 1.0.1 firmware:

1. Log in to the switch as the root user. The default password is welcome1 or changeme.
2. Ensure that the switch is at the right firmware level. If not, then upgrade the switch to the correct firmware level.
3. Restore the following files from the backup:
• /etc/sysconfig/network-scripts/ifcfg-eth0 (network configuration)
• /etc/resolv.conf (DNS information)
• /etc/ntp.conf (NTP information)
• /etc/localtime (time zone information)
• /etc/opensm/opensm.conf (openSM settings)
• /etc/sysconfig/network (host name)
• /etc/hosts (hosts file information)
4. Restore the host name by adding a HOSTNAME=switch_host_name line to the /etc/sysconfig/network file, if not already present.
5. Restore the passwords of the root and nm2user users using the passwd command.
6. Restart the network services by running the following commands in the order shown:
• service network restart
• service ntpd restart
7. If OpenSM was previously running prior to restore, then restart OpenSM from the switch CLI using the following commands:
• disablesm
• enablesm

OBTAIN CUSTOMER ACCEPTANCE
- WHAT ACTION DOES THE CUSTOMER NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:
Verify that the InfiniBand switch is reachable from the network after restoration.

PARTS NOTE:

REFERENCE INFORMATION:
Sun Datacenter InfiniBand Switch 36 Documentation: http://download.oracle.com/docs/cd/E19197-01/index.html
Source document: Backing Up and Restoring Switch Settings in Oracle Exadata Database Machine Owner's Guide 11g Release 2 (11.2)
http://wd0338.oracle.com/archive/cd_ns/E13877_01/doc/doc.112/e13874/maintenance.htm#CHDIAEID

This solution has no attachment