Oracle Exalogic Elastic Cloud X2-2 Full Rack
 
Oracle Exalogic Elastic Cloud X2-2 Qtr Rack
 
Oracle Exalogic Elastic Cloud X2-2 Half Rack
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
 

In this Document

Goal

Fix

Applies to:

Goal

How To Back Up and Restore Switch Settings for Sun Network QDR InfiniBand Gateway Switch.

Fix

DISPATCH INSTRUCTIONS
WHAT SKILLS DOES THE ENGINEER NEED:
Familiarity with the InfiniBand switch.

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 0

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:
PROBLEM OVERVIEW
Collect backup configuration of the switch for later restoration of the configuration when required.

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?

The InfiniBand switch will need to be up, running and reachable across the network. For restoring the configuration to the switch, the firmware should be at the same level as when the backup configuration was collected.

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE:

Backing Up and Restoring the InfiniBand Gateway Switch Settings.

The procedure for backing up and restoring switch settings can be done either through the switch Integrated Lights Out Manager (ILOM) or through a manual process.

Backing Up Settings on the InfiniBand Gateway Switch using ILOM:

The following procedure describes how to back up a switch using ILOM. The backup only needs to be done once after the switch has been initially configured with the correct settings.

1. Navigate to the switch ILOM URL in a browser. For example: http://dbm002-i1.us.example.com.
2. Log in as the ilom-admin user. The default password is ilom-admin.
3. Select the Maintenance tab.
4. Select the Backup/Restore tab.
5. Select the Backup operation and the Browser method.
6. Type in a passphrase. This is used to encrypt sensitive information, such as user passwords, in the backup.
7. Click Run, and save the resulting XML file in a secure location.
8. Login to the switch via a terminal shell as the root user. The default password is welcome1 or changeme.
9. Save the output from the 'version' command.
10. Save the output from 'ps -ef | grep open' command to determine whether OpenSM subnet manager daemon is already running on this switch. It may be intentionally disabled and not be running if this is a multi-rack of 4 or more full-racks, or if its connected to an Exadata.
11. Manually capture the following files not currently handled by the backup:

• /etc/opensm/opensm.conf
• /conf/bx.conf
• /conf/partitions.current

Manual Backup of the InfiniBand Gateway Switch:

The following procedure describes how to perform a manual backup of the the switch. The backup only needs to be done once after the switch has been initially configured with the correct settings.

1. Log in to the switch as the root user. The default password is welcome1 or changeme.
2. Run the hostname command and save the output, in case the host name is not set in the /etc/sysconfig/network file.
3. Save the passwords for the root and nm2user accounts.
4. Run the version command and save the output.
5. Review output from ps -ef | grep open to determine if OpenSM subnet manager daemon is already running on this switch. It may be intentionally disabled and not be running if this is a multi-rack of 4 or more full-racks, or if its connected to an Exadata.
6. Make copies of the following files: 

• /etc/sysconfig/network-scripts/ifcfg-eth0 (network configuration)
• /etc/resolv.conf (DNS information)
• /etc/ntp.conf (NTP information)
• /etc/localtime (time zone information)
• /etc/opensm/opensm.conf (openSM settings)
• /etc/sysconfig/network (host name)
• /etc/hosts (hosts file information)
• /conf/bx.conf (vnic configuration)
• /conf/partitions.current (partition information)

Restoring Settings to the InfiniBand Gateway Switch using ILOM:

The following procedure describes how to restore the settings on a switch using ILOM.

1. Run the version command, and ensure that the switch is at the right firmware level. If not, then upgrade the switch to the correct firmware level.
2. Navigate to the switch ILOM URL in a browser. For example: http://dbm002-i1.us.example.com.
3. Log in as the ilom-admin user. The default password is ilom-admin.
4. Select the Maintenance tab.
5. Select the Backup/Restore tab.
6. Select the Restore operation and the Browser method.
7. Click Browse, and select the XML file that contains the switch configuration backup.
8. Type in the passphrase that was used during the backup.
9. Click Run to restore the configuration.
10. Do the following steps to copy the file not captured by ILOM backup:

• Log in to the Sun Datacenter InfiniBand Switch 36 switch as the root user.
• Use the scp command to copy the opensm.conf file to the /etc/opensm/opensm.conf location on the switch. The opensm.conf file was captured during the previous backup operation above.
• Restore the /conf/bx.conf and /conf/partitions.current files using scp. The files were captured during the previous backup operation above.
• If OpenSM was previously running prior to restore, then restart OpenSM from the switch CLI using the following commands:

# disablesm
# enablesm

Restoring Settings to the InfiniBand Gateway Switch Manually:

The following procedure describes how to restore the switch settings manually.

1. Log in to the switch as the root user. The default password is welcome1 or changeme.
2. Ensure that the switch is at the right firmware level. If not, then upgrade the switch to the correct firmware level.
3. Restore the passwords of the root and nm2user users using the passwd command.
4. Restore the following files from the backup files captured previously:

• /etc/sysconfig/network-scripts/ifcfg-eth0 (network configuration)
• /etc/resolv.conf (DNS information)
• /etc/ntp.conf (NTP information)
• /etc/localtime (time zone information)
• /etc/opensm/opensm.conf (openSM settings)
• /etc/sysconfig/network (host name)
• /etc/hosts (hosts file information)
• /conf/bx.conf (vnic configuration)
• /conf/partitions.current (partition information)
• Restore the host name by adding a HOSTNAME=switch_host_name line to the /etc/sysconfig/network file, if not already present.

5. Restart the network services by running the following commands in the order shown:

# service network restart
# service ntpd restart

6. If OpenSM was previously running prior to restore, then restart OpenSM from the switch CLI using the following commands:

# disablesm
# enablesm

OBTAIN CUSTOMER ACCEPTANCE
- WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:

In situations where the switch is replaced and we have restored the switch configuration, we will need to verify the configuration and operation of the gateway switch.

1. Log in to the switch as the root user. The default password is welcome1 or changeme.
2. Verify switch configuration (hostname, ntp, dns, IP/Netmask information, gateway, ..etc.).
3. Verify switch operation by running the following commands:

• ibstat
• ibswitches
• ibhosts
• sminfo
• ibdiagnet -ls 10 -lw 4x
• ibdiagnet -r

REFERENCE INFORMATION:

Exalogic Machine Owner's Guide: https://docs.oracle.com/cd/E18476_01/index.htm
Sun Network QDR InfiniBand Gateway Switch Administration Guide - https://docs.oracle.com/cd/E19671-01/821-1187-11/821-1187-11.pdf
Sun Network QDR InfiniBand Gateway Switch Command Reference - https://docs.oracle.com/cd/E19671-01/821-1189-11/821-1189-11.pdf
Sun Network QDR InfiniBand Gateway Switch Service Manual - https://docs.oracle.com/cd/E19671-01/821-1188-11/821-1188-11.pdf
Oracle Integrated Lights Out Manager (ILOM) 3.0 Supplement for the Sun Network QDR InfiniBand Gateway Switch - https://docs.oracle.com/cd/E19671-01/821-1545-11/821-1545-11.pdf

This solution has no attachment