Wrong hostnames displayed during discovery of Infiniband Switch in EM Cloud Control

Asset ID:	1-72-1479677.1
Update Date:	2012-08-02
Keywords:

Solution Type Problem Resolution Sure

Solution 1479677.1 : Wrong hostnames displayed during discovery of Infiniband Switch in EM Cloud Control

Applies to:

Exadata Database Machine X2-2 Full Rack - Version Not Applicable and later
Exadata Database Machine X2-2 Half Rack - Version Not Applicable and later
Exadata Database Machine X2-2 Qtr Rack - Version Not Applicable and later
Exadata Database Machine X2-8 - Version Not Applicable and later
Information in this document applies to any platform.

Symptoms

While discovering a new Exadata Database Machine in EM Cloud Control 12c, the IB switch hostnames displayed are different from the actual hostnames of each IB switch.

Example:

a) EM Console Discovery results page lists the IB Switch name as exduatsw-ib1. Where as, the actual IB Switch Hostname is exdprdsw-ib1

Error Message

b) 'ibnetdiscover' command also lists the wrong IB Switch Hostaname as exduatsw-ib1

# Topology file: generated on Tue Jul 31 15:13:10 2012
#
# Initiated from node 0021280001ceb126 port 0021280001ceb127

vendid=0x2c9
devid=0xbd36
sysimgguid=0x21284691fba0a3
switchguid=0x21284691fba0a0(21284691fba0a0)
Switch   36 "S-0021284691fba0a0"       # "SUN DCS 36P QDR exduatsw-ib1.doe.mass.edu" enhanced port 0 lid 1 lmc 0
[19]   "S-002128469520a0a0"[32]       # "SUN DCS 36P QDR exduatsw-ib3.doe.mass.edu" lid 3 4xQDR
[21]   "S-0021284696f6a0a0"[32]       # "SUN DCS 36P QDR exduatsw-ib2.doe.mass.edu" lid 4 4xQDR

vendid=0x2c9
devid=0xbd36
sysimgguid=0x2128469520a0a3
switchguid=0x2128469520a0a0(2128469520a0a0)
Switch   36 "S-002128469520a0a0"       # "SUN DCS 36P QDR exduatsw-ib3.doe.mass.edu" enhanced port 0 lid 3 lmc 0

c) Testing each hostname using nlslookup shows:

[oracle@exduatdb01 onecommand]$ nslookup exduatsw-ib1
;; Got SERVFAIL reply from 10.0.0.2, trying next server
Server: 10.0.0.20
Address: 10.0.0.20#53

** server can't find exduatsw-ib1: SERVFAIL

Note : databasemachine.xml in this case had correct IB Switch hostnames which is exdprdsw-ib1

Changes

The IB Switch hostname was changed after initial deployment of this Exadata rack from exduatsw-ib1 to exdprdsw-ib1

Cause

/etc/hosts file on the IB switches lists the old hostname entires

The /etc/hosts file on the db nodes were updated with the new hostnames, where as the IB switches were not updated as part of the network updates/changes performed on the DB machine

Solution

Update the /etc/hosts on each IB switch with the right hostnames and IP addresses, then reboot the switches for the changes to take effect.

Rebooting the IB switches will require some coordination to ensure at least one switch is used as the Master switch.

Attachments

This solution has no attachment