| Asset ID: |
1-79-1486997.1 |
| Update Date: | 2012-10-05 |
| Keywords: | |
Solution Type
Predictive Self-Healing Sure
Solution
1486997.1
:
SB6000/Hydra NEM upgrade Procedure
| Related Categories |
- PLA-Support>Sun Systems>SPARC>Usx/Blade/Netra>SN-SPARC: SB60xx
|
In this Document
Oracle Confidential (PARTNER). Do not distribute to customers.
Reason: Escalation mode required, so should not be available to customers
Applies to:
Sun Blade 6000 System - Version All Versions to All Versions [Release All Releases]
All Platforms
Purpose
Instructions to upgrade Hydra NEM.
Scope
Intended for SB6000 Trained Field Engineers. Escalation Mode password is required to complete this procedure.
Details
TAP for NEM Upgrades/Updates:
------------------------------------------------------------
Install Oracle Hardware Management Software 2.2 (Needed to view current SAS firmware and to update if needed):
NOTE: This could be done on any blade in the chassis.
1 - Download: Oracle Hardware Management Pack 2.2 zip file (p13258091_22_Generic.zip) from MOS into a temporary directory (ie. /var/tmp/Update/HMP):
Patch 13258091: Oracle Hardware Management Pack 2.2 for Oracle Solaris 10 (SPARC)
https://updates.oracle.com/Orion/Services/download/p13258091_22_Generic.zip?aru=14316176&patch_file=p13258091_22_Generic.zip
2 - Place zip file into the temporary directory and unzip contents of Oracle Hardware Management Pack 2.2:
# cd /var/tmp/Update/HMP
- unzip OHMP 2.2 software for Solaris 10 (SPARC)
3 - Go to the "oracle-hmp-2.2/SOFTWARE" and install OHMP 2.2:
# cd oracle-hmp-2.2/SOFTWARE
NOTE: Install Software on Sparc Blade.
# ./install.bin -i console
Preparing to install...
Extracting the installation resources from the installer archive...
Configuring the installer for this system's environment...
Launching installer...
Preparing CONSOLE Mode Installation...
===============================================================================
Oracle Hardware Management Pack (created with InstallAnywhere)
-------------------------------------------------------------------------------
===============================================================================
Introduction
------------
InstallAnywhere will guide you through the installation of Oracle Hardware Management Pack.
It is strongly recommended that you quit all programs before continuing with
this installation.
Respond to each prompt to proceed to the next step in the installation. If you
want to change something on a previous step, type 'back'.
You may cancel this installation at any time by typing 'quit'.
PRESS <ENTER> TO CONTINUE:
===============================================================================
Choose Install Set
------------------
Please choose the Install Set to be installed by this installer.
1- Standard
-> 2- Customize...
ENTER THE NUMBER FOR THE INSTALL SET, OR PRESS <ENTER> TO ACCEPT THE DEFAULT : 2 <press enter>
ENTER A COMMA_SEPARATED LIST OF NUMBERS REPRESENTING THE FEATURES YOU WOULD
LIKE TO SELECT, OR DESELECT. TO VIEW A FEATURE'S DESCRIPTION, ENTER
'?<NUMBER>'. PRESS <RETURN> IF YOU ARE DONE:
1- [ ] Hardware Management Agents
2- [X] CLI Tools
3- [ ] IPMITool
Please choose the Features to be installed by this installer.: [Select 2 Only]
Options 1 and 2 are preselected. When you enter a number, it will select an item that is not selected and deselect an item that is already selected.
For example, if you type 1, 3 Hardware Management Agents is deselected and IPMITool is selected.
# Type one or more numbers separated by a comma.
Configure LAN Over USB
----------------------
Configure the LAN-over-USB interconnect between the host and ILOM.
This is a high-speed connection that allows fast communication with ILOM using an
internal IP address. This enables IPMI and SSH clients as well as a web browser
running on the host operating system to connect directly to ILOM.
1 - Configure automatically
2- Configure manually
3- Do not configure
ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT: 3
Pre-Installation Summary
------------------------
Please Review the Following Before Continuing:
Product Name:
Oracle Hardware Management Pack
Install Folder:
/opt/sun-ssm
Install Set:
Custom
Product Features:
CLI Tools
LAN Over USB:
Not Configured
Disk Space Information (for Installation Target):
Required: xxx,xxx bytes
Available: xx,xxx,xxx,xxx bytes
PRESS <ENTER> TO CONTINUE
Ready To Install
----------------
InstallAnywhere is now ready to install Oracle Hardware Management Pack onto your system at the following location:
/opt/sun-ssm
PRESS <ENTER> TO INSTALL:
The installation should take about 2 minutes. A progress bar is displayed as the installation proceeds.
When the installation is complete, the following screen opens:
Installation Complete
---------------------
Congratulations. Oracle Hardware Management Pack has been successfully installed to:
/opt/sun-ssm
PRESS <ENTER> TO EXIT THE INSTALLER:
# cd /opt/sun-ssm
# ls -l
total 24
drwxr-xr-x 2 root bin 512 Oct 14 02:56 bin
drwxr-xr-x 5 root bin 1024 Oct 14 02:56 lib
drwxr-xr-x 2 root bin 512 Oct 14 02:56 man
-rw-rw-r-- 1 root other 5224 Oct 14 02:56 Oracle_Hardware_Management_Pack_InstallLog.log
drwxr-xr-x 2 root bin 512 Oct 14 02:56 private
drwxr-xr-x 2 root bin 512 Oct 14 02:56 sbin
drwxrwxr-x 2 root other 512 Oct 14 02:56 setup
# cd bin
# ls -l
total 2896
-rwxr-xr-x 1 root bin 606484 Sep 10 15:36 fwupdate <<<------- (under /opt/sun-ssm/bin)
-rwxr-xr-x 1 root bin 600316 Sep 10 15:36 ilomconfig
-rwxr-xr-x 1 root bin 233244 Sep 10 15:36 raidconfig
4 - Check SAS firmware from under "/opt/sun-ssm/bin" directory:
# ./fwupdate list all
CONTROLLER c0
=============
Manufacturer Model Product Name F/W Version BIOS Version
-----------------------------------------------------------------------------------------------
LSI Logic 0x0058 - - -
EXPANDERS
===============
ID Chassis Slot Manufacturer Model Expander Name FW Version
--------------------------------------------------------------------------------
c0x0 0 0 SUN NEMHydra_C10 Master 5.2.13.0 <<<--------- Current SAS firmware version on NEM 0
c0x1 1 1 SUN NEMHydra_C10 Master 5.2.13.0 <<<--------- Current SAS firmware version on NEM 1
NOTE:
If you have problems with seeing one of the NEM's (c0x0 or c0x1), use the following procedure on the blade that has the HMP software on it:
++
- to clean up the device tree
# devfsadm -C
then re-create the device tree
# devfsadm
++
If it still not working, you may need to do a re-config reboot (reboot -- -r) on that blade.
.
.
How to update SAS firmware on NEM's:
1 - Get following firmware patch from MOS and unzip them in a Solaris temporary directory (ie. /var/tmp/VMF_SAS_firm):
- Patch 11883817: SUN BLADE 6000 10GBE VMF NEM SW 2.2.1 FIRMWARE
- https://updates.oracle.com/Orion/Services/download/p11883817_221_Generic.zip?aru=13604920&patch_file=p11883817_221_Generic.zip
2 - Install on blade with HMP 2.2 on it into a temporary directory.
3 - # cd /var/tmp/VMF_SAS_firm
- unzip p11883817_221_Generic.zip
4 - Go to SAS firmware directory:
# cd firmware
-rw-r--r-- 1 cforgues staff 11424815 Mar 29 2011 ilom-2_0_3_12-sun_fire_x4238.pkg
-rw-r--r-- 1 cforgues staff 844 Mar 29 2011 mfgimagecust03n.5.04.03.bin
-rw-r--r-- 1 cforgues staff 112164 Mar 29 2011 sasxfwhv.5.04.03.fw
Update Expander-manufacturing-image:
# /opt/sun-ssm/bin/fwupdate update expander-manufacturing-image -n c0x0 -f mfgimagecust03n.5.04.03.bin
The following components will be upgraded as shown:
==========================================================
ID Priority Action Status Old Firmware Ver. Proposed Ver. New Firmware Ver. System Reboot
------------------------------------------------------------------------------------------------------------
c0x0 1 Check FW Success N/A Not Provided N/A None
Do you wish to process all of the above component upgrades? [y/n]? y
Updating c0x0: Success
Verifying all priority 1 updates
No metadata provided, so version verification can not be completed
Execution Summary
==========================================================
ID Priority Action Status Old Firmware Ver. Proposed Ver. New Firmware Ver. System Reboot
------------------------------------------------------------------------------------------------------------
c0x0 1 Validate Pending N/A Not Provided N/A None
# /opt/sun-ssm/bin/fwupdate update expander-manufacturing-image -n c0x1 -f mfgimagecust03n.5.04.03.bin
The following components will be upgraded as shown:
==========================================================
ID Priority Action Status Old Firmware Ver. Proposed Ver. New Firmware Ver. System Reboot
------------------------------------------------------------------------------------------------------------
c0x1 1 Check FW Success N/A Not Provided N/A None
Do you wish to process all of the above component upgrades? [y/n]? y
Updating c0x1: Success
Verifying all priority 1 updates
No metadata provided, so version verification can not be completed
Execution Summary
==========================================================
ID Priority Action Status Old Firmware Ver. Proposed Ver. New Firmware Ver. System Reboot
------------------------------------------------------------------------------------------------------------
c0x1 1 Validate Pending N/A Not Provided N/A None
Update expander-firmware:
# /opt/sun-ssm/bin/fwupdate update expander-firmware -n c0x0 -f `pwd`/sasxfwhv.5.04.03.fw
The following components will be upgraded:
c0x0 [y/n]? y
Upgrade of c0x0 from x.x.xx.x succeeded, but is not yet active.
Refer to release notes for additional steps to ensure activation.
# /opt/sun-ssm/bin/fwupdate update expander-firmware -n c0x1 -f `pwd`/sasxfwhv.5.04.03.fw
The following components will be upgraded:
c0x1 [y/n]? y
Upgrade of c0x1 from x.x.xx.x succeeded, but is not yet active.
Refer to release notes for additional steps to ensure activation.
Init 0 Blade and then power cycle chassis.
-> stop -force /CH
Wait until prompt comes back and then wait 30 seconds to proceed.
-> start /CH
Wait 3 minutes for NEM's to reboot.
Verify Both NEM0 and NEM1:
On CMM - -> show /CH/NEM0/STATE and show /CH/NEM1/STATE and check state for "Running"
How to update NEM ILOM and Power sequencer Code:
1 - Get Escalation Password for Sunservice account on CMM
++
Step #1: You first must create a user that has "aucros" roles allowing you to do the specific commands below to "enable" escalation mode, since the "root" user doesn't have all these roles:
# ssh -l root 'ip address of CMM'
-> create /CMM/users/service role=aucros
Creating user...
Enter new password: *********
Enter new password again: *********
Created /CMM/users/service
Step #2: Logout of the "root" account.
Step #3: Login to newly made "service" account.
# ssh -l service 'ip address of CMM'
-> show /CMM/users/service role
/CMM/users/service
Properties:
role = aucros
Step #4: Some systems have a physical presence detect feature. If you are remote to the system, and there is no one at the system to indicate physical presence, you will not be able to enter service mode. You can disable physical presence detect as follows:
-> show /CMM check_physical_presence
/CMM
Properties:
check_physical_presence = true <<-------- needs to be 'false' if you remote from the system (The default is "true" which is if you are "local" to the system)
-> set /CMM check_physical_presence=false
Set 'check_physical_presence' to 'false'
-> show /CMM check_physical_presence
/CMM
Properties:
check_physical_presence = false
Step #5: The escalation mode password ( escalation mode password generator website is limited to select users and requires a collaboration task before a password will be created ) is tied to the product serial number of the system, along with the ILOM firmware version, and time on the CMM (so the password doesn't expire until its 48hrs. are up).
The following information (ILOM version, chassis_serial_number, and CMM clock datetime) is needed for a TSC Engineer to generate a escalation mode password:
-> version
CMM firmware 3.0.6.11 <<<-----ILOM Version
CMM firmware build number: 47352
CMM firmware date: Mon Aug 3 15:55:25 PDT 2009
CMM filesystem version: 0.1.22
-> show /CH chassis_serial_number
/CH
Properties:
chassis_serial_number = 0000000-0000000000 <<<----- Need full Chassis serial # (with "-")
-> show /CMM/clock
/CMM/clock
Targets:
Properties:
datetime = Fri Sep 18 07:25:49 2009 <<<----- Current time on CMM (so the password doesn't expire until its 48hrs. are up)
timezone = GMT (GMT)
usentpserver = disabled
Commands:
cd
set
show
Step #6: Entering the escalation mode password sent by me (TSC):
-> cd /CMM/users/service
/CMM/users/service
-> ls
/CMM/users/service
Targets:
ssh
service
escalation
Properties:
role = aucros
password = *****
Commands:
cd
set
show
-> set escalation escalation_password=true
Password:**** *** **** **** **** **** **** **** **** **** *** **** **** **** **** *** **** **** **** *** *** **** **** **** *** **** ****
*** *** *
Short form password is: xx xxxx xx
NOTE: Please make sure that use save this "Short Form Password" for the duration of the 48hr. period in case you logout of the "bash shell (bash-2.05b#)" and need to go back in.
-> set SESSION mode=escalation
Short Form Password:xx xxxx xx
bash-2.05b#
2 - To update NEM ILOM Firmware:
1. Find "ILOM-2_0_3_12-Sun_Fire_X4238.pkg" in firmware directory made above (/var/tmp/VMF_SAS_firm/firmware)
Note: The NEM ILOM must have its own valid IP address and parameters defined to upgrade firmware.
2 - ssh sunservice@(NEM_SP_IP_ADDRESS)
3- cd /dev/shm
4 - scp [email protected]:/var/tmp/VMF_SAS_firm//firmware/ilom-2_0_3_12-sun_fire_x4238.pkg .
5 - nf_upgrade ./ilom-2_0_3_12-sun_fire_x4238.pkg
this command takes about 5 minutes to complete.
Below is the screen capture:
=========================================================================
[(flash)root@SUNSP0021282B81B8:/dev/shm]# nf_upgrade ./ilom-2_0_3_12-sun_fire_x4238.pkg
Version: 2.0.3.12
Build: r42186
Date: Mon Jan 25 16:33:54 PST 2010
Start update of: Service Processor Firmware
Write 0 of 156
Write 0 of 156
Write 1 of 156
Write 2 of 156
Write 3 of 156
Write 4 of 156
Write 5 of 156
...
+++++
3 - To Update the Power Sequencer Code:
1. Get following firmware patch from MOS and unzip it in the blade temporary directory (ie. /var/tmp/PWR_SEQ):
- Patch 11884182: SUN BLADE 6000 10GBE VMF NEM SW 2.2.1 POWER SEQUENCER
- https://updates.oracle.com/Orion/Services/download/p11884182_221_Generic.zip?aru=13604923&patch_file=p11884182_221_Generic.zip
2 - Install on blade with HMP 2.2 on it into a temporary directory (ie. /var/tmp/PWR_SEQ).
3 - # cd /var/tmp/PWR_SEQ
- unzip 11884182_221_Generic.zip
4 - Go to PWR_SEQ "power_sequencer" directory:
# cd power_sequencer
-rwx--x--x 1 cforgues staff 12920 Aug 16 2010 adm1066_update*
-rw------- 1 cforgues staff 3025 Aug 16 2010 main_pwrseq_rev110304.hex
-rw------- 1 cforgues staff 3025 Aug 16 2010 main_pwrseq_rev3_3_mitac.hex
-rwx--x--x 1 cforgues staff 282 Aug 23 2010 nem_pwr_ver.sh*
-rw-r--r-- 1 cforgues staff 9836 Mar 29 2011 nemhydrapwrupd10.zip
-rw-r--r-- 1 cforgues staff 15228 Jan 7 2011 nemhydrasw2.2_sla&entitlement.txt
-rw-r--r-- 1 cforgues staff 55257 Jan 7 2011 nemhydrasw2.2_thirdpartylicensereadme.txt
-rw-r--r-- 1 cforgues staff 1881 Mar 17 2011 readme221.html
-rw------- 1 cforgues staff 3240 Sep 1 2010 release.txt
-rwx--x--x 1 cforgues staff 69 Aug 23 2010 restore_nem0_mainpwr.sh*
-rwx--x--x 1 cforgues staff 69 Aug 23 2010 restore_nem1_mainpwr.sh*
-rwx--x--x 1 cforgues staff 66 Aug 23 2010 update_nem0_mainpwr.sh*
-rwx--x--x 1 cforgues staff 66 Aug 23 2010 update_nem1_mainpwr.sh*
5 - Unzip nemhydrapwrupd10.zip
The following files that are needed to upgrade the power sequencer will now be available:
? update_nem0_mainpwr.sh- Script to upgrade NEM in slot 0
? update_nem1_mainpwr.sh- Script to upgrade NEM in slot 1
? nem_pwr_ver.sh- Displays the version of NEM power firmware
? adm1066_update- Binary to update power sequencer firmware (runs on the CMM)
? main_pwrseq_rev110304.hex- Modified power sequencer firmware to prevent unexpected shutdowns
Note Make sure that you have execute permissions on these files. If you do not have execute permissions, use the chmod +x command on the files before
copying them to the CMM.
6 - Enter escalation mode on the CMM see following MOS document CMM access to escalation mode (Doc ID 1353684.1)
https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=1353684.1&recomm=Y
7 - From within the ILOM bash shell (escalation mode) use scp to copy required files to to the /coredump directory
# cd /coredump
# scp [email protected]:/home/user_name/var/tmp/PWR_SEQ/Power_Sequencer/*
8 - Check current status of power sequencer firmware:
# ./nem_pwr_ver.sh
NOTE: If power sequencer firmware has been updated the following is displayed otherwise the values displayed are 0.
Nem (slot 0) main power version:
04
03
11
Nem (slot 1) main power version:
04
03
11
9 - Update the NEM in slot 0, with the following command:
# ./update_nem0_mainpwr.sh
10 - If necessary, update the NEM in slot 1:
# ./update_nem1_mainpwr.sh
Note Each command may take more than two minutes to complete.
11 - Power cycle the Virtualized NEMs
Note that there is no power cycle facility within the NEM ILOM so the easiest way to do this is the following commands from within the CMM ILOM cli (normal root log in)
stop /CH
check state of NEMs to ensure they have been powered off
show /CH/NEM0/STATE value
show /CH/NEM1/STATE value
then restart chassis
start /CH
-> stop -force /CH
Wait until prompt comes back and then wait 30 seconds to proceed.
Verify Both NEM0 and NEM1 are powered off:
On CMM - -> show /CH/NEM0/STATE and show /CH/NEM1/STATE and check state for "Power off"
-> start /CH
Wait 3 minutes for NEM's to reboot.
Verify Both NEM0 and NEM1 are running:
On CMM - -> show /CH/NEM0/STATE and show /CH/NEM1/STATE and check state for "Running"
12 - From escalation mode (ILOM bash shell) check the upgrade is complete
/coredump/nem_pwr_ver.sh
(see step 8 for required output)
++++
- SAS firmware, NEM ILOM firmware, and Power Sequencer code completed. You can now start the blades (--> start /SYS) and bring up the OS and Apps.
Attachments
This solution has no attachment
