SL3000/SL8500 - How to Recover Library Communication After Library Controller Stops Communicating

Asset ID:	1-72-1377164.1
Update Date:	2011-11-14
Keywords:

Solution Type Problem Resolution Sure

Solution 1377164.1 : SL3000/SL8500 - How to Recover Library Communication After Library Controller Stops Communicating

Applies to:

Sun StorageTek SL8500 Modular Library System - Version: Not Applicable to Not Applicable - Release: N/A to N/A
Sun StorageTek SL3000 Modular Library System - Version: Not Applicable to Not Applicable [Release: N/A to N/A]
Information in this document applies to any platform.

Symptoms

The following scenario is the most likely you will encounter in a MVS shop.
Network becomes very busy Host issues a SHPG command.
Library send acknowledgement back to the host.
Host does not received it in the allowable time resulting in a timeout.
This causes the host to drop port connection.
In turn the Library closes the socket connection.

See the following Library and System log entries:
SYSD 11310 18:45:37.28 00000090 .SLS6005I NETWORK ATTACH FUNCTION INITAPI FAILED FOR STATION 10.1.0.100
WITH ERRNO 10,218
SYSD 11310 18:45:57.19 00000281 IEF196I,.SLS6012E,ACS 00: RECOVERY OF NETWORK CONNECTION TO STATION
SYSD 11310 18:45:57.19 00000281 IEF196I 10.2.0.100 IS NOW ACTIVE
SYSD 11310 18:45:57.21 00000281 IEF196I .SLS1000I ACS 00 STATUS: DISCONNECT
SYSD 11310 18:45:57.21 00000281 IEF196I COMPATIBILITY LEVELS: HSC=21, LMU=00
SYSD 11310 18:45:57.21 00000281 IEF196I DUAL LMU NOT CONFIGURED
SYSD 11310 18:45:57.21 INTERNAL 00000090 .SLS1000I ACS 00 STATUS: DISCONNECT 636
636 00000090 COMPATIBILITY LEVELS: HSC=21, LMU=00
636 00000090 DUAL LMU NOT CONFIGURED
636 00000090 IP ADDR 10.1.0.100 NETWORK RECONNECT
636 00000090 IP ADDR 10.2.0.100 NETWORK RECONNECT
SYSD 11310 22:55:03.93 INTERNAL 00000290 .VARY,ACS,00 ONLINE
SYSD 11310 22:55:03.94 INTERNAL 00000090 .SLS0000I VARY ACS 00 ONLINE
SYSD 11310 22:55:03.94 00000281 IEF196I .SLS0000I VARY ACS 00 ONLINE

SYSD 11310 22:56:44.50 00000090 .SLS0653I SHPG OF,STATION,DEVICE 10.2.0.100 FAILED - NOP FAILED
SYSD 11310 22:56:44.50 00000281 IEF196I .SLS0653I SHPG OF STATION DEVICE 10.2.0.100 FAILED - NOP FAILED
SYSD 11310 22:56:44.51 00000090 .SLS0453I LMU ERROR 65936593 VARYING STATION 0000 ONLINE
SYSD 11310 22:56:44.51 00000281 IEF196I .SLS0453I LMU ERROR 65936593 VARYING STATION 0000 ONLINE
SYSD 11310 22:56:44.51 INTERNAL 00000090 .SLS0057I UNKNOWN RC 65936593 FROM LMURQST
SYSD 11310 22:56:44.51 00000281 IEF196I .SLS0057I UNKNOWN RC 65936593 FROM LMURQST
SYSD 11310 22:56:45.30 SYSD0010 00000290 .D ACS
SYSD 11310 22:56:45.30 INTERNAL 00000090 .SLS0000I D ACS
SYSD 11310 22:56:45.30 00000281 IEF196I .SLS0000I D ACS
SYSD 11310 22:56:45.41 SYSD0010 00000090 .SLS1000I ACS 00 STATUS: DISCONNECT 197
197 00000090 COMPATIBILITY LEVELS: HSC=21, LMU=00
197 00000090 DUAL LMU NOT CONFIGURED

This will also cause the LSM's to not come ready and tape drives to not vary online.

Changes

Cause

There are certain times when the SL Series Libraries appear to lose communication with the host systems especially in the MVS environment.

The SL Series library controller can get overwhelmed due to excessive command traffic.This normally occurs when multiple LPAR's are attempting to start HSC at the same time. Excessive command activity causes the library controller to stop communicating with the host systems.

Solution

Restore network connectivity to the SL Series Library.

The following steps should be taken as a workaround to bring the systems back up and restore communication between the host systems and the Library:

Bring all HSC systems/LPAR's down.
Reboot Library.. wait for the Library to complete the initialization.
Ping the IP address of the library port or ports from the MVS host.
Bring online 1 HSC Software/LPAR to verify host connection has been established.
This can also be observed via Library SLC from the HLI status panel.
Once communication has been verified start 2 HSCs/LPAR's at a time maximum.
Attachments

This solution has no attachment