Sun Storage 7000 Unified Storage System: BUI/CLI hang due to analytics compilation (CCP) bug

Asset ID:	1-72-1468128.1
Update Date:	2012-06-29
Keywords:

Solution Type Problem Resolution Sure

Solution 1468128.1 : Sun Storage 7000 Unified Storage System: BUI/CLI hang due to analytics compilation (CCP) bug

Applies to:

Sun Storage 7110 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7210 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7310 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7410 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun ZFS Storage 7120 - Version Not Applicable to Not Applicable [Release N/A]
7000 Appliance OS (Fishworks)

Symptoms

Symptoms observable by the customer:

System does not boot/start

Cannot login to BUI/CLI

Cluster peer CLI command "configuration cluster show" does not return

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - 7000 Series ZFS Appliances

Symptoms observable by the Oracle Support engineer:

Looks like AKD has been trying to stop for over an hour:

nas01# aklog akd | tail

Fri Jan 27 15:01:19 2012: rx_join: waiting on rejoin

Fri Jan 27 15:01:20 2012: initial cluster state AKCS_CLUSTERED

Fri Jan 27 15:01:20 2012: rx_join: done, state is AKCS_CLUSTERED

Fri Jan 27 15:01:20 2012: disconnecting from +cio by request

Fri Jan 27 15:01:20 2012: CIO: channel 1 reset by cio disable

Fri Jan 27 15:01:20 2012: CIO disabled: EAK_MUSTEXIT

Fri Jan 27 15:01:20 2012: ak_ssl_recv() failed with unexpected peer error: SSL read i/o system call error (CIO connection reset by peer)

Fri Jan 27 15:01:20 2012: disconnecting peer +cio

Fri Jan 27 15:01:20 2012: disconnecting peer 127.0.0.1:48586

Fri Jan 27 15:01:49 2012: job c497f1d6-7904-6191-d288-876c3d07a24d failed with exit status 1



nas01# date

Fri Jan 27 16:01:38 UTC 2012

/var/ak/core directory contains a 'core.cpp.xxx' file

Cause

This is a known issue due to an analytics compilation failure.

Known issue - <SunBug 7010064> - CPP exits with a segfault

Solution

Recommended action for the customer:
You will need to engage Oracle Support, by opening a Service Request, so that Oracle Support Services can provide confirmation of this issue and then carry out the appropriate activities to resolve the issue.

Recommended actions for the Oracle Support engineer:
Remove the analytics from the appliance stash - see the following wiki document:
https://stbeehive.oracle.com/teamcollab/wiki/AmberRoadSupport:Solaris+shell+procedure+to+remove+%28excessive%29+analytics
If you cannot access this document engage NAS Storage-TSC for assistance

Back to <Document 1401282.1> Sun Storage 7000 Unified Storage System: How to Troubleshoot Unresponsive Adminstrative Interface (BUI/CLI Hang).

References

@ <BUG:7010064> - CPP EXITS WITH A SEGFAULT
@Support wiki - remove excess analytics: https://stbeehive.oracle.com/teamcollab/wiki/AmberRoadSupport:Solaris+shell+procedure+to+remove+%28excessive%29+analytics
<NOTE:1401282.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot Unresponsive Administrative Interface (BUI/CLI hang)

Attachments

This solution has no attachment