Error CELL-02018: Internal error detected: java.lang.NullPointerException While list LUN / CellDisk / GridDisk

Asset ID:	1-72-1494307.1
Update Date:	2012-10-05
Keywords:

Solution Type Problem Resolution Sure

Solution 1494307.1 : Error CELL-02018: Internal error detected: java.lang.NullPointerException While list LUN / CellDisk / GridDisk

Applies to:

Exadata Database Machine X2-2 Qtr Rack - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

CellCLI> list lun

CELL-02018: Internal error detected: java.lang.NullPointerException



CellCLI> list celldisk

CELL-02018: Internal error detected: java.lang.NullPointerException



CellCLI> list griddisk

CELL-02018: Internal error detected: java.lang.NullPointerException

Following error reported in ms-odl.trc

[2012-09-26T14:36:42.747-04:00] [ossmgmt] [NOTIFICATION] [] [ms.core.MSOSSComm] [tid: 13] [ecid: 10.200.100.36:54239:1348684602744:19,0] OSS Version compatible. MS-OSS Communication successful.

[2012-09-26T14:36:42.747-04:00] [ossmgmt] [NOTIFICATION] [CELL-05506] [ms.core.MSCoreImpl] [tid: 13] [ecid: 10.200.100.36:54239:1348684602744:19,0] Sync disk lists from CELLSRV.

[2012-09-26T14:36:45.926-04:00] [ossmgmt] [NOTIFICATION] [CELL-05512] [ms.core.MSCoreImpl] [tid: 13] [ecid: 10.200.100.36:54239:1348684602744:19,0] Synched CellDisk CD_01_wmexq1cel01 with the CELLSRV.

[2012-09-26T14:36:45.928-04:00] [ossmgmt] [ERROR] [] [ms.core.MSCommandHandler] [tid: 13] [ecid: 10.200.100.36:54239:1348684602744:19,0] java.lang.NullPointerException[[

Changes

Customer has recently replaced the HDD on slot 0, Cell Disk and Grid Disk were not created automatically.

Cause

Bug 13684122 : CELL-02018: JAVA.LANG.NULLPOINTEREXCEPTION IN MS WHEN LISTING GRIDDISKS

Entries in $OSSCONF/cell_disk_config.xml are corrupt/missing for griddisk


For Example: Grid Disk - DATA1_CD_00_wmexq1cel01


    - <Target TYPE="oracle.ossmgmt.ms.core.MSNetDisk" NAME="DATA1_CD_00_wmexq1cel01">

     <Attribute NAME="cellDisk" VALUE="CD_00_wmexq1cel01" />

     <Attribute NAME="status" VALUE="not present" />

     <Attribute NAME="errorCount" VALUE="0" />

     <Attribute NAME="name" VALUE="DATA1_CD_00_wmexq1cel01" />

     <Attribute NAME="availableTo" />

     <Attribute NAME="creationTime" VALUE="1348166041405" />

     <Attribute NAME="size" VALUE="423G" />

     <Attribute NAME="offset" VALUE="32M" />

     <Attribute NAME="comment" />

     </Target>

Solution

1. Log into the cell & stop the MS service on the cell.

cellcli> alter cell shutdown services ms

2. cd to $OSSCONF on the cell and either remove the cell_disk_config.xml file or back it up by renaming and moving it aside to the /tmp directory.

    cd $OSSCONF
    mv cell_disk_config.xml /tmp/old_cell_disk_config.xml.<date>

3. Validate that this file no longer exists $OSSCONF/cell_disk_config.xml

4. Restart MS

   cellcli> alter cell restart services ms

5. Verify / Validate that list lun, list celldisk and list griddisk works.
            Querying the status of the lun/celldisk/griddisk will re-create the $OSSCONF/cell_disk_config.xml file automatically.

6. If HDD replacement occurs and CellDisk and GridDisk is not created automatically then need to create CellDisk and GridDisk manually

Refer MOS Note: 1281395.1 - Steps to manually create cell/grid disks on Exadata V2 if auto-create fails during disk replacement

8. Once CellDisk and GridDisk is created manually, we may need to add it back to ASM Disk Group as per requirement.

References

<BUG:13684122> - CELL-02018: JAVA.LANG.NULLPOINTEREXCEPTION IN MS WHEN LISTING GRIDDISKS
@<NOTE:1088475.1> - Replacing an Oracle Exadata System disk drive
<NOTE:1281395.1> - Steps to manually create cell/grid disks on Exadata V2 if auto-create fails during disk replacement

Attachments

This solution has no attachment