Sun Microsystems, Inc.  Sun System Handbook - ISO 4.1 October 2012 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1387993.1
Update Date:2012-06-20
Keywords:

Solution Type  Technical Instruction Sure

Solution  1387993.1 :   Sun Storage 7000 Unified Storage System: Identifying NDMP issues and data collection  


Related Items
  • Sun Storage 7310 Unified Storage System
  •  
  • Sun Storage 7410 Unified Storage System
  •  
  • Sun ZFS Storage 7120
  •  
  • Sun ZFS Storage 7420
  •  
  • Sun ZFS Storage 7320
  •  
  • Sun Storage 7210 Unified Storage System
  •  
  • Sun Storage 7110 Unified Storage System
  •  
Related Categories
  • PLA-Support>Sun Systems>DISK>NAS>SN-DK: 7xxx NAS
  •  
  • .Old GCS Categories>Sun Microsystems>Storage - Disk>Unified Storage
  •  




In this Document
Goal
Fix
 Identifying NDMP type issues
 Frame and describe the problem
 Data collection
References


Applies to:

Sun Storage 7110 Unified Storage System - Version Not Applicable and later
Sun ZFS Storage 7120 - Version Not Applicable to Not Applicable [Release N/A]
Sun ZFS Storage 7420 - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7310 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7410 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
7000 Appliance OS (Fishworks)

Goal

Preliminary work to identify NDMP type issues, gather necessary information and data for further analysis. Further data collection may be required depending on the nature of the problem.

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - 7000 Series ZFS Appliances

Fix

Identifying NDMP type issues

- NDMP type issues are generally identified when backup software has failed, when errors/warnings are generated, or a backup/restore is performing slowly.
On the ZFS Storage Appliance perform general checks to ensure non-NDMP components are working. If necessary resolve any issue seen and then revisit NDMP issues.

Appliance general health.
  • BUI "status show" for general appliance health.
  • BUI "maintenance problems" for reported problem.
  • BUI "maintenance alerts" for any alerts, faults and operating system log.


Typical ndmp errors may appear similar to the example below:

Dec 10 01:32:57 lab /usr/lib/ndmp/ndmpd[1880]: [ID 702911 daemon.error] Tape read error: I/O error.

 

Appliance NDMP general health
  • BUI "configuration services NDMP" for configuration and ensure NDMP service is online.
  • BUI "status ndmp" for tape library and drives device path, status and NDMP activities.

Frame and describe the problem

Describe the problem as seen on ZFS Storage Appliance and on the Data Management Application (DMA) backup software.

  • Include backup/restore detail activities with a date and time stamp when the problem is observed.
  • Include any recent changes on all backup/restore components that involve ZFS Storage Appliance.
  • Include recent changes including firmware/software updates, hardware components, configuration, TCP/IP network and/or Fibre Channel storage area network for FC connected tape system. When possible, include the procedure to reproduce the problem.

- On DMA backup software

  • Activities and errors/warning seen including logs and executed commands
  • Consult DMA manuals and engage vendors as required

Data collection

List of general information and data that needs to be collected.
Further data is possible depending on the nature of the problem.

  1. Include problem identification as per the above.
  2. Collect ZFS Storage Appliance supportbundle using <Document 1019887.1> How to collect supportfile bundle using the BUI or CLI
  3. DMA errors, warning, failed commands and where applicable include DMA vendor analysis.
  4. Network packet capture between DMA backup software and ZFS storage appliance (*).  See <Document 1398376.1> "Sun Storage 7000 Unified Storage System: How to get a network trace to assist in troubleshooting network problems" for further details on this.
  5. Capture analytics data for ZFS storage appliance NDMP performance
  6. Other data can be collected under supervision of Oracle engineer.

Depending on the problem, you may need to capture more data before collecting a supportbundle

o for suspected ndmp code

aksh> confirm shell gcore -o /var/ak/dropbox/ndmpd.gcore `pgrep ndmpd`

 o capture ndmp debug when escalating to engineering.

Starting with the 2011.1.1.0 appliance code, ndmp logging is always enabled (CR 6908633). The log is available at /var/ak/logs/ndmp/ndmplog.

o capture network snoop between DMA and ZFS Storage Appliance.

Preferably from an external device to the ZFS Storage Appliance, but if required capture a network trace from the ZFS Storage Appliance itself. See <Document 1398376.1> Sun Storage 7000 Unified Storage System: How to get a network trace to assist in troubleshooting network problems.

(*) By default NDMP uses TCP/IP port 10000. NDMP version 4 can be configured to use a different port number.
Include a network packet trace output when the issue falls in these scenarios:

  • An interoperability problem between DMA and ZFS Storage Appliance
  • The DMA vendor analysis implicates the ZFS Storage Appliance
  • The backup procedure uses remotely connected tape library and drives


Back to NDMP troubleshooting resolution path <Document 1387930.1>

References

<NOTE:1387930.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot NDMP Issues
<NOTE:1019887.1> - Sun Storage 7000 Unified Storage System: How to collect a supportbundle using the BUI or CLI
<NOTE:1398376.1> - Sun Storage 7000 Unified Storage System: How to get a network trace to assist in troubleshooting network problems
SUPPORT WIKI: HOW TO ENABLE NDMP DEBUG: HTTPS://STBEEHIVE.ORACLE.COM/TEAMCOLLAB/WIKI/AMBERROADSUPPORT:HISAO+TSUJIMURA+-+HOW+TO+ENABLE+NDMP+DEBUGGING
@ <BUG:6908633> - WCREG14:PAGE UNACCESSIBLE AFTER DEPLOYMENT WITRH WORKLITS AND PERSONAL TASK

Attachments
This solution has no attachment
  Copyright © 2012 Sun Microsystems, Inc.  All rights reserved.
 Feedback