Sun Storage 7000 Unified Storage System: How to increase the TCP buffer size to improve NFS performance in fast 10Gb EThernet or IPoIB networks

Asset ID:	1-71-1401076.1
Update Date:	2012-06-27
Keywords:

Solution Type Technical Instruction Sure

Solution 1401076.1 : Sun Storage 7000 Unified Storage System: How to increase the TCP buffer size to improve NFS performance in fast 10Gb EThernet or IPoIB networks

Applies to:

Sun ZFS Storage 7120 - Version Not Applicable to Not Applicable [Release N/A]
Sun ZFS Storage 7320 - Version Not Applicable to Not Applicable [Release N/A]
Sun ZFS Storage 7420 - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7410 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7110 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
7000 Appliance OS (Fishworks)
NAS head revision : [not dependent]
BIOS revision : [not dependent]
ILOM revision : [not dependent]
JBODs Model : [not dependent]
CLUSTER related : [not dependent]

Goal

This document will show that the TCP buffer size can be increased for the Sun Storage 7000 Unified Storage System. This is useful where packet drops and TCP transmission problems are contributing factors in performance degradation on fast networks such as 10Gb Ethernet or IPoIB.

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - 7000 Series ZFS Appliances

Fix

The default value for tcp_xmit_hiwat and tcp_recv_hiwat is 1MB on the appliance. This should really be increased to improve NFS performance on fast networks.
However since this can be acheived on the appliance by invasive support only, please call Oracle Support to raise a Service Request and reference this article.

The following CR was filed for this problem <Bug 7062307>:

CR 7062307 Updated, P2 rpe/incoming Invasive Support: Workflow to change tcp_xmit_hiwat and tcp_recv_hiwat on the Appliance

The above CR was closed as a duplicate of <Bug 7081230> (still open as of 2011.1.3.0) but has a workflow attached which will increase the tcp_xmit_hiwat and tcp_recv_hiwat buffers to 16MB.
Please notice that this workflow will change the parameters that will affect all TCP applications globally, not just for NFS.
The change made by the workflow WILL NOT survive over the boot of appliance.

The workflow is available from this link to the Amber Road Support Beehive wiki.
If you do not have access to this wiki you will need to raise a request to a member of the NAS support team.

Back to <Document 1402579.1> Sun Storage 7000 Unified Storage System: How to Troubleshoot NFS Problems.

References

@ <BUG:7062307> - INVASIVE SUPPORT: WORKFLOW TO CHANGE TCP_XMIT_HIWAT AND TCP_RECV_HIWAT ON THE APPLIANCE
@ <BUG:7081230> - AGILE00233765:FILES WITH FIENAME CONSISTING '&' COULDN'T BE DOWNLOADED INTO A ZI
@Workflow: https://stbeehive.oracle.com/content/dav/st/AmberRoadSupport/Documents/change_tcp_buffersize.akwf
<NOTE:1402579.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot NFS Problems

Attachments

This solution has no attachment