Simpler Navigation for Servers and Operating Systems - Please Update Your Bookmarks
Completed: a much simpler Servers and Operating Systems section of the Community. We combined many of the older boards, so you won't have to click through so many levels to get at the information you need. Check the consolidated boards here as many sub-forums are now single boards.
If you have bookmarked forums or discussion boards in Servers and Operating Systems, we suggest you check and update them as needed.
Operating System - Tru64 Unix
Showing results for 
Search instead for 
Did you mean: 

Poor performance in NFS Cluster over UDP

Frequent Advisor

Poor performance in NFS Cluster over UDP

Hello Everyone,
We have the following environment.
Two ES45 with a DEGXA PCI Gigabit Cards each as follows:
name = bcm0
category = network
sub_category = Ethernet
model = DEGXA
hardware_rev = BCM5703_C0
firmware_rev =
MAC_address = 00-10-18-0C-4E-39
MTU_size = 1500
media_speed = 1000
media_selection = Automatic

The NFS Environment we have is clustered running only samba.
The performance in the NFS Cluster is decreasing every day until it
reaches a point in which we have to reboot the cluster once a month to
clear out the cache and buffer. Then the services come back fine.
The following errors are constantly logged on to the /var/adm/messages
in relation to the

RFS3_GETATTR, client address = xx.xx.xx.xx, errno 70
rfs_dispatch: sendreply failed IP address: xx.xx.xx.xx
rfs_dispatch: sendreply failed IP address: xx.xx.xx.xx
NFS server: stale file handle fs(2554,616540) file 857277 gen 32771

Our environment consists of over 40 TB of files in data being accross
the NFS.
Is there a problem with the retransmit of large file systems, since
most of our file systems are over 2 gig in size.

Also, while doing some tests internally we noticed the following in
MB/sec and while reading a file on being served by the CFS.

In server 1 the reads were at 11 and the writes at 25
In server 2 the reads were at 35 and the writes at 25

Can someone tell me what is the high-performance blocksize for NFS V3.
If there is a diagram online that will make us understand this better
it will be greatly appreciated.