1832541 Members
5942 Online
110043 Solutions
New Discussion

Slow NFS with 10gbe

 
MikeBallard
Occasional Contributor

Slow NFS with 10gbe

We recently replaced the 1 GB NICs in two rx6600 servers, running HPUX 11.23, with 10gbe NICs.  These servers are in a ServiceGuard cluster.  Since the installation of the new NICs, NFS traffic to our EMC Centera/Celerra archive system has gotten 3-4 times slower than before.  This was totally unexpected.  All the other network communications with the servers seems fine, as well as NFS traffic between the two, but we are really slow to the EMC system with frequent messages like these-

Jul 17 08:59:34 coxha02 vmunix: NFS access failed for server 172.16.247.30: RPC: Timed out
Jul 17 08:59:34 coxha02 vmunix: NFS lookup failed for server 172.16.247.30: RPC: Timed out
Jul 17 09:00:33 coxha02 vmunix: NFS read failed for server 172.16.247.30: RPC: Timed out
Jul 17 09:00:34 coxha02 vmunix: NFS read failed for server 172.16.247.30: RPC: Timed out
Jul 17 09:00:34 coxha02 vmunix: NFS getattr failed for server 172.16.247.30: RPC: Timed out
Jul 17 09:00:34 coxha02 vmunix: NFS getattr failed for server 172.16.247.30: RPC: Timed out

System firmware was updated at the time the 10gbe NICs were installed and the recommended patches were already installed.

 

Mount options from fstab for the NFS file systems are these-

 

172.16.247.30:/PACS_Archive /PACS_Archive nfs soft,intr,vers=3,proto=tcp,rsize=32768,wsize=32768,bg 0 0
172.16.247.30:/PACS_Archive_2 /PACS_Archive_2 nfs soft,intr,vers=3,proto=tcp,rsize=32768,wsize=32768,bg 0 0

We're struggling to figure out why the NFS traffic is having problems to the EMC system and what we can do about it.  Is there any recommended changes to NFS configuration from adding the 10gbe NICs?  Any other suggestions?

 

Any help appreciated, thanks.

 

2 REPLIES 2
Patrick Wallek
Honored Contributor

Re: Slow NFS with 10gbe

It is possible that the latest ONCPlus release could help.

 

https://h20392.www2.hp.com/portal/swdepot/displayProductInfo.do?productNumber=ONCplus

 

Have you tried using a larger rsize and wsize?  Perhaps 64k or 128k?

MikeBallard
Occasional Contributor

Re: Slow NFS with 10gbe

I don't think larger rsize and wsize is supported with HPUX 11.23, but we've been told the EMC system doesn't support higher values than that.