NFS sharing between hp-ux and linux

[Fadia Almarei]

I have Hp-UX 11.23 server and RHELAS v.4.6 64 bot server , i run NFS sharing from HP-UX server to Linux server but i get a limitation in file (> 2GB )creation on the mount found on RHEL server, how to solve this problem

[Michal Kapalka (mikap)]

hi,

check if your exported FS, was created with largefiles and if yes if the FS is mounted with this option.

more on this link ( old but good )

http://docs.hp.com/en/940/lgfiles4.pdf

mikap

[Steven E. Protter]

Shalom,

Hard to follow this question, but it would appear that HP-UX is sharing a file and the Linux client can't create a file bigger than 2 GB.

On HP-UX as root.

use the command:

fsadm

To convert the file system to support largefiles.


Next time, help us out with the version of HP-UX involved.

SEP

[Fadia Almarei]

steven ; i already sent that the Hp-UX version is 11.23 v.2 , i did the fsadm command and change it to enable to handle large files , in the HP-UX server i could create large files using the dd command , but when i try to work on the NFS partition on linux server and use the dd command also i get the error that it is not able to create >2GB file

[Fadia Almarei]

my main problem is in the NFS partition on RHEL server from HP-UX that it could not accept files larger than 2GB

[Matti_Kurkela]

Please show your /etc/exports line on HP-UX and /etc/fstab line on Linux for this mount point.

The outputs of "rpcinfo -p" on both hosts might be useful too.

Have you used the "nfsvers=2" or "vers=2" mount options on Linux?

You need NFS v3 for file sizes > 2GB.
Sounds like you're currently using NFS v2 for some reason.

MK

[Fadia Almarei]

# more /etc/fstab
/dev/vg00/lvol3 / vxfs delaylog 0 1
/dev/vg00/lvol1 /stand vxfs tranflush 0 1
/dev/vg00/lvol4 /home vxfs delaylog 0 2
/dev/vg00/lvol5 /opt vxfs delaylog 0 2
/dev/vg00/lvol6 /tmp vxfs delaylog 0 2
/dev/vg00/lvol7 /usr vxfs delaylog 0 2
/dev/vg00/lvol8 /var vxfs delaylog 0 2
/dev/vg00/u01 /u01 vxfs delaylog 0 2
/dev/vg01/u02 /u02 vxfs rw,suid,largefiles,delaylog,datainlog 0 2
billSVR1:/u07/mediation /Bill-Med nfs rw,suid 0 0
/dev/vgmed/lvolmed /MED-Test vxfs rw,suid,largefiles,delaylog,datainlog 0 2
#
#
# more /etc/exports
/MED-Test -anon=65534
#
# rpcinfo -p
program vers proto port service
100000 4 tcp 111 rpcbind
100000 3 tcp 111 rpcbind
100000 2 tcp 111 rpcbind
100000 4 udp 111 rpcbind
100000 3 udp 111 rpcbind
100000 2 udp 111 rpcbind
100024 1 tcp 49152 status
100024 1 udp 49153 status
100021 1 tcp 49153 nlockmgr
100021 1 udp 49154 nlockmgr
100021 3 tcp 49154 nlockmgr
100021 3 udp 49155 nlockmgr
100021 4 tcp 49155 nlockmgr
100021 4 udp 49156 nlockmgr
100020 1 udp 4045 llockmgr
100020 1 tcp 4045 llockmgr
100021 2 tcp 49156 nlockmgr
100068 2 udp 49167 cmsd
100068 3 udp 49167 cmsd
100068 4 udp 49167 cmsd
100068 5 udp 49167 cmsd
100005 1 udp 49536 mountd
100005 3 udp 49536 mountd
100005 1 tcp 49225 mountd
100005 3 tcp 49225 mountd
100003 2 udp 2049 nfs
100003 3 udp 2049 nfs
100003 2 tcp 2049 nfs
100003 3 tcp 2049 nfs

[Matti_Kurkela]

That information looks like it's all from the HP-UX machine... and this indicates both NFS v2 and v3 are available on the HP-UX side:

> 100003 2 udp 2049 nfs
> 100003 3 udp 2049 nfs
> 100003 2 tcp 2049 nfs
> 100003 3 tcp 2049 nfs

Next step would be to check the /etc/fstab and "rpcinfo -p" on the Linux host, please?

MK

[Matti_Kurkela]

Ah, I see now.

From the nfs(5) man page on RHEL 4 Linux:
----
Three different versions of the NFS protocol are supported by the Linux NFS client: NFS version 2, NFS version 3, and NFS version 4.

To mount via NFS version 2, use the nfs file system type and specify nfsvers=2.

---> Version 2 is the default protocol version for the nfs file system type when nfsvers= is not specified on the mount command. <---

----

So you must add "nfsvers=3" to the NFS filesystem's mount options in /etc/fstab on Linux.

(In RHEL 5, NFS version 3 was changed to be the default. But you said you're using RHEL 4 AS, which uses the old NFS version 2 by default.)

Your /etc/fstab line for this NFS filesystem is probably something like this:

:/MED-Test / nfs 0 0

Change it to:

:/MED-Test / nfs nfsvers=3, 0 0

Then unmount & re-mount the NFS filesystem.

After that, the file size limitation should be gone.

MK

[Fadia Almarei]

this is my fstab file

[root@NODE-N ~]# more /etc/fstab
# This file is edited by fstab-sync - see 'man fstab-sync' for details
/dev/VolGroup00/LogVol00 / ext3 defaults 1 1
LABEL=/boot /boot ext3 defaults 1 2
none /dev/pts devpts gid=5,mode=620 0 0
none /dev/shm tmpfs defaults 0 0
/dev/VolGroup00/LogVol03 /home ext3 defaults 1 2
/dev/VolGroup00/LogVol06 /opt ext3 defaults 1 2
none /proc proc defaults 0 0
none /sys sysfs defaults 0 0
/dev/VolGroup00/LogVol02 /tmp ext3 defaults 1 2
/dev/VolGroup00/Work-Dir /Work-Dir ext3 defaults 1
2
/dev/VolGroup01/LogVol00 /u01 ext3 defaults 1 2
/dev/VolGroup01/LogVol01 /u02 ext3 defaults 1 2
/dev/VolGroup00/LogVol04 /usr ext3 defaults 1 2
/dev/VolGroup00/LogVol05 /var ext3 defaults 1 2
/dev/VolGroup00/LogVol01 swap swap defaults 0 0
/dev/hda /media/cdrecorder auto pamconsole,fscontext=sys
tem_u:object_r:removable_t,exec,noauto,managed 0 0
172.16.2.103:/MED-Test /MED-Test nfs nfsvers=3 0 0



but i get the same error

[root@NODE-N MED-Test]# dd if=/dev/zero of=test1 bs=1024 count=4420033
File size limit exceeded

[Dave Olker]

Hi Fadia,

The fact that you're able to create large files locally on the HP-UX system in the exported filesystem leads me to believe the HP-UX box is configured properly. The fact that the Linux box stops at 2GB makes me think (as others have already guessed) that this NFS filesystem is really using NFS v2 instead of v3.

Rather than relying on the /etc/fstab output, I'd be more inclined to believe either the nfsstat output on the server or a network trace taken during the dd command. The nfsstat route is much easier. So here's what I'd suggest:

1) On the HP-UX server: nfsstat -z (zero out the counters)
2) On the Linux client: dd command
3) On the HP-UX server: nfsstat -s (print out the server-side statistics)

That should tell for certain whether the client is using NFS v2 or v3 - or at least tell us if any of your clients are using v2.

Another suggestion - do you have any systems other than this RH4 box you could use to test with?

You could also try using a loopback NFS mount on the HP-UX system and running the dd command in the loopback mount to make sure dd works fine over NFS - even from the local system to the local system.

Finally, I'm curious which version of the nfs-utils package you're running on the RH box?

Regards,

Dave

[Steven E. Protter]

Fadia,

Please post
nfsstat

Since largefiles are enabled on HP-UX and this tests out correctly, for some reason the Linux system is defaulting to NFS v2 protocol, as Dave says.

What makes me skeptical is that Linux NFS has been at version 4 for years and version three for even longer than that. It should never default to v2.

Check other services on Linux

nfslock
portmap

portmap should be running as should nfslock.

SEP

[Fadia Almarei]

the attached file contains the nfsstat output ,

the nfs utils output is
nfs-utils-1.0.6-84.EL4
nfs-utils-lib-1.0.6-8.z1

[Dave Olker]

The nfsstat output confirms NFS v3 is being used.

Do you have any other system you can test against this HP-UX server? Have you tried the loopback NFS mount on the local HP-UX server to verify that dd works over a local NFS mount?

The latest version of nfs-utils is 1.2.1, so if all else fails you can try downloading that version and compiling/installing it to see if it resolves your problem.

Dave

[Fadia Almarei]

i tried it on another HP-UX server but i get the same
i will try to update the nfsutil

[Fadia Almarei]

i try to move file with 6GB on this partition fromthe linux server i get the same error, and also i do not have version later that what i have for nfs-util.
what do you suggest ?

[Dave Olker]

> i tried it on another HP-UX server but i get the same


Can you try using the other HP-UX server as an NFS client to the original 11.23 NFS server and make sure that works properly? That would completely eliminate the HP-UX system as the cause of the problem and focus all attention on the Linux system.

Dave

[Fadia Almarei]

as i said i try to NFS share the HP-UX partiton on another HP-UX server and get no problem

[Fadia Almarei]

Am sorry , i try to NFS share the HP-UX partition on another HP-UX server but i get the same problem in size limitation .so the problem in NFS configuration on HP-UX server , how could i solve it ?