topic Re: More Large Files in Operating System - HP-UX

More Large Files

Fred Kass — Tue, 02 Apr 2002 19:28:35 GMT

I've used large files before and never had a problem but I must be missing something here. I created the filesystem, with large files turned on, mounted it with the right option and I still can't seem to get them to mount correct. Data bellow:

554 ki:/back3 # grep back3 /etc/fstab
/dev/back3/back3 /back3 vxfs rw,nosuid,largefiles,delaylog,datainlog 0 2
555 ki:/back3 # df .
Filesystem kbytes used avail %used Mounted on
/dev/back3/back3 177209344 27065520 148970888 15% /back3
556 ki:/back3 # ls -al junk*
-rw-r--r-- 1 root users 2147483647 Feb 28 15:51 junk
-rw-r--r-- 1 root users 456052757 Mar 19 20:30 junk2
557 ki:/back3 # grep back3 /etc/fstab
/dev/back3/back3 /back3 vxfs rw,nosuid,largefiles,delaylog,datainlog 0 2
558 ki:/back3 # fsadm -F vxfs /back3
largefiles
559 ki:/back3 # bdf .
Filesystem kbytes used avail %used Mounted on
/dev/back3/back3 177209344 27065520 148970888 15% /back3
560 ki:/back3 # ls -al junk*
-rw-r--r-- 1 root users 2147483647 Feb 28 15:51 junk
-rw-r--r-- 1 root users 456052757 Mar 19 20:30 junk2
561 ki:/back3 # cat junk2 >> junk
File too large
cat: Cannot write to output.
562 ki:/back3 #

I just don't get what I could be missing. I read the largefile whitepaper, and the FAQ, followed the instructions and yet it doesn't seem to work. What am I missing?

(I hope the formatting comes out ok, this web interface has an annoying fixed window size...)
-Fred

Re: More Large Files

Francois Bariselle_3 — Tue, 02 Apr 2002 19:32:50 GMT

Hi,

It's realy a big file!!!

try with the paste command.

See:

man paste for more information

Frank.

Re: More Large Files

S.K. Chan — Tue, 02 Apr 2002 19:41:46 GMT

The only thing left to check is the 'ulimit' setting. Run ..

# ulimit

and and the output should be "unlimited". If it's not then you're limited to that "output size" and you need to change it.

Re: More Large Files

Jeff Schussele — Tue, 02 Apr 2002 19:45:03 GMT

Hi Fred,

You're hitting your shell limit by using the cat command.
You need to bump ulimit.

Rgds,
Jeff

Re: More Large Files

Fred Kass — Tue, 02 Apr 2002 19:49:09 GMT

Nope, no ulimit:

562 ki:/back3 # ulimit
unlimited

I should have also mentioned in the last post this is HPUX 11.11 system.

I used cat because it is a really simple test. Obviously this isn't what I really want to do. Paste also fails, as well as GNU Tar and vxdump.
-Fred

Re: More Large Files

Patrick Wallek — Tue, 02 Apr 2002 20:20:28 GMT

The test you are doing should work, but you already knew that.

Here is some info from one of my machines. It is an 11.11 machine also. I had no problem creating a 2.25GB file by just repeatedly cat'ing one file to another. (cat test >> test2).

# ll
total 5183762
drwxrwxr-x 2 root sys 96 Apr 2 13:45 ./
drwxrwxr-x 17 root root 1024 Mar 15 08:56 ../
-rw-rw-r-- 1 root sys 229699336 Apr 2 13:45 test
-rw-rw-r-- 1 root sys 2424369152 Apr 2 14:16 test2
[uran:root 597 /opt/alexbkup/restore]
# bdf .
Filesystem kbytes used avail %used Mounted on
/dev/vg00/alex 3072000 3072000 0 100% /opt/alexbkup
[uran:root 598 /opt/alexbkup/restore]
# fsadm -F vxfs /opt/alexbkup
largefiles
[uran:root 599 /opt/alexbkup/restore]
# grep alexbkup /etc/fstab
/dev/vg00/alex /opt/alexbkup vxfs rw,suid,largefiles,delaylog,datainlog 0 2

Your entire setup, fsadm output, fstab entry, etc., looks fine. Do you happen to have any disk quotas set up for this filesystem? That is the only other thing I can think of that might cause something like this.

Re: More Large Files

Fred Kass — Tue, 02 Apr 2002 20:35:56 GMT

I've configured a bunch of 10.20 machines for large files without a problem, but this is the first time I've tried with 11.11. The error message of "File too large" seems to be specific to the largefiles parameter, but just to be on the safe side I checked quotas (which should merely report a quota exceeded message if it were possible to set a quota for root):

/etc/mnttab: no local filesystems with quotas file

-Fred

Re: More Large Files

MANOJ SRIVASTAVA — Wed, 03 Apr 2002 17:31:51 GMT

Hi Fred

Just a thought can you cat junk >> junk2 ?

Manoj Srivastava

Re: More Large Files

Jeff Schussele — Wed, 03 Apr 2002 22:49:15 GMT

Hi Fred,

I see where you ran the fsadm query on the FS but just to verify what do the following return?

#mount
#mkfs -F vxfs -m /dev/back3/back3

Do you get contradictory results?

Also I know there should be no difference, but I'm curious if you have On-Line JFS & if so what ver?

Also have you tried removing & recreating this FS?

HTH,
Jeff