1831995 Members
3167 Online
110034 Solutions
New Discussion

More Large Files

 
Fred Kass
Occasional Contributor

More Large Files

I've used large files before and never had a problem but I must be missing something here. I created the filesystem, with large files turned on, mounted it with the right option and I still can't seem to get them to mount correct. Data bellow:

554 ki:/back3 # grep back3 /etc/fstab
/dev/back3/back3 /back3 vxfs rw,nosuid,largefiles,delaylog,datainlog 0 2
555 ki:/back3 # df .
Filesystem kbytes used avail %used Mounted on
/dev/back3/back3 177209344 27065520 148970888 15% /back3
556 ki:/back3 # ls -al junk*
-rw-r--r-- 1 root users 2147483647 Feb 28 15:51 junk
-rw-r--r-- 1 root users 456052757 Mar 19 20:30 junk2
557 ki:/back3 # grep back3 /etc/fstab
/dev/back3/back3 /back3 vxfs rw,nosuid,largefiles,delaylog,datainlog 0 2
558 ki:/back3 # fsadm -F vxfs /back3
largefiles
559 ki:/back3 # bdf .
Filesystem kbytes used avail %used Mounted on
/dev/back3/back3 177209344 27065520 148970888 15% /back3
560 ki:/back3 # ls -al junk*
-rw-r--r-- 1 root users 2147483647 Feb 28 15:51 junk
-rw-r--r-- 1 root users 456052757 Mar 19 20:30 junk2
561 ki:/back3 # cat junk2 >> junk
File too large
cat: Cannot write to output.
562 ki:/back3 #


I just don't get what I could be missing. I read the largefile whitepaper, and the FAQ, followed the instructions and yet it doesn't seem to work. What am I missing?

(I hope the formatting comes out ok, this web interface has an annoying fixed window size...)
-Fred
8 REPLIES 8
Francois Bariselle_3
Regular Advisor

Re: More Large Files

Hi,

It's realy a big file!!!

try with the paste command.

See:

man paste for more information

Frank.
Fais la ...
S.K. Chan
Honored Contributor

Re: More Large Files

The only thing left to check is the 'ulimit' setting. Run ..

# ulimit

and and the output should be "unlimited". If it's not then you're limited to that "output size" and you need to change it.
Jeff Schussele
Honored Contributor

Re: More Large Files

Hi Fred,

You're hitting your shell limit by using the cat command.
You need to bump ulimit.

Rgds,
Jeff
PERSEVERANCE -- Remember, whatever does not kill you only makes you stronger!
Fred Kass
Occasional Contributor

Re: More Large Files

Nope, no ulimit:

562 ki:/back3 # ulimit
unlimited

I should have also mentioned in the last post this is HPUX 11.11 system.

I used cat because it is a really simple test. Obviously this isn't what I really want to do. Paste also fails, as well as GNU Tar and vxdump.
-Fred
Patrick Wallek
Honored Contributor

Re: More Large Files

The test you are doing should work, but you already knew that.

Here is some info from one of my machines. It is an 11.11 machine also. I had no problem creating a 2.25GB file by just repeatedly cat'ing one file to another. (cat test >> test2).

# ll
total 5183762
drwxrwxr-x 2 root sys 96 Apr 2 13:45 ./
drwxrwxr-x 17 root root 1024 Mar 15 08:56 ../
-rw-rw-r-- 1 root sys 229699336 Apr 2 13:45 test
-rw-rw-r-- 1 root sys 2424369152 Apr 2 14:16 test2
[uran:root 597 /opt/alexbkup/restore]
# bdf .
Filesystem kbytes used avail %used Mounted on
/dev/vg00/alex 3072000 3072000 0 100% /opt/alexbkup
[uran:root 598 /opt/alexbkup/restore]
# fsadm -F vxfs /opt/alexbkup
largefiles
[uran:root 599 /opt/alexbkup/restore]
# grep alexbkup /etc/fstab
/dev/vg00/alex /opt/alexbkup vxfs rw,suid,largefiles,delaylog,datainlog 0 2


Your entire setup, fsadm output, fstab entry, etc., looks fine. Do you happen to have any disk quotas set up for this filesystem? That is the only other thing I can think of that might cause something like this.
Fred Kass
Occasional Contributor

Re: More Large Files

I've configured a bunch of 10.20 machines for large files without a problem, but this is the first time I've tried with 11.11. The error message of "File too large" seems to be specific to the largefiles parameter, but just to be on the safe side I checked quotas (which should merely report a quota exceeded message if it were possible to set a quota for root):

/etc/mnttab: no local filesystems with quotas file

-Fred
MANOJ SRIVASTAVA
Honored Contributor

Re: More Large Files

Hi Fred

Just a thought can you cat junk >> junk2 ?


Manoj Srivastava
Jeff Schussele
Honored Contributor

Re: More Large Files

Hi Fred,

I see where you ran the fsadm query on the FS but just to verify what do the following return?

#mount
#mkfs -F vxfs -m /dev/back3/back3

Do you get contradictory results?

Also I know there should be no difference, but I'm curious if you have On-Line JFS & if so what ver?

Also have you tried removing & recreating this FS?

HTH,
Jeff

PERSEVERANCE -- Remember, whatever does not kill you only makes you stronger!