topic Re: File size in Operating System - HP-UX

File size

Brian_71 — Thu, 18 Apr 2002 17:05:00 GMT

We just setup an HP 11.11 system and it's connected to a set of EMC disks.
When I try and tar a directory, tar keeps stopping after the output tar is a little over 2GB and says
Tar: end of tape
Tar: to continue, enter device/file name when ready or null string to quit
The EMC is set up in 8 GB luns with about 5 luns per logical partition, so the partitions are about 40 GB any idea why the file can't be over 2GB?

Re: File size

Jeff Schussele — Thu, 18 Apr 2002 17:07:45 GMT

Hi Brian,

The tar command itself cannot handle nor create files > 2Gb.

Rgds,
Jeff

Re: File size

Patrick Wallek — Thu, 18 Apr 2002 17:09:29 GMT

Do you have largefiles enabled on that file system?

Check by:

# fsadm /mountpoint

It should return 'largefiles' or 'nolargefiles'. If 'noloargefiles' is returned you can change it by:

# fsadm -o largefiles /mountpoint

Re: File size

S.K. Chan — Thu, 18 Apr 2002 17:11:03 GMT

It's a tar limitation, you can download GNU tar to overcome this limit.

http://hpux.cs.utah.edu/hppd/hpux/Gnu/tar-1.13.25/

Re: File size

MANOJ SRIVASTAVA — Thu, 18 Apr 2002 17:12:20 GMT

Hi Brian

Tar is limited to 2 Gb , you can use GNU tar which is better than tar or cpio , fbackup they will help u go moer than 2 GB.

Manoj Srivastava

Re: File size

James R. Ferguson — Thu, 18 Apr 2002 17:13:38 GMT

Hi Brian:

The standard HP-UX 'tar' does not support the archival of files larger than 2GB or files that have user/group IDs greater than 60K.

A far superior version is the gnu version:

http://hpux.cs.utah.edu/hppd/hpux/Gnu/tar-1.13.25/

Regards!

...JRF...

Re: File size

Jeff Schussele — Thu, 18 Apr 2002 17:14:04 GMT

Neither can cpio, gzip, etc.
If the archive will go to this system or another HP-UX system, I'd recommend you use fbackup which CAN handle files > 2 Gb.
Another option would be to use the GNU tar command - gtar. Can pick it up at

http://www.gnu.org/software/tar/tar.html

Rgds,
Jeff

Re: File size

Victor BERRIDGE — Thu, 18 Apr 2002 17:17:30 GMT

Yep,
but as Patrick mentionned if the file system is not large file enable e.g.:
/dev/r5vg01/lvol4 /data/mnt1 vxfs rw,suid,largefiles,delaylog,datainlog 0 2
then whatever utility you use will fail...

All the best
Victor

Re: File size

Brian_71 — Thu, 18 Apr 2002 17:23:46 GMT

large files are not enable on the file system. If I type in that command to enable it will may data that is there now get messed up?

Also what are the reasons that it is set to not enabled instead of enabled?

Any pros or cons?

Re: File size

pap — Thu, 18 Apr 2002 17:25:47 GMT

HI ,
Tar can not be used to backup file size larget than 2 GB.
IF you have large size file then try to compress it and make it less than 2 GB if you can make it. This is the only way to backup a file more than 2 GB size using tar.

-pap

Re: File size

pap — Thu, 18 Apr 2002 17:26:27 GMT

USe fbackup for backing up this file.IT is an awesome tool from HP.

-pap

Re: File size

Jeff Schussele — Thu, 18 Apr 2002 17:31:28 GMT

Brian,

Nope enabling now will not harm existing data.
The default is no largefiles & that's why it probably got set that way.
Go ahead & set it & you can TRY tar but > 2GB is NOT supported & not reliable.
Check fbackup out do a man fbackup.

Rgds,
Jeff

Re: File size

hpuxrox — Thu, 18 Apr 2002 17:32:25 GMT

Download and install gnu tar.

Re: File size

James R. Ferguson — Thu, 18 Apr 2002 17:32:57 GMT

Hi:

You can convert a filesystem that does not have largefiles enabled to one that does without problem.

You can choose to enable largefiles or not. Consider that you may not want some filesystems to hold largefiles because you want to be able to use the old, standard utilities for backup. This would apply to the vg00 filesystems that you want Ignite to process.

The HP-UX Large Files White Paper is worth reading if you have not already done so:

http://docs.hp.com/hpux/onlinedocs/os/lgfiles4.pdf

Regards!

...JRF...

Re: File size

Brian_71 — Thu, 18 Apr 2002 17:34:47 GMT

Any idea on the logic of why the default is nolargfiles?

Re: File size

Jeff Schussele — Thu, 18 Apr 2002 17:40:03 GMT

Brian,

JRF's response pretty well summed it up.

Rgds,
Jeff