Operating System - HP-UX
1830539 Members
3026 Online
110013 Solutions
New Discussion

2 GByte limit with gzip or TAR

 
SOLVED
Go to solution
peter demus
Frequent Advisor

2 GByte limit with gzip or TAR

good morning !

i tried to backup some lvol's to a second harddisk (parallel to using IGNITE)

i found that i can't create a TAR bigger than 2 GB. also gzip will stop at 2GB file size.

i use

TAR cvf /backup/data1-20070111.tar /data1
and
GZIP /backup/data1-20070111.tar

or
GZIP -r --fast /backup/data1-20070111.tgz /data1/*


i'm using hpux 1020

is there an update ? file sys is VxFS
or a better tool

thanks peter

jepp!
8 REPLIES 8
Ivan Krastev
Honored Contributor

Re: 2 GByte limit with gzip or TAR

You must enable largefiles support for file system - http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=1077146


regards,
ivan
Peter Godron
Honored Contributor

Re: 2 GByte limit with gzip or TAR

Peter,
once you have enabled largefile on your system:
fsadm -F vxfs -o largefiles /mount-point

This should resolve the problem.

With your unsupported version of OS however, you may also want to look at the version of tar/gzip you are running. Earlier versions of tar could only process upto 2Gb files.

Yarek
Regular Advisor

Re: 2 GByte limit with gzip or TAR

Hi,

1) largefiles option should be enabled

you can check it:

fstyp -v /dev//

If you want enable it,

#fsadm -o largefiles /mount_point
(OnllineJFS is required for online change)

2)The native tar in HPUX will not work with files bigger than 2GB. You can use GNU tar (http://hpux.connect.org.uk/hppd/hpux/)


good luck!
Dennis Handly
Acclaimed Contributor
Solution

Re: 2 GByte limit with gzip or TAR

>Yarek: 2)The native tar in HPUX will not work with files bigger than 2GB.

If each file is < 2 Gb, then if you send the tar output to a pipe, then gzip would work. Provided the total compressed size is < 2 Gb, or you have a gzip that handles large files.

tar cvf - /data1 | gzip > /backup/data1-20070111.tar.gz
peter demus
Frequent Advisor

Re: 2 GByte limit with gzip or TAR

hi !

for combatibility reasons be have only 10.20 running

are there elsewhere an 10.20 depot port of the actual GNUTAR ??


http://hpux.connect.org.uk/hppd/hpux/Gnu/tar-1.15.1/

only for hpux11.11.... ;-(

thanks
jepp!
Bill Hassell
Honored Contributor

Re: 2 GByte limit with gzip or TAR

Gtar is a proprietary tool meaning that any files larger than 2Gb in the backup cannot be restored on another system unless you also have this special tool. tar is also quite inefficient for high speed tape drives. The best solution for your obsolete system is to use fbackup as it handles any file size. Be sure to use a config file like this:

blocksperrecord 4096
records 64
checkpointfreq 4096
readerprocesses 6
maxretries 5
retrylimit 5000000
maxvoluses 200
filesperfsm 2000

---------------------------------------------

Example for a complete backup starting at / (root):

fbackup -i / -v -c config-file -f /dev/rmt/0m

Display the tape header with dates:

frecover -V - -f /dev/rmt/0m

Display the table of contents:

frecover -I - -f /dev/rmt/0m


Bill Hassell, sysadmin
Yarek
Regular Advisor

Re: 2 GByte limit with gzip or TAR

Dennis,

valuable comment

thanks, rgds
dirk dierickx
Honored Contributor

Re: 2 GByte limit with gzip or TAR

gzip does not have this limit by default, but i think 10.20 (which is old, unsupported, blabla) just has a fixed 2GB limit (not sure though).

anyway, the GNU tools (gnu tar and g(nu)zip all handle +2GB fine by default).