gunzip error file too large on file system with largefiles enabled

[Dave Bottom_1]

My system is running 10.20, I have an Autoraid 12H with a bunch of lvol's setup, vxfs format.
I've got a gzip file of an oracle export that's about 1GB in size. The lvols are setup for largefiles and fsadm -F vxfs /lvol indicates that largefiles is enabled.

gunzip (1.2.4) gets to about 2Gb in size and errors out with "file too large"

The man page for gunzip indicates that -l switch will report a bad uncompressed size for files over 2GB, hinting at least, that gunzip will unzip files larger than 2GB. I have over 4gb free on the volume in question when it errors out.

Does anyone have any hints or ideas to help me out?

thanks

dave

[A. Clay Stephenson]

I've never tried gunzip at files that big but you could be hitting ulimit.

Just a thought, Clay

[A. Clay Stephenson]

Dave,
Thought number 2; you could always download the gzip/gunzip source from one of the HP-UX Porting Centers and remove any restrictions.

[Jack C. Mahaffey]

Man, I just ran into the same problem and I need the file for database migration. I gzipped a database dump file and now can't gunzip it!

If I pulled the source, what would I change and how would I compile it?

Would I have the same problem with compress/uncompress?

I got unlimitted when typing ulimit.

jack...

[Jeff Schussele]

Hi Dave,

Once again here's my pet-peeve.
gzip 1.2.4 which is bundled in the OS will not *reliably* handle +2GB files.

You need gzip 1.3.1 or higher. Normally I'd send you to the porting center, but they don't have the compiled 10.2 version - only 11.0 & higher.
So I'd send you to gzip.org, BUT I just checked it & the HP-UX binary page on it

http://hpux.connect.org.uk/hppd/hpux/Gnu/gzip-1.3.1/

is returning 404s right now.
Check it later it may be responding then.

Rgds,
Jeff

[Jeff Schussele]

Hmmmm...I just noticed that their link points to the porting center. And they have pulled all vers except 1.3.5 - so that's why I get the 404s.

You may have no choice other than to pull the source & compile it - can be had here:

http://hpux.cs.utah.edu/hppd/hpux/Gnu/gzip-1.3.5/

Anybody have a 10.2 depot of gzip 1.3.1 handy?
We have hardly any 10.2 stuff depoted anymore as we don't have but a couple of 10.2 systems left - they're out of support.

Rgds,
Jeff

[Steven E. Protter]

I don't think gunzip for 10.20 supports files bigger than 2 GB.

You may need a new version from http://hpux.connect.org.uk/hppd/hpux/Gnu/gzip-1.3.5/

You will have to get and compile the source.

SEP

[Jack C. Mahaffey]

I'm running 11.00 and I just got the 1.3.5 version. Testing now. Thanks...

[Jack C. Mahaffey]

1.3.5 works!!!!! Thanks for replys...

[Jeff Schussele]

Hi SEP,

gzip bundled with 10.2 IS 1.2.4.
It's not the OS - it's the gzip version.

Rgds,
Jeff

[Ralph Haefner]

One other possibility related to this problem. On a Solaris box once I had a file that was zipped with GNU gzip, but the user was trying to unzip it on a machine with only the built in Solaris version of gzip available. Didn't work. Normally it was fine, but on a file over 2GB it failed. I had to install the GNU version and have the user run that instead.

So in this case, maybe trying GNU gzip would have worked as well.

[Chris Vail]

As the others mention, you have run into the issue with gzip and HP-UX. I've seen no version of gzip that reliably works on files larger than 2GB on HP-UX EXCEPT the commercial version that you can buy from pkware: http://www.pkware.com/products/enterprise/unix/?src=homeF3

This does work on huge files, its just not free.


Chris