topic Re: File compression to a different dir dynamically in Operating System - HP-UX

File compression to a different dir dynamically

HP System Handle Owner — Tue, 16 Dec 2003 07:13:31 GMT

Can anyone tell me if there is a way of dynamically compressing files to another filesystem using either compress or gzip WITHOUT having to cp the uncompressed file to the target dir first.

i.e

I start with
/mountpoint1/file1.dbf

I want to end up with
/mountpoint1/file1.dbf
and
/mountpoint2/file1.dbf.Z

It is for performing a disk backup, but I do not want to copy the file to mountpoint2 and then compress it. I would like the compression program to read /mountpoint1/file1.dbf as a source and create /mountpoint2/file1.dbf.Z as an archive in it's compressed size leaving /mountpoint1/file1.dbf intact.

Thanks in advance

Russ

We are running 10.20

Re: File compression to a different dir dynamically

John Carr_2 — Tue, 16 Dec 2003 07:19:54 GMT

cd /newfile_system

compress /explicit_path/filename

this should put the compressed file into the directory you are located in when you run the command , I cant test this at moment but you could with some small file :-) John.

Re: File compression to a different dir dynamically

Robert-Jan Goossens — Tue, 16 Dec 2003 07:20:20 GMT

Hi

Take a look at this thread, and the answer from Kenneth Platz.

http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=3212

Regards,
Robert-Jan

Re: File compression to a different dir dynamically

Pete Randall — Tue, 16 Dec 2003 07:20:55 GMT

Russ,

From looking at the man page, it appears that gzip will do what you require:

gzip -c /mountpoint1/file1.dbf > /mountpoint2/file1.dbf.Z

I would suggest trying a little test scenario first.

Pete

Re: File compression to a different dir dynamically

Mark Grant — Tue, 16 Dec 2003 07:23:48 GMT

Using the "-c" switch with "gunzip" causes output to go to the standard output so you can do "gzip -c myfile > /somewhere/else/completely/newfile.z"

Re: File compression to a different dir dynamically

John Palmer — Tue, 16 Dec 2003 07:24:02 GMT

gzip -c /mountpoint1/file1.dbf > /mountpoint2/file1.dbf.gz

As you are talking about database files, be aware that the 'standard' gzip doesn't handle files > 2Gb though.

Regards,
John

Re: File compression to a different dir dynamically

Jean-Louis Phelix — Tue, 16 Dec 2003 07:24:51 GMT

Hi,

I confirm what Pete wrote ... You can even read from standard input to be sure that compress will not open your file directly :

cat /mountpoint1/file1.dbf | compress > /mountpoint2/file1.dbf.Z

Regards

Re: File compression to a different dir dynamically

John Carr_2 — Tue, 16 Dec 2003 07:26:13 GMT

Hi

you can use -c option with compress command as well as gzip :-) John.

Re: File compression to a different dir dynamically

Massimo Bianchi — Tue, 16 Dec 2003 07:27:10 GMT

why not

gzip -9 -c /ABSOLUTE/filename > /ABSOLUTE/BACKUP/filename.gz

Re: File compression to a different dir dynamically

HP System Handle Owner — Tue, 16 Dec 2003 07:35:22 GMT

We do have source files over 2Gb. Does this mean using compress ?

I guess it discounts gzip. We only have standard gzip

Cheers

Russ

Re: File compression to a different dir dynamically

Pete Randall — Tue, 16 Dec 2003 07:38:22 GMT

Russ,

Get the gnu version:

http://hpux.cs.utah.edu/hppd/hpux/Gnu/gzip-1.3.5/

Pete

Re: File compression to a different dir dynamically

Mark Grant — Tue, 16 Dec 2003 07:39:54 GMT

Actually, I believe that modern gzip >= version 1.3 does support files larger than 2GB.

Re: File compression to a different dir dynamically

Massimo Bianchi — Tue, 16 Dec 2003 08:05:18 GMT

With standard unix utilities you can do the following:

mkdir /tmp/pipe p

dd if=/tmp/pipe of=/ABSOLUTE/BACKUP/filename.gz

gzip -9 -c /ABSOLUTE/filename > /tmp/pipe

Massimo

Re: File compression to a different dir dynamically

Mark Grant — Tue, 16 Dec 2003 08:07:38 GMT

Did you perhaps mean "mknod" and not "mkdir" there Massimo :)

Re: File compression to a different dir dynamically

Massimo Bianchi — Tue, 16 Dec 2003 08:18:45 GMT

geee... looks like i must stop writing while sleeping :)

Thanks for the correction!

Massimo

Re: File compression to a different dir dynamically

Steve Lewis — Tue, 16 Dec 2003 09:09:40 GMT

If you cat the file and pipe it to gzip or compress, then redirect the standard output to the destination, you avoid large file problems.

cat dbfile.dbf | gzip > /backup_dir/dbfile.dbf.gz

[ I think they really meant mkfifo, which can be used in conjunction with gzip/compress and tar to copy compressed versions of big files from a remote system. If you want to be really flash, you can use a named pipe as an archive device file for your database. ]

Re: File compression to a different dir dynamically

Mark Grant — Tue, 16 Dec 2003 09:13:56 GMT

Actually Steve,

Massimo's mkdir/mknod tempory mind block is creating a named pipe. "mknod" is the way to create such niceties :)

Re: File compression to a different dir dynamically

Patrick Wallek — Tue, 16 Dec 2003 09:17:02 GMT

The following will also work:

# gzip < /dir/inputfile > /dir/outputfile.gz

Re: File compression to a different dir dynamically

Steve Lewis — Tue, 16 Dec 2003 09:24:34 GMT

... quickly looks at mknod man page... so it is! Well I never knew that. Thank you for pointing that out.
/usr/bin/mkfifo appears to be a specific subset of /usr/sbin/mknod that anybody can run, not just the super-user.

Re: File compression to a different dir dynamically

Steve Lewis — Tue, 16 Dec 2003 09:27:37 GMT

Actually i screwed up again, it lets anyone mknod filename p , 0 points today again I think.