topic compressing all the small files in Operating System - HP-UX

compressing all the small files

gany59 — Thu, 26 Nov 2009 17:22:41 GMT

Hi techiees,

/tmp getting full due to many small files, so is there any way to compress all the files into one archive and then again compress by gzip

Could any body help me out on this...
Thanks in advance

Re: compressing all the small files

smatador — Thu, 26 Nov 2009 17:30:43 GMT

Hi,
I don't have a system to test but I think
You could try something start by
find /tmp -size < size of small files >| tar cvf backup_smallfile.tar
or
find /tmp -size < size of small files >| xargs tar cvf backup_smallfile.tar | gzip -c > backup.tar.gz
HTH

Re: compressing all the small files

Michael Steele_2 — Thu, 26 Nov 2009 17:33:19 GMT

Hi

Yep, that's how I'd do it.

Re: compressing all the small files

James R. Ferguson — Thu, 26 Nov 2009 17:36:40 GMT

Hi:

The '/tmp' filesystem is intended for use by the operating system. Generally, the files placed within are small lock files and socket files. '/var/tmp' is the proper repository for application temporary files.

How many is "many"? How "small" is small? How old are the files and what are they?

You can configure your server to remove the contents of the '/tmp' directory at startup. It sounds like you need to do some cleanup.

Regards!

...JRF...

Re: compressing all the small files

gany59 — Thu, 26 Nov 2009 17:41:42 GMT

Many files in the size 1200128 are generated before a month and many zero size files are generated before a week..

i just really confused how to compress all these files into one archive

Re: compressing all the small files

gany59 — Thu, 26 Nov 2009 17:47:45 GMT

If i tried the below commands , it will show the error like
find /tmp -size 1024 | tar cvf backup_smallfile.tar
Attempt to create archive of no files. Nothing dumped.

please let me know on this

Re: compressing all the small files

Jean-Luc Oudart — Thu, 26 Nov 2009 18:11:37 GMT

I think you need to change the find command :

find /tmp -type f -size -1024c |

(for file smaller than 1024 char)

Regards
Jean-Luc

Re: compressing all the small files

gany59 — Thu, 26 Nov 2009 18:32:37 GMT

Hi
while i am trying this command also ,, it shows the error

find /tmp -type f -size -1024c | tar cvf backup_smallfile.tar
Attempt to create archive of no files. Nothing dumped.

Re: compressing all the small files

Jean-Luc Oudart — Thu, 26 Nov 2009 18:59:02 GMT

try
find /tmp -type f -size -1024c | xargs tar cvf backup_smallfile.tar

Regards
Jean-Luc

Re: compressing all the small files

Dennis Handly — Thu, 26 Nov 2009 20:42:45 GMT

As JRF mentioned, you should just remove these files, possibly based on age.

>Attempt to create archive of no files. Nothing dumped.

As I say below, you can't use HP-UX's tar.

>smatador: find /tmp -size | tar cvf backup_smallfile.tar

You are not going to be able to use tar with find. The correct tools are pax(1), cpio(1) or GNU tar.
find /tmp -size -10000 | pax -w | gzip > backup.tar.gz

>Jean-Luc: find /tmp -type f -size -1024c | xargs tar cvf backup_smallfile.tar

Again, you need to give up on tar.

Re: compressing all the small files

Dennis Handly — Thu, 26 Nov 2009 23:30:16 GMT

Another thread where someone wanted to use tar with find:
http://forums.itrc.hp.com/service/forums/questionanswer.do?threadId=1362972