topic Re: archive script in Operating System - Linux

archive script

Ragni Singh — Tue, 24 Jan 2006 12:47:18 GMT

Hi all, attached is a script but I need a little bit more help.

ls -l

postgresql-2006-01-15_000000.log postgresql-2006-01-22_000000.log
postgresql-2006-01-16_000000.log postgresql-2006-01-23_000000.log
postgresql-2006-01-17_000000.log postgresql-2006-01-24_000000.log

find /var/log/pgsql/* -type f -mtime 0 > /tmp/today_files.txt

for a in `find /var/log/pgsql/* -type f -mtime +7`;

do

IS_TODAY=`grep -c $a /tmp/today_files.txt`
if [ "$IS_TODAY" = "1" ]; then

echo "skipping $a"

else

echo "zipping $a"
gzip $a

fi

done

INstead of doign it for all files, I just need to be able to do it to the *.logs. I don't want to keep re-archiving all files.

Also, I would like all files for a single week zipped or tarred into a common file so that we can use logrotate to handle management of these weekly archives for the rotations.

Any help will be greatly appreciated and points will be assigned.

Re: archive script

Ivan Ferreira — Tue, 24 Jan 2006 13:05:41 GMT

Try something like this:

> /tmp/filelist.txt
find /var/log/pgsql/* -type f -mtime 0 > /tmp/today_files.txt

for a in `find /var/log/pgsql/* -type f -mtime +7`;

do

IS_TODAY=`grep -c $a /tmp/today_files.txt`
if [ "$IS_TODAY" = "1" ]; then

echo "skipping $a"

else

echo $a >> /tmp/filelist.txt
fi
done

tar zcvf files.tgz -T /tmp/filelist.txt

Re: archive script

Ragni Singh — Tue, 24 Jan 2006 13:10:56 GMT

Ivan, but is that just going to do it to the *.logs. My whole goal here is so that it doesn't keep re-archiving the same files.

Re: archive script

Ivan Ferreira — Tue, 24 Jan 2006 13:22:25 GMT

Simply, replace your find commad with:

find "/var/log/pgsql/*.log"

Re: archive script

Ivan Ferreira — Tue, 24 Jan 2006 13:23:20 GMT

OH MY!!!! Ignore my last output, the find command sould be like this:

find /var/log/pgsql/ -type f -name "*.log"

I don't know what I was thinking.

Re: archive script

Ivan Ferreira — Tue, 24 Jan 2006 13:31:06 GMT

I was checking your sample script, your are searching for files older than 7 days, and verifying if the files where created today. You'll never get a match. You should use -mtime -7 instead.

You can also use:

find /var/log/pgsql -name "*.log" -mtime +1 -mtime -7

Re: archive script

Ivan Ferreira — Tue, 24 Jan 2006 13:33:53 GMT

So, your script could be:

tar zcvf backup.tgz $(find /var/log/pgsql/ -type f -name "*.log" -mtime +1 -mtime -7)

Re: archive script

Ragni Singh — Tue, 24 Jan 2006 13:49:33 GMT

that will not work becasue what I am doing is...searching for all files *.log, except for the one currently being written to and zipping everything up except that one.

Re: archive script

Ivan Ferreira — Tue, 24 Jan 2006 16:04:40 GMT

How do you know that is in use?, check that "-mtime +1 and mtime -7" will compress all files created since one day until seven days ago, so, today files or used files won't be saved. Isn't that what you where looking for? You can also try using the fuser command to verify if the file is used. Or you can modify your script and mix the commands showed in this thread.