topic Re: Deleting files oler than 20 minutes in Operating System - HP-UX

Deleting files oler than 20 minutes

Salman Ahmed Qureshi — Tue, 10 Feb 2009 05:36:25 GMT

Hi,
On my database server, archives are created in a file system very frequently and i move those archives to another file system so that this file system doesn't get full. My current job moves all archives to the other file system but some times it corrupts my archives because it also moves the archive currently being written and has not finished yet, so the solution in my mind is to move only archive files older than, let say 15 minutes so i will be sure that only finished archives are being moved to the other file system. Can anyone tell me how to edit my current script to accomplish this. Please see my script.
##########################################
date
for fstr in `find /odsdata1/archive/ods_* -type f -print`
do
echo "Moving $fstr"
mv $fstr /odsarchive2/backup/ods/archive/
done
date
echo "End of transfer"
######################################
Thanks

Salman

Re: Deleting files oler than 20 minutes

Jeeshan — Tue, 10 Feb 2009 06:00:53 GMT

find files older than 1 hr

# perl -MFile::Find -le 'find(sub{print $File::Find::name if -f $_ && -M _ <= 1/24},@ARGV)' /path

Re: Deleting files older than 20 minutes

Dennis Handly — Sun, 04 Sep 2011 11:13:14 GMT

You'll need to create a reference file with touch for 20 minutes ago. (Or use gnu find, -mmin +20.)

The problem with 20 minutes ago is that you need to do date arithmetic on touch. If now is 16:00, then the reference file would be:
touch 02091540 ref_file

You can also solve the reference file issue by creating it manually the first time then just use your sleep or cron to remember 20 minutes ago:
touch ref_file_new # for next time
for fstr in $(find /odsdata1/archive/ods_* -type f ! -newer ref_file); do
done
mv ref_file_new ref_file
sleep $(( 20 * 60 ))

I suppose you could put the touch at the bottom if the find and mv doesn't take too long.

Re: Deleting files oler than 20 minutes

Salman Ahmed Qureshi — Tue, 10 Feb 2009 06:18:18 GMT

Hi Dennis,
Thanks for your reply. I would be rather interested in, "find -mmin" command. Can you please edit my script to add this portion. If you think that i can't achieve 20 mins, you can make it 1 hour.
Thanks in advance

Salman

Re: Deleting files oler than 20 minutes

Steven E. Protter — Tue, 10 Feb 2009 08:40:40 GMT

Shalom Salman,

Example script:
http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=131801

How to overcome issues that may come up in such a script:
http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=1227620

SEP

Re: Deleting files older than 20 minutes

Dennis Handly — Sun, 04 Sep 2011 11:13:41 GMT

>"find -mmin" command. Can you please edit my script to add this portion?

Unless you install GNU find, you can't. HP-UX's find only has the standard day granularity with -mtime. If you don't want to use GNU, you will have to use a reference file or use ahsan's perl solution.

>you can make it 1 hour.

That is still 1/24 too small. :-)

Re: Deleting files oler than 20 minutes

James R. Ferguson — Tue, 10 Feb 2009 12:45:25 GMT

Hi Salman:

To find your candidates, use Perl like this (sorry Ahsan, you can't just copy and paste previous solutions):

# perl -MFile::Find -le '@ARGV=(".") unless @ARGV;find(sub{print $File::Find::name if -f $_ && -M _ >= 1/96},@ARGV)' /path

You can pass multiple /path arguments if you like. RUnning without any argument ('/path') infers the current directory.

The "1/96" is "1/96" of one day or one 15-miunute period of age.

Regards!

...JRF...

Re: Deleting files oler than 20 minutes

James R. Ferguson — Tue, 10 Feb 2009 13:22:47 GMT

Hi (atain) Salman:

Actually, it is just as easy to do everything in one Perl script:

# cat ./mymover
#!/usr/bin/perl
use strict;
use warnings;
use File::Find;
use File::Copy;
my $dstdir='/odsarchive2/backup/ods/archive';
@ARGV = (".") unless @ARGV;
print STDERR "Begin @ ", scalar localtime, "\n";
find(
sub {
if ( -f $_ && -M _ >= 1 / 96 ) {
print STDERR "Moving '$_'\n";
move( $File::Find::name, $dstdir ) or die "$!\n";
}
},
@ARGV
);
print STDERR "Ended @ ", scalar localtime, "\n";
1;

...Again, pass the source directory name or "." or nothing at all to denote the current working directory for the source path.

Regards!

...JRF...

Re: Deleting files older than 20 minutes

Dennis Handly — Sun, 04 Sep 2011 11:14:12 GMT

>JRF: The "1/96" is one 15-minute period

You might want to use an expression so you don't have to explain it:
15 / (24 * 60)

Re: Deleting files oler than 20 minutes

James R. Ferguson — Tue, 10 Feb 2009 13:56:02 GMT

Hi (again):

> Dennis: You might want to use an expression so you don't have to explain it:
15 / (24 * 60)

Yes, I agree, in this case that would be good. So change:

if ( -f $_ && -M _ >= 1 / 96 ) {

...to:

if ( -f $_ && -M _ >= ( 15 / ( 24 * 60 ) ) ) {

...which makes the 15-minute interval much clearer and allows leveraging further:

...
my $age=15
@ARGV = (".") unless @ARGV;
...
if ( -f $_ && -M _ >= ( $age / ( 24 * 60 ) ) ) {
...

Regards!

...JRF...

Re: Deleting files oler than 20 minutes

Arturo Galbiati — Wed, 11 Feb 2009 06:30:47 GMT

Hi Salman,
all the above solution are fine for your problem, but you have to be sure tht the log file you are trying to move is not really in use by the database.
I suggest you to include in your script some Oracle command to shiwtch the log file in use (in sorry but now I don't rememeber those). IN this way you are sure that file older than 'x' min is really not in use.
Just my .02$.

HTH,
Art

Re: Deleting files oler than 20 minutes

likid0 — Wed, 11 Feb 2009 07:26:05 GMT

Hy,

just wanted to leave you the zsh line for what you need:

ls -ltr **/*(.mm+15)

Re: Deleting files oler than 20 minutes

likid0 — Wed, 11 Feb 2009 07:27:38 GMT

Ops sorry you actually wanted to delete them:

If files, dirs and subdirs then:
rm -Rf **/*(.mm+15)
If only files:
rm -f *(.mm+15)

Re: Deleting files oler than 20 minutes

OldSchool — Mon, 16 Feb 2009 17:57:26 GMT

I saw "move", but the above deletes.....

Re: Deleting files oler than 20 minutes

James R. Ferguson — Mon, 16 Feb 2009 18:13:59 GMT

Hi:

> OldShool: I saw "move", but the above deletes.....

Well, not mine, the code even says "move" :-))

Regards!

...JRF...

Re: Deleting files oler than 20 minutes

OldSchool — Mon, 16 Feb 2009 18:49:36 GMT

seems to be that fuser might suffice to check if one of the files you want to move is open, rather than assuming that at some fixed point in time that its done.

or, as one of the other posters noted, force oracle to switch archives. in such a case, build the list first, switch the file, then process everything in the list