topic Re: perl help/excel/delete in Operating System - Linux

perl help/excel/delete

Shaf_1 — Sat, 13 Nov 2004 21:18:30 GMT

I have over 4000k .pdf files that I need to filter for the right type (i.e. Personal, Business, Notes, Report). I have an excel file that lists all the file names and the associated type. What I am trying to do is get all the files that are type ‘Notes’ and ‘Personal’ and delete the others. Once I have types ‘Notes’ and ‘Personal’ from that bunch I want to randomly select (and cut) 1000 files and put them in a new folder. Can this be done using perl?

Re: perl help/excel/delete

Steven E. Protter — Sun, 14 Nov 2004 01:16:28 GMT

use cut and paste and vi to create a simple filelist, one line per file.

put the file inot Linux(we are in linuxland).

while read -r filename
do
rm -f $filename
done < filelist

That will nuke them all and fast.

SEP

Re: perl help/excel/delete

Shaf_1 — Sun, 14 Nov 2004 01:29:44 GMT

Do I have to assign the file name path? I am guessing this is a shell script that you told me to write.

Re: perl help/excel/delete

Michael Schulte zur Sur — Sun, 14 Nov 2004 03:24:42 GMT

Hi,

Sep said to cut and paste the filenames fro your excel sheet and create a file with it then create the script he posted and let it run in the same dir as your filelist. If you do only have relative filenames than you will have to put both files at the top of your filenames path.

greetings,

Michael

Re: perl help/excel/delete

Shaf_1 — Sun, 14 Nov 2004 18:07:27 GMT

I tried using the script you told me however I keep getting an error. The error is:

"while: Expression Syntax".

The code I am using is:

#!/bin/csh
while read -r newset
do
rm -f $newset
done < filelist

What am I doing wrong?

Re: perl help/excel/delete

Stuart Browne — Sun, 14 Nov 2004 18:47:35 GMT

Steven's example was a bash/sh/ksh example, not a csh example. the language is different.

Change the #!/bin/csh to just #!/bin/sh

Re: perl help/excel/delete

Shaf_1 — Sun, 14 Nov 2004 19:45:17 GMT

That worked just great.

I have another question. From my new list of files I want to select 1000 random files.
How would I select the 1000 random files and delete them from the current folder and put them in another folder?

Re: perl help/excel/delete

Michael Schulte zur Sur — Mon, 15 Nov 2004 08:15:11 GMT

Hi,

what do mean by random?
You can select with CTRL+mouseclick and number of files in your excel sheet, create the filelist and use mv instead of rm in the script.

greetings,

Michael

Re: perl help/excel/delete

Shaf_1 — Mon, 15 Nov 2004 09:13:01 GMT

I wanted to know if there is a way to select the files at random by having the computer select the files. I have 1000 files I need to select.

Re: perl help/excel/delete

Michael Schulte zur Sur — Mon, 15 Nov 2004 09:26:10 GMT

Hi,

from what source and according to what criteria is the computer to select the files?

greetings,

Michael

Re: perl help/excel/delete

Shaf_1 — Mon, 15 Nov 2004 09:48:09 GMT

The files are stored in a folder on my hard drive. I just need to select the 1000 files with no duplicates. No other criteria.

Re: perl help/excel/delete

Michael Schulte zur Sur — Mon, 15 Nov 2004 12:13:53 GMT

Hi,

you look for something like:
#!/bin/ksh
cd /tmp
for FILE in `ls | head -1000`
do
mv ${FILE} /pathto
done
?

greetings,

Michael

Re: perl help/excel/delete

Shaf_1 — Wed, 17 Nov 2004 23:26:22 GMT

Hello,

The program is not selecting 1000 random files. It is selecting the files in order. I am not sure why that is happening. I have over 3000 files and I need to select 1000 random files out of the 3000. Any ideas?

Thanks

Re: perl help/excel/delete

Ermin Borovac — Wed, 17 Nov 2004 23:57:00 GMT

I've attached a quick perl script.

$ random.pl

should return files in random order from directory .

Re: perl help/excel/delete

Shaf_1 — Thu, 18 Nov 2004 00:34:53 GMT

I tried using the script but I have a couple of questions. Here is your script with the information you told me to enter. I have a test folder set up with a total of 50 files for testing. I want to extract 20 random files from the 50 and mv them to another folder.

Did I enter the information correctly?

Can the files be moved from one folder to another?

Thanks

#!/usr/bin/perl

if (scalar(@ARGV) != 2) {
die "usage: $0 ~/documents/erule/test/test2 20\n";
}

@files = <$ARGV[0]/*>;
fisher_yates_shuffle(\@files);
$, = "\n";
print splice(@files, 0, $ARGV[1]);
print "\n";

sub fisher_yates_shuffle {
my $deck = shift; # $deck is a reference to an array
my $i = @$deck;
while ($i--) {
my $j = int rand ($i+1);
@$deck[$i,$j] = @$deck[$j,$i];
}
}

Re: perl help/excel/delete

Ermin Borovac — Thu, 18 Nov 2004 00:46:06 GMT

The script will return the names of 20 random files. If you want to move them to a different directory do the following

$ ./random.pl ~/documents/erule/test/test2 20 | while read file
do
echo mv $i
done

If printout is ok remove 'echo' from the last second line (before mv).

Re: perl help/excel/delete

Ermin Borovac — Thu, 18 Nov 2004 02:54:07 GMT

Oops, 'mv $i' should be 'mv $file'

$ ./random.pl ~/documents/erule/test/test2 20 | while read file
do
echo mv $file
done

Re: perl help/excel/delete

Shaf_1 — Thu, 18 Nov 2004 11:12:10 GMT

The first problem I am having is that the first script does not return any file names. I only get a line saying 'usage: randomfl.pl ~/documents/erule/test 20'. How will this code return my file names?

#!/usr/bin/perl

if (scalar(@ARGV) != 2) {
die "usage: $0 ~/documents/erule/test 20\n";
}

@files = <$ARGV[0]/*>;
fisher_yates_shuffle(\@files);
$, = "\n";
print splice(@files, 0, $ARGV[1]);
print "\n";

sub fisher_yates_shuffle {
my $deck = shift; # $deck is a reference to an array
my $i = @$deck;
while ($i--) {
my $j = int rand ($i+1);
@$deck[$i,$j] = @$deck[$j,$i];
}
}

My second problem is with the second script you told me to use. It is giving me errors. I am sure I am doing something wrong. Here is the script I used for that.

#!/usr/bin/perl
$ ./randomfl.pl ~/documents/erule/test 20 | while read file
do
echo mv $file ~/documents/erule/test/test2
done

What mistake am I making?

Re: perl help/excel/delete

Michael Schulte zur Sur — Thu, 18 Nov 2004 13:17:38 GMT

Hi,

the second script is actually a shell script and the $ was the prompt from the shell. Replace /usr/bin/perl with /usr/bin/sh
That should make it work.

greetings,

Michael

Re: perl help/excel/delete

Ermin Borovac — Thu, 18 Nov 2004 18:04:00 GMT

You don't need to make any modifications to the script. On the command line type

./randomfl.pl ~/documents/erule/test 20

That should return list of 20 randomly selected files.

I assume that you are running this on Linux.