topic Re: Help: perl count/sort in Operating System - Linux

Help: perl count/sort

Junior C. — Fri, 01 Sep 2006 09:05:55 GMT

I have the following in a text file

05-JUL-06
05-JUL-06
05-JUL-06
05-JUL-06
05-JUL-06
08-JUL-06
08-JUL-06
08-JUL-06
10-JUL-06
15-JUL-06
15-JUL-06
15-JUL-06
15-JUL-06
25-JUL-06
25-JUL-06
01-AUG-06
01-AUG-06
02-AUG-06
02-AUG-06
05-AUG-06
05-AUG-06
07-AUG-06
07-AUG-06
07-AUG-06
07-AUG-06
09-AUG-06
09-AUG-06
09-AUG-06
09-AUG-06
11-AUG-06
11-AUG-06
14-AUG-06
14-AUG-06
14-AUG-06
14-AUG-06
14-AUG-06
14-AUG-06
14-AUG-06
14-AUG-06
18-AUG-06
18-AUG-06
18-AUG-06

I will like to produce the following output using perl.

05-JUL-06 : 5
08-JUL-06 : 3
10-JUL-06 : 1
15-JUL-06 : 4
25-JUL-06 : 2
01-AUG-06 : 2
02-AUG-06 : 2
05-AUG-06 : 2
07-AUG-06 : 4
09-AUG-06 : 4
11-AUG-06 : 2
14-AUG-06 : 8
18-AUG-06 : 3

Total : 42

I appreciate all help.

Thanks, in advance.

Re: Help: perl count/sort

Alexander Chuzhoy — Fri, 01 Sep 2006 09:43:19 GMT

The only problem with the following code is that it doesn't sort the date. You'll have to insert a subroutine on the line: "my @dates=sort keys %hash;" between sort and keys %hash. Let us know if you need more help.

use strict;
open FILE, "path to a file" or die "Couldn't open a file";
my $lines;
my %hash;
while () {
chomp;
$lines++;
$hash{$_}++;
}
my @dates=sort keys %hash;
for (@dates)
{
print $_." : ".$hash{$_}."\n";
}
print "Total: $lines.\n";

Re: Help: perl count/sort

g33k — Fri, 01 Sep 2006 09:46:40 GMT

if file is always sorted it's quite easy.

open (INPUT, @ARGV[0]);
@lines=;
close (INPUT);

#now you have readed all form file in lines array
$prev_line=@lines[0];
$act_count=1;
$total_count=0;
foreach $line (@lines){
total_count++;
if ($line eq $prev_line){
$act_count++;
}
else {
print "$prev_line : $act_count\n";
$perv_line = $line;
$act_count=1;
}
}

print "Total : $total_count\n";

it's all and should be OK if there are no blank lines(if there are you should tak care about them).

Re: Help: perl count/sort

g33k — Fri, 01 Sep 2006 09:51:08 GMT

anyway best solution is to learne perl yourself here is something for begginers... http://www.comp.leeds.ac.uk/Perl/start.html

for more help google is good (he always helped me). But if something is hard to understand and perl there are some hard construction, than ask us.

Re: Help: perl count/sort

Junior C. — Fri, 01 Sep 2006 10:30:55 GMT

AC/g33k,

Thanks for your reply.

I'm new to perl. following are my script.

my $Process_File="test_file.txt";

open(FP,"$Process_File") or die "Could not open $Process_File: $!\n";

while () {
@words = split ' ';
foreach $word (@words) {
$count{$word}{$ARGV}++;
$count++;
}
}

foreach $word (keys %count) {
$down_date = "$word";
$tot_count = join(", ",
map "$_: $count{$word}{$_}",
sort keys %{$count{$word}});
print "$down_date $tot_count\n"
}

close (FP);
print " \n";
print "Total : $count\n";

output:

11-AUG-06 : 2
15-AUG-06 : 4
07-AUG-06 : 4
01-AUG-06 : 2
25-JUL-06 : 2
10-JUL-06 : 1
08-JUL-06 : 3
14-AUG-06 : 8
05-AUG-06 : 2
02-AUG-06 : 2
18-AUG-06 : 3
09-AUG-06 : 4
05-JUL-06 : 5

Total : 42

Please advise what I'm doing wrong. I need output sorted by date all JUL the AUG. AUG then SEP etc......

Thanks.

JC.

Re: Help: perl count/sort

Alexander Chuzhoy — Fri, 01 Sep 2006 10:56:33 GMT

The thing with hash is that its keys are not sorted. If you could put all entries in array instead (assuming that the file you read the info from is sorted), then you could work and assign hash keys/values on array items and also print array items respectively.
Hope it helps.

Re: Help: perl count/sort

Alexander Chuzhoy — Fri, 01 Sep 2006 14:41:01 GMT

To complete what I mean - I've changed my previous code a bit. Now I collect the data into array and then I do all manipulations.
This assures that the order in which the data was placed in the array remains intact.

use strict;
open FILE, "path_to_file" or die "Couldn't open a file";
my (@entries,@uniq,%hash,$lines);
while () {
chomp;
$lines++;
push @entries,$_; #place each in the array
}
for (@entries) {
push @uniq,$_ unless (defined($hash{$_})); #Need to avoid duplicated entries in output.
$hash{$_}++; #increment the count of duplicated lines.
}
print $_." : ".$hash{$_}."\n" for @uniq;
print "Total: $lines.\n";

Hope it helps.

Re: Help: perl count/sort

Junior C. — Fri, 01 Sep 2006 16:33:19 GMT

Alexander,

Perfect. Thanks, I appreciate all your reply

Re: Help: perl count/sort

Junior C. — Fri, 01 Sep 2006 16:34:23 GMT

Thread Close