topic awk problem..any help.. in Operating System - HP-UX

awk problem..any help..

amonamon — Tue, 01 Aug 2006 07:53:37 GMT

100107 1 1000
100129 1 1000
100136 1 1000
100136 1 1000
100144 1 1000
100144 1 1000
100148 1 1000
100181 1 1000

is there a way to get file like this:

100107 1 1000
100129 1 1000
100136 2 2000
100144 2 2000
100148 1 1000
100181 1 1000

any hints?

Thanks

Re: awk problem..any help..

Ralph Grothe — Tue, 01 Aug 2006 08:00:54 GMT

man uniq

Re: awk problem..any help..

Steve Lewis — Tue, 01 Aug 2006 08:03:54 GMT

associative arrays.

awk '{c[$1]++; t[$1]+=$3}END{for(f in c)printf("%s %d %d\n",f,c[f],t[f])}' input_filename

Did the trick for me, see the evidence:

awk '{c[$1]++; t[$1]+=$3}END{for(f in c)printf("%s %d %d\n",f,c[f],t[f])}'
100107 1 1000
100129 1 1000
100136 1 1000
100136 1 1000
100144 1 1000
100144 1 1000
100148 1 1000
100181 1 1000

100107 1 1000
100129 1 1000
100144 2 2000
100148 1 1000
100181 1 1000
100136 2 2000

Re: awk problem..any help..

Steve Lewis — Tue, 01 Aug 2006 08:18:03 GMT

I assumed that you wanted the 2nd column to be a count, not a sum of the values. If you want to sum $2 as well, make this simple change:

awk '{c[$1]+=$2; t[$1]+=$3}END{for(f in c)printf("%s %d %d\n",f,c[f],t[f])}'

Re: awk problem..any help..

Jonathan Fife — Tue, 01 Aug 2006 08:18:24 GMT

Assuming the duplicate rows will always be adjacent like they were in your example:

awk 'BEGIN {prev1="BEGIN";prev2=0;prev3=0}
{if ($1 == prev1) {prev2=prev2 + $2;
prev3=prev3 + $3;
continue}
if (prev1 != "BEGIN") {print prev1 " " prev2 " " prev3}
prev1=$1;prev2=$2;prev3=$3}
END {print prev1 " " prev2 " " prev3}' filename

I thought the associated arrays approach was nicer, but there can never be too many examples :)

Re: awk problem..any help..

James R. Ferguson — Tue, 01 Aug 2006 08:21:07 GMT

Hi:

I prefer Perl.

# perl -ne '$line{$_}++;END{for $key (sort keys %line) {@a=split/ /,$key;print join " ",$a[0],$line{$key},$a[2]}}' file

...yields (in sorted output order:

100107 1 1000
100129 1 1000
100136 2 1000
100144 2 1000
100148 1 1000
100181 1 1000

Regards!

...JRF...

Re: awk problem..any help..

Sandman! — Tue, 01 Aug 2006 09:01:56 GMT

Hi amonamon...try the awk construct below:

# awk '{f[$1]++;s[$1]+=$3} END{for(i in f) print i,f[i],s[i]}' infile > outfile

~cheers

Re: awk problem..any help..

Victor Fridyev — Tue, 01 Aug 2006 10:01:42 GMT

Hi,

sort -n inputfile| uniq -c |awk '{print $1,$2,$4}'

HTH

Re: awk problem..any help..

amonamon — Wed, 02 Aug 2006 00:42:12 GMT

to Steve Lewis I want 2 col. to be sum not count of values...:)) but thanks for your very useful help :)

Re: awk problem..any help..

amonamon — Wed, 02 Aug 2006 01:38:36 GMT

and can U please explain
awk '{c[$1]+=$2; t[$1]+=$3}END{for(f in c)printf("%s %d %d\n",f,c[f],t[f])}' file >file1

I am new in awk and working with arrays in awk...so this confuses me little...

THANKS a LOOTT

Re: awk problem..any help..

Peter Nikitka — Wed, 02 Aug 2006 05:23:39 GMT

Hi,

read 'man awk' as first information - you'll find a section for ARRAYs.
For short:

c[$1]+=$2
In array c add the value of second field ($2) to the array element indexed by the value of the first field ($1). Note that awk uses associative arrays, i.e. an index needs not to be a number.

for(f in c)
Looop through all indices of the array c using f as current idex value. Thre will be no sorting of indices when running through the loop.

mfG Peter

Re: awk problem..any help..

amonamon — Wed, 02 Aug 2006 06:10:12 GMT

Thanks Peter...I read about awk..but those arrays are confusing me little...thank U for your help..