topic Re: How to print duplicate lines alone in Operating System - HP-UX

How to print duplicate lines alone

Nesan — Thu, 20 Mar 2003 17:18:15 GMT

I want to know how to print duplicate lines alone from a file.
When I tried 'uniq -c', tt prints number of times and line. For eg.

$ uniq -c serrlog
1 error 04: connection failure
4 error 11: /tmp directory not found
1 error 17: low disk space
2 error 22: out of memory

Instead of printing just number of times, I need to have print

I am not sure this option is available on any command on the unix.

Thank you
Regards
Nesan

Re: How to print duplicate lines alone

James R. Ferguson — Thu, 20 Mar 2003 17:40:34 GMT

Hi Nesan:

Here's a quick, crude way to do this:

Given your file (sorted, of course):

# uniq -u myfile > myfile.tmp
# diff myfile.tmp myfile|sed -n '/>/p'|sed -e 's/> //g'

Regards!

...JRF...

Re: How to print duplicate lines alone

Sridhar Bhaskarla — Thu, 20 Mar 2003 17:46:14 GMT

Hi Nesan

Did you try 'uniq -d' ?

-Sri

Re: How to print duplicate lines alone

Darren Prior — Thu, 20 Mar 2003 17:51:35 GMT

Hi,

I'm not quite sure what you're after as it looks like you chopped off part of your question ;)

If you want to see all unique lines plus one copy of the duplicates, without the number of duplicates at the front then you should use:
uniq serrlog

This is equivalent to uniq -ud serrlog. The -c option is adding the numbers.

uniq -d serlog will give you one line for each duplicate - without numbers.

regards,

Darren.

Re: How to print duplicate lines alone

John Palmer — Thu, 20 Mar 2003 18:31:37 GMT

I'd just write a small script fragment to process the output from your uniq -c example...

integer N
uniq -c serrlog | {
while read N LINE
do
while (( N > 0 ));
do
print -- "${LINE}"
let N=N-1
done
done
}

Regards,
John