topic Re: Removing lines from one list from another list. in Operating System - HP-UX

Removing lines from one list from another list.

Patrick Ware_1 — Thu, 01 Jul 2010 16:14:22 GMT

Hello,

I was wondering if there was an easy way to take lines from a single-column list, and remove them from a second single-column list. For example, I want to remove the contents of list 1 from list 2. How would I do this?

Contents of list 1:

server1a
server2b
server3c
server4a
server5qb
server6ocd

Contents of list 2"

server1a
server2b
server3c
server4a
server5qb
server6ocd
server7dgw
server8sg
server9be
server10zt
server11w
server12t
server13f

Re: Removing lines from one list from another list.

Patrick Ware_1 — Thu, 01 Jul 2010 16:21:14 GMT

I didn't realize it was this simple:

grep -v -f list1 list2

Re: Removing lines from one list from another list.

James R. Ferguson — Thu, 01 Jul 2010 16:23:17 GMT

Hi:

Assuming that the file contents are each sorted:

# comm -13 file1 file2

...prints the lines from file2 not present in file1.

Regards!

...JRF...

Re: Removing lines from one list from another list.

Victor Fridyev — Thu, 01 Jul 2010 16:23:59 GMT

TMF=/tmp/$$
sort list1 list2 | uniq -c | awk '$1<2 {print $2}' > $TMF
sort $TMF list1 | uniq -c | awk '$1<2 {print $2}'
rm $TMF

HTH

Re: Removing lines from one list from another list.

Dennis Handly — Fri, 02 Jul 2010 08:09:20 GMT

>I didn't realize it was this simple: grep -v -f list1 list2

Yes, provided your files don't have 10s of thousands of lines.

Be careful you don't have substring matches that you don't want.
If server1 was in list1, it would remove server1a, server10zt, etc.

You can add -x to prevent this, provided you don't have any extra columns in list2.
There you may want to use -w.