topic Re: Uregent : Record Comparison Between 3 files in Operating System - HP-UX

Uregent : Record Comparison Between 3 files

Balasubramanian — Tue, 30 Jan 2001 16:54:17 GMT

Hi

I need to compare 3 files in this manner.

First i will take file1 and compare each and every record of file1 in terms of field with other 2 files. Based on process rules, i should do some action.

My question is how i can do record comparison among files ? I am trying to do this with Shell Scripting, AWK.

Could some one tell me the how can i
achive it ?

Awaiting your early reply.

Thanks
Bala

Re: Uregent : Record Comparison Between 3 files

Vikas Khator — Tue, 30 Jan 2001 17:03:53 GMT

Hi ,

Look at the comm command

Re: Uregent : Record Comparison Between 3 files

James R. Ferguson — Tue, 30 Jan 2001 17:04:27 GMT

Hi:

Take a look at the man pages for 'diff' and 'cmp'.

...JRF...

Re: Uregent : Record Comparison Between 3 files

Jacques Simon — Wed, 31 Jan 2001 06:40:50 GMT

What about diff?! (see man diff)

Re: Uregent : Record Comparison Between 3 files

Balasubramanian — Thu, 01 Feb 2001 21:25:45 GMT

Hi,

Thank you all for your reply.

Even if i am using 'comm' or diff command i can compare only 2 files. In my case i have to compare the entire record field by field from the first file with the other two files (again record field by field).

Awaiting ur reply.

Thanks
Bala

Re: Uregent : Record Comparison Between 3 files

Curtis Larson — Thu, 01 Feb 2001 22:25:24 GMT

do your files all have the same number of records? do all the records have the same number of fields? What is your field seperator?

in the korn shell do something like this:

#save your IFS variable
OLDIFS=$IFS

#set IFS to your field seperator
IFS="," # comma seperated fields,
# probably want to add your
# record seperator here too

# open file descriptor to the files to be compared

exec 3< file1
exec 4< file2

cat yourfile |
while read field
do
read -u3 field1
read -u4 field2
if [[ $field != field1 ]] ;then
if [[ $field != field2 ]] ;then
do_case1 #!!
else
do_case2 #!=
fi
else
if [[ $field != field2 ]] ;then
do_case3 #=!
else
do_case4 #==
fi
fi
done

IFS=$OLDIFS

of course this assumes same number of records in each file and the same number of fields in each record.

Re: Uregent : Record Comparison Between 3 files

Carlos Fernandez Riera — Fri, 02 Feb 2001 12:40:52 GMT

Hi:

To acomplish this task I often use join command.

i.e:
sort f1 > f1.o
sort f2 > f2.o
sort f3 > f3.o

join -a 1 -a 2 -e "MISSING" -o 1.1 1.2 ... 2.1 2.2 file1.o file2.o > j1

join -a 1 -a 2 -e "MISSING" -o 1.1 1.2 ... 2.1 2.2 j1 file3.o > j2

And now is very easy to process with awk.

See man paste and join.

Re: Uregent : Record Comparison Between 3 files

Andre Lattier — Fri, 02 Feb 2001 13:33:02 GMT

Hi,

in Xemacs editor, have a look at :
Tools->Compare->Three files...

Re: Uregent : Record Comparison Between 3 files

Balasubramanian — Mon, 05 Feb 2001 14:54:19 GMT

Hi

Thanks every one for your reply.

Larson, my input files have the different no. of records and have the same no. of fields.
The field separator is pipe symbol (|).

I tried with this script,

Korn Shell
==========

OLDIFS="$IFS"
IFS=|
echo "Enter the first file"
read file1
echo "enter the second file"
read file2
exec 3<$file1
exec 4<$file2
exec 5>match
exec 6>nomatch
while read -u3 lineA
do
read -u4 lineB
if [ "$lineA" = "$lineB" ]
then
print -u5 "$lineA"
else
print -u6 "$lineA; $lineB"
fi
done
IFS=$OLDIFS

This scripts compare the records one after another from both the files. But what i need is,

i have to take a record from the first file (say file1) and compare that record with each and every record of the second file (say file2)
until EOF of file2. Similarly till EOF of file1.

Could you pl. anyone tell me how can i write the script to do this ?

I have a requirement to compare not only at the record level but i need to compare at the field level.

Awaiting your reply.

Thanks
Bala

Re: Uregent : Record Comparison Between 3 files

Curtis Larson — Mon, 05 Feb 2001 16:11:39 GMT

not exactly elagant but should get the job done:

#read each line of your file
while read -u3 line
do
#test line against these files
for i in file1 file2
do
#get each line that is different + the line number
grep -nvx "$line" file1 |
while read dfline
do
#get the line number that is different
numRec=$(print "$dfline" | cut -d: -f1)
dfline=$(print "$dfline" | cut -d: -f2-)

numFields=$(print "$dfline" | awk -F\| '{print NF;}')

(( x = 0 ))
while (( $x < $numFields ))
do
(( x = $x + 1 ))
field=$(print "$line" | cut -d: -f"$x")
field1=$(print "$dfline" | cut -d: -f"$x")

if [[ "$field" != "$field1" ]] ;then
print "$file1:$numRec:$x:$field:$field1"
fi
done
done
done
done

Re: Uregent : Record Comparison Between 3 files

Curtis Larson — Mon, 05 Feb 2001 17:01:45 GMT

a bit better:
exec 3< yourfile

files="$*"
#test line against these files
for i in $files
do
#read each line of your file
while read -u3 line
do
#get each line that is different + the line number
grep -nvx "$line" $i |
while read dfline
do
#get the line number that is different
numRec=$(print "$dfline" | cut -d: -f1)
dfline=$(print "$dfline" | cut -d: -f2-)

set -- $(print $line | tr "\|" " ")
set -A fields $(print $dfline | tr "\|" " ")
(( x = 0 ))
while (( $# > 0 ))
do
if [[ "$1" != "${fields[$x]}" ]] ;then
print "$i:$numRec:$x:$1:${fields[$x]}"
fi
shift
(( x = $x + 1 ))
done
done
done
done

Re: Uregent : Record Comparison Between 3 files

Balasubramanian — Wed, 21 Feb 2001 16:01:05 GMT

Hi all,

Thanks to Larson and others who shared idea/logic of implementing the comparison of record among three files.

Done it with all your support.

Thanks once again.

-Bala

Re: Uregent : Record Comparison Between 3 files

Dan Hetzel — Thu, 22 Feb 2001 06:16:50 GMT

Hi Bala,

It's nice to say 'Thanks' but it would be a lot nicer if you assigned points to the people who spent some time (or a lot of) to help you.

Thanks for them,

No point for me please !

Dan