topic Re: duplicates in a file in Operating System - Linux

duplicates in a file

lawrenzo_1 — Mon, 15 May 2006 05:43:49 GMT

Hi all,

I am trying to write a small script but struggling what to use:

I have a file with the user id then some loggin info however this is duplicated for some instances ie:

time_last_login =
tty_last_login =
host_last_login =
unsuccessful_login_count =

i need to search the file to find the user id, keeep the first instance then delete the rest but I do not know howto search userid then delete 6 lines from where the uid is.

any ideas will be a great help.

Thanks

Re: duplicates in a file

Peter Godron — Mon, 15 May 2006 07:05:53 GMT

lawrenzo,
Attached a little script, which may be a step towards your solution.

Re: duplicates in a file

Peter Godron — Mon, 15 May 2006 07:23:43 GMT

lawrenzo,
sorry, attachment missing.

Re: duplicates in a file

Chan 007 — Mon, 15 May 2006 07:38:45 GMT

Hi,
Can you post the script that you are working on,

else use this command which will provide inputs that you are looking for in one line.

testos1:/usr/sbin/acct # ./fwtmp < /var/adm/wtmp
testos1:/usr/sbin/acct # ./fwtmp
Chan

Re: duplicates in a file

Peter Nikitka — Mon, 15 May 2006 08:06:19 GMT

Hi,

I don't know if the userid you mention is literally found as "" or "userid". My example assumes the latter case, but you can easily change this.

If you mean to keep the rest of the file without duplicate entries and a record consists of skip=6 lines:
awk -v us="userid" -v skip=6 '$1 == us {if(have_us) for(i=0;ihave_us++
}
{print}' myfile

To get only the first record of "userid" and nothing else:
awk -v us="userid" -v skip=6 '$1 == us {for(i=0;i
mfG Peter

Re: duplicates in a file

lawrenzo_1 — Mon, 15 May 2006 09:34:10 GMT

cheers guys

gordon and Peter your examples are cool.

Thanks