topic Re: Scripting help in Operating System - HP-UX

Scripting help

Terrence — Fri, 08 Oct 2004 10:50:29 GMT

My scripting skills are woeful I'm afraid. I generate a file that contains only a list of user id's. Whenever I generate this file, I need to remove the same 10 user id's that always appear and leave the remaining id's. I've been doing this manually in vi but now I need to automate the process.

Simplest and/or most elegant and/or easiest to understand solution gets the full 10!!.

Re: Scripting help

RAC_1 — Fri, 08 Oct 2004 10:55:33 GMT

grep -Ev "user1|user2|upto_10_users" "input_file" > new_file

If they appear after certain line in file, then

head -"line" inout_file OR tail -"line" input_file

Anil

Re: Scripting help

Jean-Luc Oudart — Fri, 08 Oct 2004 10:57:12 GMT

grep -v user1 | grep -v user2 | grep -v user3 | ...
>

Regards,
Jean-Luc

Re: Scripting help

H.Merijn Brand (procura — Fri, 08 Oct 2004 10:59:07 GMT

Re: Scripting help

Simon Hargrave — Fri, 08 Oct 2004 10:59:26 GMT

As above, but I'd also put anchors in place, eg

grep -vE "^uid1$|^uid2$|^uid3$" file > newfile

The ^ and $ anchors ensure that for example removing "fred" doesn't also remove "frederick".

If you want to edit the file in-situ, you could do: -

ed file </^uid1$
d
/^uid2$
d
/^uid23$
d
w
q
EOF

This will let you do it without a temporary "newfile".

Re: Scripting help

Jeff_Traigle — Fri, 08 Oct 2004 11:02:07 GMT

Several ways depending what IDs you're trying to eliminate...

If they are the reserved users with UID < 100, you can simply use awk as follows:

awk '{if ($3 < 100) print}' /etc/passwd > newfile

If there are specific normal user's you're talking about, you can do similar to above specifying the UIDs of those users combined with the and operator:

awk '{if ($3 != 250 && $3 != 300) print}' /etc/passwd > newfile

or by username:

awk '{if ($1 != "joebob" && $1 != "nancysue") print}' /etc/passwd > newfile

Re: Scripting help

Jeff_Traigle — Fri, 08 Oct 2004 11:03:38 GMT

Oops... first one should have been >, not <

Re: Scripting help

Jeff_Traigle — Fri, 08 Oct 2004 11:04:50 GMT

Argh... actually >= with 100 as the right-hand operand... maybe I should just go home now. :)

Re: Scripting help

Rick Garland — Fri, 08 Oct 2004 11:07:41 GMT

Can use the "uniq" funtion as well.

cat /etc/passwd | awk -F: '{print $1, $2}' | uniq

The uniq function will get rid of repeats

Re: Scripting help

Terrence — Fri, 08 Oct 2004 11:42:21 GMT

Many thanks to all who played!

10 points to RAC for his insanely fast and simple answer. (Doh! grep! I know grep! Why didn't I think of that!)

10 points to Simon for his excellent addition to the simple answer that prevented a problem that I've had in the past where too much is removed. I'll be writing this solution down for other scripts I have as well.

10 points to Rick who unknowingly gave me a solution to a completely different scripting problem I was mulling.

Re: Scripting help

Muthukumar_5 — Fri, 08 Oct 2004 11:45:55 GMT

We can do with awk script as,

awk '{ for ( i=1; i<=NF; i++) if ( $i != "user1" && $i != "user2" && $i != "user3" ) print $0 }'

IT will give the way to get user lists except your users.

HTH.

Re: Scripting help

H.Merijn Brand (procura — Fri, 08 Oct 2004 14:27:34 GMT

Terence, not fishing for points here, but that -w option is exactly the same as the proposed anchors, only much cleaner: it means "match words only"

And in the perl statement, I did exactly the same: \b is word bound

Enjoy, Have FUN! H.Merijn

Re: Scripting help

Andrew Merritt_2 — Mon, 11 Oct 2004 07:33:51 GMT

You also have the option to put the list of user ids in a file, rather than putting them in the command, which may be less prone to mistyping if you edit the script, e.g. if the list ever changes.

So, if the list of user ids (one per line) is /tmp/uids:

grep -Fwv -f /tmp/uids file

should do what you want.

(As you're dealing with fixed strings, -F is probably faster than -E).

Andrew