topic Re: script/cmd required for avoiding the lines containing a search word in Operating System - HP-UX

script/cmd required for avoiding the lines containing a search word

Karthikeyan_5 — Sat, 13 Dec 2003 06:41:09 GMT

Hi All,

I want a script / command which'll avoid all the lines containing the word "mathi" & not "mathivanan" or "abcmathitest" from my i/p file.....my sample i/p files looks as follows:

-------------------------------
1 mathi a bcdtest
2xyz mathivanan hopeso
3 hanry
4karthik s s mathi
5 Michael Schulte mathiabc
6 Pete Randall testmathi
7Klaas D. Eenkhoorn mathi
8john korterman aa mathi
9 Dave La Mar smathia
-------------------------------

I want the ouput after avoiding the lines containing exactly the word "mathi".....which'll be as follows:

-------------------------------
2xyz mathivanan hopeso
3 hanry
5 Michael Schulte mathiabc
6 Pete Randall testmathi
7Klaas D. Eenkhoorn mathi
9 Dave La Mar smathia
-------------------------------

I hope I made my requirement very clear......I want to know how i can get this by way of "grep" or any script which'll do this job for me......

Thanks in advance.....

Regards,
karthik

Re: script/cmd required for avoiding the lines containing a search word

John Carr_2 — Sat, 13 Dec 2003 06:57:11 GMT

grep -v mathi filename > newfile

-v means do not include any lines with given search string

John.

Re: script/cmd required for avoiding the lines containing a search word

Mark Grant — Sat, 13 Dec 2003 06:58:51 GMT

perl -n -e 'if(not /\bmathi\b/){print}' testfile

But in your example line 7 contains the word "mathi" too so it presumably should be avoided.

Re: script/cmd required for avoiding the lines containing a search word

John Carr_2 — Sat, 13 Dec 2003 07:05:05 GMT

Hi

ignore my first grep that will remove all lines with mathi

grep -v " mathi " filename > newfile

:-)

JOhn.

Re: script/cmd required for avoiding the lines containing a search word

john korterman — Sat, 13 Dec 2003 08:55:49 GMT

Hi,
try the attached script, using your input file as $1

regards,
John K

Re: script/cmd required for avoiding the lines containing a search word

Hein van den Heuvel — Sat, 13 Dec 2003 09:35:29 GMT

Please help me understand why you want line 7 in the output, and not line 4. What sets them apart? Is this a problem with the forum stripping spaces? If so, I woudl recommend to ATTACH sample input as a file as well as displaying it.

The grep solution should be:

grep -E -v '(^| )mathi( |$)' x

or
grep -E -v '(^|[ ])mathi([ ]|$)' x
if you anticipate tabs or spaces and have entered a space and a tab (\t ^V^I) in the match box []

I like the perl solution better using the powerful "\b" word boundary.

To bad you did not search for, or failed to find, the following threads, which discuss much similar problems:

http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=292228

http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=284829

hth,
Hein.

Re: script/cmd required for avoiding the lines containing a search word

Michael Schulte zur Sur — Sat, 13 Dec 2003 17:17:04 GMT

Hi Karthis,

please read the statement made in the other thread regarding the comment of Hein.

What the solution is concerned, according to your specifications line 7 shouldnt show up. I attach a modified awk script, which I used in the other thread. Perhaps it helps you.
run it with
awk -f yourscriptname filetosearch.

greetings,

Michael

Re: script/cmd required for avoiding the lines containing a search word

Michael Schulte zur Sur — Sat, 13 Dec 2003 17:19:21 GMT

Oops, where did the attachment go?

Michael

Re: script/cmd required for avoiding the lines containing a search word

Karthikeyan_5 — Sun, 14 Dec 2003 23:10:30 GMT

Hi All,

First Thanks for all of u'r help/responses....

Also in my sample output "line 7" shouldn't be present.....sorry its by mistake.......

Perl is not installed in our HP-UX server....so i couldn't able to try it out....& also the scripts attached by "john korterman" & "Michael Schulte" b'coz I am new to scripting......also the command given by "Hein van den Heuvel" was very simple:

"grep -E -v '(^| )mathi( |$)' x"

But "Hein" can u pls tell me what is the meaning of (^| ) & ( |$)...i.e. starting & ending i suppose....but y opening "(" & closing ")" brackets are required......

Also I am very very sorry that there is some modification in my sample OUTPUT.......

1) first from the i/p file i should avoid all the lines containg only the word "mathi"......the output is as follows:

-------------------------------
2xyz mathivanan hopeso
3 hanry
5 Michael Schulte mathiabc
6 Pete Randall testmathi
9 Dave La Mar smathia
-------------------------------

2) secondly, in turn from the above output it should further DELETE/AVOID the alternate lines (assume all EVEN lines from the above output).......the sample output for this is some what like:

-------------------------------
2xyz mathivanan hopeso
5 Michael Schulte mathiabc
9 Dave La Mar smathia
-------------------------------

3) Finally, from the above output, the 2 2 lines should be appended to the first line of that 2 lines with a SPACE separated. The sample output is as follows:

-------------------------------
2xyz mathivanan hopeso 5 Michael Schulte mathiabc
9 Dave La Mar smathia
-------------------------------

That's it......thanks in advance.......

Regards,
karthik

Re: script/cmd required for avoiding the lines containing a search word

Jean-Louis Phelix — Mon, 15 Dec 2003 02:40:50 GMT

Hi,

First, there is a '-w' option to grep to get only matching "words". It works in your case ... So the simple script could be :

#!/usr/bin/sh
grep -vw mathi yourfile | awk '
{
line=$0
getline
getline
printf "%s %s\n", line, $0
getline
}'

The ouput should be what you need ...

Regards.

Re: script/cmd required for avoiding the lines containing a search word

John Carr_2 — Mon, 15 Dec 2003 06:09:49 GMT

grep -w

I have not seen this before and its not on my version of 11.00 can anyone clarify this option please.

John.

Re: script/cmd required for avoiding the lines containing a search word

Pete Randall — Mon, 15 Dec 2003 06:27:22 GMT

John,

From "man grep" on 11i:

-w Select only those lines containing matches
that form whole words. The test is that the
matching substring must either be at the
beginning of the line, or preceded by a non-
word constituent character. Similarly, it
must be either at the end of the line or
followed by a non-word constituent character.
Word-constituent characters are letters,
digits, and the underscore.

Pete

Re: script/cmd required for avoiding the lines containing a search word

Jean-Louis Phelix — Mon, 15 Dec 2003 06:27:23 GMT

Hi,

It comes with 11.11 I think ...

Hewlett-Packard Company - 2 - HP-UX Release 11i: November 2000

grep(1) grep(1)

-w Select only those lines containing matches
that form whole words. The test is that the
matching substring must either be at the
beginning of the line, or preceded by a non-
word constituent character. Similarly, it
must be either at the end of the line or
followed by a non-word constituent character.
Word-constituent characters are letters,
digits, and the underscore.

Re: script/cmd required for avoiding the lines containing a search word

Michael Schulte zur Sur — Mon, 15 Dec 2003 06:28:55 GMT

Hi Karthik,

(^| )mathi( |$)

It means, mathi is supposed to be at the start of a line or preceeded by a space and followed by a space or end of line.

greetings,

Michael

Re: script/cmd required for avoiding the lines containing a search word

John Carr_2 — Mon, 15 Dec 2003 07:02:50 GMT

can you donate a little time and assign points to all the people who gave up there time to help you :-)

company name:
country: india
personal quote:
certification:
ITRC member since: May 28, 2003
last contribution date: December 15, 2003
I have assigned points to 9 of 86 responses to my questions.

Re: script/cmd required for avoiding the lines containing a search word

Michael Schulte zur Sur — Mon, 15 Dec 2003 18:09:28 GMT

Hi Karthik,

what about this attachment. Put it in a file lets say kart.awk, then:
awk -f kart.awk filetogrep

greetings,

Michael

Re: script/cmd required for avoiding the lines containing a search word

Michael Schulte zur Sur — Mon, 15 Dec 2003 18:09:49 GMT

Hi Karthik,

what about this attachment. Put it in a file lets say kart.awk, then:
awk -f kart.awk filetogrep

greetings,

Michael

Re: script/cmd required for avoiding the lines containing a search word

Karthikeyan_5 — Tue, 16 Dec 2003 00:10:43 GMT

Hi All,

first of all thanks for all of u'r responses......

Jean-Louis Phelix:

I am using HP-UX 10.2....so i think "-w" option of "grep" is rulled out.....

Michael Schulte:

----------------------
(^| )mathi( |$)

It means, mathi is supposed to be at the start of a line or preceeded by a space and followed by a space or end of line.
----------------------
assume in my case, the word MATHI is preceeded & follwed by space....and not start or end......in this case, if put ' mathi '......i.e.

grep -v ' mathi ' filename

but I am not getting the required output.....can u pls explain.......also as I mentioned in my prev. post......i am new to scripting & also the script u gave is some what confusing for me b'coz i am not familiar with scripting na.......sorry my dear.....

John Carr:

I'll surely assign points for those who have helped me......i.e. assigning points comes into picture only at the ending stage of the topic...right.....so y r u hurrying my dear friend.......b'coz in my later post....as I mentioned there is some change in my output requirement.....only a part of it is complete & other 2 parts are remaining.......

waiting to c all of u'r responses......

regards,
karthik

Re: script/cmd required for avoiding the lines containing a search word

Jean-Louis Phelix — Tue, 16 Dec 2003 02:04:38 GMT

Hi,

OK ... without -w option, this one could work :

#!/usr/bin/sh
grep -v -E '^mathi | mathi | mathi$' /tmp/a | awk '
{
line=$0
getline
getline
printf "%s %s\n", line, $0
getline
}'

Regards.

Re: script/cmd required for avoiding the lines containing a search word

Michael Schulte zur Sur — Tue, 16 Dec 2003 06:54:10 GMT

Hi Karthik,

you dont need to change the grep of Hein. grep tries any combination of what you give it and grep -E -v '(^| )mathi( |$)' is equivalent to:
grep -E -v '^mathi ' or
grep -E -v ' mathi$' or
grep -E -v '^mathi$' or
grep -E -v ' mathi '.

But grep is not sufficient enough here.

Have you tried the awk script in my atachment?

Michael