topic Re: getting info between 2 fields in Operating System - Linux

getting info between 2 fields

lawrenzo_1 — Wed, 19 Sep 2007 09:29:50 GMT

Hello all,

I am attempting to get all information between two strings when a certain field is equal to Wed Sep 19.

here is an example of the data in the file (nb this is on AIX O/S)

LABEL: VPATH_PATH_OPEN
IDENTIFIER: F45CFAFB

Date/Time: Wed Sep 19 15:00:23 BST 2007
Sequence Number: 316081
Machine Id: 00C84A6D4C00
Node Id: pace
Class: H
Type: PERM
Resource Name: hdisk22
Resource Class: disk
Resource Type: 2107
Location: U787B.001.DNW3DCD-P1-C2-T1-W500507630518C473-L4031400800000000
VPD:
Manufacturer................IBM
Machine Type and Model......2107900
Serial Number...............75FDFW13108
EC Level.....................309
Device Specific.(Z0)........10
Device Specific.(Z1)........0303
Device Specific.(Z2)........075
Device Specific.(Z3)........30806
Device Specific.(Z4)........08
Device Specific.(Z5)........00

Description
OPEN FAILURE

Probable Causes
DISK
SCSI ADAPTER
SCSI CABLE

Failure Causes
DISK
SCSI ADAPTER
CABLE LOOSE OR DEFECTIVE

Recommended Actions
PERFORM PROBLEM DETERMINATION ON SCSI TARGET DEVICE
PERFORM PROBLEM DETERMINATION ON HOST SCSI ADAPTER
REPLACE SCSI CABLE

Detail Data
SENSE DATA
0000 0000 8000 002A 0000 0012 0000 0003 0000 0001 0000 0000 0000 0005

so when todays date is found I would like to print all information between LABEL: and SENSE DATA.

any help will be greatly appreciated.

Thanks Chris.

Re: getting info between 2 fields

lawrenzo_1 — Wed, 19 Sep 2007 09:43:46 GMT

I have made a start but am struggling to get it to print between the search string:

errpt -a |awk -F":" '/Date\/Time/ {if ($2 ~ /Wed Sep 19/) {print}}'

thanks again

Re: getting info between 2 fields

Oviwan — Wed, 19 Sep 2007 10:18:42 GMT

Hy

If you found the date use this.

START="LABEL"
END="SENSE DATA"
read=0

for line in $(cat yourfile) ; do

if [ "${line}" = "${START}" ]
read=1
fi

if [ ${read} -eq 1 ]
then
echo ${line}
fi

if [ "${line}" = "${END}" ]
read=0
fi

done

not tested just a brain dump

Regards

Re: getting info between 2 fields

larsoncu — Wed, 19 Sep 2007 11:57:09 GMT

this should get you pretty close

awk '
/^LABEL/ {label= $0;}
/the date/ {printf("%s",label); print $0; date="found";}
{label =. $0; if (date ~ "found" ) print $0;}
/^SENSE/ {print $0;date = "done";}

Re: getting info between 2 fields

James R. Ferguson — Wed, 19 Sep 2007 12:01:47 GMT

Hi Chris:

Try thisL:

# cat ./filter
#!/usr/bin/perl
use strict;
use warnings;

my @a;
my $toggle = 0;
my $target = shift;

while (<>) {
push @a, $_ if /^LABEL|^IDENTIFIER|^\s*$/;

if (/^Date/) {
if (/$target/) {
$toggle++;
print for @a;
@a = ();
}
else {
$toggle = 0;
@a = ();
}
}
if ($toggle) {
if (/^SENSE/) {
print;
$_ = <>;
print;
$toggle = 0;
}
else {
print;
}
}
}
1;

...Run this passing two arguments. The first is a QUOTED (single or double) string defining your target date. The second argument is the name of the file containing the data to be parsed:

# ./filter 'Sep 19' logfile

Regards!

...JRF...

Re: getting info between 2 fields

larsoncu — Wed, 19 Sep 2007 12:02:36 GMT

this should work just as well

awk '
/^LABEL/ {label= $0;}
/the date/ {label =. $0;date = "found"}
{label =. $0;}
/^SENSE/ {label =. $0;if (date ~ "found" ) {printf("%s",label);date = "done";}
}'

Re: getting info between 2 fields

Peter Nikitka — Wed, 19 Sep 2007 12:08:11 GMT

Hi Chris,

my solution uses the strings LABEL and SENSE DATA as block markers. I store all upto the date/time line in an array, which is printed when there is a match, the rest of the block is directly printed.
The matching pattern is generated by the date command and fed into an awk variable.

awk -v m="$(date '+%b %d .* %Y')" '/^LABEL/ {what=-1;next}
what<0 {keep[lino++]=$0}
/^Date\/Time: / {if($0 ~ m) {what=1;for(i=0;ielse {what=0;lino=0} }
/^SENSE DATA/ {what=0;lino=0}
what>0' /tmp/inputdata

I would prefer to skip the line 'Detail Data' additionally - just replace
/^SENSE DATA/ {what=0;lino=0}
by
/^Detail Data {what=0;lino=0}

mfG Peter

Re: getting info between 2 fields

larsoncu — Wed, 19 Sep 2007 12:15:09 GMT

oops guess i'm mixing my perl and awk up.
anyway there is no =. in awk.

you'll need to replace the concatenations like this:
label =. $0;

should be:
label = (label $0);

Re: getting info between 2 fields

larsoncu — Wed, 19 Sep 2007 12:23:20 GMT

now that i think about it a bit more
this should work just as well

awk '
{label = (label $0);}
/^LABEL/ {label = $0;}
/the date/ {date = "found";}
/^SENSE/ {if (date ~ "found" )
{printf("%s",label);
date = "done";}
}'

Re: getting info between 2 fields

Sandman! — Wed, 19 Sep 2007 18:53:46 GMT

Yet another way of doing the same thing.

awk '
{
if ($0~dt) flg++
if ($0~"LABEL:") start++
if ($0~"SENSE DATA")
{
if (flg) {print lst;lst="";flg=0;start=0}
else {lst="";start=0}
}
if (start) lst=(lst?lst"\n"$0:$0)
}' dt="$(date +"%a %b %d")" file

Re: getting info between 2 fields

lawrenzo_1 — Thu, 20 Sep 2007 02:52:42 GMT

thanks all for the exellent examples,

I will be able to adapt this for plenty of scenarios.

Chris.

Re: getting info between 2 fields

Dennis Handly — Thu, 20 Sep 2007 03:20:08 GMT

If you assume the first 4 lines are LABEL, ID, blank and date you can do:
awk -v date="Wed Sep 19" '
BEGIN { skip = 1 }
/^LABEL/ {
save1 = $0
getline
save2 = $0
getline # assume blank
getline
if ($2 " " $3 " " $4 == date) {
print save1
print save2
print $0
skip = 0
}
next
}
/^SENSE DATA/ {
# dont print this line
skip = 1
next
}
{ if (!skip) print $0
} ' input_file