PERL for HTML file parsing

[Maxim Yakimenko]

You script gives only header of report,
More of all it gives just values.
I see:


NHTEST
3848498958
NHTEST
1
10.2.0.2.0
NO
baloo_a
Begin Snap:
1728
02-Feb-07 20:00:35
20
3.1

All right, NHTEST - is the DB name, but what is for example 20? Is it Library Hit %? or Memory Usage %? You have values but you have no keys to them.

[Maxim Yakimenko]

for multiply files...

if you run script so
./process_script report.html
it outputs data on console

if you run it so
./process_script report.html >> output.txt
OS sends output to file output.txt

if bracket is single (">") then output.txt get created if it doesnot exists and truncated if exists

if bracket is double (">>") then output.txt get created if it doesnot exists and appended if exists.

This is called output redirection.
so if you run
./process_script report1.html >> output.txt
./process_script report2.html >> output.txt
./process_script report3.html >> output.txt
.................
./process_script report100.html >> output.txt

then output.txt will contain 100 lines:
first line - output of ./process_script that parsed report1.html
second line - output of ./process_script that parsed report2.html
...
100th - output of ./process_script that parsed report100.html

try this:

echo a >> output.txt
echo b >> output.txt
echo c >> output.txt


And you will see that output.txt is created if it does not exists
And when you open this file you wiil see:
a
b
c

[Dodo_5]

i have attached what i need as output..
my scripyt is giving write output(i dnt require keys) but they are printed in next lines every time..but i need it in same line for any parameters..
can you help me in do that???
if i get that pattern then i can search my required parameter name from parsed text file with values

[Dodo_5]

i know about appending and writing files...

but i actually want seperate text files..then i have to compare any variable values from different text files
help me in doin that

[Dodo_5]

attached file is here pls...

sorry for not attaching before

[Maxim Yakimenko]

if you want one line then take variable and add every extracted value to it. then output it once:

$var="";
$var=$var.$value1;
$var=$var."\t".$value2;
$var=$var."\t".$value2;
..
$var=$var."\t".$value100;
print $var;

[Dodo_5]

Buffer Cache: 5,984M 5,984M

if output is as above then i can find "buffer cache" from the parsed text file and print the whole line...which in turn will give the required value of buffer cache..i will pass it to a different text file ,ie,called as "final.txt".

then i will do same operation on my 2nd text file..and so on
and every time i will send buffer cache values to "final.txt"
then i can compare all the buffer cahe values in 100 report files
like this i have to do comparison of all variables

[Maxim Yakimenko · Accepted solution]

#!/usr/local/bin/perl


open SRC, "$ARGV[0]";
$/= undef;
$data=;
close SRC;


#take table string
$data =~ /$.*.*<\/table>.*/igs;
$data = $&;


#get read of html
$data =~ s///ig;
$data =~ s/

/\n/ig;
$data =~ s/<\/table>//ig;
$data =~ s///ig;
$data =~ s/><\/th>/>Column\t/ig;
$data =~ s/<\/th>/\t/ig;
$data =~ s/<\/TD><\/TR>//ig;
$data =~ s/<\/td>/\t/ig;
$data =~ s/<\/tr>//ig;
$data =~ s///ig;
$data =~ s///ig;
$data =~ s/\x20{2,}/\t/ig;
$data =~ s/ /\t/ig;
$data =~ s/\t{2,}/\t/ig;

print $data;


Save it to process.pl
and run
./process.pl your_report.html

Is it what you want?

[Dodo_5]

great..u have understand my problem.

but i dont need the headings of the tables like "top 5 events",or table keys "event" "waits" "time(s)"
(it's ok...no prob if they are remaining there..but read below that if they are affecting or not the rest)...actually i need only table row values (see attached file)..every second variable values should go in next line(u can ignore this also).u can keep it as like as now also.

now let i have stored the values in a output1.txt file.similarly i will get 100 text files for 100 report files.

afterthat i need to get the value of "buffer hit" or "buffer cache" values from each of those 100 text files and redirect it to a file called "final.txt",ie,where it will be values of only buffer cache(or any other variables) recovered from 100 text files.then i can compare the values of buffercache values obtained from all report files.

[Maxim Yakimenko]

I dont understand why you want to create hundered files from hundred files if using my way you can create final.txt immediatly from html files :)

[Dodo_5]

by using which script i will get the "buffer cache" or "redo size" values from 100 html files???

the last one or the before used script..and how???

[Maxim Yakimenko]

You run first version of script against your reports and output of every run of this script save to file - thus you get it in one file.

[Dodo_5]

#!/usr/local/bin/perl


open SRC, "$ARGV[0]";
$/= undef;
$data=;
close SRC;


#take table string
$data =~ /$.*.*<\/table>.*/igs;
$data = $&;


#get read of html
$data =~ s///ig;
$data =~ s/

/\n/ig;
$data =~ s/<\/table>//ig;
$data =~ s///ig;
$data =~ s/><\/th>/>Column\t/ig;
$data =~ s/<\/th>/\t/ig;
$data =~ s/<\/TD><\/TR>//ig;
$data =~ s/<\/td>/\t/ig;
$data =~ s/<\/tr>//ig;
$data =~ s///ig;
$data =~ s///ig;
$data =~ s/\x20{2,}/\t/ig;
$data =~ s/ /\t/ig;
$data =~ s/\t{2,}/\t/ig;

print $data;


Save it to process.pl
and run
./process.pl your_report.html


this is your script...after running this it is giving output like this(attached)
now running everytime this script for html report i will get this type of output.
but i now i want to seperate out only single variable name(ie,buffer cache,redo size) with its values from different reports

i can't understand your last solution properly

[Maxim Yakimenko]

You told you can find whole line with needed value - so take it from this output and compare

[Dodo_5]

NHTEST 3848498958 NHTEST 1 10.2.0.2.0 NO baloo_a
Begin Snap: 1728 02-Feb-07 20:00:35 20 3.1
End Snap: 1729 02-Feb-07 21:00:35 23 3.7
Elapsed: 60.01 (mins)
DB Time: 0.27 (mins)
Buffer Cache: 5,984M 5,984M
but if it is this format then only i can find "buffer cache" and take the whole line out and then can compare...
can i print like this instead of printing as earlier(which looks same like the table).

pls tell me a solution pls...

[Dodo_5]

i have done a perl scripting to seperate tags from HTML file...but can any one solve my prob?
plss....help