topic Re: from horizon text format into vertical text format in Operating System - HP-UX

from horizon text format into vertical text format

Matthew_50 — Wed, 24 Jun 2009 15:34:09 GMT

set 1,
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
12 0 0 0 0 0 0 18k 0 0 0 0 0 0 0 0

16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
0 22m 0 0 0 0 0 0 0 0 0 0 17k 0 0 0

Total
23m

set 2.
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
1m 0 0 0 0 0 0 800k 0 0 0 0 0 0 0 0

16 17 18 19 20 21 22 23 24 Total
0 0 200k 0 0 0 0 0 0 2m

each set, number of columns will be dynamicly output from other scripts, but will end with "Total" column, for example, how do i convert set 1 into,
0:12
1:0
.
.
.
7:18k
.
.
.
17:22m
.
28:17k
.
Total:23m

and set 2 into

0:1m
.
.
7:800k
.
.
18:200k
.
.
Total:2m

shell script is prefer, thank you.

Re: from horizon text format into vertical text format

James R. Ferguson — Wed, 24 Jun 2009 16:13:33 GMT

Hi:

This appears to meet your needs:

# cat ./reformat#!/usr/bin/awk -f
/^Total/ {print;next;print;next}
/^[ ]*$/ {next}
{
LINE1=$0
n=split(LINE1,a," ")
getline LINE2
m=split(LINE2,b," ")
for (i=1; i}

...

Run as:

# ./reformat file

...where "file" contains a set of data as shown.

Note that in the regular expression:

^[ ]*$/

the whitespace consists of a blank character followed by a TAB character. This skips blank lines in the input.

Regards!

...JRF...

Re: from horizon text format into vertical text format

Matthew_50 — Wed, 24 Jun 2009 16:48:11 GMT

what if data looks like following ?

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
=============================================
12 0 0 0 0 0 0 18k 0 0 0 0 0 0 0 0

16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
=============================================
0 22m 0 0 0 0 0 0 0 0 0 0 17k 0 0 0

Total
=========
40m

same output. how do i skip "=", must using grep -v "=" ? Thank you.

Re: from horizon text format into vertical text format

Steven E. Protter — Wed, 24 Jun 2009 16:56:03 GMT

Shalom,

grep -v excludes the search parameter.

Only use grep -v for excludes. Use other options for grep to give you equals.

SEP

Re: from horizon text format into vertical text format

James R. Ferguson — Wed, 24 Jun 2009 17:13:30 GMT

Hi (again):

> same output. how do i skip "=", must using grep -v "=" ?

No, 'awk' has all the power of 'grep' and more!

# cat ./reformat
#!/usr/bin/awk -f
/^Total/ {print;next;print;next}
/^[ ]*$/ {next}
{
LINE1=$0
n=split(LINE1,a," ")
getline LINE2
if (LINE2~/======/) {next;getline LINE2}
m=split(LINE2,b," ")
for (i=1; i}

...run as:

# ./reformat file

Regards!

...JRF...

Re: from horizon text format into vertical text format

James R. Ferguson — Wed, 24 Jun 2009 17:24:59 GMT

Hi (again):

> SEP: Only use grep -v for excludes

Yes, and that's exactly what he wants to do. My point in _not_ using 'grep' was why have an extra process when 'awk' can do it all?

However, if Matthew wanted to use my original solution he could have done:

# grep -v "======" file | ./reformat

Regards!

...JRF...

Re: from horizon text format into vertical text format

Steven E. Protter — Wed, 24 Jun 2009 17:48:47 GMT

Yea,

JRF reads my mind and interprets what I meant to say. He's da man.

SEP

Re: from horizon text format into vertical text format

Matthew_50 — Thu, 24 Sep 2009 12:25:28 GMT

what is source like this.

16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 Total
==============================================================================================
slot 9: 144m 0 212m 67m 123 0 789 0 0 0 0 0 0 0 0 0 423m

and reformat into

slot 9/16: 144m
slot 9/17: 0
slot 9/18: 212m
slot 9/19: 67m
.
.
.
slot 9/Total: 423m

possible ? Thanks.

Re: from horizon text format into vertical text format

Matthew_50 — Thu, 24 Sep 2009 12:27:15 GMT

attach input sample

Re: from horizon text format into vertical text format

James R. Ferguson — Thu, 24 Sep 2009 13:15:33 GMT

Hi Matthew:

Given your posted input, you could use the attached Perl script.

Run as:

# ./reformat file

Regards!

...JRF...

Re: from horizon text format into vertical text format

Hein van den Heuvel — Thu, 24 Sep 2009 13:28:44 GMT

This perl seems to do what you desired....

If it sees a line starting with just numbers it adds those as entries into an array @tag

If it sees a line starting with "sl...:" then it tkaes the first part as a name, and add the rest as values to an other array @val.

If the last entry in the @tag array is 'Total' then report and clear arrays for a next go around.

Hein.

-------------------- reformat.pl ------
while (<>) {
push @tag,split if /^\s*\d+\s+/;
if (/^(sl.*):(.*)/) {
$nam=$1;
$_ = $2;
push @val,split;
print " -- $#tag -- @tag[-1] --", join '*',@tag, "\n";
if (@tag[-1] eq 'Total') {
for ( $i=0;$i<=$#val;$i++) {
print "$nam/$tag[$i]:$val[$i]\n";
}
@tag = @val = ();
}
}
}
------------

Re: from horizon text format into vertical text format

Matthew_50 — Thu, 24 Sep 2009 13:47:29 GMT

Hello JRF, Hein

I have to say thank you from the bottom of my heart. You are really expert :-)

Re: from horizon text format into vertical text format

Matthew_50 — Sun, 27 Sep 2009 15:42:40 GMT

hmm, need to reformat using perl from input as pervious one

slot 1/01: 4.3k
slot 1/02: 120
slot 1/03: 68.7k
.
slot 9/16: 144m
slot 9/17: 0
slot 9/18: 212m
slot 9/19: 67m

into

slot 1/01: 4300
slot 1/02: 120
slot 1/03: 68700
.
slot 9/16: 144000000
slot 9/17: 0
slot 9/18: 212000000
slot 9/19: 67000000

Re: from horizon text format into vertical text format

James R. Ferguson — Sun, 27 Sep 2009 16:21:54 GMT

Hi (again) Matthew:

> hmm, need to reformat using perl from input as pervious one

OK, then this should satisfy your requirement:

# cat ./reformat
#!/usr/bin/perl
use strict;
use warnings;
my ( @first, @second, $slot, $n, $value );
while (<>) {
next if /^===/;
if (m{^\s*\d}) {
@first = split;
next;
}
if (m{^slot}) {
@second = split;
$slot = shift @second;
( $slot = shift @second ) =~ s/://;
}
if ( m{^\s*$} or eof ) {
for ( $n = 0; $n < @first; $n++ ) {
( $value = $second[$n] ) =~ s/(\d+)k/$1*1000/e;
( $value = $second[$n] ) =~ s/(\d+)m/$1*1000*1000/e;
print 'slot', $slot, '/', $first[$n], ':', $value, "\n";
}
}
}
1;

Regards!

...JRF...

Re: from horizon text format into vertical text format

James R. Ferguson — Sun, 27 Sep 2009 16:31:12 GMT

Hi Matthew:

Oops, I meant to add that while I used multipliers of 1000 and 1000*1000 for 'K' and 'M' respectivly, it would be better to use 1024 and 1024*1024 :

( $value = $second[$n] ) =~ s/(\d+)k/$1*1000/e;
( $value = $second[$n] ) =~ s/(\d+)m/$1*1000*1000/e;

Regards!

...JRF...

Re: from horizon text format into vertical text format

Matthew_50 — Sun, 27 Sep 2009 16:49:36 GMT

How can I combine following into perl as standard input to the while you provide ?

$count=0;
while (<>)
{
$count++;
if ( $count >= 17 && $count <= 57 )
{
print;
}
}
1;

Thanks

Re: from horizon text format into vertical text format

James R. Ferguson — Sun, 27 Sep 2009 17:11:52 GMT

Hi:

The <> operator is a read of STDIN.

# cat ./reader
#!/usr/bin/perl
use strict;
use warnings;
my $count=0;
while (<>) {
$count++;
if ( $count >= 17 && $count <= 57 ) {
print;
}
}

...execute as:

# ./reader file

OR:

# cat file | ./reader

...where 'cat' is any process that produces STDOUT.

All this said, you don't need to count lines yourself. Perl has a built-in line-number:

# cat ./reformat2
#!/usr/bin/perl
use strict;
use warnings;
while (<>) {
if ( $. >= 17 && $. <= 57 ) {
print;
}
}

...executed just like before.

Regards!

...JRF...

Re: from horizon text format into vertical text format

Hein van den Heuvel — Sun, 27 Sep 2009 17:52:58 GMT

Matthew wrote >>

>> How can I combine following into perl as standard input to the while you provide ?

Can you re-phrase that? What are you trying to accomplish here? What is file being read? The earlier provided input, or the output provided so far ?

>> if ( $count >= 17 && $count <= 57 )

Sounds to me like you are trying to skip the first 16 entries generated. Why not skip generating them instead? What is the 'rule' here?

JRF wrote >> ( $value = $second[$n] ) =~ s/(\d+)k/$1*1000/e;

Nice use of the 'e' in the search and replace to tell it to "Evaluate the right side as an expression."
And that's what needed to do the * 1024.
For use in my example:
$_ = $val[$i];
s/(\d+)k/$1*1024/e;
s/(\d+)m/$1*1024*1024/e;
print "$nam/$tag[$i]:$_\n";

But if * 1000 is requested then a simple string substitute will do fine:
s/k/000/;
s/m/000000/;

Cheers,
Hein.

Re: from horizon text format into vertical text format

Matthew_50 — Sun, 27 Sep 2009 17:57:03 GMT

Hello JRF,

the pattern seems not working with

slot4/25:4.3k
slot4/26:0
slot4/27:4.3k
slot4/28:4.3k
slot4/29:4.3k
slot4/30:0
slot4/31:0
slot4/Total:17k

output as input

Re: from horizon text format into vertical text format

Matthew_50 — Sun, 27 Sep 2009 17:59:06 GMT

Hello Hein,

The field contain the "k" might include the . dot, same does "m" field.