topic Re: List users logged in - need way to split fields - perl? in Operating System - Linux

List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 09:55:57 GMT

I run the following command (it grabs users logged in to servers via the security system we use)

boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\* |cat -v

Output is an extremely long line, here's part of it:

DATA=CDRP:fapirwan^Bsvr607:pts/4^B^B1180963725^B^BCDRP_PROD:cdrbatch^Bsvr607:pts/5^B^B1180965178^B^BCISCO:kfulford^Btmonprod01:pts/1^B^B1180015709^B^BCISCO:kfulford^Btmonprod01:pts/2^B^B1180038015^B^BCORP_APPSRV:buckie^Bapptest2:pts/0^B^B1180966869^B^BDS_DATABASE_SERVERS:dbcorphd^Bsvr032:pts/15^B^B1173891966^B^B

etc....etc...and then:
SPLIT=^B
FIELDS=USER TTY ROUTE TIME INFO
NRECORDS=669
$SERVCVER=6.0.3

With awk, line is too long...

So, in the above,

CDRP:fapirwan is the userid
svr607:pts/4 is the server and tty
1180963725 must be login time?

Should look like:

User Tty Time
CDRP:fapirwan pc0607:pts/4 06/04/07 07:28:45

Which is what I get from teh "web page" - but I want to do it from the command line instead...

Rgds...Geoff

I'm pretty sure perl is the answer (isn't it the answer to everything?)

I think this is one for my friend Hein.

Rgds...Geoff

Re: List users logged in - need way to split fields - perl?

H.Merijn Brand (procura — Mon, 04 Jun 2007 10:04:19 GMT

if

while (<>) {
my @row = split m/\cB/ => $_;
print "first field: ", $row[0], "\n";
}

doesn't work, you might like to have a look at Text::CSV_XS

use IO::Handle;
use Text::CSV_XS;
my $csv = Text::CSV_XS->new ({ sep_char => "\cB", binary => 1 });
while (my $row = $csv->getline (*ARGV) {
print "first field: ", $row->[0], "\n";
}

Enjoy, Have FUN! H.Merijn

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 10:13:40 GMT

Merijn,

Well - I tried:

#!/usr/bin/perl

foreach (`boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\* |cat -v`) {
chomp;
my @row = split m/\cB/ => $_;
print "first field: ", $row[0], "\n";
}

Just adds first field: to front of each line...doesn't seem to split on the ^B

Rgds...Geoff

Re: List users logged in - need way to split fields - perl?

H.Merijn Brand (procura — Mon, 04 Jun 2007 10:41:12 GMT

cat -v is munging you Ctrl-B to being not binary anymore :)

Then you're using foreach, which will read the whole dataset at once. And don't use backticks when you can do without.

open my $dta, "-|", 'boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*' or die "$!";
while (<$dta>) {
chomp;
my @row = split m/\cB/ => $_;
print "first field: ", $row[0], "\n";
}

Enjoy, Have FUN! H.Merijn

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 11:44:35 GMT

Cool - getting closer...

#!/usr/bin/perl

$format="%20s %20s %20s\n";
printf $format, "Userid","Server:TTY","Time";

open my $dta, "-|", 'boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*' or die "$!";
while (<$dta>) {
chomp;
my @row = split m/\cB/ => $_;
printf $format, $row[0], $row[1], $row[2], "\n";
}

Only get first row...how to get the rest?

Rgds....Geoff

Re: List users logged in - need way to split fields - perl?

H.Merijn Brand (procura — Mon, 04 Jun 2007 11:51:12 GMT

You should get all of the rows, unless the rows are not sperated by newlines.

The *field*seperator is a Ctrl-B, your snippet deals with the data as if the *record*separator is a \n (newline). If it is not, but e.g. it is a Ctrl-C, add

if (open my $dta, ...
local $/ = "\cC";
while (<$dta>) {
:
}
}

Enjoy, Have FUN! H.Merijn

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 12:14:38 GMT

That's correct - for some reason there is no new lines (strange output I know).

With the cat -v - it looks like each "line" is separated by 2 ^B's ???

Rgds...Geoff

Re: List users logged in - need way to split fields - perl?

H.Merijn Brand (procura — Mon, 04 Jun 2007 12:20:23 GMT

if there are no empty fields, you can set the line sep to "\cB\cB", and the rest will still work ok.

Enjoy, Have FUN! H.Merijn

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 12:28:46 GMT

You are getting me close - now just a format issue and I guess I need to convert the login time from for example "1180963725" to "06/04/07 07:28:45"

Here's the current script:

#!/usr/bin/perl

$format="%20s %20s %20s\n";
printf $format, "Userid","Server:TTY","Time";

if (open my $dta, "-|", 'boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*|head -1' or die "$!"){
local $/ = "\cB";

while (<$dta>) {
chomp;
my @row = split m/\cB/ => $_;
printf $format, $row[0], $row[1], $row[2], "\n";
}
}

Part of output:

# ./z |more
Userid Server:TTY Time
DATA=CDRP:fapirwan
svr607:pts/4

1180963725

CDRP_PROD:cdrbatch
svr607:pts/5

1180965178

CISCOWORKS:kfulford
tmonprod01:pts/1

1180015709

CISCOWORKS:kfulford
tmonprod01:pts/2

1180038015

Rgds...Geoff

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 12:35:14 GMT

Interesting, this

printf $format, $row[0], $row[1], $row[2], "\n";

is now the same as

printf $format, $row[0];

IE - same output...

I guess the local $/ = "\cB"; is changing what is split....

Rgds...Geoff

Re: List users logged in - need way to split fields - perl?

H.Merijn Brand (procura — Mon, 04 Jun 2007 12:39:04 GMT

Why the | head -1?
And the last shot only showed a single \cB in $/

#!/usr/bin/perl

use strict;
use warnings;

my $format = "%20s %20s %20s\n";
printf $format, "Userid", "Server:TTY", "Time";

if (open my $dta, "-|", 'boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*|head -1' or die "$!") {
local $/ = "\cB\cB";

while (<$dta>) {
chomp;
my @row = split m/\cB/ => $_;
my @tm = localtime $row[2]; # Assuming unix time stamps
printf $format, @row[0,1],
sprintf ("%2d-%02d-%4d %02d:%02d:%02d",
$tm[3], $tm[4] + 1, $tm[5] + 1900,
@tm[2,1,0]), "\n";
}
}

Enjoy, Have FUN! H.Merijn

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 12:40:25 GMT

the head -1 to get rid of the extra data fromt the command:

SPLIT=
FIELDS=USER TTY ROUTE TIME INFO
NRECORDS=688
$SERVCVER=6.0.3

Rgds...Geoff

Re: List users logged in - need way to split fields - perl?

James R. Ferguson — Mon, 04 Jun 2007 12:48:45 GMT

Hi Geoff:

> I guess I need to convert the login time from for example "1180963725" to "06/04/07 07:28:45"

That's easily added:

#!/usr/bin/perl
use POSIX qw (strftime);

printf "%-20s\n", strftime "%m/%d/%Y %T",localtime($time);

...where $time is the field representing your Epoch seconds.

Regards!

...JRF...

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 12:49:02 GMT

Okay - looking better - I get a bunch of:

Use of uninitialized value in localtime at ./zz line 15, <$dta> chunk 1036.
Use of uninitialized value in printf at ./zz line 16, <$dta> chunk 1036.

DATA=CDRP:fapirwan svr607:pts/4 31-12-1969 17:00:00
1180963725 31-12-1969 17:00:00
CDRP_PROD:cdrbatch svr607:pts/5 31-12-1969 17:00:00
1180965178 31-12-1969 17:00:00
CISCOWORKS:kfulford tmonprod01:pts/1 31-12-1969 17:00:00
1180015709 31-12-1969 17:00:00

Re: List users logged in - need way to split fields - perl?

H.Merijn Brand (procura — Mon, 04 Jun 2007 12:57:51 GMT

while (<$dta>) {
chomp;
my @row = split m/\cB/ => $_;
my $s_time = "?";
if ($row[2]) {
my @tm = localtime $row[2];
$s_time = sprintf "%2d-%02d-%4d %02d:%02d:%02d", $tm[3], $tm[4] + 1, $tm[5] + 1900, @tm[2,1,0];
}
printf $format, @row[0,1], $s_tim, "\n";
}
}

Enjoy, Have FUN! H.Merijn

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 13:06:26 GMT

Line 20 is:

printf $format, @row[0,1], $s_time, "\n";

Maybe, it's not row[2]?

Userid Server:TTY Time
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 2.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 4.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 6.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 8.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 10.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 12.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 14.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 16.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 18.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 20.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 22.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 24.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 26.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 28.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 30.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 32.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 34.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 36.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 38.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 40.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 42.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 44.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 46.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 48.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 50.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 52.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 54.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 56.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 58.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 60.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 62.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 64.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 66.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 68.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 70.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 72.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 74.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 76.
Use of uninitialized value in printf at ./zz line 20, <$dta> chunk 78.
DATA=CDRP:fapirwan svr607:pts/4 ?
1180963725 ?
CDRP_PROD:cdrbatch svr607:pts/5 ?
1180965178 ?
CISCOWORKS:kfulford tmonprod01:pts/1 ?
1180015709 ?

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 13:16:00 GMT

If I

print $row[0];

then I get one long output...

DATA=CDRP:fapirwansvr607:pts/41180963725CDRP_PROD:cdrbatchsvr607:pts/51180965178CISCOWORKS:kfulfordtmonprod01:pts/1118001570
9

If I:

print $row[0],"\n";

Userid Server:TTY Time
DATA=CDRP:fapirwan
svr607:pts/4

1180963725

CDRP_PROD:cdrbatch
svr607:pts/5

1180965178

CISCOWORKS:kfulford
tmonprod01:pts/1

1180015709

If I try
print $row[2];

I get nada....

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 13:26:34 GMT

Okay - just doing some troubleshooting...

If I:

#!/usr/bin/perl

$format="%20s %20s %20s\n";
printf $format, "Userid","Server:TTY","Time";

if (open my $dta, "-|", 'boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*|head -1' or die "$!"){
local $/ = "\cB\cB";

while (<$dta>) {
chomp;
my @row = split m/\cB/ => $_;
printf $format, $row[0], $row[1];
}
}

Output is:

# ./z |more
Userid Server:TTY Time
DATA=CDRP:fapirwan svr607:pts/4
1180963725
CDRP_PROD:cdrbatch svr607:pts/5
1180965178
CISCOWORKS:kfulford tmonprod01:pts/1
1180015709

What that tells me is, DATA=CDRP:fapirwan is row[0] and svr607:pts/4 is row[1].

For some reason, the time is also row[0]

Looking at the orig data:

# boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*|cat -v
DATA=CDRP:fapirwan^Bsvr607:pts/4^B^B1180963725^B^BCDRP_PROD:cdrbatch

we see 2 ^B's before AND after the time field :(

Re: List users logged in - need way to split fields - perl?

Geoff Wild — Mon, 04 Jun 2007 14:07:50 GMT

Here's where I am now:

#!/usr/bin/perl

use strict;
use warnings;

my $digits = '\d+';

my $format = "%20s %20s %20s\n";
printf $format, "Userid", "Server:TTY", "Time";

if (open my $dta, "-|", 'boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*|head -1' or die "$!") {
local $/ = "\cB\cB";

while (<$dta>) {
chomp;
my @row = split m/\cB/ => $_;
my $s_time = "?";
if ($row[0] =~ $digits) {
my @tm = localtime $row[0];
$s_time = sprintf "%2d-%02d-%4d %02d:%02d:%02d", $tm[3], $tm[4] + 1, $tm[5] + 1900, @tm[2,1,0];
}
else {
$s_time = " ";
}
printf $format, @row[0,1], $s_time, "\n";
}
}

I still get a lot of

Use of uninitialized value in print at ./zz line 25, <$dta> chunk 870.

And format not quite right:

DATA=CDRP:fapirwan svr607:pts/4
1180963725 4-06-2007 07:28:45
CDRP_PROD:cdrbatch svr607:pts/5
1180965178 4-06-2007 07:52:58
CISCOWORKS:kfulford tmonprod01:pts/1
1180015709 24-05-2007 08:08:29

It would be nice to somehow join the time field to be on same line as the first 2 fields...and not print out the "Unix" time at all - just the converted time...

Rgds...Geoff

Re: List users logged in - need way to split fields - perl?

Hein van den Heuvel — Mon, 04 Jun 2007 16:03:04 GMT

That should be easy, but a little tricky with the actual data. [attach?]
It seems to me there is a new line coming from the $format, as well as from a print argument.

Here what works for me, after replacing th ^B^B in the sample line with ~ and ^B with and just 'typing' the dataline ;

C:\temp>perl y.pl
Userid Server:TTY Time
CDRP:fapirwan svr607:pts/4 4-06-2007 09:28:45
CDRP_PROD:cdrbatch svr607:pts/5 4-06-2007 09:52:58
CISCO:kfulford tmonprod01:pts/1 24-05-2007 10:08:29
CISCO:kfulford tmonprod01:pts/2 24-05-2007 16:20:15
CORP_APPSRV:buckie apptest2:pts/0 4-06-2007 10:21:09
DS_DATABASE_SERVERS:dbcorphd svr032:pts/15 14-03-2007 13:06:06

-------------- y.pl -------------------
#!/usr/bin/perl

use strict;
use warnings;
my $format = "%20s %20s %20s\n";
printf $format, "Userid", "Server:TTY", "Time";

if (open my $dta, "-|", 'boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*|head -1' or die "$!") {
local $/ = "\cB\cB";

while (<$dta>) {
chomp;
my @row = split m/\cB/ => $_;
my $s_time = "?";
if ($row[0] =~ $digits) {
my @tm = localtime $row[0];
$s_time = sprintf "%2d-%02d-%4d %02d:%02d:%02d", $tm[3], $tm[4] + 1, $tm[5] + 1900, @tm[2,1,0];
}
else {
$s_time = " ";
}
printf $format, @row[0,1], $s_time, "\n";
}
}

--------------- real code ?? --------------
#!/usr/bin/perl

use strict;
use warnings;

my $format = "%20s %20s %20s\n";
printf $format, "Userid", "Server:TTY", "Time";

my (@row, $i);

open my $dta, "-|", 'boksauth -Oresults -c FUNC=read TAB=5 FIELDS=\*|head -1' or die "$!";
local $/ = "\cB\cB";

while (<$dta>) {
chomp;
s/^DATA=// unless $i++; # clean up header on first entry
if (/^(\d+)/) { # line with timestamp ?
my @tm = localtime $1;
my $s_time = sprintf "%2d-%02d-%4d %02d:%02d:%02d",
$tm[3], $tm[4] + 1, $tm[5] + 1900, @tm[2,1,0];
printf $format, @row[0,1], $s_time;
} else {
@row = split m/\cB/;
}
}

Good luck!