T4 Help

[Joshua Gould]

I've installed T4 and things look good. The problem is that the *COM.CSV report that is emailed to me only contains the column headers and no data.

I've looked at the log and I take the same lines in the log, run them and it produces a good CSV file.

(16:39:05) $ Set Command T4$Sys:T4$Mon_Extract
(16:39:05) $ T4Extr T4_ZEUS_01AUG2007_1637_1639_Mon.Dat -
/Csv_File=T4_ZEUS_01AUG2007_1637_1639_Mon.Csv -
/Class=(All,NoScs,NoDisk,NoRms) -
/Process_Name=("*LMD0*","*SHAD*","*PRODOPER*","*BATCH*","*ASSEM*","*T4*")

[Volker Halle]

Joshua,

there should be a T4$DATA:T4$COLLECT_ZEUS.LOG file. Any errors in there from the extract ?

Volker.

[Joshua Gould]

No errors in the log. (taken from a later run but they all have failed)

(17:49:05) $ Set Command T4$Sys:T4$Mon_Extract
(17:49:05) $ T4Extr T4_ZEUS_01AUG2007_1748_1749_Mon.Dat -
/Csv_File=T4_ZEUS_01AUG2007_1748_1749_Mon.Csv -
/Class=(All,NoScs,NoDisk,NoRms) -
/Process_Name=("*LMD0*","*SHAD*","*PRODOPER*","*BATCH*"
(17:49:05) $ T4Extr_Status = $Status
(17:49:05) $
(17:49:05) $
(17:49:05) $! Now extract the DISK data as a separate operation.
(17:49:05) $
(17:49:05) $ T4Extr T4_ZEUS_01AUG2007_1748_1749_Mon.Dat -
/Csv_File=T4_ZEUS_01AUG2007_1748_1749_Disk.Csv -
/Class=(NoAll,Disk)
(17:49:05) $ T4Extr_Status = $Status
(17:49:05) $
(17:49:05) $
(17:49:05) $! Now extract the SCS data as a separate operation.
(17:49:05) $
(17:49:05) $ T4Extr T4_ZEUS_01AUG2007_1748_1749_Mon.Dat -
/Csv_File=T4_ZEUS_01AUG2007_1748_1749_Scs.Csv -
/Class=(NoAll,Scs)
(17:49:05) $ T4Extr_Status = $Status
(17:49:05) $

[Martin Vorlaender]

Joshua,

perhaps you're looking in the wrong places. The snippet you posted isn't the place where the .csv files get glued together. That one starts after a comment

Last, but not least, we glue all the .CSV records together
horizontally. This is done using T4$APRC, which takes two
parameters (P1 and P2), ...

The *_COMP.CSV is generated there (although its name is *_MON.CSV there). The section ends with a line

$ Rename/Log T4_host_date_from_to_Mon.Csv; T4_host_date_from_to_Comp.Csv

HTH,
Martin

[Joshua Gould]

No errors that I can see.

(17:49:05) $ T4Aprc T4_ZEUS_01AUG2007_1748_1749_AcLg.Csv; T4_ZEUS_01AUG2007_
APRC-I-STATS, 4 record(s) read from input and 4 records written to output ...
(17:49:05) $
(17:49:05) $ If F$Search("T4_ZEUS_01AUG2007_1748_1749_Xfc.Csv", 124124) .Nes
(17:49:05) $ Then
(17:49:05) $ T4Aprc T4_ZEUS_01AUG2007_1748_1749_Xfc.Csv; -
T4_ZEUS_01AUG2007_1748_1749_Mon.Csv
APRC-I-STATS, 4 record(s) read from input and 4 records written to output ...
(17:49:05) $ EndIf
(17:49:05) $
(17:49:05) $ If F$Search("T4_ZEUS_01AUG2007_1748_1749_Lck7.Csv", 124125) .Ne
(17:49:05) $ Then
(17:49:05) $ T4Aprc T4_ZEUS_01AUG2007_1748_1749_Lck7.Csv; -
T4_ZEUS_01AUG2007_1748_1749_Mon.Csv
APRC-I-STATS, 4 record(s) read from input and 4 records written to output ...
(17:49:05) $ EndIf
(17:49:05) $
(17:49:05) $
(17:49:05) $ If F$Search("T4_ZEUS_01AUG2007_1748_1749_Tcp.Csv", 124126) .Nes
(17:49:05) $ EndIf
(17:49:05) $ Net_Device_Index = 0
(17:49:05) $ Aprc_Next_Net_Device:
(17:49:05) $ Net_Device = F$Element(Net_Device_Index, ",", P4) - ":"
(17:49:05) $ Say Net_Device

(17:49:05) $ If (Net_Device .Eqs. "") Then Goto Send_Email
(17:49:05) $ Send_Email:
(17:49:05) $ Rename/Log T4_ZEUS_01AUG2007_1748_1749_Mon.Csv; T4_ZEUS_01AUG20
%RENAME-I-RENAMED, DSA0:[000000.T4$DATA]T4_ZEUS_01AUG2007_1748_1749_MON.CSV;4 r
(17:49:06) $ Delete/Log T4_ZEUS_01AUG2007_1748_1749_Mon.Csv;*
%DELETE-I-FILDEL, DSA0:[000000.T4$DATA]T4_ZEUS_01AUG2007_1748_1749_MON.CSV;3 de
%DELETE-I-FILDEL, DSA0:[000000.T4$DATA]T4_ZEUS_01AUG2007_1748_1749_MON.CSV;2 de
%DELETE-I-FILDEL, DSA0:[000000.T4$DATA]T4_ZEUS_01AUG2007_1748_1749_MON.CSV;1 de
%DELETE-I-TOTAL, 3 files deleted (105 blocks)
(17:49:06) $

[Volker Halle]

Joshua,

(17:49:05) $ T4Aprc T4_ZEUS_01AUG2007_1748_1749_AcLg.Csv; T4_ZEUS_01AUG2007_
APRC-I-STATS, 4 record(s) read from input and 4 records written to output ...

These are just the 4 header lines, so there are/were no data records in that _AcLg.CSV file and in all the others.

Did you ever run T4 for more than 1-2 minutes ? Same problem then ?

Volker.

[Joshua Gould]

Yes. I've also ran it a few times for an hour. I did this following the directions in the T4 docs to determine space requirements. I've also tried setting the sample interval down to as low as 10 seconds to produce more data.

The truely odd thing is that if I run the extract manually (in my first post) using the same commands and .DAT file, I get a good CSV.

[Volker Halle]

Joshua,

there are various data collectors running for T4. Are you saying that none of the files collected by the various collectors have any data, e.g.

T4$DATA:T4_ZEUS_01AUG2007_1748_1749_*.CSV

or does this affect just the _MON.CSV file ?

If you look at the 3 *_xxx.ZIP files (xxx=COMP,DISK,SCS) created for each collection, do they also contain no data records ?

Volker.

[Joshua Gould]

Disk and SCS have data. Mon and COMP do not.

[Volker Halle]

Joshua,

*_MON.CSV will be renamed to *_COMP.CSV and the older copies of *_MON.CSV will be deleted.

The *_MON.CSV file will be created by the first T4Extr from *_MON.DAT. Then the data from the other collectors will be appended with T4Aprc, created a new *_MON.CSV file for every append operation.

In your example, T4Aprc has only copied 4 records from the other .CSV files, this will probably happen, if the original input file specified as P2 (*_MON.CSV) only has 4 records.

Is this consistent with a longer run, i.e. only 4 records copied from initial _MON.CSV even if running T4 for an hour ?

So - as shown in your initial question - why does the first T4Extr command fail silently in the context of the T4$COLLECT batch job, but not when executed interactively ?

Take the commands executed interactively and run them in a batch procedure under the same user as T4$COLLECT is running.

Volker.