- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - OpenVMS
- >
- Re: T4 EVA CSV problem
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 06:01 AM
тАО03-15-2010 06:01 AM
T4 EVA CSV problem
Can these files be salvaged?
Cheers,
Art
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 06:04 AM
тАО03-15-2010 06:04 AM
Re: T4 EVA CSV problem
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 06:55 AM
тАО03-15-2010 06:55 AM
Re: T4 EVA CSV problem
The error seems clear and explicit.
Maybe a configuration change on the EVA?
Maybe the data was:
A1, A2, A3, B1, B2, B3, C1, C2, C2
Now target B goes away and the sources output values: a1, a2, a3, c1, c2, c2
But those are just numbers. (no XML here... fortunately!).
So is this really: a1, a2, a3, c1, c2, c2, 0, 0, 0 ?
or: a1, a2, a3, 0, 0, 0, c1, c2, c2 ?
You can probably tell. But TLviz van not.
I would still be sure to try with TLviz V2 but expect that it will call out the same issue. Still: http://trendsthatmatter.com/nbu/t4-tools/TLViz-2.0-1.exe
When you open with Excel, does the data around row (data) 153 ( + header offsets) allow you recognize what has changed?
For similar problems I have written (perl) scripts to add zero-columns to fill out no longer available data.
Other than the data provider injecting a new header line, what can the visualizer do? It can not magically decide what is good, what is bad right?
It will likely fix itself on restart, or like I said, you can script around.
hth,
Hein
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 07:10 AM
тАО03-15-2010 07:10 AM
Re: T4 EVA CSV problem
Thanks,
Art
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 07:22 AM
тАО03-15-2010 07:22 AM
Re: T4 EVA CSV problem
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 07:30 AM
тАО03-15-2010 07:30 AM
Re: T4 EVA CSV problem
Try OpenOffice.org suite?
Try iWork Numbers?
Try jTLViz?
Try counting and appending six commas onto row 153?
Convert and salvage the files into (more strictly-constructed) CSV or into XML or such using perl or python or php or DCL?
I have libcsv ported to VMS and details posted, if you're interested.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 08:34 AM
тАО03-15-2010 08:34 AM
Re: T4 EVA CSV problem
That's actually a TLVIZ error message ... Excel can open the CSV just fine. No need for a wholesale office uplift yet ;-)
If you look at the second attachment, at the 14-Mar file, you can see where the problem occured. We did have "some sort" of EVA related problem last night (which is why I was trying to look at these files), perhaps it (the EVA's) provided the EVA data collector on VMS "crap". I haven't heard an explanation from the storage folks yet. I got involved because a disk to disk backup that normally takes 15 minutes took an hour and 15 minutes!
Cheers,
Art
ps. the v2.0-1 TLVIZ reports the same error in the exact same way.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 09:12 AM
тАО03-15-2010 09:12 AM
Re: T4 EVA CSV problem
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 09:37 AM
тАО03-15-2010 09:37 AM
Re: T4 EVA CSV problem
Seems clear and clean. What more could it possibly report?
Now Excel on the other hand does it's usual crap on the OpenVMS date formatting.
Even when selecting "text" Format, for which the description reads "The text is displayed exactly as entered" it munges the text irreversibly to numbers. :-(
Anyway, the file contains junk. Records. Just look at the date's. The following perl reports each day found and its count:
# perl -ne "$x{$1}++ if /^\s*(\d+-...-\d\d\d\d)/;}{ print qq($_ $x{$_}\n) for (keys %x) " art.csv
15-Mar-2010 60
07-Feb-2106 33
14-Mar-2010 1346
Now fix those non-2010 dates by bluntly replacing them with the last seen 2010 date:
# perl -pe "next unless /^(\d\d-...-.*?,)/; $x=$1; if (!/-2010/) {s/$x/$g/} else {$g=$x}" art.csv >
x.csv
re-count:
15-Mar-2010 60
14-Mar-2010 1379
Now TLviz will 'eat' the file without chocking and pretty much just ignore the bad lines.
It's still not 'right', but it gives you something to look at.
For example the data for "PD Write RPS" looks ok-ish.
You can get rid of the error message, but possible create confusion by blindly adding zero columns to the line:
# perl -pe "next unless /2010 /; chomp; $x=split /,/; $c=$x unless $c; $_ .= q(,0)x($c-$x).qq(\n)" x.
csv > y.csv
for non-perl folks, the 'x' operator multiplies/replicates strings, for any positive multiplier. That q(text) is the same as a single quote (non-interpolated) string but easier for DCL usage. Similar for qq(text) but that is double-quoted and interpolated making \n into a new-line.
For example:
# perl -le "print qq(aap noot mies\n) x 3"
aap noot mies
aap noot mies
aap noot mies
More/Better recovery is likely possible but would be 'real work'.
Cheers,
Hein
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-15-2010 10:46 AM
тАО03-15-2010 10:46 AM
Re: T4 EVA CSV problem
--
TLViz Vx.y-z has detected a file corruption at record [line] in file [name].
An incorrect number of columns are present within the record; [columns] were expected and [columns] found.
Processing will attempt to continue at the next valid record located in the file.
--
Or better, create a cache of these diagnostics to the side, and offer to display a listing of all errors after the processing has completed, or after TLViz has given up on trying to load the file. "Do you want to review formatting errors detected within this file?" or some such dialog.
--
Hyperlinks to the documentation and to where you can check for updates would probably be viewed as overkill with a Windows product, but it tends to be the norm on some other platforms.