Operating System - OpenVMS
1825906 Members
3619 Online
109689 Solutions
New Discussion

Testers for virtual tape library wanted

 
SOLVED
Go to solution
David Jones_21
Trusted Contributor

Testers for virtual tape library wanted

I'm thinking about submitting my virtual tape software for the OpenVMS freeware distibution and would like to see how the source kit packaging behaves in different environments.
It should build on any Alpha running 7.2 or higher with DECC 6.0, but most development has been at 8.2.

The code is an update of Wolfgang Moeller's old remote tape driver using TCP/IP instead of DECnet (ZT_DRIVER.MAR is virtually unchanged). I use the software to backup my AS800 at home to a 300GB disk drive connected to a Windows PC.
I'm looking for marbles all day long.
14 REPLIES 14
Uwe Zessin
Honored Contributor

Re: Testers for virtual tape library wanted

With all due respect, but that is not what I would call a "virtual tape library" these days.

A VTL is either a separate hardware box (usually connected via Fibre Channel) that can be configured to looke like a (set of) tape drive(s) or tape library (/libraries) to other servers, but the data is stored on disk drives.

Or the emulation is part of a backup software, but the data is still stored on disks.
.
David Jones_21
Trusted Contributor

Re: Testers for virtual tape library wanted

Uwe Zessin:
"With all due respect, but that is not what I would call a "virtual tape library" these days."

I'm not sure where you are drawing the line.

The ZTA0 pseudo-device looks like a tape drive to applications issuing I/O to it, but the data goes over the network to a disk file acting as a container for the virtual tape. Hence it is a virtual tape drive.
The remote host serves several of these files and will respond to a mount request by loading the appropriate virtual tape automatically. Seems to meet the minimal criteria for a tape library to me.
I'm looking for marbles all day long.
Richard Whalen
Honored Contributor

Re: Testers for virtual tape library wanted

What has this been tested with? It sounds like TCP/IP Services, but has any testing been done with MultiNet or TCPware? How do the IRPs from the ZT driver get sent off to the TCP/IP drivers? How is the server program on the other side set up?
David Jones_21
Trusted Contributor

Re: Testers for virtual tape library wanted

The IRPs trigger a mailbox message to a transport process which then does most of its work in user mode. The tape operations are virtualized as separate protocol messages between the transport and the library server, the remote process doesn't VMS IO$* function codes. There is a protocol.txt in the distribution that tries to explain the network protocol.

It hasn't been tested with Multinet or Tcpware. It does a couple direct QIO operations when reading library responses (IO$M_NOWAIT and IO$M_LOCKBUF) modifiers which would have to be translated if using Multinet or TCPware native interfaces.

The remote side (zt_library.c) was kept as basic as possible for maximum portability and does all network I/O through standard socket library functions.
I'm looking for marbles all day long.
David Jones_21
Trusted Contributor

Re: Testers for virtual tape library wanted

"How is the server program on the other side set up?"

You invoke the program specifying a path to a local directory and any files in that directory whose names end in .VTAPE are served as virtual tapes.
I'm looking for marbles all day long.
Uwe Zessin
Honored Contributor

Re: Testers for virtual tape library wanted

Sorry, I saw 'remote tape driver', missed the 300GB disk drive and thought that it provides access to a tape drive in another system.

A *library* includes a robotic device that is used to move arbitrary cartridges between slots and tape drives.

It sounds like you have implemented what I would call a 'virtual autoloader', but that is a bit of nitpicking. Certainly open to debate, because many libraries can be switched to a 'sequential mode' as well, so I really better stop right now ;-)
.
John Travell
Valued Contributor

Re: Testers for virtual tape library wanted

I would be happy to test this for you. Alphaserver1000 5/333, VMS 7.3-1 until I get time to upgrade, HP TCPIP 5.3eco2.
Look up my profile, you will find a description of my email address.
JT:
Volker Halle
Honored Contributor

Re: Testers for virtual tape library wanted

John,

the software is attached as a .ZIP file on David's initial message. Just go ahead, download, build and test it ;-)

Volker.
Duncan Morris
Honored Contributor

Re: Testers for virtual tape library wanted

David, I have downloaded it for testing on my own AS800, VMS 7.3-2. Will report any problems.
Volker Halle
Honored Contributor

Re: Testers for virtual tape library wanted

Dave,

I've built both the library and the transport on OpenVMS Alpha V8.2 and OpenVMS I64 V8.2 (both single CPU systems). I've then run localhost tests (both transport and driver on same machine) on the Alpha system and also run a test from Alpha (transport) to I64 (zt_library).

Backing up 5.5 GB from the Alpha (10 mbit LAN) to a local USB disk on the I64 achieved a throughput rate between 400 to 700 kByte/sec using -wbc (write back caching).

Some tests with vtape_to_rms on Alpha (extracting savesets from .VTAPE and comparing them with BACK/COMPARE against the original BACKUP source files) showed no problems.

localhost tests on I64 are not yet successful.

Nice piece of software.

Volker.
Volker Halle
Honored Contributor
Solution

Re: Testers for virtual tape library wanted

Dave,

it also works on OpenVMS I64 V8.2 (once I added compilation support for __ia64 in zt.h):

#if defined(__ALPHA) || defined(__ia64)

Before, it failed with 'BUGCHECK, driver buffer wrong size!' in ZT_TRANSPORT.LOG as ZTmsg was defined for VAX.

Volker.
fons666
New Member

Re: Testers for virtual tape library wanted

Hi David.
I'm really interested in testing you code. I'm currently managing 7 remote sites and need to implement a remote backup solution. I've downloaded the zip file. Please advise steps required to implement.

Thanks

Hoff
Honored Contributor

Re: Testers for virtual tape library wanted

fons666, you're replying to a thread from 2005.
The ZT software was -- as was the original comment in the thread -- submitted to and is available on the OpenVMS Freeware now. I expect the testing is over. Specifically, look here:
http://h71000.www7.hp.com/freeware/freeware80/zt/

There's also a simple DECnet-to-tape DCL-based server in the OpenVMS FAQ. Here: http://www.hoffmanlabs.com/vmsfaq



David Jones_21
Trusted Contributor

Re: Testers for virtual tape library wanted

"Please advise steps required to implement."

Your first step is to read the aaareadme.txt file in the zipfile you downloaded. Then you build the images and experiment using 3 terminal sessions: one for executing the zt_transport.com client; one for running the zt_library.exe; and one to do tape operations (i.e. small backups) to the ZT: psuedo-device.

What you want to do is the inverse of what I'm doing. I have a single ZT device on a cluster backing up to virtual tape robots on multiple machines (running windows). Your host machines can have a common zt_transport configuration (i.e. accept connections from your respository machine). On your repository machine, you have to write startup scripts to run a separate zt_library process for each client host, keeping the virtual tape container files for each in a separate directory.

Observations after 18 months:
The method of loading tapes by inference from IO$_DISPLAY requests burdens somewhat your ability to manage the virtual tapes. If you accidently give 2 tapes the same label you can't control which tape you get for a mount request. I have command procedures to enforce the labeling scheme (e.g. the backup of $15$DKA200 for 15th week of 07 is 715202.BCK).

Reading a virtual tape is a lot slower than writing it (if you enable -wbc option on the zt_library command). Adding a decompress step for records read slows it down even further. Tracking tape position for speculative read ahead is more work than I wanted to do.

Given the slow reads, a virtual EOT on the tape at say 20GB would have been a nice feature. Restoring user ZHANG's files could use the trick of loading a 'not the start of a saveset' tape. This would of course exacerbate the tape label problem, since you are down to 5 meaningful characters.
I'm looking for marbles all day long.