Autoloader - 1/8 G2, LTFS. Copying files from a tape to a disk takes a very long time. < 8 MB

[vsh]

Hello! The tape contains 199 files in 3 directories. File size from 10GB to 30GB. If I copy one file, everything is fine, the speed is 300MBytes/sec and more. If I try to copy all the files at once, nothing happens, the speed constantly floats, drops to 0. I tried to copy using Windows explorer, robocopy and ltfscopy, there is no difference. (Windows server 2019, HPE StoreOpen Software 3.4)

"C:\Program Files\HPE\LTFS>date /T && time /T && ltfscopy.exe -r -s t:\ -d "f:\temp\READONLY-FG (LTO)" && date /T && time /T"
11.03.2021
10:25
Indexing files... Please wait. It may take few minutes depending on the number of files.

..........It's been hanging for 5 hours

[vsh]

I found the following error in the log: The LTFS file system encountered an error

- System

- Provider

[ Name] LTFS

- EventID 100

[ Qualifiers] 0

Level 2

Task 0

Keywords 0x80000000000000

- TimeCreated

[ SystemTime] 2021-03-11T07:12:49.617043900Z

EventRecordID 53287

Channel System

Computer bu

Security

- EventData

LTFS14075E Cannot set up tape drive

[vsh]

And also the new HPE Library and Tape Tools version(https://downloads.hpe.com/pub/softlib2/software1/pubsw-generic/p1910951539/v192312/hpe_ltt60_win.exe)

[vsh]

By time(10:12), the error was earlier than the start of the copy

copy time: 10:25
Indexing files... Please wait. It may take few minutes depending on the number of files.

[vsh]

I have updated the LTT program to version 6. Just in case.

I tried to reduce the path, the data was copied, 350GB 1296 files in 2 hours. But this is unacceptable

C:\Program Files\HPE\LTFS>date /T && time /T && ltfscopy -c -r -s t:\wirth5 -d "F:\temp\READONLY-FG (LTO)" && date /T && time /T
12.03.2021
01:18
Indexing files... Please wait. It may take few minutes depending on the number of files.
Sorting files...
Copying...
'F:\temp\READONLY-FG (LTO)\MSSQL.1\MSSQL\Backup\BigData\BigData_2021-02-25T061502.trn' copied.

...

'F:\temp\READONLY-FG (LTO)\MSSQL.1\MSSQL\Backup\SysLogRepl\SyslogRepl_2021-02-26T000237.bak' copied.

'F:\temp\READONLY-FG (LTO)\MSSQL.1\MSSQL\Backup\TaskService\TaskService_2021-02-26T002518.bak' copied.

'F:\temp\READONLY-FG (LTO)\MSSQL.1\MSSQL\Backup\Fact2old\md5_04032021180158.csv' copied.

Summary:
Total files: 1296
Files copied: 1296
12.03.2021
03:29

[vsh]

As for the "The LTFS file system encountered an error" above, it occurs every time I change the tape.

[vsh]

I figured it out a little, there was a of some kind of failure during recording, but I can't say what, a question for support!

Pay attention to the size of the index file of the problematic cassette "CCP376" it contains only 199 files with a size of 10 to 30 GB, and the index file with a size of 1 GB!!!

C:\Program Files\HPE\LTFS>dir C:\ltfs
Volume in drive C is system
Volume Serial Number is 4AA8-D0BB

Directory of C:\ltfs

12.03.2021 19:01 <DIR> .
12.03.2021 19:01 <DIR> ..
09.03.2021 14:47 82 297 CCP370.schema
11.03.2021 10:11 970 666 CCP371.schema
09.03.2021 10:13 1 485 064 CCP372.schema
10.03.2021 23:28 1 182 120 CCP373.schema
11.03.2021 23:57 1 159 604 CCP374.schema
12.03.2021 08:56 836 706 CCP375.schema
12.03.2021 19:02 993 598 451 CCP376.schema
12.03.2021 18:59 1 009 CCP377.schema
8 File(s) 999 315 917 bytes
2 Dir(s) 380 249 071 616 bytes free

Example of a section for one the files:

<name>BigData.DS_001.2021-03-07T005047.295.01of03.bak</name>
<length>28515373056</length>
<readonly>false</readonly>
<creationtime>2021-03-09T18:17:10.000096000Z</creationtime>
<changetime>2021-03-09T18:30:23.000701000Z</changetime>
<modifytime>2021-03-06T21:58:57.000000000Z</modifytime>
<accesstime>2021-03-10T14:42:32.000707000Z</accesstime>
<backuptime>2021-03-09T18:17:10.000096000Z</backuptime>
<fileuid>1452</fileuid>
<extentinfo>
<extent>
<fileoffset>0</fileoffset>
<partition>b</partition>
<startblock>1138448</startblock>
<byteoffset>0</byteoffset>
<bytecount>4096</bytecount>
</extent>
<extent>
<fileoffset>4096</fileoffset>
<partition>b</partition>
<startblock>906345</startblock>
<byteoffset>4096</byteoffset>
<bytecount>241664</bytecount>
</extent>
<extent>
<fileoffset>245760</fileoffset>
<partition>b</partition>
<startblock>906347</startblock>
<byteoffset>0</byteoffset>
<bytecount>245760</bytecount>
</extent>
<extent>
<fileoffset>491520</fileoffset>
<partition>b</partition>
<startblock>906349</startblock>
<byteoffset>0</byteoffset>
<bytecount>245760</bytecount>
</extent>
...
...

and so on for each file with a total size of 1GB

[vsh]

Could the support please comment to avoid such problems in the future?

[vsh]

MORE.

ltfs copy does not work, often hangs on indexing and does nothing. I use robocopy after fixing the tape, and the speed is more or less good.

Total Copied Skipped Mismatch FAILED Extras
Dirs : 53 52 1 0 0 0
Files : 1914 1914 0 0 0 0
Bytes : 620.759 g 620.759 g 0 0 0 0
Times : 0:57:54 0:57:54 0:00:00 0:00:00

Speed : 191858111 Bytes/sec.
Speed : 10978.209 MegaBytes/min.
Ended : 15 марта 2021 г. 11:40:15

[rwhitaker.cr]

Hello @vsh,

Thanks for using HPE StoreEver Tape Storage Community Forum.

As per StoreOpen 3.4.2 release notes, the highest supported Windows version is Server 2016.

Hope that helps.