VM Explorer Practitioner Forum
Showing results for 
Search instead for 
Do you mean 

Unexpected end of network stream

Visitor

Unexpected end of network stream

[ Edited ]

Hello,

I have the following error at the end of a scheduled backup task : Download error: Unexpected end of network stream

The backup is running well till it reaches 99% percent of completion, then it suddenly failed with the error above.

Here is the debug log VMExplorer-6_1_5.log  :

[15200] 23.11.2016 20:15:00        ##### VM Explorer started  with CLA #####
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
[15200] 23.11.2016 20:15:00        [5259913] VM Explorer started as Client Executor: f4fd27b1-5d07-4c8b-9ce4-e1de045fe5e8
[15200] 23.11.2016 20:15:00        [5259913] Connection to VM Explorer Service..
[15200] 23.11.2016 20:15:01        [5259913] VM Explorer connected to Service
[15200] 23.11.2016 20:15:01        [5259913] Start opening host
[15200] 23.11.2016 20:15:01        [5259913] Host opened
[15200] 23.11.2016 20:15:01        [5259913] ClientExecutor is preparing Task
[15200] 23.11.2016 20:15:01        CombineCurrentAndNewDrive procedure for drive Z:
[15200] 23.11.2016 20:15:01        [5259913] Task 'Sauvegarde SBS' found - preparing to start
[15200] 23.11.2016 20:15:01        Initializing scheduled task: 1c4df134-b1a9-4633-aac0-74eb632d80cf [instance 1c51f350-4f89-4f4a-b09c-63acd9b90390 - 23.11.2016 20:15:01]
[15200] 23.11.2016 20:15:01        New Task Result XML created "C:\ProgramData\Trilead\VMX\TempTaskHistory\1c51f350-4f89-4f4a-b09c-63acd9b90390.xml"
[15200] 23.11.2016 20:15:01        Checking if user is System: True
[15200] 23.11.2016 20:15:20        ---------------------------------------------------------------------------------------
[15200] 23.11.2016 20:15:20        [2221806] Agent Incremental Backup Task started for VM:'SBS' (VMX: 6.1.005.0)
[15200] 23.11.2016 20:15:20        [2221806] Agent Incremental Backup transport mode is compressed: False. Keep backup compressed: False. Encrypt: False
[15200] 23.11.2016 20:15:20        [2221806] Agent Incremental Backup write data directly to disk: False
[15200] 23.11.2016 20:15:20        [2221806] Trying to use agent for flat-file downloads
[15200] 23.11.2016 20:15:20        [2221806] Searching for VM SBS on ESX Server 192.168.0.x (e84f2e3f-e952-49c6-9a1c-b3cb710eb589)
[15200] 23.11.2016 20:15:22        [2221806] Source: 'ESX Server' (License 'ESXBasic') Target: 'Local Machine'
[15200] 23.11.2016 20:15:24        [5942910] Search existing backups for VM = "SBS" (564d23e4-2c07-9cda-30f7-5b527462ac41), Server = "e84f2e3f-e952-49c6-9a1c-b3cb710eb589", checkServerGUID= False, backup task = "aee6e7f0-7237-48a9-bbdb-2ce30c3d16aa", search only task releated backups = False, search incremental backup = True
[15200] 23.11.2016 20:15:24        [5942910] Backup folder "Z:\SBS\backup-version-2016-11-17-201523" (Z:\SBS\backup-version-2016-11-17-201523)
[15200] 23.11.2016 20:15:24        [5942910] Search old backups in folder: Z:\SBS\backup-version-2016-11-17-201523\2016-11-18-201521
[15200] 23.11.2016 20:15:25        [5942910] Search old backups in folder: Z:\SBS\backup-version-2016-11-17-201523
[15200] 23.11.2016 20:15:25        [5942910] Found 2 backups
[15200] 23.11.2016 20:15:25        [5942910] Check incremental backup integrity
[15200] 23.11.2016 20:15:26        [2221806] Existings backup integrity OK. There are 2 versions.
[15200] 23.11.2016 20:15:27        [2221806] Start INCREMENTAL backup/replication
[15200] 23.11.2016 20:15:27        [2221806] ForceSnapshot is enabled.
[15200] 23.11.2016 20:15:27        [2221806] Checking backup size
[15200] 23.11.2016 20:15:27        [2221806] Available space: 2'021'255'094'272 bytes
[15200] 23.11.2016 20:15:27        [2221806] Creating backup snapshot "Backup Snapshot 2016-11-23-201520" on VM: 192.168.0.9/SBS(memory=False, quiesce=True)
[15200] 23.11.2016 20:16:56 [ERROR]    GetCurrentESXSnapshot return null value
[15200] 23.11.2016 20:16:57        [2221806] Snapshot created on VM: 192.168.0.x/SBS
[15200] 23.11.2016 20:17:02        [2221806] Creating target .vmx file SBS.vmx
[15200] 23.11.2016 20:17:02        [2221806] Target File 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS.vmx.112320152012.tmp' created
[15200] 23.11.2016 20:17:02        [2221806] Target File "Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS.vmsd.112320152012.tmp" created
[15200] 23.11.2016 20:17:02        [2221806] Copying [datastore1] SBS/SBS.vmxf
[15200] 23.11.2016 20:17:04        [2221806] Copying [datastore1] SBS/SBS.nvram
[15200] 23.11.2016 20:17:05        [2221806] Copying [datastore1] SBS/SBS.vmdk
[15200] 23.11.2016 20:17:06        [2221806] Copying [datastore1] SBS/SBS-flat.vmdk
[15200] 23.11.2016 20:17:07        [2221806] Running Download on Agent: /vmfs/volumes/datastore1/SBS/SBS-flat.vmdk
[15200] 23.11.2016 21:28:34        [2221806] Download of /vmfs/volumes/datastore1/SBS/SBS-flat.vmdk done
[15200] 23.11.2016 21:28:40        [2221806] Copying [datastore1] SBS/SBS_1.vmdk
[15200] 23.11.2016 21:28:41        [2221806] Copying [datastore1] SBS/SBS_1-flat.vmdk
[15200] 23.11.2016 21:28:42        [2221806] Running Download on Agent: /vmfs/volumes/datastore1/SBS/SBS_1-flat.vmdk
[15200] 23.11.2016 21:28:42 [ERROR]    [2221806] Download on Agent problem - Download error: Unexpected end of network stream.
[15200] 23.11.2016 21:28:42        [2221806] Download on Agent re-trying in 10s
[15200] 23.11.2016 21:28:52        [2221806] Re-trying Download on Agent [1]
[15200] 23.11.2016 21:28:53        [2221806] Running Download on Agent: /vmfs/volumes/datastore1/SBS/SBS_1-flat.vmdk
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS.vmx.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS.vmsd.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS.vmxf.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS.nvram.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS.vmdk.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS-flat.vmdk.config.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS-flat.vmdk.delta.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS_1.vmdk.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS_1-flat.vmdk.config.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Removing temp file 'Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520\SBS_1-flat.vmdk.delta.112320152012.tmp'
[15200] 23.11.2016 21:28:54        [2221806] Check if target folder is empty
[15200] 23.11.2016 21:28:54        [2221806] Backup directory deleted: Z:\SBS\backup-version-2016-11-17-201523\2016-11-23-201520
[15200] 23.11.2016 21:28:54        [2221806] Removing Backup snapshot on: 192.168.0.x/SBS
[15200] 23.11.2016 21:32:19        [2221806] Backup snapshot removed: 192.168.0.x/SBS
[15200] 23.11.2016 21:32:19        [2221806] Unmount storage snapshot.
[15200] 23.11.2016 21:32:19        [2221806] Unmap and delete storage snapshot.
[15200] 23.11.2016 21:32:19 [ERROR]    [2221806] BackupExecutor: Download error: Unexpected end of network stream.
[15200] 23.11.2016 21:32:19 [ERROR]    PerformBackup AI exception: Download error: Unexpected end of network stream.
[15200] 23.11.2016 21:32:19        [5259913] Saving Result for task "Sauvegarde SBS"
[15200] 23.11.2016 21:32:20        [5259913] Task 'Sauvegarde SBS' ("1c4df134-b1a9-4633-aac0-74eb632d80cf") terminated sending FinishJob
[15200] 23.11.2016 21:32:20        [5259913] Start closing host
[15200] 23.11.2016 21:32:30        [5259913] Host closed
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
[15200] 23.11.2016 21:32:30        ##### VM Explorer closed #####

Here is the VmExplorer.log :

==========================================
VMX Version: 6.1.5 (64-bit)
Licence:     Pro Edition (15.08.2016 00:00:00)
Scheduler:   True

==========================================
Current Directory:       C:\Windows\system32
MachineName:             SBS
Processor arch:          64-bit
OSName:                  Microsoft Windows® Small Business Server 2011 Standard
OSVersion:               6.1.7601
ProcessorCount:          4
SystemDirectory:         C:\Windows\system32
UserDomainName:          xxxx
UserInteractive:         False
UserName:                Système
.net Version:            4.0.30319.34209
WorkingSet:              205266944
WriteDataDirectlyToDisk: False
Drive list:
   A:\ -  , format: , type: Removable, root: , space: -1/-1
   C:\ -  , format: NTFS, type: Fixed, root: , space: 26369081344/230746484736
   D:\ -  , format: , type: CDRom, root: , space: -1/-1
   E:\ - Data , format: NTFS, type: Fixed, root: , space: 124399370240/324041437184
   Z:\ - Sauvegarde , format: NTFS, type: Network, root: \\192.168.0.x\Sauvegarde, space: 2021255094272/2948501864448

Web Server status
Web Server is running:  True
Web server address: https://sbs.xx.local:4433/

==========================================

VMX NFS Server status
VMX NFS running:     True
VMX NFS address:     Any
VMX NFS port:        2049
VMX Mountd port:     4242
VMX Portmapper:      111

==========================================

SAN InfrastructureNo SAN hosts were added to this configuration.
==========================================

Server: ESX Server
   GUID:         e84f2e3f-e952-49c6-9a1c-b3cb710eb589
   Host Type:    ESX 3/4, ESXi 3/4/5/6
   Host Status:  Connected
   Host UUID:    4c4c4544-004b-3910-8052-c4c04f38354a
   Hostname:     192.168.0.x
   HTTPS Port:   443
   SSH Port:     22
   Version:      VMware ESXi 5.1.0 build-2323236
   Initialized:  1
   ESXi:         y
   Use TechMode: y
   Use Agent:    y
   Dont open FW: n
   VmkfsToolsLC: y
   API.ConnV:    55
   API.Type:     HostAgent
   API.Version:  5.1
   API.PLine:    embeddedEsx
   API.ESXName:  VMware ESXi
   API.ESXBuild: 2323236
   API.UseCUA:   y
   UseVDService: n
   VcenterChild: n

   DataStores:
      datastore1(VMFS//vmfs/volumes/58220a3f-0a16b41d-af5f-d4ae52691fff/58220a3f-0a16b41d-af5f-d4ae52691fff/144712925184)

   Recovery Datastores:
      No Recovery Datastores mounted on this host.

-----------------------------------------------
   Virtualmachine: SBS
      Config Dir:  [datastore1] SBS
      Config File: [datastore1] SBS/SBS.vmx
      UUID:        564d23e4-2c07-9cda-30f7-5b527462ac41
      VMwareTools: True
      Powerstate:  ON
      Guest Info:  Microsoft Windows Server 2008 R2 (64-bit)
      Disk: [datastore1] SBS/SBS.vmdk
      Disk: [datastore1] SBS/SBS_1.vmdk
-----------------------------------------------
   Virtualmachine: TS
      Config Dir:  [datastore1] TS
      Config File: [datastore1] TS/TS.vmx
      UUID:        564df9f9-ec93-241e-5132-e43f21de4dd8
      VMwareTools: True
      Powerstate:  ON
      Guest Info:  Microsoft Windows Server 2008 R2 (64-bit)
      Disk: [datastore1] TS/TS.vmdk

==========================================
Counters
ESX/ESXi hosts  : 1
vCenter Hosts   : 0(0)
ESX/ESXi VMs    : 2
Hyper-V hosts   : 0
Hyper-V Clusters: 0(0)
Hyper-V VMs     : 0
==========================================
Tape Infrastructure
 - Tape Libraries   : 0
 - Standalone Drives: 0
==========================================
Scheduled Tasks
Taskname      : Backup TS
UUID          : 24a98e5d-f58f-46a1-be04-a774ec5f0e22
StartTime     : 18:00
ScheduleEnabl.: True
RunType       : RunWeekly
Weekmask      : MO,TU,WE,TH,FR (31)
LastRun       : 23.11.2016 18:00:00
LastRunResult : Download error: Unexpected end of network stream.
TaskElements  : BackupTask (vm: TS, source:e84f2e3f-e952-49c6-9a1c-b3cb710eb589, target:, options: Z:\BackupTS\{VM};1;True) [34a20873-cb6c-4853-bbad-1ea38292262a - multi:]


Taskname      : Sauvegarde SBS
UUID          : 1c4df134-b1a9-4633-aac0-74eb632d80cf
StartTime     : 20:15
ScheduleEnabl.: True
RunType       : RunWeekly
Weekmask      : MO,TU,WE,TH,FR (31)
LastRun       : 23.11.2016 20:15:00
LastRunResult :
TaskElements  : BackupTask (vm: SBS, source:e84f2e3f-e952-49c6-9a1c-b3cb710eb589, target:, options: Z:\{VM};1;True) [aee6e7f0-7237-48a9-bbdb-2ce30c3d16aa - multi:]

I don't understand why this happening and I don't know how to solve it?

I have already updated VMExplorer from version 6.0.011 to version 6.1.5. I have tried recreate the backup task, and to validate the esxi parameters again without any success. The only thing that recently changed is that the esxi server has been updated from version 5.0.0 to version 5.1.0 and also the VM have been moved from one datastore to another on the esxi

.