HPE Morpheus VM Essentials
1833554 Members
3119 Online
110061 Solutions
New Discussion

Re: The migration tool remains incomplete.

 
shiba9967
Occasional Advisor

The migration tool remains incomplete.

When I tried the migration tool, there was an issue with the source VM that prevented it from completing, leaving it in an incomplete state. Even after stopping and restarting the manager VM, the issue persists, and we are unable to safely finish this task. Is there a way to manually force-terminate this task?

We suspect that the reason it did not complete successfully was not that we chose not to skip the agent installation, but that the source VM could not install the qemu-guest-agent over the Internet.

I apologize for any expressions that may seem inappropriate due to machine translation.

13 REPLIES 13
PeterTzvetanov
HPE Pro

Re: The migration tool remains incomplete.

Hello Shiba9967,

best would be to have session together and look on it. Please send a mail on hpe-sw-trial-vmessentials@hpe.com and we could have a look eventually next week.

With regards

Peter Tzvetanov

Support Engineer

**Confidential information erased**

Technical Support Phone Numbers

HPE Operations

You can manage your cases on HPE Support Center



I work at HPE
HPE Support Center offers support for your HPE services and products when and how you need it. Get started with HPE Support Center today.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
Accept or Kudo
dccolpitts
Occasional Advisor

Re: The migration tool remains incomplete.

Here's what I did for my migration testing.

I wrote a PowerShell script that removes all the OS drivers from the virtio-win-0.1.271.iso except the OS you want to keep (in this case Windows 2022, so 2k22):

$ParentPath = "C:\VME\virtio-win-0.1.271"
$FolderToKeep = "2k22"
Get-ChildItem -Path $ParentPath -Directory | Select Name | Foreach {
$Name = $_.name
$ParentFolder = $ParentPath + "\" + $Name
Get-ChildItem -Path $ParentFolder -Directory -Exclude $FolderToKeep | Remove-Item -Recurse -Force
}

Then I copied "C:\VME\virtio-win-0.1.271" (which now only has the 2k22 folders / drivers in it) to my test migration server (in "C:\VME\virtio-win-0.1.271"), and then I rebooted the VM into WinPE (you can probably just use the Windows 2022 .iso image to boot off and when setup appears, press Shift + F10 to open a command prompt). Once at the WinPE command prompt, I injected the Virtio drivers with:

dism /image:c:\ /add-driver /driver:C:\VME\virtio-win-0.1.271 /recurse

You may get an Error 50 with the smbus driver as it is not properly signed depending on which OS you are injecting into.  I ignored that, as the biggest thing was to get the storage drivers injected so the VM would boot.

When that finished, I rebooted the VM back into Windows (wpeutil reboot) and installed virtio-win-gt-x64.msi. The virtio-win-guest-tools.exe crashed when I tried to run it, so I ignored it.

I shut the VM down at this point and created a migration plan. When creating the migration plan, I did add the local Administrator credentials (not domain credentials, making sure to type hostname\Administrator so it would be the local credentials). I did NOT select either of the migration options (skip prechecks, skip guest tools). The VM only had about a 20GB boot volume, and my test VME cluster is connected on a segregated VLAN across a firewall at 1Gbps to my production VMware cluster. The enitre migration process took about 12 minutes. The time estimates given were rather high compared to what reality was. It finished in 12m11s (which happened when I was gone making a fresh coffee). When I came back from making my coffee, I saw it was completed, so I went back to provisioning and found it was powered on.

Upon connecting to the console, it was booted and it had a valid DHCP address from the vlan's DHCP server.  I then logged in, installed virtio-win-guest-tools.exe from C:\VME\virtio-win-0.1.271. VMware Tools threw up a crash too on logon. I removed them with this script:

https://gist.github.com/broestls/f872872a00acee2fca02017160840624

At this point, the VM migration was completed and Windows Server 2022 was runnnig with the Virtio tools and without VMware Tools.

For Linux, I test migrated a Ubuntu 18.04 VM.  I first installed qemu-guest-agent (apt-get install -y qemu-guest-agent).  I then verified that the guest had the Virtio drivers already in it (https://www.tencentcloud.com/document/product/213/9929), and then I rebooted the VM so it was at a clean boot.  I then created a migration plan, providing my user credentials to it (my credentials are also a sudo user) and leaving everything else default.  Once the migration finished, the VM automatically booted.  I logged into the console and found networking was not functioning.  Upon checking the yaml (/etc/netplan), I discovered that under ESXi the nic was labeled ens160, while under VME it's labeled as ens1.  I updated the adapter name (and IP since it was no longer on my production vlan) and ran netplan apply and I immediately had network connectivity again.

Good luck!

dcc

shiba9967
Occasional Advisor

Re: The migration tool remains incomplete.

When I made the initial attempt, even after about two hours the VM migration had not completed. However, when I ran the tool again with the same VM, network, and options, it failed after more than 40 minutes. I do not understand the difference in causes between the situation where the process runs for more than two hours under the same conditions, and the situation where it fails after 40 minutes. Since I thought the two-hour migration from the initial attempt was reproducible, I did not collect any logs or other information at that time...

What I want to know is how to safely stop the migration tool if it continues to remain in the running state.

dccolpitts
Occasional Advisor

Re: The migration tool remains incomplete.

Well the first thing I would check is your vCenter logs to see the status of the "Export OVF template" task for the migrated VM.  You should be able to watch this in running tasks in vCenter and see the percentage completed.  I would also recommend that until you figure out your issue, build a basic Windows VM with as small of a foot print as possible to test with (like I said, in my case, I used a 20GB Windows Server 2022 VM, so the process was realtively quick).

dcc

shiba9967
Occasional Advisor

Re: The migration tool remains incomplete.

Thank you for your reply. After checking the vCenter logs, I didn’t find any logs related to OVS export. Considering that it took an unusually long time (about 2 hours) during “PRECHECK” and “Prepare Source Workload” on the HVM side, it seems that the verification of the source VM in vCenter might have gotten stuck, resulting in an incomplete state. However, I haven’t been able to reproduce the issue under the same conditions, so it’s still unclear whether it was just a temporary problem.

I repeated the process several times, and in most cases, the process ended in 49 minutes with a “qemu-guest-agent installation failed” message. This is an expected and predictable behavior.

shiba9967
Occasional Advisor

Re: The migration tool remains incomplete.

Although it’s not exactly the same issue, I was able to reproduce a situation where the migration neither completed successfully nor failed, and the process remained unfinished.

【Chose Option】
Skip Prechecks
Skip Guest Tools
【Source VM】
VirtIO driver and qemu-guest-agent were not installed
Disk size is 40GB
*This was a test of migration without prior preparation, and I understand that these components should be installed on the VM beforehand. 

The process was stuck at “Transfer Data” for 1 hour and 20 minutes without completion. From the manager VM logs, it appears that the following entries are related. Additionally, the vCenter event log seems to show that the OVF export operation timed out.

2025-08-26_02:24:44.82794 '[2025-08-26 02:25:16,028] [appJobNormal-6] ESC[34mINFO ESC[0;39m ESC[36mc.m.m.MigrationPlanServiceESC[0;39m - Migration Transfer Action Map: xxxx (VM info omitted)
2025-08-26_02:25:16.02916 '[2025-08-26 02:25:16,662] [pool-2-thread-4] ESC[1;31mERROR ESC[0;39m ESC[36mc.m.AgentPromiseESC[0;39m - Error Processing Agent Promise Error Callback: No such property: message for class: com.morpheus.AgentCommandResult
2025-08-26_02:25:16.66352 'groovy.lang.MissingPropertyException: No such property: message for class: com.morpheus.AgentCommandResult

I would like to know how to safely stop and remove such incomplete processes.

kurotan
Frequent Advisor

Re: The migration tool remains incomplete.

I had the same problem.
The cause was that a CD-ROM was set up on the target VM.
Changing it to a client device resolved the transfer failure.


I would also like to know how to successfully terminate a failed job.

kurotan
Frequent Advisor

Re: The migration tool remains incomplete.

I tried to cancel the process using morpheus shell but was unable to do so.

***************************************************************************************************

[36mmorpheus>[0m process list

Process List
==================

PROCESS ID | NAME | DESCRIPTION | PROCESS TYPE | CREATED BY
-----------|---------------------------|-------------|--------------------------|----------------
483 | fbk-VM70.5-DNSClone | | Migration | holo fbk
482 | fbk-VM70.5-DNSClone | | Start Server |
479 | fbk-VM70.7-Migration | | Migration | holo fbk
476 | fbk-VM70.7-Migration | | Migration | holo fbk
467 | fbk-VM70.124-Migration | | Migration | holo fbk
465 | fbk-VM70.7-DNSClone | | Migration | holo fbk
464 | ubuntu-cli | | Post-Provision | holo fbk
463 | ubuntu-api | | Post-Provision | holo fbk
462 | ubuntu-cli | | Provision | holo fbk
461 | ubuntu-api | | Provision | holo fbk


Viewing 1-25 of 66 processes

[36mmorpheus>[0m process get 465

Process Details | Process ID: 465
==================

Process ID: 465
Name: fbk-VM70.7-DNSClone
Description:
Process Type: Migration
Created By: holo fbk
Start Date: 08/25/25 04:39 PM
End Date:
Duration: 00:03:00
Status: RUNNING

Process Events
---------------------

EVENT ID | NAME | DESCRIPTION | PROCESS TYPE | CREATED BY
---------|------------------------|-------------|------------------------------|----------------
1468 | fbk-VM70.7-DNSClone | | Migration preCheck | holo fbk
1469 | fbk-VM70.7-DNSClone | | Preparing Source Workloads | holo fbk
1470 | fbk-VM70.7-DNSClone | | Create Destination Workloads | holo fbk
1471 | fbk-VM70.7-DNSClone | | Transferring Workload | holo fbk
1472 | fbk-VM70.7-DNSClone | | Finalize Migration | holo fbk

Viewing 1-5 of 5

[36mmorpheus>[0m process cancel 465
Are you sure you would like to cancel process 465? (yes/no): yes
Process is not cancelable
[36mmorpheus>[0m

***************************************************************************************************

kurotan
Frequent Advisor

Re: The migration tool remains incomplete.

I'm sharing some information regarding the issue of activity remaining.
I checked the activity in question on the Operations - Activity History screen.
The migration activity was performed in the following steps:

・PreCheck Workload
・Prepare Source Workload
・Create Target Resource
・Transfer Data
・Finalize Migration

If the OVF template export on the vCenter side fails due to an "operation timeout" after starting the migration,
the initial timeout for the Transfer Data section appears to be 24 hours.
It also appears to retry, but it terminates with a failure after a while.
Finalize Migration also terminated with a failure immediately.

My environment is as follows, and activity remains.
If the OVF template export on the vCenter side fails due to an "operation timeout" after starting the migration, the migration task is forcibly terminated.
The VM to be migrated has been powered on again.
The VM created in the VME has been deleted.

shiba9967
Occasional Advisor

Re: The migration tool remains incomplete.

Thank you for providing the information. As you described, I have confirmed that the activities follow the flow below:

  • PreCheck Workload
  • Prepare Source Workload
  • Create Target Resource
  • Transfer Data
  • Finalize Migration

Depending on the plan, failures often occur at either the "Create Target Resource" or "Transfer Data" steps. As you pointed out, if exporting the OVF template from the vCenter side fails due to an "operation timeout," the migration tool process on the HVM side remains in a continuing state.

After 24 hours, a retry did indeed occur, and the retry failed immediately and the process ended. In my case, the VM created in HVM remained in an incomplete state (an incomplete VM with only a 193KB disk size).

Even though the process will eventually end after 24 hours, it would be problematic if there is no way to manually force-terminate the incomplete process before then.

Arnout_Verbeken
HPE Pro

Re: The migration tool remains incomplete.

For migrations where the OVF export times out, can you let me know if your VME setup is a fresh 8.0.8 install or if it has been upgraded from previous versions?



I work at HPE
HPE Support Center offers support for your HPE services and products when and how you need it. Get started with HPE Support Center today.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
Accept or Kudo
kurotan
Frequent Advisor

Re: The migration tool remains incomplete.

I can only use the evaluation license, so it's a fresh install.


The cause of the timeout was that the CD-ROM of the source VM had a datastore ISO file set.
Changing the settings on the client device eliminated the timeout error.

PeterTzvetanov
HPE Pro

Re: The migration tool remains incomplete.

Hi Shiba9967,

as I wrote already, the fastest way would be to send a mail to the hpe-sw-trial-vmessentials@hpe.com with the problem and we will have a look on that.

With regards

Peter Tzvetanov

Support Engineer

Peter.Tzvetanov@hpe.com

Technical Support Phone Numbers

HPE Operations

You can manage your cases on HPE Support Center



I work at HPE
HPE Support Center offers support for your HPE services and products when and how you need it. Get started with HPE Support Center today.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
Accept or Kudo