ESXi7.0.0b Agentless Management Service on DL20 GEN10 doesn't start

[mbmb]

Hi all, 

I've installed the latest version of the HP Agentless Management Service on a freshly installed HPe DL20 Gen 10 server. ESXi confirms de packeges are installed:

amscli Agentless Management Service ESXCLI Extension for ESXi 11.5.0.22-1OEM.700.0.0.15525992 HPE 

amsd Agentless Management Service Daemon for VMware ESX 700.11.5.0.28-1OEM.700.1.0.15525992 HPE 

But they don't start when ESXi is booted and also a manual start through SSH doens't help:

[root@localhost:/etc/init.d] ./amsd start

[root@localhost:/etc/init.d] ./amsd status
daemon_smarev is not running
daemon_ahslogger is not running
daemon_amshelper is not running
daemon_ahsd is not running
daemon_amsd is not running
daemon_smad is not running

Below the syslog, hopefully someone has some suggestions.

2020-08-30T08:54:51Z jumpstart[1049796]: executing start plugin: amsd
2020-08-30T08:54:51Z jumpstart[1049796]: executing start plugin: loadESX
2020-08-30T08:54:51Z jumpstart[1049796]: vmtoolsd started.
2020-08-30T08:54:51Z jumpstart[1049796]: xorg started.
2020-08-30T08:54:51Z jumpstart[1049796]: Jumpstart failed to start: esxapiadapter reason: Execution of command: /etc/init.d/esxapiadapter start failed with status: 3
2020-08-30T08:54:51Z jumpstart[1049796]: Method invocation failed: esxapiadapter->start() failed: Execution of command: /etc/init.d/esxapiadapter start failed with status: 3
2020-08-30T08:54:51Z jumpstart[1049796]: loadESX started.
2020-08-30T08:54:51Z daemon-amsd-smad: daemonizing setsid /usr/lib/vmware/daemonMgmt/bin/watchdog.sh -t 100 -n -s amsd-smad /opt/amsd/bin/smad
2020-08-30T08:54:51Z daemon-amsd-smad: [1050942] Begin '/opt/amsd/bin/smad', min-uptime = 60, max-quick-failures = 5, max-total-failures = 100,
2020-08-30T08:54:51Z daemon-amsd-smad: Executing '/opt/amsd/bin/smad'
2020-08-30T08:54:51Z daemon-amsd-smad: saved 1050942 1050949 in /var/run/vmware/daemon-amsd-smad.pid
2020-08-30T08:54:51Z daemon-amsd-smad: returned from wait for PID 1050949 with exit status 0
2020-08-30T08:54:52Z vaainasd[1049930]: DISKLIB-PLUGIN : DiskLibNasPluginFindAndStartSession : NasPluginAddMapping failed
2020-08-30T08:54:52Z vaainasd[1049930]: DISKLIB-PLUGIN : DiskLibNasPluginFindAndStartSession : NasPluginAddMapping failed
2020-08-30T08:54:52Z vaainasd[1049930]: DISKLIB-PLUGIN : DiskLibNasPluginFindAndStartSession : NasPluginAddMapping failed
2020-08-30T08:54:52Z vaainasd[1049930]: DISKLIB-PLUGIN : DiskLibNasPluginFindAndStartSession : NasPluginAddMapping failed
2020-08-30T08:54:53Z lsud: [info] fd6:GETDEVICEINFO dev name = mxxxxxxxxxxxx
2020-08-30T08:54:53Z lsud: [info] fd7:GETDEVICELOCATION dev name = mxxxxxxxxxxxx, num = 4
2020-08-30T08:54:53Z lsud: [info] fd6:GETDEVICEINFO dev name = mxxxxxxxxxxxx
2020-08-30T08:54:57Z slpd[1050566]: SLPDRegMulticast: no v6 service sock found, no service groups joined for service:wbem:https
2020-08-30T08:54:58Z sfcb-vmw_ipmi[1051048]: IpmiIfcSdrReadRecordId:record id: 29, error 210. Try again...
2020-08-30T08:54:58Z sfcb-vmw_ipmi[1051048]: IpmiIfcSdrReadRecordId:record id: 29, error 210. Try again...
2020-08-30T08:55:00Z crond[1049715]: USER root pid 1051062 cmd /bin/hostd-probe.sh ++group=host/vim/vmvisor/hostd-probe/stats/sh
2020-08-30T08:55:00Z hostd-probe.sh: Starting hostd-probe
2020-08-30T08:55:01Z jumpstart[1049796]: amsd started.
2020-08-30T08:55:01Z jumpstart[1049796]: executing start plugin: amsesxcli.sh
2020-08-30T08:55:01Z root: amsesxcli.sh: runtime check ok.
2020-08-30T08:55:01Z root: amsesxcli.sh: /opt/amsd/bin/amsdesxcliwd.sh start
2020-08-30T08:55:01Z root: amsdesxcliwd start
2020-08-30T08:55:01Z jumpstart[1049796]: amsesxcli.sh started.
2020-08-30T08:55:01Z init: starting pid 1051088, tty '': '/usr/lib/vmware/misc/bin/ucode_workarounds.py'
2020-08-30T08:55:01Z init: starting pid 1051089, tty '': '/bin/apply-host-profiles'
2020-08-30T08:55:01Z init: starting pid 1051090, tty '': '/usr/lib/vmware/configmanager/bin/applyconfig'
2020-08-30T08:55:01Z daemon-amsd-smad: Unable to verify amsd-smad started after 10 seconds
2020-08-30T08:55:01Z daemon-amsd-amsd: daemonizing setsid /usr/lib/vmware/daemonMgmt/bin/watchdog.sh -t 100 -n -s amsd-amsd /opt/amsd/bin/amsd
2020-08-30T08:55:01Z daemon-amsd-amsd: [1051101] Begin '/opt/amsd/bin/amsd', min-uptime = 60, max-quick-failures = 5, max-total-failures = 100,
2020-08-30T08:55:01Z daemon-amsd-amsd: Executing '/opt/amsd/bin/amsd'
2020-08-30T08:55:01Z daemon-amsd-amsd: saved 1051101 1051108 in /var/run/vmware/daemon-amsd-amsd.pid
2020-08-30T08:55:01Z daemon-amsd-amsd: returned from wait for PID 1051108 with exit status 0

2020-08-30T08:55:02Z init: starting pid 1051120, tty '': '/usr/lib/vmware/secureboot/bin/secureBoot.py ++group=host/vim/vmvisor/boot -a'
2020-08-30T08:55:02Z sfcb-vmw_ipmi[1051048]: IpmiIfcFruGetInv: fruDeviceId = 0x3, failed send cc = 0xcb
2020-08-30T08:55:02Z sfcb-vmw_ipmi[1051048]: IpmiIfcFruGetInv: fruDeviceId = 0x2, failed send cc = 0xcb
2020-08-30T08:55:03Z init: starting pid 1051137, tty '': '/usr/lib/vmware/vmksummary/log-bootstop.sh boot'
2020-08-30T08:55:03Z addVob[1051140]: Log for VMware ESXi version=7.0.0 build=build-16324942 option=Release
2020-08-30T08:55:03Z addVob[1051140]: DictionaryLoad: Cannot open file "/usr/lib/vmware/config": No such file or directory.
2020-08-30T08:55:03Z addVob[1051140]: DictionaryLoad: Cannot open file "//.vmware/config": No such file or directory.
2020-08-30T08:55:03Z addVob[1051140]: DictionaryLoad: Cannot open file "//.vmware/preferences": No such file or directory.
2020-08-30T08:55:03Z init: starting pid 1051141, tty '': '/usr/lib/vmware/coredump/collect-coredump-at-boot.sh'
2020-08-30T08:55:03Z init: starting pid 1051149, tty '': '/bin/vmdumper -g 'Boot Successful''
2020-08-30T08:55:03Z init: starting pid 1051150, tty '': '/usr/lib/vmware/misc/bin/killTimeoutConsole.sh'
2020-08-30T08:55:03Z init: starting pid 1051157, tty '': '/bin/sh ++min=0,group=host/vim/vimuser/terminal/shell /etc/rc.local'
2020-08-30T08:55:03Z root: init Running cleanupStatefulHost.py
2020-08-30T08:55:04Z root: init Completed cleanupStatefulHost.py (exit 0)
2020-08-30T08:55:04Z root: init Running kickstart.py
2020-08-30T08:55:04Z root: init Completed kickstart.py (exit 0)
2020-08-30T08:55:04Z root: init Running lifecycle.sh
2020-08-30T08:55:05Z root: init Completed lifecycle.sh (exit 0)
2020-08-30T08:55:05Z root: init Running local.sh
2020-08-30T08:55:05Z root: init Completed local.sh (exit 0)
2020-08-30T08:55:05Z root: init Completed /etc/rc.local.d
2020-08-30T08:55:05Z init: starting pid 1051230, tty '': '/bin/esxcfg-init --set-boot-progress done'
2020-08-30T08:55:05Z init: starting pid 1051231, tty '': '/bin/vmware-autostart.sh start'
2020-08-30T08:55:05Z init: starting pid 1051234, tty '': '/usr/lib/vmware/perf/bin/bootStatsRead.sh'
2020-08-30T08:55:05Z VMware[startup]: Starting VMs
2020-08-30T08:55:05Z init: starting pid 1051235, tty '/dev/tty1': '/bin/initterm.sh tty1 /bin/techsupport.sh'
2020-08-30T08:55:05Z init: starting pid 1051236, tty '/dev/tty2': '-/bin/initterm.sh tty2 /bin/dcuiweasel'
2020-08-30T08:55:05Z DCUI[1051236]: Log for VMware ESXi version=7.0.0 build=build-16324942 option=Release
2020-08-30T08:55:05Z DCUI[1051236]: DictionaryLoad: Cannot open file "/usr/lib/vmware/config": No such file or directory.
2020-08-30T08:55:05Z DCUI[1051236]: DictionaryLoad: Cannot open file "//.vmware/config": No such file or directory.
2020-08-30T08:55:05Z DCUI[1051236]: DictionaryLoad: Cannot open file "//.vmware/preferences": No such file or directory.

2020-08-30T08:55:11Z daemon-amsd-amsd: Unable to verify amsd-amsd started after 10 seconds
2020-08-30T08:55:11Z daemon-amsd-ahsd: daemonizing setsid /usr/lib/vmware/daemonMgmt/bin/watchdog.sh -t 100 -c -s amsd-ahsd /opt/amsd/bin/ahsd
2020-08-30T08:55:11Z daemon-amsd-ahsd: [1051295] Begin '/opt/amsd/bin/ahsd', min-uptime = 60, max-quick-failures = 5, max-total-failures = 100,
2020-08-30T08:55:11Z daemon-amsd-ahsd: Executing '/opt/amsd/bin/ahsd'
2020-08-30T08:55:11Z daemon-amsd-ahsd: saved 1051295 1051302 in /var/run/vmware/daemon-amsd-ahsd.pid
2020-08-30T08:55:11Z daemon-amsd-ahsd: returned from wait for PID 1051302 with exit status 0
2020-08-30T08:55:11Z daemon-amsd-ahsd: not restarting due to exit status 0
2020-08-30T08:55:22Z daemon-amsd-ahsd: Unable to verify amsd-ahsd started after 10 seconds
2020-08-30T08:55:22Z daemon-amsd-amshelper: daemonizing setsid /usr/lib/vmware/daemonMgmt/bin/watchdog.sh -t 100 -c -s amsd-amshelper /opt/amsd/bin/amshelper
2020-08-30T08:55:22Z daemon-amsd-amshelper: [1051342] Begin '/opt/amsd/bin/amshelper', min-uptime = 60, max-quick-failures = 5, max-total-failures = 100,
2020-08-30T08:55:22Z daemon-amsd-amshelper: Executing '/opt/amsd/bin/amshelper'
2020-08-30T08:55:22Z daemon-amsd-amshelper: saved 1051342 1051349 in /var/run/vmware/daemon-amsd-amshelper.pid
2020-08-30T08:55:22Z daemon-amsd-amshelper: returned from wait for PID 1051349 with exit status 0
2020-08-30T08:55:22Z daemon-amsd-amshelper: not restarting due to exit status 0
2020-08-30T08:55:32Z daemon-amsd-amshelper: Unable to verify amsd-amshelper started after 10 seconds
2020-08-30T08:55:32Z daemon-amsd-ahslogger: daemonizing setsid /usr/lib/vmware/daemonMgmt/bin/watchdog.sh -t 100 -c -s amsd-ahslogger /opt/amsd/bin/ahslogger
2020-08-30T08:55:32Z daemon-amsd-ahslogger: [1051384] Begin '/opt/amsd/bin/ahslogger', min-uptime = 60, max-quick-failures = 5, max-total-failures = 100,
2020-08-30T08:55:32Z daemon-amsd-ahslogger: Executing '/opt/amsd/bin/ahslogger'
2020-08-30T08:55:32Z daemon-amsd-ahslogger: saved 1051384 1051391 in /var/run/vmware/daemon-amsd-ahslogger.pid
2020-08-30T08:55:32Z daemon-amsd-ahslogger: returned from wait for PID 1051391 with exit status 0
2020-08-30T08:55:32Z daemon-amsd-ahslogger: not restarting due to exit status 0
2020-08-30T08:55:42Z daemon-amsd-ahslogger: Unable to verify amsd-ahslogger started after 10 seconds
2020-08-30T08:55:42Z daemon-amsd-smarev: daemonizing setsid /usr/lib/vmware/daemonMgmt/bin/watchdog.sh -t 100 -n -s amsd-smarev /opt/amsd/bin/smarev
2020-08-30T08:55:42Z daemon-amsd-smarev: [1051425] Begin '/opt/amsd/bin/smarev', min-uptime = 60, max-quick-failures = 5, max-total-failures = 100,
2020-08-30T08:55:42Z daemon-amsd-smarev: Executing '/opt/amsd/bin/smarev'
2020-08-30T08:55:42Z daemon-amsd-smarev: saved 1051425 1051432 in /var/run/vmware/daemon-amsd-smarev.pid
2020-08-30T08:55:42Z daemon-amsd-smarev: returned from wait for PID 1051432 with exit status 0
2020-08-30T08:55:52Z daemon-amsd-smarev: Unable to verify amsd-smarev started after 10 seconds

[SanjeevGoyal]

Hello,

I would suggest you try the below steps.

As a workaround, remove the Agentless Management Service (AMS) performing the following steps:

Steps to Uninstall AMS: ESXi 7.x

1. Stop AMS Service: # ./etc/init.d/amsd stop
2. Starting with ESXi 7.x, the vib commands should not be used. Instead, use the official "component" commands:
   • To uninstall component: esxcli software component remove -n <componentName>
     • # 7.0 AMS componentName is "amsdComponent".
     • # This ESXi 7.x component (formerly known as ESXi 6.x offline bundle) includes both amsd vib and amscli vib. Removing the component will remove both vibs.
3. Reboot

Please let me know the further assistance.

If you feel this was helpful please click the KUDOS! thumb below!   

Regards,