SPP Gen10 2022.09.01.00 fails to import into iLO Amplifier 2.14

[aireynol]

SPP Gen10 2022.09.01.00 is failing to import into iLO Amplifier 2.14 with error:

Import Firmware Baseline job failed because iLO Amplifier failed to upload ISO. Contact HPE support. Details for support: Unable to find the error description in catalog file..

[UdoErdelhoff]

Same problem here on two different Amplifier installations.  Double-checked that the checksum match, rebooted the Amplifier instances before attempting to import, deleted all old baselines before importing, no joy.  Downloaded the support bundle from the appliance and went on a search through the log files. This showed that the SPP ID is ea469b39ed5106434169397999e816bf, and search for that ID in the log files eventually shows the following in ./opt/reposerver/logs/celery/w1-1.log:

[2022-10-05 08:36:24,241: WARNING/ForkPoolWorker-1] manifest.json with installation dependency /mnt/ea469b39ed5106434169397999e816bf/manifest/manifest.json
[2022-10-05 08:36:24,241: WARNING/ForkPoolWorker-1] Adding comp location to mjson
[2022-10-05 08:36:24,304: WARNING/ForkPoolWorker-1] Creating rssppea469b39ed5106434169397999e816bf table
[2022-10-05 08:36:24,330: WARNING/ForkPoolWorker-1] Adding manifest information to database
[2022-10-05 08:36:25,851: WARNING/ForkPoolWorker-1] zip is HPE-703.0.0.10.10.0.10-Sep2022-Addon-depot.zip
[2022-10-05 08:36:25,851: WARNING/ForkPoolWorker-1] addon path is -- /opt/wolfram/baselines/SPPs/ea469b39ed5106434169397999e816bf/vmw/HPE-703.0.0.10.10.0.10-Sep2022-Addon-depot
[2022-10-05 08:36:25,990: WARNING/ForkPoolWorker-1] General error - [Errno 2] No such file or directory: '/opt/wolfram/baselines/SPPs/ea469b39ed5106434169397999e816bf/vmw/HPE-703.0.0.10.10.0.10-Sep2022-Addon-depot/metadata.zip'
[2022-10-05 08:36:25,999: WARNING/ForkPoolWorker-1] num docs 1
[2022-10-05 08:36:26,069: INFO/ForkPoolWorker-1] Deleted /mnt/ea469b39ed5106434169397999e816bf

Mounting the ISO file shows that there is a file named "HPE-703.0.0.10.10.0.10-Sep2022-Addon-depot.zip", but it is in /manifest/vmw/ rather than /vmw/, so my guess is that HPE needs to re-roll this SPP.

In short, epic fail of HPE quality control.

[Torsten.]

May I ask from where you get this SPP?

[aireynol]

https://support.hpe.com/connect/s/softwaredetails?softwareId=MTX_7d8ee25ee8fe4031b47179d44c

[Christian664]

Any solution yet?

[aireynol]

Not as far as I can tell.

And to throw more salt on the wound the first two nodes that I installed this SPP on are now bricked, not even able to get into bios

IML error is: X64 Exception Type 0x0 (Divide By Zero Exception) occurred during the previous boot. Image name: Unknown

Platform is DL385 Gen10 Plus V2, I've opened a support case for that issue.

Edit: if anyone is curious about the DL385 RSOD, we tracked this down to an issue with the 5.32 smart array controller firmware and the AMD DMA Remapping feature which is part of the Secured Core feature set.

[Stupots]

I've read enough to avoid this for now, Amplifier is flaky at the best of times.

At least HPE have great hardware.

[Christian664]

Hi again

I edited the ISO file. Under manifest\vmw there is two zip-files HPE-703.0.0.10.10.0.10-Sep2022-Addon-depot.zip and HPE-800.0.0.10.10.0.24-Sep2022-Addon-depot.zip. In those files there should be a metadata.zip file but they are missing. Instead there is a HPE-703.0.0.10.10.0.10-Sep2022-metadata.zip and HPE-800.0.0.10.10.0.24-Sep2022-metadata.zip. If you copy those files to metadata.zip and put them in the same directory the import will succed

[Christian664]

Well, evendough the import was successfull it is not working as expected

[Fr3D]

Bonjour,

Here is the L2 answer :

Latest SPP 2022 09 is new format and will be supported in upcoming AMP v2.16
This issue will fix in ILO AMP v2.16 Approx.
ETA is end of OCT will release

Regards,

Frederic

[pirx]

Why does everything I have to use to manage HPE server suck so much?! ILO Amp was never really working in my environement and my POC with OneView and OV4VC doesen't look much better. Current OV4VC doesn't support the new format either, there should be an update in November.

Hey HPE, what about fixing stuff first before throwing it at customers?!

[Felix_P]

---

@Fr3D  schrieb:

Bonjour,

Here is the L2 answer :

Latest SPP 2022 09 is new format and will be supported in upcoming AMP v2.16
This issue will fix in ILO AMP v2.16 Approx.
ETA is end of OCT will release

Regards,

Frederic

---

Since there are only 3 days left I doubt it and after wasting half a day installing iLO Amplifier Pack and troubleshooting I am a bit pissed right now.

[Stupots · Accepted solution]

Forced a check this morning....

"New version of iLO Amplifier Pack is available for update. Please click on Details for more information."

iLO Amplifier v2.16 Build Number: 10 Release Date: October 13, 2022 What's New!

• 4-Octet SPP Support (such as 2022.09.01.00).
• Appliance OS Updates.

Issues Resolved

• Fixed an issue where iLO Amplifier pack does not update the hard drive firmware during a firmware update.
• Provided a fix to avoid rare unauthorized login attempts observer in the HPE iLO Event Log.
• Fixed an issue where HPE iLO Amplifier pack fails to install CP050331.zip on SPP V2022.03.0 due to adependency check when called from vLCM.

I'll give it a whirl!

[Fr3D]

my iLO Amplifier Pack did no see the update.

I tried a manual upgrade with the update binary and the process is stuck at 23%

at now I can not login...

I am starting a new 2.16 VM install...

[Stupots]

No issues for me. The update installed via the Amplifier update page and 2022.09.01.00 SPP imported fine in Amplifier and I've successfully added it in HSM in our vCenter.

(I took a VM snapshot of the appliance before of course)

[Christian664]

Work fine for me also

[Fr3D]

So I was unlucky

And now I have another problem, I had to unregister my servers in remote support, and now I am not able to register 'Remote Support Registration Error.'

I was able to upgrade iLO on my servers but other updates are in pending state in the installation queue

and will starts 'Immediately after the associated updater checks' or 'After previous tasks are executed' but noting appends

[pirx]

I was able to update ILO-A to version 2.16 and import latest SPP P52581_001_gen10spp-2022.09.01.00-SPP2022090100.2022_0930.1.iso. In vCenter I then see in HSM settings that the new SPP is available.

Available SPPs                                Version               Supported ESXi Versions    Online Software Depot
Gen10 Service Pack for ProLiant   2022.03.1            6.5,6.7,7.0,6.0                          Added
Gen10 Service Pack for ProLiant   2022.09.01.00    6.7,7.0,6.5,6.0,8.0                    Added

But if I then want to create a new update image, I get below error I did not get with 2022.03

Invalid hardware support spec specified in the draft.
Failed to fetch component information for hardware support package Gen10 Service Pack for ProLiant in the depot
Manifest with Hardware Support Manager com.hpe.vlcmhsm and Hardware Support Package Gen10 Service Pack for ProLiant version SPP-2022.09.01.00.703 cannot be found in depot.

vLCM shows SPP source as connected, vCenter has internet connection.

https://10.11.0.55/baselines/SPPs/ea469b39ed5106434169397999e816bf/vmw/HPE-703.0.0.10.10.0.10-Sep2022-Addon-depot/index.xml

Any ideas?

[Stupots]

I'm not sure @pirx mine validated fine, so I don't think Amplifier or the SPP is at fault.

• ESXi Version 7.0 U3g - 20328353
• Vendor Addon  HPE Customization for HPE Servers 703.0.0.10.9.1-5
• Firmware and Drivers Addon  Gen10 Service Pack for ProLiant SPP-2022.09.01.00.703
• Components  1 additional components

[pirx]

But above configuration is not supported by HPE anyway with vLCM. There is no U3g in the matrix.

Valid-vLCM-Combos.pdf (hpe.com)

[Stupots]

I see. Well, let's assume that out of date document doesn't state that it is supprted.

I'm remediating a host now, so I'll let you know if the world ends.

[Felix_P]

---

@pirx  schrieb:

I was able to update ILO-A to version 2.16 and import latest SPP P52581_001_gen10spp-2022.09.01.00-SPP2022090100.2022_0930.1.iso. In vCenter I then see in HSM settings that the new SPP is available.

Available SPPs                                Version               Supported ESXi Versions    Online Software Depot
Gen10 Service Pack for ProLiant   2022.03.1            6.5,6.7,7.0,6.0                          Added
Gen10 Service Pack for ProLiant   2022.09.01.00    6.7,7.0,6.5,6.0,8.0                    Added

But if I then want to create a new update image, I get below error I did not get with 2022.03

Invalid hardware support spec specified in the draft.
Failed to fetch component information for hardware support package Gen10 Service Pack for ProLiant in the depot
Manifest with Hardware Support Manager com.hpe.vlcmhsm and Hardware Support Package Gen10 Service Pack for ProLiant version SPP-2022.09.01.00.703 cannot be found in depot.

Any ideas?

---

Did you import the Ilo Amplifier Pack certificate in your vCenter? 

Had the same issue and that fixed it. 

[pirx]

Does the certificate change with 2.16 update? I didn't habe this error with 2022.09 SPP before, but now after updating ILO-A I also get "Manifest with Hardware Support Manager com.hpe.vlcmhsm and Hardware Support Package Gen10 Service Pack for ProLiant version SPP-2022.03.1 cannot be found in depot."

Edit: seems not, It's still the old cert 25. August 2022 um 07:29:56

[Stupots]

"SPP-2022.09.01.00.703 cannot be found in depot" or "SPP-2022.03.1 cannot be found in depot"? You state both seperatly?

I'd be tempted to remove them in VLC and un-add from HSM, clear out the ILO depot and then republish them to vSphere

[pirx]

Both, depdending on what I use in the image configuration. The one with 2022.03 worked this morning in a call with VMware. I'll try cleaning up everything. But looking at other threads in this community, I'm not the only one with this issue.

Edit: after removing everything from vCenter and ILO Amplifier I only added the 2022.09 SPP and get no error.