DL360Gen10 system ROM/BIOS update

[Jiri3]

Hi guys,

I succesfully installed HPE server one year ago.  Default system ROM version was  U32 v2.02.  Subsequently  updates 2.10 to 2.16 worked perfectly by ILO Update Firmware utility . So last version i have today.. ILO5 is version 2.16.

But updates to 2.20 or 2.22 or 2.34 without success.  ILO show message: 
"The last attempt to update or upload firmware was not successful. Make sure you are using a valid, signed flash file and try again. If you are attempting to install a component, first upload it to the iLO Repository then add it to the Installation Queue."

So, I tried IloRest by fwpkg U32 v2.22 successfully. But after server reboot I have only version 2.16 again.

Table ILO Information shows:
System ROM U32 v2.16
Redundant System ROM U32 v2.22

Table ILO Firmware&OS Software shows:
System ROM U32 v2.16
Redundant System ROM U32 v2.10

Could me to say, where is version U32 v2.22 after reboot?  Or what is current and redundant/swapped version?

Thanks  Jiri

[BPSingh]

Hello Jiri,

Greetings!

The current and redundant ROM information can be checked from iLO under Information-iLO Overview page.

If you find the system ROM still not updated, please perform an iLO reset from Information-Diagnostics page and re-attempt the flash process using "Update Firmware" option in iLO.

Have you also tried flashing the BIOS from Operating System?

Regards,
Bhupendra

[Jiri3]

Hallo Bhupendra,

thank you very much for your respond.

I tried again:
- reset ILO and update to new version 2.18 at the same time,
- try flash process using "Update Firmware":
files U32_2.22_11_13_2019.signed.flash and also U32_2.34_04_08_2020.signed.flash
- result the same Message: "The last attempt to update or upload firmware was not successful...."

Please, let me know what is mentioned by you "flashing from Operating System"?
It is (putty) connection, for example "ssh 16.1.15.1"?
and command "load /system1/... -source http://16.1.15.2/..."

Unfortunately I do not know the exact syntax for this utility...

Regards

Jiri

[BPSingh]

Hello Jiri,

Greetings!

What Operating system is the host running?

1. Please update the HPE Innovation Engine Firmware (if not updated) from iLO web browser. You can verify the current firmware version from firmware tab in iLO.

Download link: https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_641abebae642483b823c2dcc23&swEnvOid=4168#tab2 

If IE version is 0.1.4.4 (or later) please use flash file IEGen10_0.2.2.0.signed.bin

IE version 0.1.3.2 (or earlier)then use IEGen10_0.2.2.0B.signed.bin

Reboot Requirement: Reboot is required after installation for updates to take effect and hardware stability to be maintained.

2. Also please update the iLO firmware to latest before re-attempting BIOS update from iLO interface.

Regards,
Bhupendra

[Jiri3]

Hello Bhupendra,

our host server Operating System is linux, debian/buster.

Regards

Jiri

[BPSingh · Accepted solution]

Hello Jiri,

Greetings!

May I know if you had performed the steps/workaround shared in the my previous update?

If you continue to see the same issue, please download online version of system ROM as per OS flavour installed and attempt to flash the BIOS. Installation steps are mentioned on the download link itself.

https://support.hpe.com/hpesc/public/km/product/1010093150/HPE-ProLiant-DL360-Gen10-Server-Models?ismnp=0&l5oid=1010007891#t=DriversandSoftware&sort=relevancy&layout=table&numberOfResults=25&hpe=1

[Jiri3]

Hallo Bhupendra,

thank you for your respond.

I understand that two steps are needed:
1. Update the HPE_Innovation_Engine_Firmware to 0.2.2.0 from ILO_web browser
2A. Update system ROM on U32_2.34_04_08_2020.signed.flash from ILO_web browser
OR
2B. Update system ROM on U32_2.34_04_08_2020.signed.flash from POST, -> F9 -> System Utilities....

This requires shutting down the respective reboot server. Unfortunately,  we operate our server in a continuous
7x24 service and we must announce a service break at least two weeks in advance. So I assume I will be able
to try out the recommended steps in early August.

Thank you very much for your help and time.

Jiri

[BPSingh]

Hello Jiri,

Greetings!

Please follow the blow in sequence.

1. Update iLo firmware from iLo web interface (server re-boot not required) and re-attempt to flash BIOS from iLO.

2. If issue persists, please update HPE Innovation Engine Firmware (if not updated) from iLO web browser and then try to flash BIOS update from iLO interface.

Note: Reboot is required after installation for HPE Innovation Engine Firmware updates to take effect and hardware stability to be maintained.

3. Please try to update system ROM from iLO rest as mentioned under installation instruction no below link.

https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_ee6001463ecb4ffc8544070363#tab1

4. If you are still unable to flash BIOS from iLO interface and iLO reset from above steps. Then please attempt to update system ROM online from the operating system level. Do no see online ROM update option for Debian/Ubuntu, please check if you can use another lInux flavour file like RHEL, CentOS etc.

https://support.hpe.com/hpesc/public/km/product/1010093150/HPE-ProLiant-DL360-Gen10-Server-Models?ismnp=0&l5oid=1010007891#t=DriversandSoftware&sort=relevancy&layout=table&numberOfResults=25&hpe=1

5. Another option is to use Gen10 Service Pack for ProLiant (SPP) ISO which is 2.32 ROM version for DL360 Gen10. You can boot from the ISO and perform the update.

https://techlibrary.hpe.com/us/en/enterprise/servers/products/service_pack/spp/index.aspx#!&tab=TAB1

6. If any assistance required with ROM update during the downtime, please reach us by selecting any of the options under "Contact Support" on the web-link below.

https://support.hpe.com/hpesc/public/home

[Jiri3]

Hallo Bhupendra,

my report after downtime:

First, I found out via the POST screen that the backup ROM had already been updated to the newest release 2.34.
POST shows this:
System ROM U32 2.16
Redundant System ROM U32 2.34
Apparently this is the result of my previous attempts. A month ago, I successfully uploaded this version 2.34
and even then I saw that it would not turn into current.

Then I went to update:
ILO firmware updated and reset to newest version 2.18 - success
Innovation Engine updated to newest version 0.2.2.0 - success
Server Platform Service updated to newest version 4.1.4.339 - success
Firmware information see image below.

Restart the server and then:
Flash BIOS update via ILO web browser - unsuccessful
Flash BIOS update via ILOrest - unsuccessful
Flash BIOS update via SPP - unsuccessful

So I think that the BIOS update works, but only on the backup ROM and will not allow it to be
overwritten same version or does the switch backup to curent after flash not work? The update
process failed in the flash phase, there will be no reboot yet.

My questions:
- Is there any way to safely overwrite the existing backup ROM?
- Would it be possible to downgrade - to version 2.16, ie the same as on the current ROM and then again to update?
- How would the update behave in POST - F9 - Embedded Applications - Firmware update?
- Would it be possible to manually try to switch the backup/current ROM in RBSU?

BTW:
I'm trying to look for errors in some log, but I can't open the AHS log. Viewer writes a message:
Error: File was not able to be processed as SMBIOS type 0 records are not found.

Thank you very much for your help.

Jiri

[BPSingh]

Hello Jiri, 

Thank you for the update.

I understand that the backup ROM got updated to 2.34.

In that case, please toggle the system ROM from iLO.

Replacing the active system ROM with the redundant system ROM Page#92

https://itpfdoc.hitachi.co.jp/manuals/ha8000v/hard/Gen10/iLO/880740-002a_en.pdf

You may refer Integrated Management logs to check if any errors are getting logged. If you want to have the AHS logs analysed then I would advise you to open a support ticket.

- Is there any way to safely overwrite the existing backup ROM?
Updating BIOS should update the primary ROM automatically.
- Would it be possible to downgrade - to version 2.16, ie the same as on the current ROM and then again to update?
Yes, we can swap ROM and downgrad but again it is not recommended. Instead make the latest ROM as primary.
- How would the update behave in POST - F9 - Embedded Applications - Firmware update?

Updating the firmware from the UEFI Embedded Shell

Procedure:

Access the System ROM Flash Binary component for your server from the Hewlett Packard Enterprise Support Center (https://www.hpe.com/support/hpesc).
When searching for the component, always select OS Independent to locate the binary file.
Copy the binary file to a USB media or iLO virtual media.
Attach the media to the server.
Boot to the UEFI Embedded Shell.
To obtain the assigned file system volume for the USB key, enter map –r.
Change to the file system that contains the System ROM Flash Binary component for your server. Enter one of the fsx file systems available, such as fs0: or fs1:, and press Enter.
Use the cd command to change from the current directory to the directory that contains the binary file.
Flash the system ROM by entering fwupdate –d BIOS -f filename.
Reboot the server. A reboot is required after the firmware update in order for the updates to take effect and for hardware stability to be maintained.

- Would it be possible to manually try to switch the backup/current ROM in RBSU?
You can swap from iLO as shared above.

[Moderator edit: Updated the broken link.]