ILO 5 update triggered server reset

[pirx]

I've never had this before but today I updated a few servers to ILO 5 v3.10 (DL380Gen10+ server). One of them was immediately reset 5s after update was finished. Is there any "feature" that might have triggered this? A watchdog? 

Informational Browser login: _HPOneViewMonitor - 10.11.5.54(oneviewxxx). 01/29/2025 14:09:01
Informational Server power restored. 01/29/2025 14:07:13
Caution Server reset. 01/29/2025 14:07:13
Informational Server power removed. 01/29/2025 14:07:12
Caution Server reset. 01/29/2025 14:07:02
Informational Browser login: _HPOneViewMonitor - 10.11.5.54(oneviewxxx). 01/29/2025 14:06:50
Informational XML logout: _HPOneViewMonitor - 10.11.5.54(oneviewxxx). 01/29/2025 14:06:15
Informational XML login: _HPOneViewMonitor - 10.11.5.54(oneviewxxx). 01/29/2025 14:06:14
Informational iLO network link up at 1000 Mbps. 01/29/2025 14:05:56
Informational iLO was reset when the system is in POST. 01/29/2025 14:05:53
Caution iLO reset for Firmware upgrade. 01/29/2025 14:05:53
Informational Firmware upgraded to version 3.10. 01/29/2025 14:05:53
Informational Server power restored. 01/29/2025 14:05:23
Caution Server reset. 01/29/2025 14:05:23
Informational Firmware update success from WebGUI 01/29/2025 14:05:18
Informational XML logout: _HPOneViewMonitor - 10.11.5.54(oneviewxxx). 01/29/2025 14:05:00
Informational XML login: _HPOneViewMonitor - 10.11.5.54(oneviewxxx). 01/29/2025 14:05:00
Informational Browser login: _HPOneViewMonitor - 10.11.5.54(oneviewxxx). 01/29/2025 14:03:19
Informational Firmware upgrade started from: 10.1.0.91(DNS name not found). 01/29/2025 14:03:06

[support_s]

System recommended content:

1. HPE iLO 5 3.06 User Guide | iLO reboot (reset)

2. HPE iLO 5 3.06 User Guide | Rebooting (resetting) the iLO processor with the web interface

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".

Thank you for being a HPE valuable community member.

[pirx]

@support_s  finest AI generated bull....

[Rakesh0404]

 I'm sorry to hear about your concern, and I'd like to help you.

These are known issues that have been identified along with their resolutions:

1. Advisory - HPE Support Document
2. Advisory - HPE Support Document

Please review these links for detailed information and apply the recommended resolutions accordingly. Let me know if further assistance is required!

[pirx]

I'm not sure if the first advisory matches 100%. It's true that the update was performed from 3.05 -> 3.10. But I thought an ILO would reboot and not reset after update. From the advisory it sounds like the "Reset iLO" feature is triggering the reboot.  The advisory also does not mention that this can happen becasue of ILO update. The opposit, the advisory recommends to update to version 3.06 ASAP.

HPE issues this critical advisory to urge you not to perform a "reset iLO" when a server is powered on if running HPE Integrated Lights-Out 5 (iLO 5) firmware v3.05 or HPE iLO 6 firmware v1.60. 

The second advisory clearly has nothing to do with my issue as it's about an unexpected ILO reset and not an unexpected server reset...

So thanks for the tips, but they seem not to be the root cause. Still better than reply from support that claimed that a full server reset is expected after ILO update. I really wish to get one good answer from support each year, just one. That would be great.

[Rakesh0404]

Hi Pirx, 
Good day! 

As I understand, the server did not reset or reboot. By design, the iLO resets after a firmware update.

iLO reboot and iLO soft reset are the same process, which restarts the iLO management processor without affecting the server or its settings, and this happens automatically after a firmware update. In contrast, an iLO factory reset wipes all configurations and restores it to default settings, taking it back to square one.

If you encounter any issues or errors during the update, let us know, and we’ll be happy to assist.

[pirx]

I thought my initial post was pretty clear. The whole server was reset/restarted after ILO update (only ILO, no other firmware). All VMs and services were hard stopped because of this. I know that the ILO mgmt processor is reset/rebooted after update, but I've never had an unplanned server reset because of this.

Caution Server reset. 01/29/2025 14:05:23

From the advisory you posted....

Advisory: (Revision) HPE Integrated Lights-Out 5 (iLO 5) and iLO 6 - CRITICAL ADVISORY - Servers Running iLO 5 Firmware v3.05 or iLO 6 Firmware v1.60 May Experience Unplanned Server Outage After Initiating a "Reset iLO"

...Unplanned Server Outage After Initiating a "Reset iLO"

Please elaborate if the is for also true for "iLO resets after a firmware update", or if the advisory only describes the outcome after manually using the "Reset ILO" feature?

[Rakesh0404]

Hi Prix, 
I apologize for the confusion, with the shared message it is not clear on why was the reboot done or happened, are there any errors captured in the AHS logs or the OS logs. 
If the server has rebooted for the ILO firmware update, then we would have to investigate further on the logs, with OS logs what happened at that exact time. So we would request you to log a case in the Portal to diagnose further.
Link : https://support.hpe.com/connect/s/?language=en_US 

[pirx]

Case 5387612953 was opened last week, AHS logs were uploaded. Initial response was that an ILO update triggers a server reset/reboot, which is clearly wrong. From my experience with HPE support I guess this case will not get any useful result in the next 5-6 months.

[Rakesh0404]

Hi Pirx,

Thank you for sharing the Case ID 5387612953, We see the Concerned Level 2 team is working on this case. 
We will close this Community case for now.