BladeSystem - General
1747993 Members
4993 Online
108756 Solutions
New Discussion юеВ

Re: ILO5 Firmware update for Gen10 Blades via Onboard Admistrator

 

ILO5 Firmware update for Gen10 Blades via Onboard Admistrator

So, trying to mass update ILO5 on Gen10 Blades on a C7000 chassis using the UPDATE command from my Onboard Administrators running v4.80.  Haven't tried this with Gen10s before, been doing it for years with previous versions.

update ilo all http://<URL>/ilo5_120.bin

Previous versions are still working great.  However, when I tried the above command to update all Gen10 Blades, my Onboard Administrator crashed and rebooted.  Wondering if anyone has tried this before and is seeing the same issue?  Looks like the OA ran out of memory from the logs:

Apr  5 14:39:52  OA: Proliant iLO firmware update attempted by user
Apr  5 14:43:24  Kernel: Out of Memory: Kill process 26164 (sshd) score 4315 and children.
Apr  5 14:43:24  Kernel: Out of memory: Killed process 26165 (cli).
Apr  5 14:43:58  OA: System Out Of Memory
Apr  5 14:46:13  OA: Onboard Administrator is rebooting

ILO5 Firmware is double the size of ILO4 (32MB vs 16MB), so I'm guessing that contributed.  Just wondering if this is a supported operation.  I'm not seeing anything that says it's not.  I don't have a ton of Gen10 Servers, but I would prefer to not have to update those individually if I have to...

5 REPLIES 5
Suvamay
HPE Pro

Re: ILO5 Firmware update for Gen10 Blades via Onboard Admistrator

Wait for next release of OA firmware. To validate more on this you can log a support ticket with HPE.

I'm an HPE employee.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
Accept or Kudo
ouzo12
Occasional Advisor

Re: ILO5 Firmware update for Gen10 Blades via Onboard Admistrator

It is now 2020 and I am using OA 4.85 and the problem still occurs.

The OA rebooted itself after running out of memory. To be sure it wasn't a one-off, I tried again. Sure enough, it restarted itself again.

I have done this operation countless times successfully with iLO2 and earlier releases of OA.

Apr 9 10:33:32 OA: Proliant iLO firmware update attempted by user Administrator
Apr 9 10:39:05 Kernel: Out of Memory: Kill process 1112 (httpd2) score 5476 and children.
Apr 9 10:39:05 Kernel: Out of memory: Killed process 1113 (dvd.iso).
Apr 9 10:39:05 Kernel: Out of memory: Killed process 1122 (dvd.iso).
Apr 9 10:39:05 Kernel: Out of memory: Killed process 1123 (dvd.iso).
Apr 9 10:39:37 OA: System Out Of Memory
Apr 9 10:39:50 Kernel: Out of Memory: Kill process 1112 (httpd2) score 5128 and children.
Apr 9 10:39:50 Kernel: Out of memory: Killed process 1129 (dvd.iso).
Apr 9 10:39:50 Kernel: Out of memory: Killed process 1130 (dvd.iso).
Apr 9 10:39:50 Kernel: Out of memory: Killed process 1131 (dvd.iso).
Apr 9 10:40:44 Kernel: Out of Memory: Kill process 1112 (httpd2) score 5344 and children.
Apr 9 10:40:44 Kernel: Out of memory: Killed process 1139 (dvd.iso).
Apr 9 10:40:44 Kernel: Out of memory: Killed process 1140 (dvd.iso).
Apr 9 10:40:44 Kernel: Out of memory: Killed process 1141 (dvd.iso).
Apr 9 10:40:45 Kernel: Out of Memory: Kill process 1112 (httpd2) score 4388 and children.
Apr 9 10:40:45 Kernel: Out of memory: Killed process 1150 (dvd.iso).
Apr 9 10:40:45 Kernel: Out of memory: Killed process 1151 (dvd.iso).
Apr 9 10:40:45 Kernel: Out of memory: Killed process 1152 (dvd.iso).
Apr 9 10:40:45 Kernel: Out of Memory: Kill process 5906 (httpd2) score 3922 and children.
Apr 9 10:40:46 Kernel: Out of memory: Killed process 6508 (hpoa).
Apr 9 10:41:45 Kernel: Out of Memory: Kill process 1112 (httpd2) score 5464 and children.
Apr 9 10:41:45 Kernel: Out of memory: Killed process 6619 (dvd.iso).
Apr 9 10:41:37 OA: SEGV /ramdisk/lcd/menu (pid=104) Address accessed 0x8. IP=0x300f98ec,Link=0x300f98e4
Apr 9 10:42:29 OA: Function callback 0x300f98e4 0x300f98e4 0x30854450 0x10009b08
Apr 9 10:42:32 Kernel: Out of Memory: Kill process 1112 (httpd2) score 5338 and children.
Apr 9 10:42:32 Kernel: Out of memory: Killed process 6692 (dvd.iso).

sudhirsingh
HPE Pro

Re: ILO5 Firmware update for Gen10 Blades via Onboard Admistrator

Hi @Jonathan Schroeber@ouzo12 

This seems like a concurrent update limitation of OA.

Based on my understanding firmware update is two step process:

  1. Downloading the image, and
  2. Flashing the image.

While doing firmware update for multiple blades OA will attempt to download firmware for a blade while another download is in progress so there are chances that it may fail since it download the same file everytime before first download complete.

However you can try following:

1. Check if individual blade ilo update works:

e.g:

OA1> update ilo 1 http://<URL>/ilo5_120.bin

OA1> update ilo 2 http://<URL>/ilo5_120.bin

2. Instead of ALL try 4-5 blades at a time.

e.g:

OA1> update ilo 1,2,3,4 http://<URL>/ilo5_120.bin

3 . Update OA to 4.95 (latest firmware) and check.

https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_b9c6229f881e45f19089d17115#tab-history

 

If you feel this was helpful please click the KUDOS! thumb below!

Regards,

Sudhir

While I am an HPE Employee, all of my comments (whether noted or not), are my own and are not any official representation of the company

>Accept or Kudo

ouzo12
Occasional Advisor

Re: ILO5 Firmware update for Gen10 Blades via Onboard Admistrator

Hi,

I tried 4 BL460s only and it still died. And because of change management, I cannot just upgrade the OA. Neither do I have time to muck about trying different versions etc. This should just work, like it did in the past.

In the end, I updated the BL460s from their iLO pages one by one. Disappointing.

Regards,

sudhirsingh
HPE Pro

Re: ILO5 Firmware update for Gen10 Blades via Onboard Admistrator

Hi,

Certainly it should work, future firmware should fix it.

However,

I believe you should raise a support case with HPE to investigate this issue.

Regards,

Sudhir

 

While I am an HPE Employee, all of my comments (whether noted or not), are my own and are not any official representation of the company

>Accept or Kudo