ML350 Gen11 won't turn on following HPE Flexible Slot Power Supply firmware update

[sdrake48]

After attempting firmware update (from v2.0 to v3.01) on HPE Flexible Slot Power Supplies(SKU:P38995-B21) in ML350 Gen11, server will no longer power on.  If remove/reconnect power, green power led blinks for 10-15 seconds, hard drive leds light up, network activity led under power led turns green, power led becomes solid green, then 2-3 seconds later power led turns yellow.  There is never any display on monitor.

Via ILO6 attempts to reflash the power supply firmware fails with error that there is a component failure that must be corrected first. But there is no info on what this component failure is.  Nothing in event log.  ILO6 power tab shows no power supplies detected.  This server has two 800W power supplies (redundant).  Replacing both power supplies with same power supplies from GL385 Gen11 doesn't help. Same problem.  It is not the power supplies.  

I opened a case with HP support and their first response is where do we send the new system board. 

Has anybody had success installing the v3.01 firmware update for gen11 800W redundant power supplies?  

I tried this first on my DL385 Gen11 and it only updated the fw (v2.0 --> v3.01) on one of the supplies, regardless of what slot it was in.

So I tried it on the ML350 Gen11 and killed it.

In case you're wondering, the only reason I am even trying this is because of an event log error showing a power supply failure on only 1 PS on the DL385 and a firmware update that supposedly addresses this error.  I performed the update using the downloaded fwpkg file and ILO6.

Also curious why this firmware is not in the 2024.09 Gen11 Service Pack.  

Is there really no way to recover from this?

[support_s]

System recommended content:

1. Compaq ProLiant ML350 Setup and Installation Guide

2. Compaq ProLiant ML350 Server General Troubleshooting Guide

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".

Thank you for being a HPE valuable community member.

[sdrake48]

Nothing in either document about what to do if ILO6 reports unspecified component error. Nothing about what to do if firmware update results in power on problem.

[BPSingh]

Greetings!

Are the power supply models across ML350 Gen11 and DL385 Gen11 same?

Since you've already logged a support case, I recommend allowing an onsite Field Engineer to visit and test the server in a minimal hardware configuration. This will isolate which component is causing the issue. If the issue remains the same even in minimum config, then the board can be replaced and checked. 

[support_s]

Hello,

Let us know if you were able to resolve the issue.

If you have no further query, and you are satisfied with the answer then kindly mark the topic as Solved so that it is helpful for all community members.

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".

Thank you for being a HPE valuable community member.

[sdrake48]

All 4 power supplies are identical:

HPE 800W FS Plat Hot Plug LH Power Supply P38995-B21

New system board arrived, replaced it, problem solved.  Sure would be nice to be told what failure analysis shows on the returned system board. Without this information there is no way to have any confidence that any future power supply firmware update will not cause the same problem.  Meanwhile, 3 of the 4 power supplies have v2.0 firmware and I will not be attempting any further firmware updates on them.

[sdrake48]

There is no solution.  The question to the forum was "has anybody successfully updated 800W power supply firmware version 3.01 using ILO6 without bricking their system board".   Still waiting for a response.

[sdrake48]

As there has been no response, it is likely that proliant power supply firmware updates are a rare thing.  The Service Pack (online or offline) will not inventory the power supply and does not flash it.  You have to go out of your way and use ILO fwupdpkg to do it.  The only reason I tried this (1st time I've every updated power supply firmware on any HP server (since 1997)), is a Support Document about an ILO Event Log power supply error.  I happened to be watching the ILO Event Log daily to confirm that an e208 firmware fix solved a MSA2060 logical drive disconnect problem that had been happening for months - up to 21 days between events - so I had to check the log for weeks to make sure the problem was solved (it is).   During this time, I saw the power supply error described in the Support Document and thought I'd give the solution a try (power supply firmware update).  The update worked on 1 of 2 power supplies in one server (ML350 Gen11) and bricked the system board on the other (DL385 Gen11).  Replacing the system board solved the DL385 issue, but with no failure analysis or update from HP I lack the confidence to ever try this again.  I was hoping to see a bunch of 'worked for me' responses, then I would feel better about trying this again in the future.  For now, the recommendation to our customers is to never flash the power supply firmware unless you don't need the server for 3 days and have an active warranty.