System Power Fault Detected (XR: 10 00 MID: FF 0F F0 00 00 FF 3F 0D 0D 04 04 0D 0D 0D 0D 0

[alpignolo]

My server DL580 g9 do not start anymore. I got from integrated management log:

Power 01/01/1970 00:01 08/21/2023 13:40 9 System Power Fault Detected (XR: 10 00 MID: FF 0F F0 00 00 FF 3F 0D 0D 04 04 0D 0D 0D 0D 06 06 06 06 06 06 06 06 06 06 06 06 06 06 06 06 06) 

Power 08/13/2023 11:08 08/13/2023 11:08 1 System Power Supply: General Failure (Power Supply 4)  

Power 08/13/2023 11:08 08/13/2023 11:08 1 System Power Supply: General Failure (Power Supply 1) 

Power 08/13/2023 11:07 08/13/2023 11:07 1 System Power Supply: General Failure (Power Supply 2) 

Power 08/13/2023 11:07 08/13/2023 11:06 1 System Power Supply: General Failure (Power Supply 3)

There is also smell of burning part, even if at a visual inspection everything seems ok. The led on the PSU units are all off.

It is possible that all 4 PSU failed at the same time? What your suggestions?

[Suman_1978]

Hi,

It could be the PSU or the backplane where the PSU will be plugged in.
Here are some docs and videos which may help you.

https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=a00027218en_us
https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=sf000048032en_us

Also if you have a spare PSU please try with that or even a different power cord.

Thank You!
I work with HPE but opinions expressed here are mine.
HPE Tech Tips videos on How To and Troubleshooting topics

[Vinky_99]

Hello @alpignolo 

Good day!

It does seem unusual for all four power supply units (PSUs) to fail simultaneously. However, it's not impossible for multiple PSUs to fail at once, especially if there was a power surge or some other electrical issue that affected the server.

You can try the below instructions:

>> If it smell burning, there might be a serious electrical issue. Turn off the power to the server and unplug it from the power source immediately to prevent further damage or potential hazards.

>> Carefully inspect the power supply units and other components for any signs of physical damage, such as burn marks, melted plastic, or loose connections. Pay close attention to the area where you detected the burning smell.

>> If it's safe to do so, you can try testing each power supply unit one by one. To do this, disconnect all power supplies except one, then attempt to power on the server. If it doesn't power on, try a different PSU, and so on. This can help determine if all four PSUs have indeed failed or if it's a different issue.

>> Power supply failures can sometimes be a symptom of another underlying hardware problem. Inspect other components, such as the motherboard, RAM, and CPU, for any visible damage or loose connections.

>> Ensure that the power source (e.g., the electrical outlet, PDU, or UPS) is functioning correctly. Sometimes, issues with the power source can mimic PSU failures.

>> You've provided some server log entries indicating power supply failures. Check if there are any additional logs or error messages that might provide more information about the issue.

>> In mission-critical environments, having redundant power supplies and other critical components can prevent downtime in the event of a failure. If you're able to resolve this issue, consider implementing redundancy for future stability.

>> If you're unable to identify and resolve the issue on your own, it's advisable to contact the support team for further assistance.

I hope this helps! Let me know..

[Tam92]

Hello,

We have a fix in iLO 2.78 firmware for this :

https://support.hpe.com/connect/s/softwaredetails?language=en_US&softwareId=MTX_a9ec0cf26b8c4f0e9ddd4d3f67&tab=revisionHistory

If this does not fix, please log a case with HPE to identify if it is a hardware fault.

Thanks,
TAM

[alpignolo · Accepted solution]

I found the problem, it was the memory riser that is burned and it has taken with him a ram module. PSU's and relative power chains seem to be all ok now.

What is mysterious to me is what could be the root cause, RAM hardware failure is not so common as far as I know. Any suggestion in order to avoid in the future the same problem?

[Tam92]

Hello,

The one common reason could be a power surge. It can occur either from the power source or any of the components in the server.

Make sure all the components are properly seated and the cables are connected firmly. 

Thanks,

TAM