DL380e Gen8 - Failing fan then power error System Power Fault Detected [error code]

[NetEn]

Hello,

I have an issue with a DL380e Gen8 server. The server was running fine (as they tend to do) and then suddenly died due to one fan failing (insufficient amount of fans to boot, currently 4 installed). I replaced the fan (error cleared), the server booted once and rebooted, and now the error LED is blinking red, and ILO is showing this error:

System Power Fault Detected (XR: 20 00 MID: FF 3D AE 29 F9 F0 00 10 10 00 40 3F 04 00 00 00 96 00 F0 0F F0 43 00 00 00 00 00 00 00 00 00 00)


Can someone help and decode it?

I already tried reseating PSU/moving to another slot, juggling with fans in slots , replaced CMOS battery, disconnected drives, it didn't help. After a few attempts the server "partially" started and fans were running on max speed but there was no video output in iLO and the server seemed to be stuck in POST. (status LED on the PSU went to green, but the error LED on the front was still flashing red)

I HAVEN'T tried another PSU yet, but google results seem to indicate more serious issues (I hope not).

It's a single CPU, single PSU sever.

ProLiant DL380e Gen8
Product ID: 668667-421
System ROM: P73 05/24/2019
System ROM Date: 05/24/2019
Backup System ROM: P73 02/10/2014
Also iLO logs indicate some time-keeping plus REST API memory cleared (?) issues (but I already replaced the CMOS battery today as part of troubleshooting)

10/20/2021 17:16 10/20/2021 17:16 1 On-board clock set; was previously [NOT SET].
[NOT SET] [NOT SET] 1 APO: System configured to always remain off after power is restored.
[NOT SET] [NOT SET] 1 Power restored to iLO.
10/20/2021 17:17 10/20/2021 17:12 2 REST API Warning: REST API memory cleared (SCHEMA_PROV_ID master storage file set to default. Reboot system.).
10/20/2021 17:17 10/20/2021 17:12 2 Embedded Flash/SD-CARD: Embedded media initialization failed due to media write-verify test failure.
10/20/2021 17:11 10/20/2021 17:11 1 On-board clock set; was previously [NOT SET].
[NOT SET] [NOT SET] 1 APO: System configured to always remain off after power is restored.
[NOT SET] [NOT SET] 1 Power restored to iLO.
[NOT SET] [NOT SET] 2 iLO network link up at 1000 Mbps.
10/20/2021 17:09 10/20/2021 17:09 1 Server power removed.
10/20/2021 17:51 10/20/2021 17:07 1 iLO clock has been synchronized with 217.114.59.3.

Any ideas? I hope you can help, it is (was?) a great server and I was really hoping that it can be used for the next 6 months or so.

[SanjeevGoyal]

Hello,

Issue due to faulty SAS backplane.
I would suggest you replace the SAS backplane.

If you feel this was helpful please click the KUDOS! thumb below and accept the solution.
Regards,

[sudhirsingh]

@NetEn 

Seems like Primary riser (riser1) or SAS backplane issue. 

Incase does not work after removing the SAS backplane, remove the Primary riser and check the status,

Regards,

Sudhir