New ML350 Gen 10 server - unusable iLO and fan speed problem

[Karina31]

Hi,

we recently (10 days ago) bought a new ML 350 Gen 10 server. After 1 day of use iLO stopped working and it started to show a lot of errors during POST: 

- 329 Power Management Controller Firmware Error

- 270 iLO FW Communication Issue

- 312 HP Smart Storage Battery X Failure

- 338 HPE RESTful API Error

After some hours, the fans start to spin at maximum speed making it so noisy that we have to shut it down. A case with HP was opened (after all possible firmware updates and tests) but now they tell me that parts that need to be replaced are not available and we have to wait. Now, iLO not working is for now not urgent, but fan speed is, as the only way to make them be quiet is to power off the server, unplug power, wait 5 minutes, and then reboot... besides leave it off at night. HIgh speed fan is 99% due to 312 HP Smart Storage Battery error as with an older ProLiant Gen 9 with a similar problem, unplugging the battery solved high speed fan issue but in this case, I would avoid unplugging it...How is possible that still there isn't a utility to easily  control/change fan speed from Windows/SSH/PowerShell or anything else? What else we can do while we wait for HP technician?

Thank you

[BPSingh]

Greetings!

I trust that the server has been updated with the latest SPP (Service Pack for ProLiant).

It's important to note that adjusting the fan speed directly from the operating system is not possible. However, you can modify the thermal configuration from the BIOS settings. If you haven't configured it yet, I recommend setting it to "Optimal Cooling" and verifying the performance.

For instructions on how to change the thermal configuration in the BIOS, you can refer to the following link: https://techlibrary.hpe.com/docs/iss/proliant-gen10-uefi/s_select_thermal_config.html

In case the issue persists, it is advisable to replace any faulty hardware to ensure the optimal performance and overall health of the server. 

Support team would be able to guide you in a better way as they have access to the server logs and additional information, which can be invaluable in diagnosing and resolving issues effectively. 

[thutchings]

Hello,

I am not convinced you will be able to change the fan speeds to operate as expected while the iLO is in this state. Generally, the iLO talks to the components in the server in order to adjust the fan speed based on the thermal readings it has. In this case, the iLO is having trouble talking to anything. The errors during POST indicate that the communication between the BIOS and the iLO is not working. 

I think you should be able to address the overall problem here (iLO communication issue) by pulling the CMOS battery, waiting approx 20 minutes, putting it back in and powering the server on. Obviously, this is something you would need to be comfortable with also.

Regards

[Karina31]

Hello @BPSingh , @thutchings !

Thank you for your replies. Eventually HPE change the whole motherboard as it was probably faulty. Strange thing is that it work for a while (1 day) after latest SPP was applied. I didn't try to pull the CMOS battery off but I'll keep in mind this suggestion so if i will happen again (I hope never) I'll try.

Thank you

Kari

[Jay32]

Hi All

I'd like to share my experience and how I was bale to resolve it .

I had the same sympthoms (High spped fan and not booting up)  after applying 2024.11.00.00 GEN 10 SPP .Removing the CMOS battey did not help. 

I was able to resolve the issue by:

1-Downgrading ilo from 3.09 to 2.3 (the previously installed version on server).

2-Clearing NVRAM by following the steps in NVRAM reset on HPE ProLiant Gen9/Gen10 Server - Hardware - Spiceworks Community.

Here are the steps from above foroum in case the link is not available : 

1-Power down the server
2-Remove the server from rack (if needed)
3-remove the access panel.
4-change position S6 of the system maintenance switch to on.

Note: Please refer to System board components | HPE ProLiant ML350 Gen10 Server User Guide to locate System Maintenance switches on the board. (number 22)

5-install the access panel.
6-install the server in the rack and power on the server.
7-Wait for the POST message that prompts user to change the switch setting. (wait 5 minutes at least).
here is the message:
Maintenance switch detected in the "On" position. Power off the server and turn switch to the "Off" position.
8-Repeat steps 1 through 3.
9-Change position S6 of the system maintenance switch to OFF.
10-Repeat steps 5 and 6.

I only had to login to BIOS in next boot and update "Boot Order"  and Set the "Time Zone".