DL 380 G9 High fan speed

[Mano Hernandez]

We just purchased 7 G9's and installed windows 2012. However one of them after about 20 minutes, the fans kick in really loud and just roar. They do not stop. a restart will fix it, but that's not the solution. It seems to me the issue started when I ran all of the Windows updates on this one machine. It's not in production yet, but it will be.

[Jimmy Vance]

Have you looked at the IML or iLO event logs?

[Webdoggie]

Was there a resolution on this item? I am seeing the same thing on my DL380 G9. High Fan speed with no entries in the logs that note any state changes.

Rather than reboot, connecting to the ILO and restarting it relieves the condition.

ILO is 2.40. System ROM is P89 v2.20 (6/2/2016). All system info is showing green checkmarks, even when the fans are running a full blast.

Power Management Controller is v1.0.9

Any resolution would be helpful. Have to restart the ILO about 1 or 2 times per day about every 4th or 5th day.

Thanks

Ron Eubank
PYRAMID

[Webdoggie]

Ach, nevermind....

http://h20565.www2.hpe.com/hpsc/doc/public/display?sp4ts.oid=7271241&docLocale=en_US&docId=emr_na-c05098585

The above link contains the solution. If web pages change, look for Document ID c05098585 Version 3,  

Advisory: (Revision) Certain ProLiant Gen8 and Gen9 Servers - Fans May Run at a High Speed After Updating The Adapter Firmware with Version 4.0.1.17 of the HPE Broadcom NX1 Online Firmware Upgrade Utility for Windows

~re

[ziasiddiqui]

I've faced the same issue when I purchased this server. It has something to do with the firmware upgrade as initially, I was not able to go to provisioning option. Get the latest firmware upgrade (i.e. 2.5 or 2.6) from enterprise support website and install it.

This will solve the issue.

[jonahgroup]

It doesn't solve the problem for me.

And unfortunately this server recently fell out of warranty status, so HP won't even fart in my general direction.

No errors in the health logs.  I've tried updating everything with SPP 2018.3, SPP 2017.10 and 2017.7, and the problem still won't go away.  It's been like this for almost a week now.

And now one of the hard drives has failed.  Don't know if the constant high fans rattled its connections loose or something, but now I can't even experiment further until the array rebuilds.  Don't know if that also causes the fans to go crazy, but until the array is rebuilt I can't play anymore firmware flash merry go round.

[Jimmy Vance]

---

@jonahgroup wrote:

It doesn't solve the problem for me.

And unfortunately this server recently fell out of warranty status, so HP won't even fart in my general direction.

No errors in the health logs.  I've tried updating everything with SPP 2018.3, SPP 2017.10 and 2017.7, and the problem still won't go away.  It's been like this for almost a week now.

And now one of the hard drives has failed.  Don't know if the constant high fans rattled its connections loose or something, but now I can't even experiment further until the array rebuilds.  Don't know if that also causes the fans to go crazy, but until the array is rebuilt I can't play anymore firmware flash merry go round.

---

What does iLO report the fan speeds at? Have you looked at the system tempatures in iLO to see if something is running warm? Has the ambient room tempature increased?  Verify in RBSU the thermal settings are not set to max or increased cooling as those option will spin the fans faster.  You checked both iLO and the IML logs?

.  

[jonahgroup]

We were repurposing the machine, and in the process I reconfigured the array from JBOD to RAID10, and I applied SPP2018.3.  The problems immediately started occurring after that.  There were zero problems prior.

The environment itself (server room) is identical to what it was before.  I checked the bios system health report and everything showed up as Healthy.  I haven't had time to dig further than that.

[jonahgroup]

I've revert all firmwares on the system to whatever is provided by SPP 2017.4.  Everything appears to have calmed down now.  I will have to wait and see if it stays that way.

But we lost *4* hard drives in 2 days because of this.

And to answer your questions, everything had been reset to defaults, so the power had been configured for "Balanced".  Nothing had changed environment-wise, and the fans would kick in almost immediately after boot, before the primary OS had even started.

I didn't check what iLO was reporting before I reverted everything, but at this point all sensors are nominal.

I have to say I am thoroughly disgusted with HP.  Between poor quality VMWare drivers that purple screen the entire host

I very much regret buying HP.

[jonahgroup]

The fans have kicked on high again.  iLO shows them running at 73%.

All temperatures are reported within good range.

Of the highest values I'm seeing:

08-HD Max is at 47C
02-CPU 1 is at 40C
19-PS 1 Internal is at 40C
20-PS 2 Internal is at 40C
27-HD Controller is at 48C
29-LOM is at 40C

All other sensors are in the low 20s or less.  Everything is well below the "Caution" limit.

Room temperature is only 18C.

The only errors in the iLO event log is that it can't reach the NTP server.

These values don't seem generally that high to me.

Thoughts?

[jonahgroup]

I just checked the ILM and it gave me something possibly actionable.  It thought that one of the new hard drives was overheating.  So I spread them out a bit, and did a full power cycling (removing the power cords and waiting a bit) and now it seems to be stable again. 

Not sure which part of all my futzing did the trick, but so far the server is stable again.  For reference, here is what I'm at:

HPE Smart Storage Battery 1 Firmware 1.0 Embedded iLO 2.50 Sep 23 2016 System Board Intelligent Platform Abstraction Data 24.02 System Board Intelligent Provisioning 2.01.29 System Board Power Management Controller Firmware 1.0.9 System Board Power Management Controller FW Bootloader 1.0 System Board Redundant System ROM P89 v2.56 (01/22/2018) System Board SAS Programmable Logic Device Version 0x02 System Board Server Platform Services (SPS) Firmware 3.0.6.267.1 System Board Smart Array P440ar Controller 5.04 Embedded System Programmable Logic Device Version 0x30 System Board System ROM P89 v2.40 (02/17/2017) System Board 

All was provided by SPP 2017.04.  At this point I won't even consider upgrading to anything newer cause I'm afraid everything will melt down again.

[LemmyC_AU]

HP FAN NOISE PROBLEM SOLVED 

Fans spin up randomly -very noisy

System has reported a problem with storage cahe battery

POST Error: 312-HPE Smart Storage Battery 1 Failure - Communication with the battery failed. Its output may not be enabled. Action: Verify battery is properly installed. Refer to user guide. Contact HPE support if condition persists.

 All firmware up to date - problem remains, Replace battery - problem solved

Product Name ProLiant DL360 Gen9
System ROM P89 v2.60 (05/21/2018)
System ROM Date 05/21/2018
License Type iLO Advanced
iLO Firmware Version 2.61 Jul 27 2018

Smart Array P440ar Controller
Firmware Version 6.60
Controller Type HPE Smart Array

Regards  LemmyC

[KristinB]

High LemmyC I have a client with a Prliant ML350 experiencing intermittant high speed fan noise from the server.  Immediately I found in iLO the primary power supply had failed, I replace this today with no change to the fan speed reguarly spinng up and very noisy.  However after checking the system health in the bios I noticed a storage battery failure error.

Can you confirm this resolved your issue with the fan speeds, I'm confused as to the relation between the failed battery and the system fans.

Regardless I will suggest the battery is replaced.

Thanks in advance

Kristin

[gdespaux]

Just wanted to confirm that the Smart Storage battery failing is indeed a possible cause for the fans to spin up to very high RPMs.

After going through HP support, updating all firmware and drivers for the server and iLO, including the attached P2000 storage array, the solution was to remove/replace the Smart Storage battery.

Just wanted to verify that this did resolve our issue, and if you're seeing the POST message/iLO warning concerning the battery and having the issue with fans, this is most likely your cause. However, if you aren't having the message you may have a different cause.