ProLiant DL380 G6 Continually Reboots

[T. Coenders]

Same problem here;

- 2x DL380 G6 (19 november 2009),
- single 3304 CPU,
- most recent BIOS versions, including the
last iLo 1.80!!
- 1x W2K8 Std
- 1x W2k8 HyperV

Tried (almost) everything, except downgrading BBWC memory (512 -> 256)

Keep you informed

[Arian van der Pijl]

We had 2 server motherboards replaced.
A total of three;
2 for the reboot issue and one for erroneous misconfigured memory error (all mem diag leds burning).

Quote /
HP made the determination that our servers reboot because of a known HP bug in the P410i controller with firmware v1.66 and 512MB cache module. /

In our case we do not use the P410 at all (no local storage except for an SDCard -> ESX4i).

So this story doesn't make sense.

Only a motherboard swap will do eventually I guess. HP did acknowledge the issue and warranted quickly a motherboard replacement.

One note to HP; Why knowingly selling defect servers while this issue was already known for some time?

[Arian van der Pijl]

To me another issue is that you can disable the P410i but sometimes the controller enables 'itself'!
Guess the BIOS checks some bootdevices and activates the P410i when editing or saving the bios when configuring other settings.
Very annoying.

And also, many DL380G5 intermittend continuous high fan noise when starting after reboot. Sometimes iLO not responding and long boot times. This only occurs to me on Windows Servers.

But all this offtopic ;-).

[Arian van der Pijl]

I meant DL380G6 ..

[T. Coenders]

Both motherboards replaced; still don't know for sure if it helped really...

[Michael Barbere]

Advisory: (Revision) HP ProLiant DL380 G6 Server - Limited Number of Servers Shipped Prior to November 16, 2009 (11/16/2009) and Configured with a System Board with Revision Level Earlier Than Rev 0S May Unexpectedly Reboot


Happended to one of our server with the absolute latest updates from VCA. VCA still does not have the cp012068 patch. I was getting frustrated this afternoon trying to figure out why there was no logging of the failures when everything seemed to be operating normally.

My colleague found this post and the subsequent fix. I definately need to get on the customer advisory list.

Also the patch requests local console access to install it? ILO2 console, RDP, SSH and VCA are not suitable to deploy this?

"This component updates the System Programmable Logic Device on HP ProLiant DL380 G6 servers. This component IS NOT suitable for remote and/or automated deployment. You must have physical access to the server."


--

Michael Barbere

[Stephen Delaney]

Update:

I have applied the flash patch and the server rebooted twice last night. Looks like a DOA replacement on the cards.

[MAH_2]

I have also same issue. WHat action plan I can take for this?
O.S is win2K8 R2

[T. Coenders]

Gents,

HP seems to approach this problem as a known issue. After both Motherboards of my DL380/G6 machines were replaced, the problem didn't come back.

For me it worked, curious 'bout what your experiences are...

\\Tom

[Josh Saunders]

Has anyone updated on ESX server (4 update1)
obviously applying the windows or linux flash fix cant be applied.
any ideas?

[Stephen Delaney]

I originally had ESX on my DL380 G6 but had to install a basic W2k3 install to apply the fix. I applied the fix via windows and the machine still reboots at least once an hour. I am waiting on our suppliers response to DOA.

[Jean-Marc Ulrich]

Hello
For us the Patch for the System Programmable Logic Device worked perfect. (Installed under Windows 2008 Server x64) No Reboots since then. Now I am worried.

For those without success with the patch: Did you plugged out both power cords for at least 30 seconds ?

We hope that the problem is fixed for us forever !

Happy new year !

[Arian van der Pijl]

I could not successfully deploy the patch as I normally do with Firmware CD 8.60 and adding extra updates (scexe files)

ftp://ftp.hp.com/pub/softlib2/software1/sc-linux-fw/p1687714714/v57919/CP012069.scexe

Guess the Firmware CD 8.60 does not load the iLO driver and therefore cannot update the device?

Guess I have (unfortunately) have to install Windows (or linux) to deploy this patch?
Anyone managed to install this as a supplemental update within Firmware DVD 8.60?

[Alistair N G Swanson]

Same problem ESXi 4.0 - i've got 2 identical DL380 G6s, 1 serial number apart.

One is having this problem, the other isn't.

As they are not production servers (yet!) they've asked me to swap the disk drives. I decided to try swapping the SD cards ESXi is installed on first.

I'll see what happens.

When I asked why there was only a fix for Windows Server and Linux they suggested perhaps the problem does not occur on any other OS!!! Not happy.

[Lawrance Lee_1]

Mark Ostroski's post earlier on in this thread may have the answer that you are all looking for.

Basically there is an advisory from HP which describes unexpected reboots on some units of DL380G6 servers.

The only message that is logged by server hardware or HP utilities is in the HP Integrated Lights-Out 2 (iLO 2) Event Log is as follows:

Server Reset, Server Power Removed, Server Power Restored

More details can be found at this URL:

http://h20000.www2.hp.com/bizsupport/TechSupport/Document.jsp?objectID=c01955503

[DMorgan]

As mentioned many many times throughout this thread the answer is the updated firmware. This is a standalone installer that isnt on any of the firmware disks and cant even be run by the Firmware disk.

To get things moving all I did was build a quick Windows 2003 with the package on the desktop. Run it, shut it down. Move the two disks to the next server and repeat. Download all the lastest firmware for the G6 and add them to the 8.60 firmware maintainance CD in the SWpackages folder. Burn the disk and then flash all the rest of the firmwares via the disk. Job done! No more reboots and its the easiest way with Linux and ESX.

Make sure you do the power firmware first!! As we found....a reboot in the middle of flashing the iLO will screw it! luckily the system BIOS's have a backup too.

[Alistair N G Swanson]

Ah, apparently there is no VMWare firmware update due to the size, so they are sending out an engineer to update it. (I don't have the time nor the tools to update it through windows server or linux).

[Wohlwend]

Hello,

you can also use the USB-Stick with the conntend of the firmware update cd 8.7 an copy the needed update CP012069 on it.
Boot from the usb-stick after language and license agreement on the main window

press strg-alt-f1 to switch on commandline.
there you can execute the ./cp012069.scexec
if is successfully you can switch back with strg-alt-f2.

but you should power off the system,
disconnect the powercord for 10sec.

[MGray]

After system board replacement its still happening. Anyone else had the same issue?

Seeing the reset/removed/restored in the iLO logs

[RTX]

Well, more or less the same status here. Allthough a bit different.

The server reboots about 30 sec. to 2 minutes after the Logon screen appears (win2008 Datacenter) - continuesly.

But if I boot up with - Last Good Know Configuration - The server does not reboot.

Do not know if this relates to a windows error or the same HP problem you guys have.

â ¢ All the latest HP software/ firmware installed (8.40 support pack)
â ¢ Power cords unplugged for at least a minute.

Don't know what to do anymore...

[Ruud Smits]

I also have a rebooting system.
have a case open at support at the moment.
My system reboots about once a month, but last weekend twice....

I have an exact same system which is not rebooting.(coming from the same order)

[David A. White]

We have experienced this same issue with our DL380G6 (running ESXi 4.1) at our church; however, our server randomly shuts down altogether. Sometimes it will go for days, and other times it will shut down several times a day.

The motherboard was replaced, we just replaced all of the RAM, and now HP is sending us two new CPUs. If this doesn't work, the next step is to replace the server.

I actually convinced the tech team at our church (all volunteers) to move away from Dell to HP. I have used HP Proliant servers in large scale production Data Centers for years without any problems like this, but of course that means nothing to the disappointed church staff. Here I sit with egg on my face waiting for HP (going on for 5 weeks now) to provide a solution that works.

[Kopp2]

Hi David,
I hope you tried already to update firmware:
-iLO2 to v2.01
- SmartArray P41xx to v3.50
- latest BIOS
and other components with FW DVD v9.10c.

I'm sure you checked also the advisory report:
http://h20000.www2.hp.com/bizsupport/TechSupport/Document.jsp?objectID=c01955503

Is your serial number earlier as xxx947xxxx or not?

PS. my 3x DL380 G6 running stable since HP technician was here and installed this "magic" patch for "System Programmable Logic Device".

so long...
JK