ML350 G5 Win2003 R2 restarts with event ID 6008

[Vernon Osting]

I have 2 new ML350 G5 servers installed at different locations that restart every couple of days or even weeks with event ID 6008, about 8 of these restarts on both systems since 1/Jan/08. There are no errors in the system event log that seem to indicate the nature of the problem. One of the servers I did get a single error in the ILO2 log Blue Screen Trap (BugCheck, STOP: 0x0000000A (0x00000000, 0xD000001B, 0x00000000, 0x808543BF))

Both servers were installed around the 1st of the year with the latest HP firmware CD installed.
They are both in the following configuration.
Windows 2003 R2 SP2 with Sata-Raid-5 3GB memory
SQL2000 Symantec ver10.1.7.700
They are primarily used as SQL servers.
Both systems are connected to a UPS along with another server that does not restart.

[Blazhev_1]

Hi,

first the basic things, firmware & drivers :

latest drivers & agents :

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=1121586&prodNameId=3279711&swEnvOID=1005&swLang=8&mode=2&taskId=135&swItem=MTX-6f78c741679b4ec7a6ff1198ba

latest FW CD :

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=US&swItem=MTX-6e09964448994337ad23016691

If the problem is not driver related, then this can be the symantec, there are some issues with antivirus Sw...can you stop the symantec on one of the servers and check if the server will reboot?

Pac

[Vernon Osting]

I'll stop the Symantec realtime protection on both of the servers and see if that has any effect. Since they are not file servers I don't have a problem turning of Symantec for a couple of days.
I'll also check the firmware and drives.

Thanks
Vern

[Vernon Osting]

I see that both the OS drive CD and firmware CD suggested above are the next version from the ones used when the servers were configured. Does it matter which updates drive or firmware are installed first and can they be install remotely. From the instruction it looks like the drive can be updates remotely but I'm not sure about the firmware.

Vern

[KarloChacon]

hi

not the same issue but this storport is affecting several Ml350 G5

http://support.microsoft.com/kb/941276

regards

[Vernon Osting]

Turning off Symantec real-time protect seems to have had no effect. One of the systems restarted with event ID 6008 at 10:10pm last night and there was not an entry in the event log or ILO2 log before the restart. So it looks like it's time to try updating the HP drives to the latest versions.

[Vernon Osting]

Looks like this is a power related problem. I miss read the ILO2 event log and did not scroll completely to the bottom of the log where there are errors stating "Server power removed" and "Server power restored"
This ML350 has a single power supply plugged into an APC UPS with another smaller Shuttle server which does not power fail or restart. But the APC log which is on the Shuttle shows the the UPS did go to Battery Power when the ML350 lost power. Perhaps it's time to get a larger and dedicated UPS for the ML350 server.
Vern

[KarloChacon]

hi

so swap power supply to the other bay, in that way you can if it is the power supply or the power backplane that is causing the issue

regards

[Blazhev_1]

Hi,

well there are actually a lot of issues with the G5's and DL385 G2's power supplies(older revisions), because they use new colling technology(there is an advisory about the technlogoy). But if you have a bluescreen, don't think this is a power related issue...although you can replace them if you have spares and check
regards

[Vernon Osting]

Thanks for the input Pac

These servers where purchased new a couple of months ago and have been install since the first of the year.
This appears to be a power related problem. I have two Ml350 G5's at two different locations a few miles apart and they both restart this morning at the same time with a "Power removed" entry in the ILO2 log on both. The APC UPS at the sites recored a power failure at the same time although the other Dell Server and Shuttle server at the sites did not restart. Perhaps the HP is a lot more sensitive to power issues.
I wounder if adding a redundant supply would help. For now I'm going to get a newer larger APC UPS for both locations.

Vern

[Vernon Osting]

I replaced the APC UPS units on both of the ML350 G5 with two APC BX1500LCD units to see if that makes a differance. I pulled one of the power supples and the PN on it was 379123-001 Rev 06M which as far as I can tell is not on the defective list. If the servers continue to restart with a Power Removed message logged in the ILO2 I'll call HP for service.

Vern

[Ulf Kjellsson]

Is it ok to jump in here? I have the same 6008 event and restart of one 380G5 server. It is one of 9 equal servers in a system controling a papermachine. I have an alarm in the HP log, pointing to PCI slot1, bus0, divice0, function0. I don't have anything in this slot. However I have a Sunix serial interface card in slot2. If anybody have any idéa, i appreciate it, otherwise I need to get HP support on site after Easter Holiday.

Ulf

[Vernon Osting]

I replaced the APC UPS units on both of these ML350 G5 server with new ACP 1500 units and over the past couple of days both of these servers have restarted with an entry in the ILO2 saying "server power removed" and "server power restored". I decided to simulate a power fail on the APC UPS by unplugging the power cord to the APC UPS while the server was running the server immediately restart with a power fail in the ILO2 log. It defiantly looks like there is a problem with the power supply's in both of these units.

Vern

[Ulf Kjellsson]

HP Support has mailed us an upgraded bios and updated drivers (latest from HP). These have been installed and we haven't had any restarts with 6008 since Monday 3/24.

[Vernon Osting]

The problem with my two HP ML350 G5 servers rebooting with unexpected power loses appears to have been solved by replacing the APC UPS units with UPS units the output a true sine wave. Although I tried several different models of APC UPS units only the APC SmartUPS (not the SC variant) and HP UPS units seem to work with theses servers. The other units worked fine on my other servers but not on the HP ML350. It appears the power supplies in the ML350 are unable to operate on UPS units the output a modified sine wave.

[INGJUAN]

wich model of APC SmartUPS worked fine?
a have de same problem

[Vernon Osting]

I used the APC Smart UPS 1500 DLA1500 from www.onsale.com

[Chuck Dornon]

After calling HP support and running through there SMART Tools, checking the Rev's on the power supplies the Technical support person at the other end informed me that the P/S's on the ML-350 sever's are very sensative and are not compatible with APC UPS and that I need to purchase an HP UPS to fix this problem. In her explanation she informed me that the HP UPS are the only ones tested with the P/S's for the ML-350 servers.

[RaMpaNTe]

The ACP 1500 UPS is well known for causing rebooting and power down issues in several G5 models. We have fixed tons of issues that even after replacing parts nothing seemed to work.

Everything was resolved once the customers decided to stop using the ACP1500 UPS.

Thanks,
\RaMpaNTe