HPCISSs2 Event ID 129 appears after applying HP Service Pack for ProLiant version 2015.04

[jwo]

Hi Everyone,

Not sure if anyone has this issue and if you have, I was wondering if you managed to find a solution to this?

After we upgraded our ProLiant Servers to the latest HP Service Pack for ProLiant Servers, (dated April 2015), we started getting these warning messages in the system log.  Event ID 129.  "Reset to device, \Device\RaidPort0, was issued"  Source: HPCISSs2

This happen to majority of our HP ProLiant servers after the SPP update.  In particular DL360 G7 with Smart Array Controller P410i.  After the update, the firmware is on 6.62 and the driver is  6.28.0.64.   We are on Windows Server 2008 R2.

We did some research and we have looked at the following but couldn't find any answers.

http://h20564.www2.hp.com/hpsc/doc/public/display?docId=c01611218&DocLang=en&docLocale=en_US&jumpid=reg_r1002_usen_c-001_title_r0001

http://h20564.www2.hp.com/hpsc/doc/public/display?docId=c00810284&DocLang=en&docLocale=en_US&jumpid=reg_r1002_usen_c-001_title_r0009

http://h20564.www2.hp.com/hpsc/doc/public/display?docId=c01208743&DocLang=en&docLocale=en_US&jumpid=reg_r1002_usen_c-001_title_r0003

http://h30499.www3.hp.com/t5/ProLiant-Servers-ML-DL-SL/DL370-G6-with-SAS-p410i-HpCISSs2-129/m-p/1113668#M130270

http://h20566.www2.hp.com/hpsc/doc/public/display?docId=emr_na-c00810284

Any advises and help will be very much appreciated.

P.S. This thread has been moved from General to ProLiant Servers (ML,DL,SL). - Hp Forum Moderator

[Suman_1978]

Hi,

Please check the Application Event Log, check the timings of Event ID 129 from System Event Log and see if any application is causing this issue.

Once we had a similar issue where "Double-Take Management Service" was causing the controller to log event id 129 in the system event logs.

Thank You!
I am a HP employee.

Useful Links for ProLiant Servers

Self Solve Options for ProLiant Servers

[AdiGri]

Did you run the Array Diagnostics Utility to see if it provides some addtional clues? 

https://www.eventid.net/display-eventid-129-source-HpCISSs2-eventno-9180-phase-1.htm provides some additonal tips but since this was a software upgrade with no physical changes, not all of them would be applicable.

[jwo]

Thanks.  I've checked and application event log but nothing stands out during the time where the event id 129 appeared.

Also, I have ran the  Diagnostic Report and the only thing which has a "warning" status is the "License key Status" with a Checksum Failed.  I don't think this is relavent though as we didn't opt for the HPSAAP and I have checked on all other servers, they have the same.

Any other suggestions?   

I thought it could be either the ROM or the Driver for the Smart Array Controller.  On a few servers we excluded both from being applied during the SPP.2015.04, but still, on one server.  the HPCISSs2 warning event appeared event though we didn't apply the firmware and drivers.  Running out of ideas.... 

[jwo]

Attached screen shot of the warning messages after I applied HP SPP April 2015. 

[RenRom]

We have exactly the same with one server. I noticed on that server the HP Insight Management Agents weren't updated to 10.10.0.0. Just upgraded that and hopefully those errors will go away.

[jwo]

We have upgraded the Insight Manager Agent to version 10.10.0.0.   Same issue persist. 

Come on HP, is this a bug or what? 

[dcw-erik]

Hi!

I have the same issue for a while now. Even went through HP support some time and they diagnosed the storage sub system and said everything is fine.

Did anyone resolve the issue?

Best regards,

  Erik

[Kevi]

Hi,

Same fault on 580 G7 and now on 580 Gen8 all with Win2008R2

The Gen8 is running the July 2015 SPP

I have a server 580 G7 with 6.28.0.64 HPCisss2 with a P410i controller 6.60 with Event ID 129 and 5008 Raid resets

Another server 580 G7 with 6.28.0.64 HPCisss2 with a P410i controller 6.40 with no resets or errors

Another server 580 G7 with 6.26.0.64 HPCisss2 with a P410i controller 6.00 Build2 with no resets or errors

and the  Gen8 on the other hand (6.10.0.64 - HPCisss3 ) with an P830i controller (2.40) which has the raid resets even after HP replaced the SPI board and the cache Module.

Other than rolling back the firmware for the 410 controller is there any other solutions??

For the Gen8 is there a working combination?

Kevin

[Kevi]

Just upgraded to the Latest SPP Oct 2015. on the DL580Gen8 Windows 2008 R2 SP1.

It has reduded the number of resets to just a couple a day.

Not the best solution...    :(

[PZel]

When I look closer at your attached jpg it looks like it is a CISSS3 driver (instead of CISSS2).

My understanding is that on P420i (as used in DL380pGEN8) you can use 2 drivers: 1) The older CISSS2 driver (as named: SAS/SATA controller driver) 2) The newer (more sophisticated) CISSS3 driver (as named: CISSS3 driver). When you update with HPSUM (from 2014.09) HPSUM looks whether you are using (=active) CISSS2 or CISSS3 (ControlPanel/Syste/DeviceManager/SCSIController/Driver/Details) and upgrades ONLY that driver !!

Here at my plant after upgrading to the newest CISSS3 driver (6.12.0.64/62.6.0.64) there is a fairly chance that a lot of 5009(informational) OR 5008/129 errors in System Event Log appear. It looks like that it is solved by using the CISSS2 driver, just by running the SAS/SATA controller executable (6.28.0.64) AND a reboot. Then you're using the CISSS2 driver as active again.

Is there another solution for this problem.

[Server-Support]

Yes, me too, I'm still having issue with this warning logged every hourly in my system here.

So I wonder what is the latest development in this issue / case ?

[Dan0]

We had same issue recently running Server 2012 R2 on HP DL380p Gen8 server after running latest HP Service Pack.  Tried many fixes and now looks like it has been resolved after we un-installed HP Insight Management WBEM Providers 10.44.0.00 after reading this HP Advisory - http://h20564.www2.hpe.com/hpsc/doc/public/display?docId=emr_na-c04718464