'proliant dl380p gen9' CRITICAL: Drive Array Subsystem - Drive Array Controller Failure (Slot 0)

[Jae88]

Hi all,

we have dl380 g9 and running 64 bit CENT OS 7.3  Tonight suddenly one of node crashed 

and IML logs shows following error when server rebooted

Here is log 

Event: 8 Added: 02/02/2020 10:41
CRITICAL: Drive Array Subsystem - Drive Array Controller Failure (Slot 0).

Event: 9 Added: 02/02/2020 01:52
CRITICAL: Unrecoverable System Error - An Unrecoverable System Error (NMI) has occurred (Service Information: 0x00CC47F0, 0x00CC4AF0).

Event: 10 Added: 02/02/2020 01:54
CRITICAL: ASR - ASR Detected by System ROM.

Event: 11 Added: 02/02/2020 01:55
CAUTION: POST Messages - Option ROM POST Error: 1719-Slot 0 Drive Array - A controller failure event occurred prior to this power-up. (Previous lock up code = 0x13) Action: Install the latest controller firmware. If the problem persists, replace the controller..

Press q to quit, c to continue without pagination
or any other key to see the next screen.:

Event: 12 Added: 02/02/2020 01:55
INFO: POST Messages - Option ROM POST Information: 1792-Slot 0 Drive Array - Valid Data Found in Write-Back Cache. Data will automatically be written to drive array. Action: No action required..

And i tried to update firmware but it failed 

warning: kmod-hpsa-3.4.20-181.rhel7u7.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 26c2b797: NOKEY
error: Failed dependencies:
kernel(__check_object_size) = 0x88db9f48 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(__x86_indirect_thunk_r10) = 0x7e526bfa is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(__x86_indirect_thunk_r11) = 0xbfdcb43a is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(__x86_indirect_thunk_rax) = 0x2ea2c95c is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(__x86_indirect_thunk_rdx) = 0xb601be4c is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(arch_dma_alloc_attrs) = 0xa587ed11 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(blk_queue_init_tags) = 0x294f285c is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(page_offset_base) = 0x7cd8d75e is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sas_end_device_alloc) = 0xc47450df is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sas_port_add) = 0x00e23698 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sas_port_add_phy) = 0x46f0aa07 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sas_port_alloc_num) = 0x7da963bb is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sas_port_delete) = 0x30272314 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sas_port_delete_phy) = 0x1d193f51 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sas_port_free) = 0x31612c90 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sme_active) = 0x7ae5ad74 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(sme_me_mask) = 0x17fbce60 is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64
kernel(vmemmap_base) = 0x97651e6c is needed by kmod-hpsa-3.4.20-181.rhel7u7.x86_64

Please let me know if you face such error and how did u fix this?

Thanks

[sudhirsingh]

Hi,

"kmod-hpsa-3.4.20-181.rhel7u7.x86_64.rpm" is a smart array driver for RHEL7 so

are you updating firmware or driver ?

There are relevents fixes in the gen9 controller firmware hence i suppose

you should update controller firmware to latest using offline SPP 2019.09.

SPP 2019.09

https://techlibrary.hpe.com/us/en/enterprise/servers/products/service_pack/spp/index.aspx?version=2019.09.0

later you should update the driver also.

Regards,
Sudhir