Updating firmware of BL460c Gen9 with QMH2572 resulted in Adapter failing to initialize

[sean_yt_kim]

Hi,

I have BL460c Gen9  running RHEL 6.9. I am using SPP2018.11.0 and using "hpsum --s --target <host OS IP> ....". All firmware and software updates for servers were successful but when I rebooted the server I noticed the following error with the effect that HBA is not initialised/usable by the OS.

Has anyone experienced this before and if so what was the remedial actions taken to recover from this situation.

Regards,

Peter

16:52:18 27/02/2019] > dmesg | grep qla2
qla2xxx [0000:00:00.0]-0005: QLogic Fibre Channel HBA Driver: 8.08.00.08.06.0-k1.
qla2xxx 0000:09:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
qla2xxx [0000:09:00.0]-001d: Found an ISP2532 irq 16 iobase 0xffffc9002af7e000.
qla2xxx 0000:09:00.0: irq 248 for MSI/MSI-X
qla2xxx 0000:09:00.0: irq 249 for MSI/MSI-X
qla2xxx 0000:09:00.0: setting latency timer to 64
qla2xxx [0000:09:00.0]-006b:1: Inconsistent NVRAM checksum=0x0 id= version=0x0.
qla2xxx [0000:09:00.0]-006c:1: Falling back to functioning (yet invalid -- WWPN) defaults.
qla2xxx [0000:09:00.0]-0070:1: NVRAM configuration failed.
qla2xxx 0000:09:00.0: firmware: requesting ql2500_fw.bin
qla2xxx [0000:09:00.0]-00cd:1: ISP Firmware failed checksum.
qla2xxx [0000:09:00.0]-00cf:1: Setup chip ****FAILED****.
qla2xxx [0000:09:00.0]-00d6:1: Failed to initialize adapter - Adapter flags 2.
qla2xxx 0000:09:00.0: PCI INT A disabled
 [16:52:33 27/02/2019] >

Checking the " /var/log/sum/<IP address>/sum_detail_log.txt" I found the relevant firmware for QLogic FC HBA update was successful as per below.

////////////////////////////////////////////////////////////////////////////////
//  Smart Update Manager for Node 10.56.245.11 Started: Tue Feb 26 2019 13:16:11
//  SUM Version: 8.3.7."8".33246.x64
////////////////////////////////////////////////////////////////////////////////

====== Smart Update Manager Installation Log ======

Source:   firmware-fc-qlogic-2018.09.01-1.1.x86_64.rpm
Version:  2018.09.01  Device 0 [multiboot image:03.77.08 ]  Device 1 [multiboot image:03.77.08 ]
Log Date: 2/26/19 1:45 PM

Preparing...                ##################################################
firmware-fc-qlogic          ##################################################
=================================================================

Installation started: Tue Feb 26 13:45:15 EET 2019

     Installing: CP036356.scexe
        Version: 2018.09.01
    Description: HPE Firmware Flash for QLogic Fibre Channel Host Bus Adapters - Linux (x86_64)

---------------------------------------------------
Loading references...done.
Performing discovery...
Performing flash -- DO NOT INTERRUPT!
Executing flash engine: ./hpqlafwupdate /s
Flash Engine exit code: 0
Flash complete [1]

     Return code:    1

Installation complete: Tue Feb 26 13:45:35 EET 2019

=================================================================

[Kamalji]

Going by the error it looks like driver is not able to initialise the adpter ..

From the your discription this seems my seems due to mismatch between firmware and driver .

To match with the firmware and drivers ,use the same SPP to apply with the drivers .

Its seems you have used SPP2018.11 for firmware update .

Once the firmware and drivers are matched pair part of same SPP at the minimum .

If you are still getting the error .

Shutdown the server gracefully and then power On to check if the HBA get initialized sucessfully without any error during POST and no crossponding event in server IML.
If any error ,please capture AHS and sosreport to logs a ticket with HPE Customer support center .

[piewie]

We have experienced serveral QLogic HBA damages. It is possible to brick the QLogic HBA (QMH2672 and 3830C) with QConvergeConsoleCLI (scli/qaucli) commands - independently from the firmware version.

dmesg also results in:

qla2xxx [0000:09:00.0]-00cd:1: ISP Firmware failed checksum.
qla2xxx [0000:09:00.0]-00cf:1: Setup chip ****FAILED****.

Then the HBA is recognized as "PCI Card" in OneView - and not as FC Card anymore.

The syntax check of the QCCCLIO is insufficient.

We are still investigating the reason(s), but the situation is still confusing.

Do you have new information about your HBA problem?