ilorest issues with power supply fan status

[eplodn]

Hi,

I'm having issues with ilorest (and also iLO web interface) not reporting some problems with the PSU.

PSU Fan warning seen in Integrated Management log, but not in Power status.

Steps to reproduce:

In our DL380 Gen10, I stick a pencil into the PSU fan to simulate fan failure.

Observation:

In system log:

{'severity': 'Caution',
  'class': 'Power',
  'last_update': '02/16/2020 13:28:13',
  'initial_update': '02/16/2020 13:28:13',
  'count': 1,
  'description': 'System Power Supply: Fan Warning (Power Supply 1)',
  'event_class': '0x000b',
  'event_code': '0x0054'}

In system status:

Observed:

{'Power Supply 1': {'label': 'Power Supply 1',
  'present': 'Yes',
  'status': 'Good, In Use',
  'pds': 'No',
  'hotplug_capable': 'Yes',
  'model': '865414-B21',
  'spare': '866730-001',
  'serial_number': '5WBXU0DLLBJ4FL',
  'capacity': '800 Watts',
  'firmware_version': '1.00'},
 'Power Supply 2': {'label': 'Power Supply 2',
  'present': 'Yes',
  'status': 'Good, In Use',
  'pds': 'No',
  'hotplug_capable': 'Yes',
  'model': '865414-B21',
  'spare': '866730-001',
  'serial_number': '5WBXU0DLLBJ4H5',
  'capacity': '800 Watts',
  'firmware_version': '1.00'},
 'Battery 1': {'label': 'Battery 1',
  'present': 'Yes',
  'status': 'OK',
  'model': '875241-B21',
  'spare': '878643-001',
  'serial_number': '6WQXK0EWYC40UK',
  'capacity': '96 Watts',
  'firmware_version': '0.70'}}

 Expected:

{'status': 'Fan Failure'}

This is contrary to the documentation of ilo-rest that states the following statuses:

        Unknown
        Good, In Use
        Good, Standby
        General Failure
        Over Voltage Failure
        Over Current Failure
        Over Temperature Failure
        Input Voltage Lost
        Fan Failure
        High Input A/C Warning
        Low Input A/C Warning
        High Output Warning
        Low Output Warning
        Inlet Temperature Warning
        Internal Temperature Warning
        High Vaux Warning
        Low Vaux Warning
        Mismatched Power Supplies

[ShruthiSK]

Hi, 

Please provide us with the version of the iLO5 firmware installed. 

BR, 

Shruthi

[eplodn]

ilorest --nocache --nologo get --selector=Manager. Oem/Hpe/Firmware/Current --json
Local login initiated...
Discovering data...Done
{
  "Oem": {
    "Hpe": {
      "Firmware": {
        "Current": {
          "Date": "Oct 30 2019",
          "DebugBuild": false,
          "MajorVersion": 2,
          "MinorVersion": 10,
          "VersionString": "iLO 5 v2.10"
        }
      }
    }
  }
}

[ShruthiSK]

Hi, 

Thank you for the update. 

1. Could you please remove the PSU from Slot 2 and run the command again? Please share the output of the same.

2. If the iLOrest commands still give an output that the PSU is fine then please update the iLO to the latest version and then provide us with an update. 

BR, 

Shruthi

[eplodn]

After updating the iLo 5 to ver.2.14:

{
  "PowerSupplies": [
    {
      "FirmwareVersion": "1.00",
      "LastPowerOutputWatts": 144,
      "LineInputVoltage": 223,
      "LineInputVoltageType": "ACHighLine",
      "Manufacturer": "LTEON",
      "MemberId": "0",
      "Model": "865414-B21",
      "Oem": {
        "Hpe": {
          "AveragePowerOutputWatts": 144,
          "BayNumber": 1,
          "HotplugCapable": true,
          "MaxPowerOutputWatts": 185,
          "Mismatched": false,
          "PowerSupplyStatus": {
            "State": "Ok"
          },
          "iPDUCapable": false
        }
      },
      "PowerCapacityWatts": 800,
      "PowerSupplyType": "AC",
      "SerialNumber": "5WBXU0DLLBJ6TE",
      "SparePartNumber": "866730-001",
      "Status": {
        "Health": "OK",
        "State": "Enabled"
      }
    },
    {
      "FirmwareVersion": "1.00",
      "LastPowerOutputWatts": 138,
      "LineInputVoltage": 225,
      "LineInputVoltageType": "ACHighLine",
      "Manufacturer": "LTEON",
      "MemberId": "1",
      "Model": "865414-B21",
      "Oem": {
        "Hpe": {
          "AveragePowerOutputWatts": 138,
          "BayNumber": 2,
          "HotplugCapable": true,
          "MaxPowerOutputWatts": 180,
          "Mismatched": false,
          "PowerSupplyStatus": {
            "State": "Ok"
          },
          "iPDUCapable": false
        }
      },
      "PowerCapacityWatts": 800,
      "PowerSupplyType": "AC",
      "SerialNumber": "5WBXU0DLLBJ6RU",
      "SparePartNumber": "866730-001",
      "Status": {
        "Health": "OK",
        "State": "Enabled"
      }
    }
  ]
}

After taking one PSU out:

{
  "PowerSupplies": [
    {
      "MemberId": "0",
      "Oem": {
        "Hpe": {
          "BayNumber": 1
        }
      },
      "Status": {
        "Health": "Warning",
        "State": "Absent"
      }
    },
    {
      "FirmwareVersion": "1.00",
      "LastPowerOutputWatts": 257,
      "LineInputVoltage": 225,
      "LineInputVoltageType": "ACHighLine",
      "Manufacturer": "LTEON",
      "MemberId": "1",
      "Model": "865414-B21",
      "Oem": {
        "Hpe": {
          "AveragePowerOutputWatts": 257,
          "BayNumber": 2,
          "HotplugCapable": true,
          "MaxPowerOutputWatts": 266,
          "Mismatched": false,
          "PowerSupplyStatus": {
            "State": "Ok"
          },
          "iPDUCapable": false
        }
      },
      "PowerCapacityWatts": 800,
      "PowerSupplyType": "AC",
      "SerialNumber": "5WBXU0DLLBJ6RU",
      "SparePartNumber": "866730-001",
      "Status": {
        "Health": "OK",
        "State": "Enabled"
      }
    }
  ]
}

In iLo web interface - Power page, I can see the status of either one ot two as "OK" and "Good, In Use".

In iLo web interface - Integrated Management log, I can see the Warnings about PSU Fan.

[ShruthiSK]

Hi, 

Thank you for your response.

So the PSU still shows as Good to use and in OK status when you try to simuate the issue using a pencil even after the iLO firmwaer update, right?

BR, 

Shruthi

[eplodn]

You are correct. Even with the latest iLo, the state of the PSU with fan issue is "Good, In use" regardless of whether it's one PSU or a part of two.

[ShruthiSK]

Hi, 

Apologies for the delay in getting back. 

Requesting you to log a case with HPE support team so that this can be looked for further progress. 

Regards,

Shruthi 

[eplodn]

We already have a case, they sent us to the community for iLo support.