topic HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object in Server Management - Remote Server Management

HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Sasler — Thu, 15 Nov 2018 07:50:52 GMT

Hi,

We have been using HPEBIOS CmdLets quite extensively on our Gen10 servers. In most cases it works just fine, but on some we get the "Object reference not set to an instance of an object" error on any HPEBIOS Set cmdlet, although HPEBIOS Get cmdlets work just fine. Some times a simple reboot fixes the issue, but in others multiple reboots, cold boots and lot of waiting is needed.

Here is an example script:

Enable-HPEBIOSLog -Verbose
$connection = Connect-HPEBIOS -IP 10.10.10.10 -Credential (Get-Credential) -DisableCertificateAuthentication
Get-HPEBIOSWorkloadProfile -Connection $connection
Set-HPEBIOSWorkloadProfile -WorkloadProfile VirtualizationMaximumPerformance -Connection $connection
Disconnect-HPEBIOS -Connection $connection
Disable-HPEBIOSLog

And here is the log output:

2018-11-15 08:29:56,848 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Parameter processing started. 
2018-11-15 08:29:56,850 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - IP.
2018-11-15 08:29:56,851 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - Username.
2018-11-15 08:29:56,852 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - Password.
2018-11-15 08:29:56,853 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - AdminPassword.
2018-11-15 08:29:56,854 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - ClientLoggedInUserPassword.
2018-11-15 08:29:56,855 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - Credential.
2018-11-15 08:29:56,856 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - DisableCertificateAuthentication.
2018-11-15 08:29:56,857 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - Port.
2018-11-15 08:29:56,858 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Processing parameter - Timeout.
2018-11-15 08:29:56,864 HPE.Framework.Logging.Logger.LogMessage INFO - [Connect-HPEBIOS] Executing the cmdlets with 1 task serially.
2018-11-15 08:29:56,866 HPE.Framework.Logging.Logger.LogMessage INFO - Connect-HPEBIOS ProcessCommand() -- Starts
2018-11-15 08:29:56,867 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationModel() -- Start
2018-11-15 08:29:56,868 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationProtocolType() -- Start
2018-11-15 08:29:56,879 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationProtocolType() -- End
2018-11-15 08:29:56,881 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationModel() -- End
2018-11-15 08:29:56,882 HPE.Framework.Logging.Logger.LogMessage INFO - BuildCommand() -- Start
2018-11-15 08:29:56,883 HPE.Framework.Logging.Logger.LogMessage INFO - Connect() -- Start
2018-11-15 08:29:56,885 HPE.Framework.Logging.Logger.LogMessage INFO - CreateConnection() -- Start
2018-11-15 08:29:57,118 HPE.Framework.Logging.Logger.LogMessage INFO - InitializeConnectionProperties() -- Start
2018-11-15 08:29:57,276 HPE.Framework.Logging.Logger.LogMessage INFO - InitializeConnectionProperties() -- End
2018-11-15 08:29:57,278 HPE.Framework.Logging.Logger.LogMessage INFO - CreateConnection() -- End
2018-11-15 08:29:57,278 HPE.Framework.Logging.Logger.LogMessage INFO - Connect() -- End
2018-11-15 08:29:57,280 HPE.Framework.Logging.Logger.LogMessage INFO - BuildCommand() -- End
2018-11-15 08:29:57,281 HPE.Framework.Logging.Logger.LogMessage INFO - Connect-HPEBIOS ProcessCommand() -- Ends
2018-11-15 08:29:57,283 HPE.Framework.Logging.Logger.LogMessage INFO - [Get-HPEBIOSWorkloadProfile] Parameter processing started. 
2018-11-15 08:29:57,288 HPE.Framework.Logging.Logger.LogMessage INFO - [Get-HPEBIOSWorkloadProfile] Processing parameter - Connection.
2018-11-15 08:29:57,290 HPE.Framework.Logging.Logger.LogMessage INFO - [Get-HPEBIOSWorkloadProfile] Processing parameter - OutputType.
2018-11-15 08:29:57,291 HPE.Framework.Logging.Logger.LogMessage INFO - [Get-HPEBIOSWorkloadProfile] Executing the cmdlets with 1 task serially.
2018-11-15 08:29:57,292 HPE.Framework.Logging.Logger.LogMessage INFO - Get-HPEBIOSWorkloadProfile ProcessCommand() -- Starts
2018-11-15 08:29:57,293 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationModel() -- Start
2018-11-15 08:29:57,294 HPE.Framework.Logging.Logger.LogMessage INFO - TestConnection() -- Start
2018-11-15 08:29:57,307 HPE.Framework.Logging.Logger.LogMessage INFO - TestConnection() -- End
2018-11-15 08:29:57,309 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationModel() -- End
2018-11-15 08:29:57,310 HPE.Framework.Logging.Logger.LogMessage INFO - BuildCommand() -- Start
2018-11-15 08:29:57,311 HPE.Framework.Logging.Logger.LogMessage INFO - InitializeConnectionInfo() -- Start
2018-11-15 08:29:57,312 HPE.Framework.Logging.Logger.LogMessage INFO - ReadBIOSRegistryData() -- Start
2018-11-15 08:29:57,323 HPE.Framework.Logging.Logger.LogMessage INFO - ReadBIOSRegistryData() -- End
2018-11-15 08:29:57,325 HPE.Framework.Logging.Logger.LogMessage INFO - InitializeConnectionInfo() -- End
2018-11-15 08:29:57,370 HPE.Framework.Logging.Logger.LogMessage INFO - BuildCommand() -- End
2018-11-15 08:29:57,372 HPE.Framework.Logging.Logger.LogMessage INFO - Get-HPEBIOSWorkloadProfile ProcessCommand() -- Ends
2018-11-15 08:29:57,377 HPE.Framework.Logging.Logger.LogMessage INFO - [Set-HPEBIOSWorkloadProfile] Parameter processing started. 
2018-11-15 08:29:57,378 HPE.Framework.Logging.Logger.LogMessage INFO - [Set-HPEBIOSWorkloadProfile] Processing parameter - Connection.
2018-11-15 08:29:57,379 HPE.Framework.Logging.Logger.LogMessage INFO - [Set-HPEBIOSWorkloadProfile] Processing parameter - WorkloadProfile.
2018-11-15 08:29:57,380 HPE.Framework.Logging.Logger.LogMessage INFO - [Set-HPEBIOSWorkloadProfile] Executing the cmdlets with 1 task serially.
2018-11-15 08:29:57,381 HPE.Framework.Logging.Logger.LogMessage INFO - Set-HPEBIOSWorkloadProfile ProcessCommand() -- Starts
2018-11-15 08:29:57,382 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationModel() -- Start
2018-11-15 08:29:57,383 HPE.Framework.Logging.Logger.LogMessage INFO - TestConnection() -- Start
2018-11-15 08:29:57,396 HPE.Framework.Logging.Logger.LogMessage INFO - TestConnection() -- End
2018-11-15 08:29:57,397 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationModel() -- End
2018-11-15 08:29:57,398 HPE.Framework.Logging.Logger.LogMessage INFO - ValidateParameterRecord() -- Start
2018-11-15 08:29:57,400 HPE.Framework.Logging.Logger.LogMessage INFO - ValidateParameterRecord() -- End
2018-11-15 08:29:57,401 HPE.Framework.Logging.Logger.LogMessage INFO - BuildCommand() -- Start
2018-11-15 08:29:57,402 HPE.Framework.Logging.Logger.LogMessage INFO - InitializeConnectionInfo() -- Start
2018-11-15 08:29:57,403 HPE.Framework.Logging.Logger.LogMessage INFO - ReadBIOSRegistryData() -- Start
2018-11-15 08:29:57,412 HPE.Framework.Logging.Logger.LogMessage INFO - ReadBIOSRegistryData() -- End
2018-11-15 08:29:57,414 HPE.Framework.Logging.Logger.LogMessage INFO - InitializeConnectionInfo() -- End
2018-11-15 08:29:57,415 HPE.Framework.Logging.Logger.LogMessage INFO - ValidateParameterAndValue() -- Start
2018-11-15 08:29:57,436 HPE.Framework.Logging.Logger.LogMessage ERROR - Failed for 10.10.10.10: Object reference not set to an instance of an object.
2018-11-15 08:29:57,457 HPE.Framework.Logging.Logger.LogMessage INFO - [Disconnect-HPEBIOS] Parameter processing started. 
2018-11-15 08:29:57,458 HPE.Framework.Logging.Logger.LogMessage INFO - [Disconnect-HPEBIOS] Processing parameter - Connection.
2018-11-15 08:29:57,459 HPE.Framework.Logging.Logger.LogMessage INFO - [Disconnect-HPEBIOS] Executing the cmdlets with 1 task serially.
2018-11-15 08:29:57,460 HPE.Framework.Logging.Logger.LogMessage INFO - Disconnect-HPEBIOS ProcessCommand() -- Starts
2018-11-15 08:29:57,461 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationModel() -- Start
2018-11-15 08:29:57,463 HPE.Framework.Logging.Logger.LogMessage INFO - TestConnection() -- Start
2018-11-15 08:29:57,477 HPE.Framework.Logging.Logger.LogMessage INFO - TestConnection() -- End
2018-11-15 08:29:57,478 HPE.Framework.Logging.Logger.LogMessage INFO - GetCommunicationModel() -- End
2018-11-15 08:29:57,479 HPE.Framework.Logging.Logger.LogMessage INFO - BuildCommand() -- Start
2018-11-15 08:29:57,481 HPE.Framework.Logging.Logger.LogMessage INFO - Disonnect() -- Start
2018-11-15 08:29:57,500 HPE.Framework.Logging.Logger.LogMessage INFO - ClearRedfishSession() -- Start
2018-11-15 08:29:57,501 HPE.Framework.Logging.Logger.LogMessage INFO - ClearRedfishSession() -- End
2018-11-15 08:29:57,502 HPE.Framework.Logging.Logger.LogMessage INFO - Disonnect() -- End
2018-11-15 08:29:57,503 HPE.Framework.Logging.Logger.LogMessage INFO - BuildCommand() -- End
2018-11-15 08:29:57,504 HPE.Framework.Logging.Logger.LogMessage INFO - Disconnect-HPEBIOS ProcessCommand() -- Ends

As you can see, the Get-HPEBIOSWorkloadProfile worked just fine but Set-HPEBIOSWorkloadProfile returned the "Object reference not set to an instance of an object" error.

This doesn't seem to make any sesne. We are seeing this perhaps every 6th or 7th server (mostly DL380 Gen10) and since we provision several servers evey week, we do see this issue a lot. Is anyone else encountering this issue?

Thanks

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

rookie1082 — Thu, 15 Nov 2018 12:45:18 GMT

Saser

We provision many Gen10 servers as well and this issue popped up for us earlier this year. Then it went away after it was discovered a reboot fixes it.

Now, it has come back in the ML110 Gen10 model, none of the set hpebios commands work only some of the time. I am not sure what the issue is. Reboots do not fix it.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Sasler — Thu, 15 Nov 2018 14:02:22 GMT

@rookie1082 wrote:
Saser

We provision many Gen10 servers as well and this issue popped up for us earlier this year. Then it went away after it was discovered a reboot fixes it.

Now, it has come back in the ML110 Gen10 model, none of the set hpebios commands work only some of the time. I am not sure what the issue is. Reboots do not fix it.

We also do quite few ML110 Gen10 models, but I see this mostly on DL380 Gen10 and only on some ML110. Also, in most cases a reboot fixes it, but not always.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

rookie1082 — Thu, 15 Nov 2018 15:21:43 GMT

This also occurs on the ML350 Gen10 models I believe, because my techs have reported that model to me as well, although the quantities are minimal.

The majority of the Gen10 servers we are currently configuring are just firmware and ILO settings, no BIOS settings - so this issue hasn't been that critical for us recently.

I have messaged Rajesh on this issue but he has not replied back yet, they are usually pretty busy.

The gen9 models worked perfectly and still do.

Have you tried the HPE Redfish commands from the HPE Powershell Gallery to try and set? When I used that to trouble shoot, it gave me a more clear "reboot needed" error. Maybe this time it would give a more verbose error message telling you what the exact issue. I don't have any new servers at the moment to test this on.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Sasler — Fri, 16 Nov 2018 12:50:22 GMT

@rookie1082 wrote:

Have you tried the HPE Redfish commands from the HPE Powershell Gallery to try and set? When I used that to trouble shoot, it gave me a more clear "reboot needed" error. Maybe this time it would give a more verbose error message telling you what the exact issue. I don't have any new servers at the moment to test this on.

No, I haven't really used HPE Redfish. Would you have an exmaple how to get that "reboot needed" data?

Thanks

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Vijay_B — Mon, 19 Nov 2018 06:57:07 GMT

HPERedfishCmdlets can be installed from the PowerShell gallery by executing the cmdlet

 Install-Module HPERedfishCmdlets

Modifying the WorkloadProfile requires a system reboot. You could try the following script to modify the WorkloadProfile using HPERedfishCmdlets. This script also resets the server and prints the value of the WorkloadProfile setting after reboot.

$s = Connect-HPERedfish $address $username $password -DisableCertificateAuthentication 

$settingl1 = @{}
$settingl1.Add("WorkloadProfile","Virtualization-MaxPerformance") # check redfish/v1/registries for BIOS attribute names and allowable values to be used
$setting = @{}
$setting.Add("Attributes",$settingl1)
 
$msg1 = Set-HPERedfishData -Odataid redfish/v1/systems/1/bios/settings/ -Setting $setting -Session $s -DisableCertificateAuthentication
$msg1.error


# check setting update before reset
$get = Get-HPERedfishDataRaw /redfish/v1/systems/1/bios/settings/ -Session $s -DisableCertificateAuthentication
$get.Attributes.WorkloadProfile
 

# reset server for BIOS settings to take effect
$sys = Get-HPERedfishDataRaw /redfish/v1/systems/1/ $s -DisableCertificateAuthentication

$payload = @{}
$payload.Add("ResetType","ForceRestart")

$msg2 = Invoke-HPERedfishAction -Odataid $sys.Actions.'#ComputerSystem.Reset'.target -Data $payload -Session $s -DisableCertificateAuthentication
$msg2.error


# sleep is to wait till reset
Start-Sleep -Seconds 300
 

# check if the setting applied correctly
$get2 = Get-HPERedfishDataRaw redfish/v1/systems/1/bios/ -Session $s -DisableCertificateAuthentication
$get2.Attributes.WorkloadProfile


Disconnect-HPERedfish -Session $s -DisableCertificateAuthentication

The variable $msg1 in the above script would have the details if the system reboot is needed on the setting change.

Thank you,

Vijay Bhojwani

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Sasler — Mon, 19 Nov 2018 12:58:15 GMT

@Vijay_B wrote:
HPERedfishCmdlets can be installed from the PowerShell gallery by executing the cmdlet
 
Modifying the WorkloadProfile requires a system reboot. You could try the following script to modify the WorkloadProfile using HPERedfishCmdlets. This script also resets the server and prints the value of the WorkloadProfile setting after reboot.
 
The variable $msg1 in the above script would have the details if the system reboot is needed on the setting change.

Thank you,
Vijay Bhojwani

Thanks, I shall test that.

Another thing that I noticed is that when reboot or cold boot doesn't help, shutting down and removing power cables does help.

Thanks

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

rookie1082 — Wed, 28 Nov 2018 17:07:02 GMT

Saser,

Have you had a chance to test the steps provided to see if there are any more details provided by the redfish cmdlets?

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Sasler — Wed, 05 Dec 2018 09:36:38 GMT

@rookie1082 wrote:
Saser,
Have you had a chance to test the steps provided to see if there are any more details provided by the redfish cmdlets?

No, sorry. I've been too busy to test that. Our server installers have been using that full power of cycle as a workaround in the meanwhile.

Thanks

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Sasler — Mon, 17 Dec 2018 13:11:27 GMT

@rookie1082 wrote:
Saser,
Have you had a chance to test the steps provided to see if there are any more details provided by the redfish cmdlets?

Hi,

So I tested your redfish script against a server which was getting that "Object reference not set to an instance of an object" error and it did indeed work. It did change the workload profile correctly. However, when trying to run the HPEBIOS cmdlets after that, including the reset, I was still getting the same error.

So it seem like there is something wrong within the HPEBIOS module, since the redfish module is able to do the same thing without any issues.

Thanks

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

rookie1082 — Mon, 17 Dec 2018 15:57:13 GMT

Very interesting, Thanks Saser.

My technicians were not reporting any problems to me until I updated the BIOS cmdlets to 2.1.0.1 .

Prior to that, they were configuring machines correctly. I think i'll have to go back to the old version of BIOS cmdlets until this bug is worked out.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

rookie1082 — Mon, 17 Dec 2018 19:44:00 GMT

Small update...

I have an ML110 Gen10 that I am trying to set the workload profile (among other things) and i can reproduce the error that Saser is getting.

I have tried with different version of HPEBIOS cmdlets, 2.1.0.1, 2.1.0.0, and 2.0.0.0 and all get this error. I will try to set the settings with the redfish cmdlets next.

I was able to set the workload profile successfully with the redfish commands though. I reset and it applied it successfully. LIke saser, I'm having the same issue on Gen10 servers using the HPEBiosCmdlets. However it's not all Gen10 models as I can set BIOS settings (such as asset tag) on a DL380 Gen10 successfully.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

B_Rajesh — Tue, 18 Dec 2018 05:11:54 GMT

Thank you Rookie for update,

Can we have call since we are not able to reproduce the issue at our end.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

rookie1082 — Tue, 18 Dec 2018 05:16:37 GMT

Hey Rajesh,

The server I had today is not in my possession any longer. If I get any more in the future I will let you know.
I incorporated redfish cmdlets to set the bios settings for now.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

B_Rajesh — Tue, 18 Dec 2018 05:19:04 GMT

Thank you Rookie,

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Sasler — Tue, 18 Dec 2018 09:29:09 GMT

@B_Rajesh wrote:
Thank you Rookie for update,
Can we have call since we are not able to reproduce the issue at our end.

I have two DL380 Gen10s with this issue available now, if needed.

Thanks

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

rookie1082 — Wed, 09 Jan 2019 15:08:35 GMT

This issue still persists on various Gen10 models (it is intermittent I admit). To get around this problem for now, I have migrated my BIOS changes to the redfish cmdlets in the meantime.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

B_Rajesh — Wed, 16 Jan 2019 15:01:22 GMT

Hi Rookie,

Can we have a call via Skype for more details since we are not able to reproduce the issue at our end.

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

Sasler — Thu, 02 May 2019 08:33:16 GMT

Just an update for this issue. After seeing this issue becoming more prevelant, we desided start using Redfish instead. That simply works as intedent every time.

Thanks

Re: HPEBIOS cmdlets 2.1.0.1: Object reference not set to an instance of an object

GokulKS — Thu, 02 May 2019 09:30:43 GMT

Hi,

HPEBIOSCmdlets has released 2.2 version which has a fix for "Object reference not set to an instance of an object" on Gen9 and Gen 10 servers.

Check the below yammer link post for more details on the new release. https://www.yammer.com/hpe.com/threads/122426154901504

Thanks,

Gokul