ProLiant Servers (ML,DL,SL)
1753893 Members
7592 Online
108809 Solutions
New Discussion

DL580 Gen9 - Workload Accelerator FIO_EXTERNAL_POWER_OVERRIDE won't take effect

 
ReneSchell
Occasional Contributor

DL580 Gen9 - Workload Accelerator FIO_EXTERNAL_POWER_OVERRIDE won't take effect

Hi dear fellas,

I'm trying to override the PCIe power limit on my DL580 Gen9 with:

fio-config -p FIO_EXTERNAL_POWER_OVERRIDE 1526G0438:50000

But it doesn't take it.

It's also kinda weird, that the only PCIe slot witch took the POWER_OVERRIDE is the one with fct6 (see result from fio-status)

Found 1 VSL driver package:
   4.2.4 build 1179 Driver: loaded

Found 7 ioMemory devices in this system

Adapter: ioMono  (driver 4.2.4)
	HP 5.2TB FH/HL Light Endurance (LE) PCIe Workload Accelerator, Product Number:775672-B21, SN:3UN532Z005
	ioMemory Adapter Controller, PN:775680-001  
	Product UUID:5935b634-c00f-56e9-8deb-f1f24c081316
	PCIe Bus voltage: avg 12.22V
	PCIe Bus current: avg 0.81A
	PCIe Bus power: avg 9.93W
	PCIe Power limit threshold: 12.75W
	PCIe slot available power: unavailable
	Connected ioMemory modules:
	  fct0: 41:00.0, 	Product Number:775672-B21, SN:3UN532Z005

fct0	Attached
	ioMemory Adapter Controller, Product Number:775672-B21, SN:1526G0442
	ioMemory Adapter Controller, PN:775680-001  
	Microcode Versions: App:0.0.30.0
	Powerloss protection: protected
	Last Power Monitor Incident: 3693 sec
	PCI:41:00.0, Slot Number:6
	Vendor:1aed, Device:3001, Sub vendor:1590, Sub device:b5
	Firmware v8.9.4, rev 20151216 Public
	5200.00 GBytes device size
	Format: v501, 1269531250 sectors of 4096 bytes
	PCIe slot available power: 2.50W
	PCIe negotiated link: 8 lanes at 5.0 Gt/sec each, 4000.00 MBytes/sec total
	Internal temperature: 31.50 degC, max 36.91 degC
	Internal voltage: avg 1.01V, max 1.04V
	Aux voltage: avg 1.80V, max 1.84V
	Reserve space status: Healthy; Reserves: 100.00%, warn at 10.00%
	Active media: 100.00%
	Rated PBW: 64.00 PB, 99.96% remaining
	Lifetime data volumes:
	   Physical bytes written: 26,583,361,654,632
	   Physical bytes read   : 45,149,459,354,496
	RAM usage:
	   Current: 517,476,672 bytes
	   Peak   : 2,661,878,848 bytes
	Contained Virtual Partitions:
	  fct0:	ID:0, UUID:2be48a9a-a7d3-4868-b6db-6c72721e45ed

fct0	State: Online, Type: block device, Device: \\?\PhysicalDrive4
	ID:0, UUID:2be48a9a-a7d3-4868-b6db-6c72721e45ed
	5200.00 GBytes device size
	Format: 1269531250 sectors of 4096 bytes
	Sectors In Use: 45552611
	Max Physical Sectors Allowed: 1269531250
	Min Physical Sectors Reserved: 1269531250

Adapter: ioMono  (driver 4.2.4)
	HPE 1.3TB HH/HL Light Endurance (LE) PCIe Workload Accelerator, Product Number:775668-B21, SN:3UN539W01B
	ioMemory Adapter Controller, PN:775678-001  
	Product UUID:916740f1-2dbb-51fc-a8ba-d8a9988411ad
	PCIe Bus voltage: avg 12.20V
	PCIe Bus current: avg 0.74A
	PCIe Bus power: avg 9.01W
	PCIe Power limit threshold: 12.75W
	PCIe slot available power: unavailable
	Connected ioMemory modules:
	  fct1: 84:00.0, 	Product Number:775668-B21, SN:3UN539W01B

fct1	Attached
	ioMemory Adapter Controller, Product Number:775668-B21, SN:1529G0007
	ioMemory Adapter Controller, PN:775678-001  
	Microcode Versions: App:0.0.44.0
	Powerloss protection: protected
	Last Power Monitor Incident: 3497 sec
	PCI:84:00.0, Slot Number:4
	Vendor:1aed, Device:3002, Sub vendor:1590, Sub device:b3
	Firmware v8.9.4, rev 20151216 Public
	1300.00 GBytes device size
	Format: v501, 317382812 sectors of 4096 bytes
	PCIe slot available power: 2.50W
	PCIe negotiated link: 8 lanes at 5.0 Gt/sec each, 4000.00 MBytes/sec total
	Internal temperature: 30.51 degC, max 35.44 degC
	Internal voltage: avg 1.02V, max 1.03V
	Aux voltage: avg 1.79V, max 1.82V
	Reserve space status: Healthy; Reserves: 100.00%, warn at 10.00%
	Active media: 100.00%
	Rated PBW: 16.00 PB, 99.99% remaining
	Lifetime data volumes:
	   Physical bytes written: 838,499,193,216
	   Physical bytes read   : 2,870,525,649,600
	RAM usage:
	   Current: 126,946,368 bytes
	   Peak   : 637,226,048 bytes
	Contained Virtual Partitions:
	  fct1:	ID:0, UUID:647392f8-169f-4721-87a7-82a12eb95abb

fct1	State: Online, Type: block device, Device: \\?\PhysicalDrive1
	ID:0, UUID:647392f8-169f-4721-87a7-82a12eb95abb
	1300.00 GBytes device size
	Format: 317382812 sectors of 4096 bytes
	Sectors In Use: 22992
	Max Physical Sectors Allowed: 317382812
	Min Physical Sectors Reserved: 317382812

Adapter: ioMono  (driver 4.2.4)
	HP 5.2TB FH/HL Light Endurance (LE) PCIe Workload Accelerator, Product Number:775672-B21, SN:3UN532Z006
	ioMemory Adapter Controller, PN:775680-001  
	Product UUID:9b1ce4a1-0ea2-55be-a3ea-1d3237e2c510
	PCIe Bus voltage: avg 12.21V
	PCIe Bus current: avg 0.85A
	PCIe Bus power: avg 10.18W
	PCIe Power limit threshold: 12.75W
	PCIe slot available power: unavailable
	Connected ioMemory modules:
	  fct2: 81:00.0, 	Product Number:775672-B21, SN:3UN532Z006

fct2	Attached
	ioMemory Adapter Controller, Product Number:775672-B21, SN:1526G0488
	ioMemory Adapter Controller, PN:775680-001  
	Microcode Versions: App:0.0.30.0
	Powerloss protection: protected
	Last Power Monitor Incident: 3692 sec
	PCI:81:00.0, Slot Number:3
	Vendor:1aed, Device:3001, Sub vendor:1590, Sub device:b5
	Firmware v8.9.4, rev 20151216 Public
	5200.00 GBytes device size
	Format: v501, 1269531250 sectors of 4096 bytes
	PCIe slot available power: 2.50W
	PCIe negotiated link: 8 lanes at 5.0 Gt/sec each, 4000.00 MBytes/sec total
	Internal temperature: 31.50 degC, max 35.93 degC
	Internal voltage: avg 1.01V, max 1.04V
	Aux voltage: avg 1.80V, max 1.84V
	Reserve space status: Healthy; Reserves: 100.00%, warn at 10.00%
	Active media: 100.00%
	Rated PBW: 64.00 PB, 99.96% remaining
	Lifetime data volumes:
	   Physical bytes written: 26,445,448,049,312
	   Physical bytes read   : 42,478,646,416,416
	RAM usage:
	   Current: 337,576,640 bytes
	   Peak   : 2,472,489,664 bytes
	Contained Virtual Partitions:
	  fct2:	ID:0, UUID:1280703a-9c2b-4298-83f8-ff35495bd83d

fct2	State: Online, Type: block device, Device: \\?\PhysicalDrive6
	ID:0, UUID:1280703a-9c2b-4298-83f8-ff35495bd83d
	5200.00 GBytes device size
	Format: 1269531250 sectors of 4096 bytes
	Sectors In Use: 45552652
	Max Physical Sectors Allowed: 1269531250
	Min Physical Sectors Reserved: 1269531250

Adapter: ioMono  (driver 4.2.4)
	HP 5.2TB FH/HL Light Endurance (LE) PCIe Workload Accelerator, Product Number:775672-B21, SN:3UN532Z002
	ioMemory Adapter Controller, PN:775680-001  
	Product UUID:10b9ffa7-d0a3-56bd-9713-2f53281b8092
	PCIe Bus voltage: avg 12.19V
	PCIe Bus current: avg 0.79A
	PCIe Bus power: avg 9.56W
	PCIe Power limit threshold: 12.75W
	PCIe slot available power: unavailable
	Connected ioMemory modules:
	  fct3: c1:00.0, 	Product Number:775672-B21, SN:3UN532Z002

fct3	Attached
	ioMemory Adapter Controller, Product Number:775672-B21, SN:1526G0454
	ioMemory Adapter Controller, PN:775680-001  
	Microcode Versions: App:0.0.30.0
	Powerloss protection: protected
	Last Power Monitor Incident: 3693 sec
	PCI:c1:00.0, Slot Number:1
	Vendor:1aed, Device:3001, Sub vendor:1590, Sub device:b5
	Firmware v8.9.4, rev 20151216 Public
	5200.00 GBytes device size
	Format: v501, 1269531250 sectors of 4096 bytes
	PCIe slot available power: 2.50W
	PCIe negotiated link: 8 lanes at 5.0 Gt/sec each, 4000.00 MBytes/sec total
	Internal temperature: 30.51 degC, max 35.93 degC
	Internal voltage: avg 1.02V, max 1.04V
	Aux voltage: avg 1.80V, max 1.84V
	Reserve space status: Healthy; Reserves: 100.00%, warn at 10.00%
	Active media: 100.00%
	Rated PBW: 64.00 PB, 99.96% remaining
	Lifetime data volumes:
	   Physical bytes written: 26,551,703,674,464
	   Physical bytes read   : 43,767,192,063,168
	RAM usage:
	   Current: 337,576,640 bytes
	   Peak   : 2,472,489,664 bytes
	Contained Virtual Partitions:
	  fct3:	ID:0, UUID:40b1fe07-f07c-427e-b9b1-1dda0f625d7b

fct3	State: Online, Type: block device, Device: \\?\PhysicalDrive5
	ID:0, UUID:40b1fe07-f07c-427e-b9b1-1dda0f625d7b
	5200.00 GBytes device size
	Format: 1269531250 sectors of 4096 bytes
	Sectors In Use: 45552716
	Max Physical Sectors Allowed: 1269531250
	Min Physical Sectors Reserved: 1269531250

Adapter: ioMono  (driver 4.2.4)
	HP 5.2TB FH/HL Light Endurance (LE) PCIe Workload Accelerator, Product Number:775672-B21, SN:3UN532Z009
	ioMemory Adapter Controller, PN:775680-001  
	Product UUID:23830194-88d1-5b91-b603-306bec7f712a
	PCIe Bus voltage: avg 12.22V
	PCIe Bus current: avg 0.81A
	PCIe Bus power: avg 10.05W
	PCIe Power limit threshold: 12.75W
	PCIe slot available power: unavailable
	Connected ioMemory modules:
	  fct4: c4:00.0, 	Product Number:775672-B21, SN:3UN532Z009

fct4	Attached
	ioMemory Adapter Controller, Product Number:775672-B21, SN:1526G0487
	ioMemory Adapter Controller, PN:775680-001  
	Microcode Versions: App:0.0.30.0
	Powerloss protection: protected
	Last Power Monitor Incident: 864 sec
	PCI:c4:00.0, Slot Number:2
	Vendor:1aed, Device:3001, Sub vendor:1590, Sub device:b5
	Firmware v8.9.4, rev 20151216 Public
	5200.00 GBytes device size
	Format: v501, 1269531250 sectors of 4096 bytes
	PCIe slot available power: 2.50W
	PCIe negotiated link: 8 lanes at 5.0 Gt/sec each, 4000.00 MBytes/sec total
	Internal temperature: 31.01 degC, max 36.42 degC
	Internal voltage: avg 1.02V, max 1.04V
	Aux voltage: avg 1.78V, max 1.84V
	Reserve space status: Healthy; Reserves: 100.00%, warn at 10.00%
	Active media: 100.00%
	Rated PBW: 64.00 PB, 99.96% remaining
	Lifetime data volumes:
	   Physical bytes written: 26,376,302,705,784
	   Physical bytes read   : 41,946,554,206,368
	RAM usage:
	   Current: 361,331,456 bytes
	   Peak   : 2,472,620,736 bytes
	Contained Virtual Partitions:
	  fct4:	ID:0, UUID:4435b9ed-34dd-47e2-a136-245249b78278

fct4	State: Online, Type: block device, Device: \\?\PhysicalDrive7
	ID:0, UUID:4435b9ed-34dd-47e2-a136-245249b78278
	5200.00 GBytes device size
	Format: 1269531250 sectors of 4096 bytes
	Sectors In Use: 45552728
	Max Physical Sectors Allowed: 1269531250
	Min Physical Sectors Reserved: 1269531250

Adapter: ioMono  (driver 4.2.4)
	HP 5.2TB FH/HL Light Endurance (LE) PCIe Workload Accelerator, Product Number:775672-B21, SN:3UN532Z00A
	ioMemory Adapter Controller, PN:775680-001  
	Product UUID:e5089c09-d558-50f8-9b9c-68c0bb235b07
	PCIe Bus voltage: avg 12.22V
	PCIe Bus current: avg 0.81A
	PCIe Bus power: avg 10.00W
	PCIe Power limit threshold: 12.75W
	PCIe slot available power: unavailable
	Connected ioMemory modules:
	  fct5: 87:00.0, 	Product Number:775672-B21, SN:3UN532Z00A

fct5	Attached
	ioMemory Adapter Controller, Product Number:775672-B21, SN:1526G0438
	ioMemory Adapter Controller, PN:775680-001  
	Microcode Versions: App:0.0.30.0
	Powerloss protection: protected
	Last Power Monitor Incident: 3693 sec
	PCI:87:00.0, Slot Number:5
	Vendor:1aed, Device:3001, Sub vendor:1590, Sub device:b5
	Firmware v8.9.4, rev 20151216 Public
	5200.00 GBytes device size
	Format: v501, 1269531250 sectors of 4096 bytes
	PCIe slot available power: 2.50W
	PCIe negotiated link: 8 lanes at 5.0 Gt/sec each, 4000.00 MBytes/sec total
	Internal temperature: 31.50 degC, max 36.42 degC
	Internal voltage: avg 1.02V, max 1.04V
	Aux voltage: avg 1.80V, max 1.84V
	Reserve space status: Healthy; Reserves: 100.00%, warn at 10.00%
	Active media: 100.00%
	Rated PBW: 64.00 PB, 99.96% remaining
	Lifetime data volumes:
	   Physical bytes written: 26,536,973,085,648
	   Physical bytes read   : 43,950,841,754,400
	RAM usage:
	   Current: 337,576,640 bytes
	   Peak   : 2,472,710,848 bytes
	Contained Virtual Partitions:
	  fct5:	ID:0, UUID:ad1e3447-4f51-4fbd-a16d-71526f7f08e7

fct5	State: Online, Type: block device, Device: \\?\PhysicalDrive3
	ID:0, UUID:ad1e3447-4f51-4fbd-a16d-71526f7f08e7
	5200.00 GBytes device size
	Format: 1269531250 sectors of 4096 bytes
	Sectors In Use: 45552763
	Max Physical Sectors Allowed: 1269531250
	Min Physical Sectors Reserved: 1269531250

Adapter: ioMono  (driver 4.2.4)
	HPE 1.3TB HH/HL Light Endurance (LE) PCIe Workload Accelerator, Product Number:775668-B21, SN:3UN539W01A
	ioMemory Adapter Controller, PN:775678-001  
	Product UUID:25ac4f55-096f-5638-870c-0234f8eddc83
	External Power Threshold Override: 49.75W
	PCIe Bus voltage: avg 12.20V
	PCIe Bus current: avg 0.71A
	PCIe Bus power: avg 8.68W
	PCIe Power limit threshold: 49.75W
	PCIe slot available power: unavailable
	Connected ioMemory modules:
	  fct6: 44:00.0, 	Product Number:775668-B21, SN:3UN539W01A

fct6	Attached
	ioMemory Adapter Controller, Product Number:775668-B21, SN:1529G0058
	ioMemory Adapter Controller, PN:775678-001  
	Microcode Versions: App:0.0.44.0
	Powerloss protection: protected
	PCI:44:00.0, Slot Number:7
	Vendor:1aed, Device:3002, Sub vendor:1590, Sub device:b3
	Firmware v8.9.4, rev 20151216 Public
	1300.00 GBytes device size
	Format: v501, 317382812 sectors of 4096 bytes
	PCIe slot available power: 2.50W
	PCIe negotiated link: 8 lanes at 5.0 Gt/sec each, 4000.00 MBytes/sec total
	Internal temperature: 31.01 degC, max 37.90 degC
	Internal voltage: avg 1.02V, max 1.03V
	Aux voltage: avg 1.79V, max 1.82V
	Reserve space status: Healthy; Reserves: 100.00%, warn at 10.00%
	Active media: 100.00%
	Rated PBW: 16.00 PB, 99.97% remaining
	Lifetime data volumes:
	   Physical bytes written: 5,074,472,010,024
	   Physical bytes read   : 2,216,040,380,064
	RAM usage:
	   Current: 132,542,272 bytes
	   Peak   : 642,821,952 bytes
	Contained Virtual Partitions:
	  fct6:	ID:0, UUID:5c5e39cc-a4c7-4056-ac8b-e1df3444a8f1

fct6	State: Online, Type: block device, Device: \\?\PhysicalDrive2
	ID:0, UUID:5c5e39cc-a4c7-4056-ac8b-e1df3444a8f1
	1300.00 GBytes device size
	Format: 317382812 sectors of 4096 bytes
	Sectors In Use: 22992
	Max Physical Sectors Allowed: 317382812
	Min Physical Sectors Reserved: 317382812

And via ioSphere i get this error:

Over PCIe power budget alarm triggered.

Thank you all for every help and idea I get!

1 REPLY 1
RainerQ
New Member

Re: DL580 Gen9 - Workload Accelerator FIO_EXTERNAL_POWER_OVERRIDE won't take effect

I am pretty shure you have found the solution meanwhile, but here it is:
If you have mutliple adapters , always put in the parameters for all cards separated with a comma alltogether in one single command.  This also applies on changes.  Try this: 

fio-config -p FIO_EXTERNAL_POWER_OVERRIDE 1526G0438:50000,1526G0442:50000,1529G0007:50000,.  ..,1529G0058:50000