276 Option Card requires more memory mapped IO than is available

[Carmagustus]

276-Option Card Configuration Error

Symptom

276-Option Card Configuration Error. An option card is requesting more memory mapped I/O than is available.

Cause

An option card is requesting more memory mapped I/O than is available

Can not load more than 4 PCIe cards Cards 5 and 6 show no memory assigned, and they fail to register.

[BPSingh]

Greetings!

What is the server model?
Is this a new installation?
What type of cards are you installing?
Have you consulted the server's quickspecs for the configuration?

[Carmagustus]

Host information HPE ProLiant DL580 Gen10 Server.

Product: HPE ProLiant DL580 Gen10 8SFF Configure-to-order Server 

Gold Processors - 1st Generation Intel® Xeon® Scalable Processor Family

Intel Xeon Models CPU: Gold 6136 Processor

BIOS: U34 v3.10 (02/22/2024) 

The PCI cards are PCI-5565. Five of these cards work perfectly fine in the server. However additional cards don't get (initialized) memory mapped IO to opererate.

How do you extend PCI memory mapped IO?

[BPSingh]

Please refer the server quickspecs for config details. 

https://www.hpe.com/psnow/doc/a00021850enw.pdf?jumpid=in_pdp-psnow-qs

I understand that you are installing 3rd party cards. 

Set workload profile to HPC or Virt Max performance from BIOS and check the outcome. 

Page#49 https://www.hpe.com/psnow/doc/a00016407en_us

[Carmagustus]

Quick specs show: Gold 61xx and 51xx series - 2 and 4 socket capable, 3UPI @ 10.4 GT/s on 61xx processors, 2UPI @ 10.4 GT/s on 51xx
processors, 6-Channel DDR4 @ 2400 MHz (SKU 5122=supports 2666), 768 GB memory capacity (1.5 TB on select skus),
Intel Turbo Boost Technology, Intel Hyper-Threading Technology, Intel AVX-512(1x 512-bit FMA) (SKU 5122 supports 2x
512 bit FMA), 48 lanes PCIe 3.0, advanced RAS.

PCie - 7 slot primary, 7 slot secondary 2 slot tertiary. = 16 PCIe

Will try workload settings for HPC, why not try workload settings for Graphics?

[Carmagustus]

Tested the "HPC" work load, and the "Graphics" work load. 

In both cases still get the 276 configuration error - option card requesting more memory mapped IO than is availaible (MMIO error) when more than 5 cards are enabled.

Each card requires only 128 MB, does not seem like a lot. How can the Memory Mapped IO allocation be increased?

[BPSingh]

Since you are attempting to add a third-party card, I cannot be certain of its compatibility or functionality with the server. Could you please log a support case so the logs can be reviewed to further isolate the issue?