HPE DL380 Gen11 and NVIDIA H100 GPU

[Luis Otavio da Costa]

Hi folks ,

I have a potential client initially wanting an HPE DL380 Gen11 server with an Nvidia H100 GPU.
Everything is fine when configuring this initial need in the HPE OCA tool.
However, the potential customer will need  a second H100 GPU in the near future and wants to use the NVLINK feature by connecting the two GPUs directly.
Later on, the potential customer will expand the environment with more DL380 Gen11 servers also with one or more GPUs and will want to form a cluster with the NVSwitch resource.
I don't find any information if we can support NVLINK and NVSwitch on the DL380 Gen11 line.
Can we really support these technologies (both) on the DL380 Gen11 line,
Thank you in advance for any support.
Hugs

[Suman_1978]

Hi,

If you see the QuickSpecs for Nvidia the NVlink is supported on DL380a Gen11 model and other few servers but not the DL380 Gen11.

Nvidia QS, page# 5 & 8
DL380a Gen11 QS. page# 20

Thank You!
I work with HPE but opinions expressed here are mine.

[Luis Otavio da Costa]

@Suman_1978 Thanks for your feedback, but we are configuring the H100 model and I can't find NVLINK support in QuickSpecs for this GPU.
Furthermore, I need to know if the DL380 Gen11 or DL380a Gen11 line will be able to support NVSwitch and what the requirements are for this.
Hugs

[Suman_1978]

Hi,

If you are referring to this part number R6V66A which is a NVIDIA Ampere 2‑way 2‑slot Bridge for HPE, this is supported on DL380a Gen11.
DL380 Gen11 QuickSpecs does not show the NVlink part because its not supported.
You may also refer to this post.

If you have further questions about compatibility, you may contact HPE Sales team in your region.

Thank You!
I work with HPE but opinions expressed here are mine.

[Suman_1978]

Hi,

Regarding NVswitch, there is no mention of this switch in the server documentation as of today.

If I check the Fabric Manager for NVIDIA NVSwitch Systems, page# 6, NVSwitches are used in DGX H100 and NVIDIA HGX H100 8-GPU server systems.

Thank You!
I work with HPE but opinions expressed here are mine.

[Luis Otavio da Costa]

@Suman_1978 

Hi ,

No , we are considering the PN R9S41C - NVIDIA H100 80GB PCIe Accelerator for HPE .

I do not understand ... this PN/GPU is recommended for DL380a Gen11 but I can't include it in the server using OCA. 

Thanks