topic Re: HPE RDMA hyperV help in Operating System - Microsoft

HPE RDMA hyperV help

o1wall — Mon, 01 Apr 2024 05:53:51 GMT

I’m looking for support with RDMA configuration on a DL380 Gen11 Host running Microsoft Server 2022 with Hyper-V.

We can get RDMA and SRIOV functioning correctly using HPe DL380’s Gen11 and HPe P210Tep 10gb network cards on a Physical level – that’s not the issue.

The issue is we can’t get RDMA functioning with a Hyper-V Virtual Machine. We’ve followed several guides but to no avail.

Summary: - Cisco Core (configured to use RDMA with a relevant policy)

10GB HPe P210Tep Network Card(s)

HPe DL380 Gen11

Server 2022 Host

Hyper-V

Server 2022 VM’s

Virtual Switch using Embedded Team

1.Switches: We are using Cisco which have been configured for RDMA.

RDMA is functioning correctly between physical hosts with impressive performance.

(Nexus 9504 chassis with 48p 10GB line cards Firmware version 05.47 NXOS: version 9.3(12) BIOS compile time: 04/28/2022)

2.SR-IOV Support: SR-IOV has been enabled on the HPe Ethernet P210Tep NIC(s) in the NIC features and in the DL380 Gen11 BIOS/UEFI settings of the server? (Note there are several settings to enable, device specific and global-

(DL380 gen11 Bios U54 v1.44 (07/31/2023) & HPe P210Tep firmware version 224.1.102.0)

3.NIC Driver version: 227.0.125.0

VM NIC Driver version: 227.0.125.0

The VM shows RDMA being enabled but also shows RDMA Operational as False, hence transfer speeds are standard.

Do HPe P210tep(s) support VF functionality in a Hyper-V environment?

I can see several guides for Dell & Lenovo but so far, I haven't seen anything for HP.

Re: HPE RDMA hyperV help

Suman_1978 — Mon, 01 Apr 2024 05:09:15 GMT

Hi,

Do you have the HPE Part number for this P210Tep card?
I am not an expert on this technology, but can check if this card supports the said technology.

Digging into the model, I found that, its a Broadcom P210tep NetXtreme-E Dual-port 10GBASE-T Ethernet BCM57416 PCIe Adapter.
You can read the QuickSpecs from HPE for the BCM57416 PCIe Adapter.
https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=a00073559enw
https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=a00047731enw

Thank You!
I work with HPE but opinions expressed here are mine.

Re: HPE RDMA hyperV help

StephenBuxton — Thu, 04 Apr 2024 12:23:27 GMT

According to the Specification sheet RDMA (Roce v2) is supported on the P210TEp & 535T.