What kind of PCIe network card is required for HP DL320e gen8 v2 server to pass through

[CloudStrife]

server: HP DL320e gen8 v2

cpu：intel e3-1240L v3

memory：8g ecc memory×2

system: ESXI 6.7 u3

我升级到了2019年最新的bios固件，并在bios中开启了所有虚拟化选项包括vt-d

测试了包括HP NC365T网卡以及使用intel I350芯片的网卡、intel 82576GB网卡，这些网卡在ESXI 6.7 u3中可以识别，也可以使用，但无法使用pcie直通功能。当激活pcie直通并开启绕过acs检查选项后，将直通的设备分配给虚拟机，虚拟机内核崩溃无法启动，错误提示联系生产商。

我也试过使用这个方法：https://support.hpe.com/hpesc/public/docDisplay?docId=emr_na-c04781229

依然无法使用pcie网卡设备直通

更换到linux下使用kvm也无法直通

已经通宵很多天搜索资料和尝试，没有成功，也没有发现HPE在什么地方提及相关资料，请问哪些网卡支持此机型的pcie直通功能呢？是否可以让技术人员解答一下，谢谢

Google Translated

Server: HP DL320e gen8 v2

cpu: intel e3-1240L v3

memory: 8g ecc memory × 2 system: ESXI 6.7 u3

I upgraded to the latest bios firmware in 2019, and opened all virtualization options in bios including vt-d test

Including HP NC365T network card and the use of Intel I350 chip network card, Intel 82576GB network card, these network cards can be identified in ESXI 6.7 u3, can also be used, but can not use the PCIe pass-through function. When pcie pass-through is activated and the bypass ACS check option is enabled, the pass-through device is assigned to the virtual machine, the virtual machine kernel fails to start, and the error prompts to contact the manufacturer.

I also tried to use this method: https://support.hpe.com/hpesc/public/docDisplay?docId=emr_na-c04781229

I still ca n’t use the pcie network card device pass-through.

I ca n’t use the kvm under linux.

I ’ve been searching all night long. The information and attempts have not been successful, and nowhere has HPE mentioned relevant information. Which network cards support the pcie pass-through function of this model?

Can the technical staff answer it?

Thank you 

[sudhirsingh]

Hi,

ESXi 6.7 not supported on this server model as per support matrix,

https://techlibrary.hpe.com/us/en/enterprise/servers/supportmatrix/vmware.aspx

however from the link you have mentioned in your post,

NIC pass-through with HPE ProLiant Gen8-series servers with HPE PCI network adapters using Intel Ethernet controllers or third-party NICs

ProLiant Gen8-series servers, with the exception of the HP ProLiant DL580 Gen8 server, can be configured to support device pass-through for following set of NICs:

• HP Ethernet 1GB 2-port 361T Adapter
• HP Ethernet 1GB 4-port 366M Adapter
• HP Ethernet 10GB 2-port 560SFP+ Adapter
• HP Ethernet 10GB 2-port 560M Adapter
• HP Ethernet 10GB 2-port 561T Adapter
• HP Ethernet 10GB 1-port P560SFP+ Adapter

Also based on the server quickspec i can see following NIC are supported

https://h20195.www2.hpe.com/v2/gethtml.aspx?docname=c04123220

HP Networking

Gigabit Ethernet Adapters

HP NC112T PCI Express Gigabit Server Adapter

503746-B21

HP NC365T 4-port Ethernet Server Adapter

593722-B21

HP Ethernet 1Gb 2-port 361T Adapter

652497-B21

HP Ethernet 1Gb 4-port 331T Adapter

647594-B21

HP Ethernet 1Gb 2-port 332T Adapter

615732-B21

10 Gigabit Ethernet Adapters
NOTE: A minimum of two Gigabytes (2 GB) of server memory is required per each adapter.

HP NC523SFP 10Gb 2-port Server Adapter

593717-B21

HP NC552SFP 10Gb 2-port Ethernet Server Adapter

614203-B21

HP Ethernet 10Gb 2-port 530T Adapter

656596-B21

HP Ethernet 10Gb 2-port 560SFP+ Adapter

665249-B21

Not sure whether using 560SFP+ Adapter will solve this issue but you can try.

Regards,

Sudhir

[CloudStrife · Accepted solution]

thanks for the quickly answer. after almost half month investigation. I finally realized this issue is caused by bios. HP doesn't supply a fixed bios firmware for old servers(gen7 or gen8 series) to disable RMRR.

I tried to patch linux's kernel and forced it bypass RMRR.

now my HP DL320e gen8 v2 can use pcie passthrough function on both HP nc365T and HP nc112T cards. (and I believe other NICs too, can use pcie passthrough function now)

I can even assign any single port of these NICs to virtual machine(centos etc.).  the virtual machine recognizes MAC address of these port correctly.

to others who want ot use pcie passthrough function on their gen7 or gen8 series servers:

DON'T WASTED YOUR TIME. PATCHING LINUX KERNEL IS THE ONLY WAY OUT.

[1crb1]

Hi, I'm having similar issues trying to passthrough a nic on Proxmox on a DL360P Gen8 V2. I know this post is rather old, but I'm hoping you can point me in the right direction for patching the kernel to bypass RMRR. Did you follow a guide or just experiment until you got it working? Any advice is much appreciated.