topic Re: The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3 in Operating System - Linux

The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3

senthil_kumar_1 — Tue, 23 Mar 2010 11:02:37 GMT

Hi All,

I have connected one dual port Mellanox Connect-X2 10GigE ethernet card in my HP Proliant DL 360 G6 and running RHEL 5.3

Only one port is detected properly

I have used following methods.

method 1:

I have checked whether two ports are detected properly by the command "lspci" , but it is showing only one

Ex:

# lspci | grep -i ethernet
0d:00.0 Ethernet controller: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] (rev b0)

Method 2:

I issued "system-config-network" from GUI mode.

It is showing only one ethernet "eth0" device Under "devices" tab

But under "hardware" tab, it is showing two eth0 and eth1 , eth0 taken the correct driver and eth1 have not taken the correct driver

Ex:

eth0 -> Mellanox Technologies MT26448[ConnectX EN 10GigE, PCIe 2.0 5 GT/s] (eth0)

eth1 --> mlx4_en (HP_0CD0210010) (eth1).

So I think the second prot has been detected but driver is not updated correctly.

So How to solve this issue.

Re: The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3

Michael Steele_2 — Tue, 23 Mar 2010 12:52:36 GMT

Hi

I would start with the Manufacturer and provide him with the kernel version as it likely his driver can't handle his chipset and Red Hat all at the same time.

I've contacted RH for a current list of compatible NICS and will post when I have it.

For some reason, RH never posts this list on their website and I believe its because they can't keep up with the demand.

Re: The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3

senthil_kumar_1 — Tue, 23 Mar 2010 13:38:16 GMT

Hi Michael Steele,

Server details:

Manufacturer: HP
Product Name: ProLiant DL380 G6

Kernel details:

2.6.18-128.el5

Re: The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3

Michael Steele_2 — Tue, 23 Mar 2010 13:40:59 GMT

http://mellanox.com/content/pages.php?pg=products_dyn&product_family=27&menu_section=35#tab-two

Here you go. It's on the Mellanox site but not on the RHEL site. Which means you'll be following the Mellanox driver installation instructions and doing a 'make', 'make install', modprobe.conf, etc.

I heard from RH also and still, they do not provide a list of compatible NICS and haven't for a couple of years now.

Re: The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3

Steven E. Protter — Tue, 23 Mar 2010 13:41:59 GMT

Shalom Sentil,

This is a known issue. RH does not have unlimited resources to support each and every card in the kernel.

The maker of the card, if it is certified by the manufacturer to work with Linux should provide a driver.

RH 5, update 4 or the soon expected update 5 might also provide relief for this problem.

SEP

Re: The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3

senthil_kumar_1 — Wed, 24 Mar 2010 09:57:37 GMT

Hi All,

Actually this card is having two ports.

One port is taken correct driver.

So that the driver (module) for the that card has been installed in linux.

As per logic, the same driver might be applicable to second port (since firs and second port are in same card), am i correct?

Why the same driver is not suitable for second port?

How to resolve the this issue.

Re: The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3

Michael Steele_2 — Wed, 24 Mar 2010 13:49:46 GMT

Hi

Read more carefully:

"...ConnectXÂ® EN / ConnectXÂ®-2 EN NICs with Ethernet and Fibre Channel over Ethernet support., ..."

One port is for a SAN / Fibre channel

The other port is for network / Ethernet.

This has become the typical I/O card installation for several years now, saving an I/O slot on the server by combining SAN and ETHERNET into one PCI card.

Note that this card will have two forms of firmware upgrades which you should investigate, (* use fcmsutil *), as well as two different drivers.

Re: The network card "Mellanox Connect-X2 10GigE" is not detecting properly in RHEL5.3

Michael Steele_2 — Wed, 24 Mar 2010 13:50:27 GMT

Sorry, not fcmsutil. The command and firmware update will be based upon the type of HBA, ie., qlogic.