topic Re: Linux with 10 GB network cards in Operating System - Linux

Linux with 10 GB network cards

JaYKaY_1 — Sun, 25 Jul 2010 07:31:49 GMT

Real issue for the customer.

Network connectivity is not stable - getting disconnected, threw is slow, hangs.

OS - Linux
Using bonding with two 10 Gb cards.(HP NC510C PCIe 10 Gigabit Server Adapter)
Server Details HP DL580G5 E7330 2X3M 2P 4G EU Svr GB8842603E
Connectivity CX4

Network - HP procurve. with J8702A Modules.

Now
I want to test the threw, by connecting two servers directly with a cable.

how can test test it?

can i use the same cable for connecting the saervers ?

Re: Linux with 10 GB network cards

Jeeshan — Mon, 26 Jul 2010 03:50:13 GMT

what is the output of "ethtool eth0" command.

check also the router or switch connected to it.

If your network is based on 1 GB than 10 GB will not be used. You may set "Autonegociation On" in your router or switch.

Or, finally you may consult with HP.

Re: Linux with 10 GB network cards

Gerhard Roets — Mon, 26 Jul 2010 08:37:52 GMT

Hi Jishanth

If you can post a "show tech all" fromt he Procurve it would be good :). I know it might not be possible.

Another quick suggestion, on the CX4 cable there is latches, be sure they are engaged, that is one of the fun things about CX4 if those are not clipped in, the cables is very vulnerable to slight bumps causing connection glitches.

HTH
Gerhard

Re: Linux with 10 GB network cards

Rob Leadbeater — Mon, 26 Jul 2010 12:43:12 GMT

Hi,

Slow network throughput may be due to a bug in the current bnx2x driver as detailed in Red Hat knowledgebase article 36394.

https://access.redhat.com/kb/docs/DOC-36394

The work around is to put this into /etc/modprobe.conf

options bnx2x disable_tpa=1

That said, I haven't checked whether the NC510C is a Broadcom card...

Cheers,

Rob

Re: Linux with 10 GB network cards

Alan_152 — Mon, 26 Jul 2010 13:33:59 GMT

Which version of Linux? I've done work using 10G cards using RHEL 4.3 and SLES10.2.

Re: Linux with 10 GB network cards

Gerhard Roets — Mon, 26 Jul 2010 14:54:04 GMT

Hi Jishanth

For your questions Yes you can just use the same cable :).

HTH
Gerhard

Re: Linux with 10 GB network cards

Alzhy — Mon, 26 Jul 2010 15:03:17 GMT

If you're on RHEL 5.4 or 5.5, you may have that toxic driver module described in the Redhat Advisory.

The workaround (pending an errata fix) should adderss your issue.

Please try it.

Re: Linux with 10 GB network cards

Stjames — Sat, 04 Sep 2010 16:36:02 GMT

Alzhy, what is the link for the Red Hat advisory about the RHEL 5.5 having issue with 10GB connectivity?

Re: Linux with 10 GB network cards

Abushad — Mon, 06 Sep 2010 08:32:34 GMT

Hi,

Please give me output of the command
#vi /proc/net/bonding/bond0

i guess one of your ethernet port is intermittently going down and hence slowing down the network

Regards,
Abushad