System Administration
cancel
Showing results for 
Search instead for 
Did you mean: 

Linux with 10 GB network cards

 
Highlighted
Advisor

Linux with 10 GB network cards

Real issue for the customer.


Network connectivity is not stable - getting disconnected, threw is slow, hangs.

OS - Linux
Using bonding with two 10 Gb cards.(HP NC510C PCIe 10 Gigabit Server Adapter)
Server Details HP DL580G5 E7330 2X3M 2P 4G EU Svr GB8842603E
Connectivity CX4

Network - HP procurve. with J8702A Modules.

Now
I want to test the threw, by connecting two servers directly with a cable.

how can test test it?

can i use the same cable for connecting the saervers ?
8 REPLIES 8
Highlighted
Honored Contributor

Re: Linux with 10 GB network cards

what is the output of "ethtool eth0" command.

check also the router or switch connected to it.

If your network is based on 1 GB than 10 GB will not be used. You may set "Autonegociation On" in your router or switch.

Or, finally you may consult with HP.
a warrior never quits
Highlighted
Esteemed Contributor

Re: Linux with 10 GB network cards

Hi Jishanth

If you can post a "show tech all" fromt he Procurve it would be good :). I know it might not be possible.


Another quick suggestion, on the CX4 cable there is latches, be sure they are engaged, that is one of the fun things about CX4 if those are not clipped in, the cables is very vulnerable to slight bumps causing connection glitches.

HTH
Gerhard
Highlighted
Honored Contributor

Re: Linux with 10 GB network cards

Hi,

Slow network throughput may be due to a bug in the current bnx2x driver as detailed in Red Hat knowledgebase article 36394.

https://access.redhat.com/kb/docs/DOC-36394

The work around is to put this into /etc/modprobe.conf

options bnx2x disable_tpa=1

That said, I haven't checked whether the NC510C is a Broadcom card...

Cheers,

Rob
Highlighted
Honored Contributor

Re: Linux with 10 GB network cards

Which version of Linux? I've done work using 10G cards using RHEL 4.3 and SLES10.2.
Highlighted
Esteemed Contributor

Re: Linux with 10 GB network cards

Hi Jishanth

For your questions Yes you can just use the same cable :).

HTH
Gerhard
Highlighted
Honored Contributor

Re: Linux with 10 GB network cards

If you're on RHEL 5.4 or 5.5, you may have that toxic driver module described in the Redhat Advisory.

The workaround (pending an errata fix) should adderss your issue.

Please try it.
Hakuna Matata.
Highlighted
New Member

Re: Linux with 10 GB network cards

Alzhy, what is the link for the Red Hat advisory about the RHEL 5.5 having issue with 10GB connectivity?
Highlighted
Advisor

Re: Linux with 10 GB network cards

Hi,

Please give me output of the command
#vi /proc/net/bonding/bond0

i guess one of your ethernet port is intermittently going down and hence slowing down the network

Regards,
Abushad