topic DL360G5 network speed issue in Operating System - Linux

DL360G5 network speed issue

DLuser_1 — Tue, 13 Jan 2009 21:29:32 GMT

Hi,

I am having hard time getting HP360G5 Broadcom nic to negotiate 1000MB/sec FD while on RHEL 5.2 latest kernel/patches. I flashed the latest nic firmware and use the 1.81c HP bnx2 kernel driver without success. On the other end are CISCO 45xx switches set to auto negotiate.

Tried to set
ETHTOOL_OPTS="autoneg off speed 1000 duplex full" and
ETHTOOL_OPTS="autoneg on" in ifcfg-eth0 without success the server nic coming as 100 BaseTx-FD.

Is anyone able to get nic to 1GB-FD working on RHEL 5.2 x86_64?

Please help.

Thanks.

Re: DL360G5 network speed issue

Ivan Ferreira — Tue, 13 Jan 2009 21:38:39 GMT

Try with:

ETHTOOL_OPTS="autoneg on speed 1000 duplex full"

This will advertise 1000 FD leaving the required autoneg on.

Re: DL360G5 network speed issue

DLuser_1 — Tue, 13 Jan 2009 21:58:45 GMT

This is partially working as after I do:
/etc/init.d/network restart both nics come as 100 Mbit, full duples, link ok.

However if I do an ifdown eth0;ifup eth0 it is working.

How do I make sure that this 1000 MB speed is the one that come after each reboot?

should I use rc.local with ifdown/ifup?

Thanks.

Re: DL360G5 network speed issue

Ivan Ferreira — Wed, 14 Jan 2009 01:08:25 GMT

What if you use the ethtool after network initialization, maybe that command you could run in rc.local.

Re: DL360G5 network speed issue

niki67 — Wed, 14 Jan 2009 07:58:59 GMT

Hi,
if yuo set in the configuration file of your NIC the option:

ETHTOOL_OPTS="autoneg off speed 1000 duplex full"

you need to set the speed and duplex value in the interface configuration parameter, because the auto negotiate in CISCO switch cause problem, you set in the interface parameter the values like in this example:

interface GigabitEthernet y/xx
...
speed 1000
duplex full

This set the speed ad duplex to 1000/full and eliminate the auto negotiate default option.

I hope this suggestion resolve your problem.

Hi, Nicola.

Re: DL360G5 network speed issue

DLuser_1 — Wed, 14 Jan 2009 16:39:37 GMT

That's how it started my problem niki67. I had autonegotiaton turned off on Cisco and DL360G5 and both were forced to 1000 FD - it did not worked!!??? at 1000-FD. The only way to made this work was to turn CISCO autonegotiations on and on server side the same like was suggested

ETHTOOL_OPTS="autoneg on speed 1000 duplex full" and that would only work after ifdown/ifup ethX...

Not sure if this is a problem with this new chipset, firmware, bnx2 driver but is not something that I like. I will switch to Intel Pro cards for any GB servers.

Re: DL360G5 network speed issue

DLuser_1 — Wed, 14 Jan 2009 16:43:44 GMT

It seems that DL360G5 nics have problems under RHEL 5.2 when trying to get 1000-FD and using Cisco switches.

It seems that every time when vendors use Broadcom chipsets in their on-board servers and clients have CISCO gears there are lots of problems with speed negotiation. I believe that HP, IBM, Dell should have serious talks with Cisco and Broadcom to make sure that they talk to each other and implement the same layer two specifications...

Re: DL360G5 network speed issue

Morgan Johansson — Mon, 16 Feb 2009 12:14:09 GMT

DLuser:

Did you get around this somehow?

Where did you find this info:

"It seems that every time when vendors use Broadcom chipsets in their on-board servers and clients have CISCO gears there are lots of problems with speed negotiation."

Thx
Morgan