topic Re: 1000Base-SX slow in Operating System - HP-UX

1000Base-SX slow

Jeff Smee — Tue, 26 Aug 2003 20:05:01 GMT

I have an N4000-55 running HP-UX 11.00.
I have an A4926A card installed and I am only getting 12MBytes/sec out of it.
It is running at 1000 Full Duplex.

Any ideas?

Jeff

Re: 1000Base-SX slow

Patrick Wallek — Tue, 26 Aug 2003 20:07:08 GMT

What is your switch set to? Is it also 1000FD? Are you manually setting the card and switch or using auto negotiate?

Re: 1000Base-SX slow

Jeff Smee — Tue, 26 Aug 2003 20:07:17 GMT

Sorry for the triple entry.

Jeff

Re: 1000Base-SX slow

Jeff Smee — Tue, 26 Aug 2003 20:17:35 GMT

lanadmin -x says...
Speed = 1000 Full-Duplex
Autonegotiation = On

Not sure about the switch.

Re: 1000Base-SX slow

Steven E. Protter — Tue, 26 Aug 2003 20:20:40 GMT

I don't have one of these cards.

I do believe that I saw docs saying that contrary to slower HP NICs, both switch and card must be configured to auto negotiate.

lanadmin -x #

replace # with the lan number of the card.

SEP

Re: 1000Base-SX slow

Steven E. Protter — Tue, 26 Aug 2003 23:38:45 GMT

You and I were posting at the same time.

I believe that its important that the switch be set to Autonegotiate. If its not, it could result in performance problems. Contact your network folks. Its a simple change on a Cisco switch, but its the default.

SEP

Re: 1000Base-SX slow

Michael Tully — Tue, 26 Aug 2003 23:48:15 GMT

Your best bet is to set the switch to the same as your lan card, DON'T USE AUTONEGOTIATE. Hard code as 1000 Full Duplex autonegotiate =off both ends, that way it is set in concrete, if that is what the switch can handle. If not, then set it accordingly.

# lanadmin -X 1000FD 0 (will set it to 1000FD)
# lanadmin -X 100FD 0

Make sure that update the appropriate config file in /etc/rc.config.d or you'll lose your settings on the next reboot.

Re: 1000Base-SX slow

doug mielke — Tue, 26 Aug 2003 23:59:57 GMT

I thought I'd read that the 1000 base cards can not be set to auto off.

Thus forcing us to go through the pain of having the network folks confirm their auto settings on their gear

Re: 1000Base-SX slow

Jeff Smee — Wed, 27 Aug 2003 00:13:06 GMT

I also read that this card has to have autonegotiate turned on. i.e. you can't set it to 1000FD. However it is running at that speed.

Re: 1000Base-SX slow

Jeff Smee — Wed, 27 Aug 2003 00:15:49 GMT

http://www.hp.com/products1/unixserverconnectivity/adapters/ethernet/specifications/gigabit_ethernet_specs_print.html

Re: 1000Base-SX slow

rick jones — Wed, 27 Aug 2003 15:31:50 GMT

12 MByte/sec using what sort of transfer method? What sort of system(s) are receiving the data? Are you sure there isn't a 100BT link somewhere between the two?

What do your netstat -p tcp statistics look like (ftp://ftp.cup.hp.com/dist/networking/briefs/annotated_netstat.txt)

What do the lanadmin statistics look like?

Re: 1000Base-SX slow

Jeff Smee — Wed, 27 Aug 2003 15:47:05 GMT

I've tried cp, tar and ftp. 12MB/sec is the best I can do. I also have 2 RP7410's that get the same result. And I am sure there is no 100Mb in the loop.

Re: 1000Base-SX slow

Geoff Wild — Wed, 27 Aug 2003 15:50:33 GMT

We had this same issue - you have to get your network support to set "Auto Negotiation On" on the switch. The strange thing is, there is only one setting for a 1000SX card 1000 Full Duplex. That said, it seems the HP wants to see the aut-negotiate flag on the switch....

We had an HP tech onsite - and that was the only solution - set auto-negotiate on the switch.

Rgds...Geoff

Re: 1000Base-SX slow

rick jones — Wed, 27 Aug 2003 16:06:51 GMT

i'd suggest getting filesystems and discs completely out of the equation - http://www.netperf.org/ run the TCP_STREAM test, and use:

$ netstat -p tcp > /tmp/before_56K
$ netperf -H -l 30 -- -s 56K -S 56K -m 32K
$ netstat -p tcp > /tmp/after_56K
$ beforeafter /tmp/before_56K /tmp/after_56K > delta_56K

and
$ netstat -p tcp > /tmp/before_128K
$ netperf -H -l 30 -- -s 128K -S 128K -m 32K
$ netstat -p tcp > /tmp/after_128K
$ beforeafter /tmp/before_128K /tmp/after_128K > /tmp/delta_128K

Where remote is the remote system where you have a netserver running, and beforeafter is the utility you can retrieve from ftp://ftp.cup.hp.com/dist/networking/tools/

Then post the output of each netperf run, and the delta file from before after and we'll see what things look like. Also include a description of the system actingas the target of the netperf test.

Re: 1000Base-SX slow

Steven E. Protter — Wed, 27 Aug 2003 16:43:54 GMT

We seemed to have read the same doc.

Two choices right now.

If you have a software contract, contact HP.

Or seriously check into those port settings with the switch admin.

Thought of another idea.

From a remote unix box. ping the nic. Watch the ping times. If they continually rise, the card might just be bad.

SEP

Re: 1000Base-SX slow

Jeff Smee — Wed, 27 Aug 2003 16:52:07 GMT

I got the beforeafter program, but I can't find netperf on that site.
Does someone have a link they know works.

Thanks
Jeff

Re: 1000Base-SX slow

Jeff Smee — Wed, 27 Aug 2003 16:59:54 GMT

I'm patching one of my systems now. But I have the same problem on all my HP's with Gigabit cards. I do have software support, but I know what HP will say. They'll say it's the switch. I have opened a case with Cisco to see what they say about our switches. Ping times seem fine (all 0ms).

Jeff

Re: 1000Base-SX slow

Patrick Wallek — Wed, 27 Aug 2003 17:06:03 GMT

I had an issue today with some of my 100Mb cards. NFS performance between a couple of servers was pitiful. One card was hard set at 100FD the other Auto Neg'ed to 100FD. The problem was that the switch was set to Auto Neg, but it just negotiated 100HD. Fixed the switch and all was well.

So I guess my advice is that the first thing you should do is talk to the network guys, have them actually log into the switch and see what the settings are. Make absolutely sure it auto negotiated the correct settings.

Re: 1000Base-SX slow

rick jones — Wed, 27 Aug 2003 17:38:46 GMT

netperf would be under ftp://ftp.cup.hp.com/dist/networking/benchmarks/ - that is where http://www.netperf.org/ should be pointing - if that is amis, please let me know and I'll see what might be wrong.

Re: 1000Base-SX slow

Jeff Smee — Wed, 27 Aug 2003 18:36:09 GMT

netperf revealed quite a bit. Now I think the problem might be disk. I have Ultra160 LVD SCSI, but if I copy a file from disk to disk I get 10Mbytes/sec. I also have a fibre attached EMC SAN. If I copy to it, I get 17Mbytes/sec.

Any one have any ideas now?

Jeff