topic Re: C-7000 blade system Network Delay in Operating System - Linux

C-7000 blade system Network Delay

Namal Kulathunga — Tue, 24 Feb 2009 06:17:42 GMT

We are using a c7000 enclosure with BL460c blades and Cisco 3020 switches.

Operating system using is Redhat EL 5.1.

I'm using two blades for Telco. VAS applications and found , there is a huge delay or packet loss when I run my applications in a blade.

Comparatively it is as below,
when I run the same application in a IBM Rack mounted 2U server ( OS : RHEL 4) within the given time period server can handle 80000 requests.
But within the same time period BL460 can handle only 4000 requests .(20 times less)

here in BL 460 I'm using NIC bonding to utilize both network interfaces.

Can any one please help me with this.....

Re: C-7000 blade system Network Delay

Steven E. Protter — Tue, 24 Feb 2009 11:42:22 GMT

Shalom,

Please upload /etc/modeprobe.conf
/etc/sysconfig/network-scripts/ifcfg-eth0
/etc/sysconfig/network-scripts/ifcfg-eth1
(any others in configuration)
/etc/sysconfig/network-scripts/ifcfg-bond0

SEP

Re: C-7000 blade system Network Delay

rick jones — Wed, 25 Feb 2009 00:37:23 GMT

Which is it - delay, or packet loss? I'd suggest taking snapshots of ethtool -S stats and netstat -s stats over some intervals of interest and then run them through beforeafter from:

ftp://ftp.cup.hp.com/dist/networking/tools/

that should show packet drops.

WRT latency, with default NIC settings and 3020's, back with RHEL 5.1 on some BL480cs I could see 11200 transactions per second on a stock netperf TCP_RR test - this is from BL480 c to BL480c. If I tweaked the NIC settings to undo the throughput bias, that increased to 20100 transactions per second. The tweak I used was to set rx-frames to 1 with ethtool.

Now, that was without any bonding. So, as a quick test you might try running a single unbonded interface.

Re: C-7000 blade system Network Delay

Namal Kulathunga — Fri, 27 Feb 2009 08:21:48 GMT

hi,

These are the files u hv requested..

/etc/modprobe.conf

alias eth0 bnx2
alias eth1 bnx2
alias scsi_hostadapter cciss
alias scsi_hostadapter1 usb-storage
alias bond0 bonding
options bonding miimon=100 mode=0

/etc/sysconfig/network-scripts/ifcfg-eth0

# Broadcom Corporation NetXtreme II BCM5708S Gigabit Ethernet
DEVICE=eth0
BOOTPROTO=none
MASTER=bond0
SLAVE=yes
USERCTL=no
ONBOOT=yes

/etc/sysconfig/network-scripts/ifcfg-eth1

# Broadcom Corporation NetXtreme II BCM5708S Gigabit Ethernet
DEVICE=eth1
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no

/etc/sysconfig/network-scripts/ifcfg-bond0

DEVICE=bond0
BOOTPROTO=none
ONBOOT=yes
NETWORK=192.168.2.0
NETMASK=255.255.255.0
IPADDR=192.168.2.209
USERCTL=no

Please go through these and if you have any idea about the problem please let me know..

Thanks...

Namal