NIC card issues

[Sureshbabu-HP]

Hi,
I have been having some issues with one of the NIC cards on my server(Proliant DL580 G5). The server is part of Oracle RAC cluster and its peer node has no such issues.

The server has 6 NIC ports (2 on-board) 2 PCI-E Dual port HP NC380T cards. The on-board cards are eth0 and eth1. While the remaining eth2,eth3, eth4 and eth5. The eth5 card is not getting enabled. When i run ifconfig its gives me the following error
#ifconfig eth5
eth5: error fetching interface information: Device not found
#ifconfig eth5 10.1.1.1/24 up
SIOCSIFADDR: No such device
SIOCSIFNETMASK: No such device
SIOCGIFADDR: No such device
SIOCSIFBROADCAST: No such device
eth5: unknown interface: No such device
eth5: unknown interface: No such device

I shutdown the server and ran offline-diagnostics and found the NIC card was detected and was healthy. But the linux OS is not able to detect it.

But when I ran dmesg I can see all the 6 cards.
#dmesg | grep eth
eth0: Broadcom NetXtreme II BCM5708 1000Base-T (B2) PCI-X 64-bit 133MHz found at mem dc000000, IRQ 169, node addr 00:22:64:2d:7e:32
eth1: Broadcom NetXtreme II BCM5708 1000Base-T (B2) PCI-X 64-bit 133MHz found at mem de000000, IRQ 177, node addr 00:22:64:2d:7e:34
eth2: Broadcom NetXtreme II BCM5706 1000Base-T (A2) PCI-X 64-bit 100MHz found at mem f4000000, IRQ 217, node addr 00:21:5a:d3:64:34
eth3: Broadcom NetXtreme II BCM5706 1000Base-T (A2) PCI-X 64-bit 100MHz found at mem f6000000, IRQ 75, node addr 00:21:5a:d3:64:36
eth4: Broadcom NetXtreme II BCM5706 1000Base-T (A2) PCI-X 64-bit 100MHz found at mem f8000000, IRQ 217, node addr 00:21:5a:d3:64:28
eth5: Broadcom NetXtreme II BCM5706 1000Base-T (A2) PCI-X 64-bit 100MHz found at mem fa000000, IRQ 75, node addr 00:21:5a:d3:64:2a
bonding: bond0: Adding slave eth0.
bnx2: eth0: using MSI
bonding: bond0: enslaving eth0 as an active interface with a down link.
bnx2: eth0 NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON
bnx2: eth0 NIC Copper Link is Down
bonding: bond0: Adding slave eth1.
bnx2: eth1: using MSI
bonding: bond0: enslaving eth1 as an active interface with a down link.
bnx2: eth1 NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON
bonding: bond0: link status definitely up for interface eth1.
bonding: bond0: making interface eth1 the new active one.
device eth1 entered promiscuous mode
audit(1239851848.926:11): dev=eth1 prom=256 old_prom=0 auid=4294967295 ses=4294967295
bnx2: eth0 NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON
bonding: bond0: link status definitely up for interface eth0.
bnx2: eth2: using MSI
bnx2: eth2 NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON
bnx2: eth3: using MSI
bnx2: eth3 NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON
device eth1 left promiscuous mode
audit(1239851858.922:12): dev=eth1 prom=0 old_prom=256 auid=4294967295 ses=4294967295
bnx2: eth4: using MSI
bnx2: eth4 NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON
eth3: no IPv6 routers present
eth1: no IPv6 routers present
eth0: no IPv6 routers present
eth2: no IPv6 routers present
eth4: no IPv6 routers present

Here is the output of lspci
#lspci | grep NetXtreme
06:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12)
08:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12)
0e:04.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5706 Gigabit Ethernet (rev 02)
0f:05.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5706 Gigabit Ethernet (rev 02)
11:04.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5706 Gigabit Ethernet (rev 02)
12:05.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5706 Gigabit Ethernet (rev 02)

Here is the output of lsmod
#lsmod
Module Size Used by
hangcheck_timer 8025 0
mptctl 31685 1
mptbase 75877 1 mptctl
ipmi_si 41056 2
ipmi_devintf 12808 4
ipmi_msghandler 38336 2 ipmi_si,ipmi_devintf
ipv6 258145 50
xfrm_nalgo 13765 1 ipv6
crypto_api 11969 1 xfrm_nalgo
oracleasm 46356 1
hp_ilo 34620 4
hidp 23105 2
l2cap 29505 5 hidp
bluetooth 53797 2 hidp,l2cap
sunrpc 144893 1
bonding 81197 0
dm_round_robin 7617 1
dm_multipath 22089 2 dm_round_robin
video 21193 0
sbs 18533 0
backlight 10049 1 video
i2c_ec 9025 1 sbs
i2c_core 23745 1 i2c_ec
button 10705 0
battery 13637 0
asus_acpi 19289 0
ac 9157 0
parport_pc 29157 0
lp 15849 0
parport 37513 2 parport_pc,lp
ide_cd 40033 0
sg 36061 0
bnx2 173320 0
cdrom 36705 1 ide_cd
serio_raw 10693 0
pcspkr 7105 0
dm_snapshot 21477 0
dm_zero 6209 0
dm_mirror 29125 0
dm_mod 61405 41 dm_multipath,dm_snapshot,dm_zero,dm_mirror
lpfc 272129 5
scsi_transport_fc 37449 1 lpfc
ata_piix 22341 0
libata 144125 1 ata_piix
cciss 62149 4
ext3 123593 5
jbd 56553 1 ext3
uhci_hcd 25549 0
ohci_hcd 23389 0
ehci_hcd 33613 0
qla2xxx 940244 70
sd_mod 24897 58
scsi_mod 134605 9 mptctl,sg,lpfc,scsi_transport_fc,libata,cciss,qla2xxx,sd_mod
qla2xxx_conf 305924 1
intermodule 8196 2 qla2xxx,qla2xxx_conf


Please let me know what is wrong with this.

[skt_skt]

do u have the corresponding files under /etc/sysconfig/network-scripts? try "ifup ethx" before you proceed with ifconfig

[UVK]

Though the problem doesn't seem to be with the network settings you might just want to check if the interface is plumbed and is up.

If the problem still persists. Try to uninstall and reinstall the modules. If you still have the problem try calling HP and log a case.