HPE GreenLake Administration
- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - Linux
- >
- Re: HP DL145 G3 ethernet interrupt sharing
Operating System - Linux
1830979
Members
2075
Online
110018
Solutions
Forums
Categories
Company
Local Language
back
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Forums
Discussions
Discussions
Discussions
Forums
Discussions
back
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Blogs
Information
Community
Resources
Community Language
Language
Forums
Blogs
Topic Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-28-2008 01:52 PM
10-28-2008 01:52 PM
HP DL145 G3 ethernet interrupt sharing
We have a DL145 G3 with 2 dual-core Opterons and two NC364T quad-ethernet.
The interrupts are unfortunately shared:
32: 145724432 3 1771329 9121 IO-APIC-fasteoi eth6, eth7, eth8, eth9
35: 0 439014411 115 30272 IO-APIC-fasteoi eth2, eth3, eth4, eth5
36: 0 16 152 722287939 IO-APIC-fasteoi eth0, eth1
The largest problem is that eth0 and eth1 share interrupts, since they are busiest. This means that the 4th core gets severely overloaded, while the 3rd core is almost completely idle. I was hoping to reduce the overload by switching to quad-core CPU's, but as it is, that would just lead to 5 idle cores instead of 1.
Is there a HP DL server which can provide unique interrupts to at least the two built-in ethernets and each of the ports on a quad-ethernet card? Would a different NIC solve the problem? Do I need to pass any options to the Linux kernel (hopefully not, interrupt routing seems to be deep magic these days.)
The interrupts are unfortunately shared:
32: 145724432 3 1771329 9121 IO-APIC-fasteoi eth6, eth7, eth8, eth9
35: 0 439014411 115 30272 IO-APIC-fasteoi eth2, eth3, eth4, eth5
36: 0 16 152 722287939 IO-APIC-fasteoi eth0, eth1
The largest problem is that eth0 and eth1 share interrupts, since they are busiest. This means that the 4th core gets severely overloaded, while the 3rd core is almost completely idle. I was hoping to reduce the overload by switching to quad-core CPU's, but as it is, that would just lead to 5 idle cores instead of 1.
Is there a HP DL server which can provide unique interrupts to at least the two built-in ethernets and each of the ports on a quad-ethernet card? Would a different NIC solve the problem? Do I need to pass any options to the Linux kernel (hopefully not, interrupt routing seems to be deep magic these days.)
3 REPLIES 3
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-29-2008 07:24 AM
10-29-2008 07:24 AM
Re: HP DL145 G3 ethernet interrupt sharing
Which Linux distribution are you running?
RHEL has the "irqbalance" process, which is supposed to auto-tune IRQ settings so that all processors/cores get used equally. I think irqbalance is available in other distributions too, but perhaps it is not installed by default.
How fast are those counters increasing on average, i.e. what was the server's uptime at the time you got those values?
MK
RHEL has the "irqbalance" process, which is supposed to auto-tune IRQ settings so that all processors/cores get used equally. I think irqbalance is available in other distributions too, but perhaps it is not installed by default.
How fast are those counters increasing on average, i.e. what was the server's uptime at the time you got those values?
MK
MK
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-29-2008 10:14 AM
10-29-2008 10:14 AM
Re: HP DL145 G3 ethernet interrupt sharing
I am using irqbalanced, but that doesn't help when interrupts are shared. You can't spread the load from a shared interrupt between two different processors.
Hence my request for a server which can provide unique interrupts...
Hence my request for a server which can provide unique interrupts...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-10-2008 03:24 AM
11-10-2008 03:24 AM
Re: HP DL145 G3 ethernet interrupt sharing
It turns out that the DL160G5 can do it with the NC364T, at least for one card. I'll have to remove the SAS controller to test with 10 ports.
17: 15 10 6398 1380147367 IO-APIC-fasteoi eth0
18: 19 3237571 20 353767456 IO-APIC-fasteoi uhci_hcd:usb4, eth1
19: 0 0 0 0 IO-APIC-fasteoi uhci_hcd:usb3, ata_piix
23: 11 10 11 10 IO-APIC-fasteoi ehci_hcd:usb1, uhci_hcd:usb2
48: 26 1635373469 28 28 IO-APIC-fasteoi eth2
52: 27950 7711 4983 920 IO-APIC-fasteoi ioc0
58: 80 52635075 6 193398 IO-APIC-fasteoi eth3
62: 6 159171 17 326447 IO-APIC-fasteoi eth5
66: 10 323184 5 162442 IO-APIC-fasteoi eth4
eth0 and eth1 share interrupts with USB, so I should probably turn off USB.
17: 15 10 6398 1380147367 IO-APIC-fasteoi eth0
18: 19 3237571 20 353767456 IO-APIC-fasteoi uhci_hcd:usb4, eth1
19: 0 0 0 0 IO-APIC-fasteoi uhci_hcd:usb3, ata_piix
23: 11 10 11 10 IO-APIC-fasteoi ehci_hcd:usb1, uhci_hcd:usb2
48: 26 1635373469 28 28 IO-APIC-fasteoi eth2
52: 27950 7711 4983 920 IO-APIC-fasteoi ioc0
58: 80 52635075 6 193398 IO-APIC-fasteoi eth3
62: 6 159171 17 326447 IO-APIC-fasteoi eth5
66: 10 323184 5 162442 IO-APIC-fasteoi eth4
eth0 and eth1 share interrupts with USB, so I should probably turn off USB.
The opinions expressed above are the personal opinions of the authors, not of Hewlett Packard Enterprise. By using this site, you accept the Terms of Use and Rules of Participation.
Company
Events and news
Customer resources
© Copyright 2025 Hewlett Packard Enterprise Development LP