Who/what is using my cpu.

[joseph wholey]

I hate to send so much data, but can someone look at the output of my TOP command and tell me why my cpus show "usage" when processes don't appear to be using any? Sometimes my cpu's near 100%, and I see only a fraction of that amount being used by processes. I've also attached the output to a *.txt file if that makes life easier. Any help would be greatly appreciated. thx.

13:55:02 up 108 days, 19:17, 6 users, load average: 2.82, 3.45, 4.00
663 processes: 659 sleeping, 2 running, 2 zombie, 0 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 12.7% 0.0% 0.3% 0.0% 0.0% 0.0% 86.9%
cpu00 3.7% 0.0% 0.1% 0.0% 0.1% 0.0% 95.8%
cpu01 24.0% 0.0% 0.1% 0.0% 0.0% 0.0% 75.7%
cpu02 5.1% 0.0% 0.3% 0.0% 0.0% 0.0% 94.4%
cpu03 2.3% 0.0% 0.5% 0.0% 0.0% 0.0% 97.0%
cpu04 13.6% 0.0% 0.0% 0.0% 0.0% 0.0% 86.3%
cpu05 32.1% 0.0% 0.3% 0.0% 0.0% 0.0% 67.4%
cpu06 19.2% 0.0% 0.0% 0.0% 0.0% 0.0% 80.7%
cpu07 1.1% 0.0% 0.9% 0.0% 0.0% 0.0% 97.8%
Mem: 8063880k av, 6365528k used, 1698352k free, 0k shrd, 29976k buff
4727400k actv, 735560k in_d, 33772k in_c
Swap: 4194216k av, 21968k used, 4172248k free 3606164k cached

PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
19539 db2ap 25 0 103M 103M 79896 R 12.2 1.3 108:51 5 db2sysc
4567 root 16 0 1096 1096 652 S 0.1 0.0 412:26 0 tqrtap
14658 root 15 0 1760 1760 896 R 0.1 0.0 0:00 7 top
1 root 15 0 500 500 440 S 0.0 0.0 60:18 1 init
2 root RT 0 0 0 0 SW 0.0 0.0 0:00 0 migration/0
3 root RT 0 0 0 0 SW 0.0 0.0 0:00 1 migration/1
4 root RT 0 0 0 0 SW 0.0 0.0 0:00 2 migration/2
5 root RT 0 0 0 0 SW 0.0 0.0 0:00 3 migration/3
6 root RT 0 0 0 0 SW 0.0 0.0 0:00 4 migration/4
7 root RT 0 0 0 0 SW 0.0 0.0 0:00 5 migration/5
8 root RT 0 0 0 0 SW 0.0 0.0 0:00 6 migration/6
9 root RT 0 0 0 0 SW 0.0 0.0 0:00 7 migration/7
10 root 15 0 0 0 0 SW 0.0 0.0 0:57 7 keventd
11 root 34 19 0 0 0 SWN 0.0 0.0 0:00 0 ksoftirqd/0
12 root 34 19 0 0 0 SWN 0.0 0.0 0:00 1 ksoftirqd/1
13 root 34 19 0 0 0 SWN 0.0 0.0 0:07 2 ksoftirqd/2
14 root 34 19 0 0 0 SWN 0.0 0.0 0:09 3 ksoftirqd/3
15 root 34 19 0 0 0 SWN 0.0 0.0 0:04 4 ksoftirqd/4
16 root 34 19 0 0 0 SWN 0.0 0.0 0:01 5 ksoftirqd/5
17 root 34 19 0 0 0 SWN 0.0 0.0 0:00 6 ksoftirqd/6
18 root 34 19 0 0 0 SWN 0.0 0.0 0:00 7 ksoftirqd/7
21 root 15 0 0 0 0 SW 0.0 0.0 0:01 4 bdflush
19 root 15 0 0 0 0 SW 0.0 0.0 1408m 0 kswapd
20 root 15 0 0 0 0 SW 0.0 0.0 4217m 4 kscand
22 root 15 0 0 0 0 SW 0.0 0.0 74:00 5 kupdated
23 root 25 0 0 0 0 SW 0.0 0.0 0:00 0 mdrecoveryd
30 root 18 0 0 0 0 SW 0.0 0.0 0:00 0 scsi_eh_0
31 root 18 0 0 0 0 SW 0.0 0.0 0:00 0 scsi_eh_1
37 root 15 0 0 0 0 SW 0.0 0.0 52:55 3 kjournald
98 root 25 0 0 0 0 SW 0.0 0.0 0:00 3 khubd
1491 root 15 0 0 0 0 SW 0.0 0.0 31:56 2 dmp_errd_loop

[George Liu_4]

Your system was most used by processes:
tqrtap of root, and db2sysc of db2ap

[joseph wholey]

How do you ascertain that? What is the correlation between the cpu usage as displayed for the cpu's and cpu usage as displayed by processes?

[George Liu_4]

CPU usage includes the usage of all cpu user nice system irq softirq iowait idle, not just processes displayed only. Your overall system usage was pretty light

[joseph wholey]

George,

I agree. However, I see my cpu usage jump to near 100% on all 8 cpus at times, however, I do not see any corresponding processes using anywhere near that amount of cpu... cumulative or otherwise.