out of memory

[Ryan Lee]

I have big problem about AS3 on 4xCPU 5gb Memory. after RHEL hang, the messages shows me out of memory as below, I tried to add more one swap files to 2GB(Total 4GB).But still out of memory and hang. The kernel now using SMP-2.4.9-15EL.

kernel: Mem-info:
kernel: Zone:DMA freepages: 2900 min: 0 low: 0 high: 0
kernel: Zone:Normal freepages: 1309 min: 1279 low: 4544 high: 6304
kernel: Zone:HighMem freepages: 254 min: 255 low: 16894 high: 25341
kernel: Free pages: 4463 ( 254 HighMem)
kernel: ( Active: 1192520/1489, inactive_laundry: 36, inactive_clean: 76, free: 4463 )
kernel: aa:0 ac:0 id:0 il:0 ic:0 fr:2900
kernel: aa:184711 ac:2651 id:1176 il:39 ic:76 fr:1309
kernel: aa:995255 ac:9894 id:319 il:0 ic:0 fr:254
kernel: 0*4kB 2*8kB 4*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 2*4096kB = 11600kB)
kernel: 73*4kB 76*8kB 15*16kB 10*32kB 5*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 5236kB)
kernel: 10*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1016kB)
kernel: Swap cache: add 1088449, delete 1084269, find 5364809/5397452, race 0+0
kernel: 8151 pages of slabcache
kernel: 1062 pages of kernel stacks
kernel: 0 lowmem pagetables, 8436 highmem pagetables
kernel: Free swap: 0kB
Oct 7 20:53:14 theta kernel: 1310719 pages of RAM
kernel: 1015801 pages of HIGHMEM
kernel: 85979 reserved pages
kernel: 224721 pages shared
kernel: 4182 pages swap cached
kernel: Out of Memory: Killed process 1777 (java).
kernel: Out of Memory: Killed process 1925 (java).
kernel: Out of Memory: Killed process 1926 (java).
kernel: Out of Memory: Killed process 1927 (java).
kernel: Out of Memory: Killed process 1928 (java).
kernel: Out of Memory: Killed process 1929 (java).

[Ryan Lee]

I found a similar case http://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=118152

can i update the kernel to fix this? also posted vmstat

[xyko_1]

Ryan,

I think you only need to apply two modifications on your system paarmeters.

echo 1 15 15 > /proc/sys/vm/pagecache

and

echo 30 > /proc/sys/vm/inactive_clean_percent

but remember that the default values will be restored after a system boot.

If this solves your problem you have to put those commands on rc.local or another place that executes on boot time.

If it does not solve your problem you have a real memory constraint and you will have to minimise the use of ram (less concurrent processes)or buy more memory.

There is a config file (/etc/sysctl.conf) where you can customize those system parameters and others.

Try

sysctl -a

to see your current values for all system parameters.

Hope it helps.
yko

[Ryan Lee]

Thanks for your help, I had tried to add sysctl -w vm.inactive_clean_percent = 30 and vm.kswapd = 1024 32 64. But still out of memory. It looks like memory leak. can I tuning something for limit specific process in memory usage.

[xyko_1]

There's any reason why you didn't set

echo 1 15 15 > /proc/sys/vm/pagecache

or you did ?

I don't know how to control the number of process submited by users, does anybody know ?

Regards,
Xyko