HP-UX 에서 JAVA java.lang.OutOfMemoryError: unable to create new native thread

[jwpark]

위 에러가 계속 납니다 

다른 서버에서는 이상이 없는데 HP에서만 나네요

max_thread_proc 1024 ->2048 

nkthread 8416 -> 12000 

위 수치도 수정 하고 java 의 xss 도 수정을 하였습니다.

하지만 계속 해서 똑같은 오류내용이 반복 됩니다.

#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (11) at pc=fa7a472c, pid=24542, tid=3182
#
# JRE version: 6.0
# Java VM: Java HotSpot(TM) Server VM (16.3-b01-jre1.6.0.07-rc1 PA2.0 (aCC_AP) m
ixed mode hp-ux-pa-risc )
# Problematic frame:
# V [libjvm.sl+0xffa63fc4]
#
# Please report this error to HP customer support.
#

--------------- T H R E A D ---------------

Current thread (00e16550): JavaThread "Unknown thread" [_thread_in_vm, id=3182,
lwp_id=3628186, stack(269ce000,26a00000)]

siginfo:si_signo=SIGSEGV: si_errno=0, si_code=0 (SEGV_UNKNOWN), si_addr=0000014c

Registers:
r1: fa7a3ca0 rp: fa7a4337 r3: 00e16550 r4: fa7a4480
r5: 013c50b0 r6: 013c50b4 r7: 00000000 r8: 00000007
r9: 00000130 r10: 013c50b0 r11: f9c57cb4 r12: 00000000
r13: 00000000 r14: 00000000 r15: 00000000 r16: 00000000
r17: 013c5494 r18: 00000000 r19: f99d1608 r20: 00000000
r21: 00000000 r22: 00000000 r23: 013c50ac r24: 013c50b0
r25: 28c2feb0 r26: 28c34ca4 dp: 0000e900 ret0: 26a00678
ret1: 01000021 sp: 26a007c0 r31: 00000000
Stack pointer: (sp=26a007c0)
26a007a0: f99d1608 26a00468 00e16550 00379a70
26a007b0: 013c50a0 013c50bc 013c5494 26a00448
Instructions: (pc=fa7a472c)
fa7a470c: 8d1d200a cbe69c6d 6bc63ea9 4bdf3d99
fa7a471c: 93e03000 cbe08002 4bff0000 37e90260
fa7a472c: 0d282089 89203bdf 487a0128 cae09c0d

Stack: [269ce000,26a00000], sp=26a007c0, free space=%pk
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.sl+0xffa63fc4]

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
00a289c8 JavaThread "Thread-3183" [_thread_in_Java, id=3205, lwp_id=3628209, s
tack(2738e000,273c0000)]
00e42a88 JavaThread "Thread-3173" [_thread_in_Java, id=3195, lwp_id=3628199, s
tack(26c4e000,26c80000)]
=>00e16550 JavaThread "Unknown thread" [_thread_in_vm, id=3182, lwp_id=3628186,
stack(269ce000,26a00000)]
00e24788 JavaThread "Thread-3155" [_thread_blocked, id=3178, lwp_id=3628182, s
tack(26a8e000,26ac0000)]
003dfac0 JavaThread "Thread-3153" [_thread_blocked, id=3176, lwp_id=3628180, s
tack(26b0e000,26b40000)]
00a15d38 JavaThread "Thread-3154" [_thread_blocked, id=3175, lwp_id=3628179, s
tack(26b4e000,26b80000)]
00a14140 JavaThread "Thread-3152" [_thread_blocked, id=3174, lwp_id=3628178, s
tack(26b8e000,26bc0000)]
00696fe0 JavaThread "Thread-3150" [_thread_blocked, id=3172, lwp_id=3628176, s
tack(26c0e000,26c40000)]
00280d20 JavaThread "Thread-3142" [_thread_blocked, id=3164, lwp_id=3628168, s
tack(26cce000,26d00000)]
00693218 JavaThread "Thread-3141" [_thread_blocked, id=3163, lwp_id=3628167, s
tack(26d0e000,26d40000)]
00692b80 JavaThread "Thread-3140" [_thread_blocked, id=3162, lwp_id=3628166, s
tack(26d4e000,26d80000)]
0039bde0 JavaThread "Thread-3138" [_thread_blocked, id=3161, lwp_id=3628165, s
tack(26d8e000,26dc0000)]
0061fdb0 JavaThread "Thread-3137" [_thread_blocked, id=3160, lwp_id=3628164, s
tack(26dce000,26e00000)]
00e51518 JavaThread "Thread-3139" [_thread_blocked, id=3159, lwp_id=3628163, s
tack(26e0e000,26e40000)]
00026ab8 JavaThread "Thread-3136" [_thread_blocked, id=3158, lwp_id=3628162, s
tack(26e4e000,26e80000)]
0060fdf8 JavaThread "Thread-3135" [_thread_blocked, id=3157, lwp_id=3628161, s
tack(26e8e000,26ec0000)]
002808b0 JavaThread "Thread-3133" [_thread_blocked, id=3156, lwp_id=3628160, s
tack(26ece000,26f00000)]
0060de00 JavaThread "Thread-3134" [_thread_blocked, id=3155, lwp_id=3628159, s
tack(26f0e000,26f40000)]
00450df8 JavaThread "Thread-3132" [_thread_blocked, id=3154, lwp_id=3628158, s
tack(2714e000,27180000)]
0043e780 JavaThread "Thread-3131" [_thread_blocked, id=3153, lwp_id=3628157, s
tack(2740e000,27440000)]
0016e038 JavaThread "Thread-30" [_thread_blocked, id=72, lwp_id=3624835, stack
(26fce000,27000000)]
0016de18 JavaThread "Thread-50" [_thread_blocked, id=71, lwp_id=3624834, stack
(270ce000,27100000)]
0016c038 JavaThread "Thread-49" [_thread_blocked, id=70, lwp_id=3624833, stack
(2700e000,27040000)]
00169c60 JavaThread "Thread-39" [_thread_blocked, id=69, lwp_id=3624832, stack
(2704e000,27080000)]
00169a40 JavaThread "Timer-1" [_thread_blocked, id=68, lwp_id=3624831, stack(2
708e000,270c0000)]
00169820 JavaThread "Timer-0" [_thread_blocked, id=67, lwp_id=3624830, stack(2
710e000,27140000)]
003b7538 JavaThread "Thread-35" [_thread_blocked, id=56, lwp_id=3624819, stack
(2718e000,271c0000)]
00cf9848 JavaThread "Thread-25" [_thread_blocked, id=47, lwp_id=3624807, stack
(2720e000,27240000)]
00d002e8 JavaThread "Thread-24" [_thread_blocked, id=46, lwp_id=3624806, stack
(271ce000,27200000)]
00cf9e70 JavaThread "Thread-23" [_thread_in_vm, id=45, lwp_id=3624805, stack(2
724e000,27280000)]
00cd2d08 JavaThread "Thread-18" [_thread_blocked, id=41, lwp_id=3624800, stack
(2734e000,27380000)]
00cad0c8 JavaThread "Thread-17" [_thread_blocked, id=39, lwp_id=3624798, stack
(2728e000,272c0000)]
00c41170 JavaThread "Thread-16" [_thread_blocked, id=38, lwp_id=3624797, stack
(272ce000,27300000)]
00c1fae8 JavaThread "Thread-15" [_thread_blocked, id=37, lwp_id=3624796, stack
(2730e000,27340000)]
00be9c58 JavaThread "Thread-12" [_thread_in_native, id=34, lwp_id=3624792, sta
ck(273ce000,27400000)]
0037e688 JavaThread "Thread-11" [_thread_blocked, id=32, lwp_id=3624790, stack
(2744e000,27480000)]
00ae8768 JavaThread "Thread-9" [_thread_blocked, id=31, lwp_id=3624789, stack(
2748e000,274c0000)]
0066fe20 JavaThread "Thread-6" [_thread_blocked, id=30, lwp_id=3624788, stack(
274ce000,27500000)]
00623190 JavaThread "Thread-8" [_thread_blocked, id=29, lwp_id=3624787, stack(
2750e000,27540000)]
00622d20 JavaThread "MySQL Statement Cancellation Timer" daemon [_thread_block
ed, id=28, lwp_id=3624777, stack(2754e000,27580000)]
0098fa50 JavaThread "Thread-5" [_thread_blocked, id=27, lwp_id=3624774, stack(
2758e000,275c0000)]
0097f040 JavaThread "Thread-4" [_thread_blocked, id=26, lwp_id=3624773, stack(
275ce000,27600000)]
0067fdc8 JavaThread "Thread-3" [_thread_blocked, id=25, lwp_id=3624772, stack(
2760e000,27640000)]
0059fd18 JavaThread "Thread-2" [_thread_in_native, id=24, lwp_id=3624771, stac
k(2764e000,27680000)]
0009cfb8 JavaThread "DestroyJavaVM" [_thread_blocked, id=2, lwp_id=3624747, st
ack(f96ce000,f9700000)]
00730830 JavaThread "Thread-1" [_thread_blocked, id=23, lwp_id=3624770, stack(
2768e000,276c0000)]
006c99b0 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=22, lwp_i
d=3624769, stack(276ce000,27700000)]
006a5010 JavaThread "RMI TCP Accept-5554" daemon [_thread_in_native, id=21, lw
p_id=3624768, stack(2770e000,27740000)]
004e7a10 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=20, lwp_i
d=3624767, stack(2774e000,27780000)]
00277700 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=19, lwp_
id=3624766, stack(2778e000,277c0000)]
000c3ba8 JavaThread "CompilerThread1" daemon [_thread_blocked, id=17, lwp_id=3
624764, stack(27700000,27800000)]
0025ca30 JavaThread "CompilerThread0" daemon [_thread_blocked, id=16, lwp_id=3
624763, stack(27900000,27a00000)]
0025bdb0 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=15, lwp_id
=3624762, stack(f93ce000,f9400000)]
0022e640 JavaThread "Finalizer" daemon [_thread_blocked, id=14, lwp_id=3624759
, stack(f940e000,f9440000)]
0022a850 JavaThread "Reference Handler" daemon [_thread_blocked, id=13, lwp_id
=3624758, stack(f960e000,f9640000)]

Other Threads:
000c5048 VMThread [stack: 27b00000,27b80000] [id=12, lwp_id=3624757]
000c5150 WatcherThread [stack: 278c0000,27940000] [id=18, lwp_id=3624765]

VM state: not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
PSYoungGen total 1014272K, used 464193K [b7c00000, f7400000, f7400000)
eden space 991040K, 46% used [b7c00000,d40f4650,f43d0000)
from space 23232K, 1% used [f5a70000,f5acc000,f7120000)
to space 23168K, 0% used [f43d0000,f43d0000,f5a70000)
PSOldGen total 699072K, used 116106K [38c00000, 636b0000, b7c00000)
object space 699072K, 16% used [38c00000,3fd628f0,636b0000)
PSPermGen total 16384K, used 11824K [28c00000, 29c00000, 38c00000)
object space 16384K, 72% used [28c00000,2978c2f8,29c00000)

Dynamic libraries:
/data/imj/jdk/bin/PA_RISC2.0/java
text:0x00001000-0x0000d3bc data:0x0000e000-0x0000eb70
/data/imj/jdk/bin/PA_RISC2.0/../../jre/lib/PA_RISC2.0/jli//libjli.sl
text:0xf9740000-0xf97486b4 data:0xf9c66000-0xf9c67394
/data/imj/jdk/bin/PA_RISC2.0/../../jre/lib/PA_RISC2.0/server/libjvm.sl
text:0xf9c94000-0xfabb0edc data:0xf99b9000-0xf9c59044
/usr/lib/libpthread.1
text:0xf974c000-0xf97c5434 data:0xf9c5c000-0xf9c5ebe8
/usr/lib/librt.2
text:0xf981c000-0xf98201a4 data:0xfad3f000-0xfad3f0a4
/usr/lib/libcl.2
text:0xf9824000-0xf99b58f4 data:0xf97f0000-0xf9815250
/usr/lib/libm.2
text:0xf97c8000-0xf97ef364 data:0xf9c60000-0xf9c64ad0
/usr/lib/libisamstub.1
text:0xfad7d000-0xfad7d974 data:0xfad45000-0xfad450a0
/usr/lib/libCsup.2
text:0xf9c6c000-0xf9c87ed4 data:0xf9c68000-0xf9c6ae24
/usr/lib/libc.2
text:0xfabd0000-0xfad3e62c data:0xfabbb000-0xfabcfc90
/usr/lib/libdld.2
text:0xfabb8000-0xfabba95c data:0xfb022000-0xfb0221e0
/data/imj/jdk/jre/lib/PA_RISC2.0/libverify.sl
text:0xf96f0000-0xf96fc4bc data:0xfabb1000-0xfabb1984
/data/imj/jdk/jre/lib/PA_RISC2.0/libjava.sl
text:0xf96bc000-0xf96ee814 data:0xf99b6000-0xf99b8138
/data/imj/jdk/jre/lib/PA_RISC2.0/native_threads/libhpi.sl
text:0xf96a8000-0xf96b8ab4 data:0xf9816000-0xf981702c
/data/imj/jdk/jre/lib/PA_RISC2.0/libzip.sl
text:0xf967c000-0xf968ea5c data:0xf97c6000-0xf97c7a98
/usr/lib/nls/loc/locales.3/ko_KR.eucKR
text:0xf9734000-0xf97367ec data:0x27b2c000-0x27b7f85c
/usr/lib/nls/loc/methods.2/libHP15.sl
text:0xf96fe000-0xf96ff49c data:0xf9c5f000-0xf9c5f078
/data/imj/jdk/jre/lib/PA_RISC2.0/libmanagement.sl
text:0xf9674000-0xf967a77c data:0xf9821000-0xf9821230
/data/imj/jdk/jre/lib/PA_RISC2.0/libnet.sl
text:0xf9528000-0xf953c9f4 data:0xf9749000-0xf974964c
/usr/lib/libnss_files.1
text:0xf951c000-0xf9524dd4 data:0xf9737000-0xf973757c
/usr/lib/libnss_dns.1
text:0xf9514000-0xf95190dc data:0xf9733000-0xf97332a0
/data/imj/engine/lib/libJSMail2_jni.so
text:0xf9508000-0xf95101cc data:0xf96fd000-0xf96fd2b0
/data/imj/engine/lib/libJSMail2_hpux.sl
text:0x28be0000-0x28bfc28c data:0xf9478000-0xf947c400

VM Arguments:
jvm_args: -XX:ThreadStackSize=200k -XX:MaxPermSize=256m -Xss200k -Xms1024m -Xmx3
048m -Dhostname=fssra1 -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxre
mote.port=5554 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.manag
ement.jmxremote.ssl=false -DName=IMJInfomailer -Djava.ext.dirs=lib:/data/imj/eng
ine/lib:/data/imj/jdk/jre/lib:/data/imj/jdk/lib:/data/imj/jdk/jre/lib/ext
java_command: com.iwn.imj.infomailer.Infomailer
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/data/imj/jdk
CLASSPATH=/data/imj/jdk/jre/lib:/data/imj/jdk/jre/lib/ext:/data/imj/jdk/lib:./li
b:/data/imj/engine/lib/class:/data/imj/engine/lib/imj-dmail-customer.jar
PATH=/data/cm4/mysql/bin:/usr/sbin:/usr/bin:/usr/local/bin:/usr/ccs/bin:/usr/con
trib/bin:/usr/contrib/Q4/bin:/opt/perl/bin:/opt/ipf/bin:/opt/gvsd/bin:/opt/nettl
adm/bin:/opt/fcms/bin:/opt/wbem/bin:/opt/wbem/sbin:/opt/sas/bin:/opt/graphics/co
mmon/bin:/opt/atok/bin:/usr/bin/X11:/usr/contrib/bin/X11:/opt/sec_mgmt/bastille/
bin:/opt/caliper/bin:/opt/drd/bin:/opt/dsau/bin:/opt/dsau/sbin:/opt/resmon/bin:/
opt/firefox:/opt/gnome/bin:/opt/perf/bin:/usr/contrib/kwdb/bin:/opt/mozilla:/opt
/perl_32/bin:/opt/perl_64/bin:/opt/prm/bin:/opt/sfm/bin:/opt/swm/bin:/opt/sec_mg
mt/spc/bin:/opt/ssh/bin:/opt/sentinel/bin:/opt/swa/bin:/opt/hpsmh/bin:/opt/thund
erbird:/opt/langtools/bin:/opt/gwlm/bin:/opt/ignite/bin:/opt/aCC/bin:/opt/cadvis
e/bin:/sbin:/home/root:/opt/java6:/opt/java6/bin:/opt/hpws22/apache/bin:/opt/hpw
s22/shell:/data/imj/jdk/bin
LD_LIBRARY_PATH=/data/imj/mysql/lib/mysql:/data/imj/engine/lib:/data/imj/engine/
lib/class
SHELL=/sbin/sh
SHLIB_PATH=/data/imj/jdk/jre/lib/PA_RISC2.0:/data/imj/jdk/jre/lib/PA_RISC2.0/ser
ver:/data/imj/jdk/jre/../lib/PA_RISC2.0:/data/imj/mysql/lib/mysql:/data/imj/engi
ne/lib:/data/imj/engine/lib/class
PTHREAD_COMPAT_MODE=1

Signal Handlers:
SIGSEGV: [libjvm.sl+0xfecb908a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000051
SIGBUS : [libjvm.sl+0xfecb908a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000051
SIGFPE : [libjvm.sl+0xfecb908a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000050
SIGPIPE: [libjvm.sl+0xfecb908a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000050
SIGXFSZ: [libjvm.sl+0xfecb908a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000050
SIGILL : [libjvm.sl+0xfecb908a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000051
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000004
SIGUSR2: [libjvm.sl+0xfecb604a], sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGHUP : SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000004
SIGINT : SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000004
SIGQUIT: [libjvm.sl+0xfecb909a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000040
SIGTERM: [libjvm.sl+0xfecb909a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000040
SIGRTMIN: [libjvm.sl+0xfecb9092], sa_mask[0]=0x00000000, sa_flags=0x00000010
SIGRTMIN+1: [libjvm.sl+0xfecb908a], sa_mask[0]=0xff7ffeff, sa_flags=0x00000050

--------------- S Y S T E M ---------------

OS:HP-UX
uname:HP-UX B.11.31 U ia64
rlimit: STACK 8192k, CORE 2097151k, NOFILE 8192, AS infinity
load average:0.12 0.10 0.16

CPU:total 8

Memory: 4k page, physical 33485588k(10124900k free)

vm_info: Java HotSpot(TM) Server VM (16.3-b01-jre1.6.0.07-rc1) for hp-ux-pa-risc
JRE (1.6.0), built on May 11 2010 14:28:25 by "jinteg" with aCC

time: Sat May 2 00:31:38 2015
elapsed time: 343 seconds