out of dynamic memory in yy_scan_buffer

[tom quach_1]

Hello,

I am using HPUX 11.11 with oracle database 9i
and COGNOS power House.
When using qtp program from COGNOS to upload the data to oracle 9i. it ran for about 1hr and put out an error.
"out of dynamic memory in yy_scan_buffer"
I already increased the MAXDSIZ to 1GB, COGNOS application is a 32bit.
but still receive error.
Any suggestions are really appreciated.

Regards,

Tom

[Sameer_Nirmal]

Can you post the kernel parameters of the system ?

[tom quach_1]

Hi Sameer:
Below is kernel parameters of my system.
Your help is appreciated.
Thanks,
Tom



kmtune
Parameter Current Dyn Planned Module Version
===============================================================================
NSTRBLKSCHED - - 2
NSTREVENT 50 - 50
NSTRPUSH 16 - 16
NSTRSCHED 0 - 0
STRCTLSZ 0 - 0
STRMSGSZ 65535 - 65535
acctresume 4 - 4
acctsuspend 2 - 2
aio_listio_max 256 - 256
aio_max_ops 2048 - 2048
aio_physmem_pct 10 - 10
aio_prio_delta_max 20 - 20
allocate_fs_swapmap 0 - 0
alwaysdump 1 - 1
bcvmap_size_factor 2 - 2
bootspinlocks - - 256
bufcache_hash_locks 128 - 128
bufpages 0 - (NBUF*2)
chanq_hash_locks 256 - 256
clicreservedmem 0 - 0
core_addshmem_read 0 Y 0
core_addshmem_write 0 Y 0
create_fastlinks 0 - 0
dbc_max_pct 18 - 18
dbc_min_pct 5 - 5
default_disk_ir 0 - 0
desfree - - 0
disksort_seconds 0 - 0
dmp_rootdev_is_vol 0 - 0
dmp_swapdev_is_vol 0 - 0
dnlc_hash_locks 512 - 512
dontdump 0 - 0
dskless_node - - 0
dst 1 - 1
effective_maxpid - - ((NPROC<=30000)?30000:(NPROC*5/4))
eisa_io_estimate - - 0x300
enable_idds 1 - 1
eqmemsize 15 - 15
executable_stack 1 - 1
fcp_large_config 0 - 0
file_pad - - 10
fs_async 0 - 0
ftable_hash_locks 64 - 64
hdlpreg_hash_locks 128 - 128
hfs_max_ra_blocks 8 - 8
hfs_max_revra_blocks 8 - 8
hfs_ra_per_disk 64 - 64
hfs_revra_per_disk 64 - 64
hp_hfs_mtra_enabled 1 - 1
hpux_aes_override - - 0
initmodmax 50 - 50
io_ports_hash_locks 64 - 64
iomemsize - - 40000
ksi_alloc_max 32768 - (NPROC*8)
ksi_send_max 32 - 32
lotsfree - - 0
max_async_ports 50 - 50
max_fcp_reqs 512 - 512
max_mem_window 0 - 0
max_thread_proc 3000 - 3000
maxdsiz 0x40000000 - 0X40000000
maxdsiz_64bit 0x80000000 - 0X80000000
maxfiles 2048 - 2048
maxfiles_lim 4096 Y 4096
maxqueuetime - - 0
maxssiz 0x4000000 - 0X4000000
maxssiz_64bit 0x40000000 - 0X40000000
maxswapchunks 16384 - 16384
maxtsiz 0x4000000 Y 0X4000000
maxtsiz_64bit 0x40000000 Y 0X40000000
maxuprc 1500 Y 1500
maxusers 512 - 512
maxvgs 10 - 10
mesg 1 - 1
minfree - - 0
modstrmax 500 - 500
msgmap 2050 - (2+MSGTQL)
msgmax 8192 Y 8192
msgmnb 16384 Y 16384
msgmni 50 - 50
msgseg 32767 - 32767
msgssz 8 - 8
msgtql 2048 - 2048
nbuf 0 - 0
ncallout 8000 - 8000
ncdnode 150 - 150
nclist 8292 - (100+16*MAXUSERS)
ncsize 39936 - (NINODE+VX_NCSIZE)+(8*DNLC_HASH_LOCKS)
ndilbuffers 30 - 30
netisr_priority - - -1
netmemmax - - 0
nfile 32768 - 32768
nflocks 4096 - 4096
nhtbl_scale 0 - 0
ninode 34816 - (8*NPROC+2048)
nkthread 7184 - (((NPROC*7)/4)+16)
nni - - 2
no_lvm_disks 0 - 0
nproc 4096 - 4096
npty 60 - 60
nstrpty 60 - 60
nstrtel 60 - 60
nswapdev 10 - 10
nswapfs 10 - 10
nsysmap 8192 - ((NPROC)>800?2*(NPROC):800)
nsysmap64 8192 - ((NPROC)>800?2*(NPROC):800)
o_sync_is_o_dsync 0 - 0
page_text_to_local - - 0
pfdat_hash_locks 128 - 128
public_shlibs 1 - 1
region_hash_locks 128 - 128
remote_nfs_swap 0 - 0
rtsched_numpri 32 - 32
scroll_lines 100 - 100
scsi_max_qdepth 8 Y 8
scsi_maxphys 1048576 - 1048576
select_enh 0 Y 0
sema 1 - 1
semaem 16384 - 16384
semmap 4098 - (SEMMNI+2)
semmni 4096 - 4096
semmns 8192 - (SEMMNI*2)
semmnu 4092 - (NPROC-4)
semmsl 2048 Y 2048
semume 10 - 10
semvmx 32767 - 32767
sendfile_max 0 - 0
shmem 1 - 1
shmmax 4294967296 Y 4294967296
shmmni 512 - 512
shmseg 120 Y 120
st_ats_enabled 0 - 0
st_fail_overruns 0 - 0
st_large_recs 0 - 0
st_san_safe 0 - 0
streampipes 0 - 0
swapmem_on 1 - 1
swchunk 2048 - 2048
swsp_trc_flags - - 0x10001002 swspBus -
sysv_hash_locks 128 - 128
tcphashsz 0 - 0
timeslice 10 - (100/10)
timezone 420 - 420
unlockable_mem 0 - 0
vas_hash_locks 128 - 128
vnode_cd_hash_locks 128 - 128
vnode_hash_locks 128 - 128
vol_checkpt_default 10240 - 10240
vol_dcm_replay_size 262144 - (256*1024)
vol_default_iodelay 50 - 50
vol_fmr_logsz 4 - 4
vol_max_bchain 32 - 32
vol_max_nconfigs 20 - 20
vol_max_nlogs 20 - 20
vol_max_nmpool_sz 4194304 - (4*1024*1024)
vol_max_prm_dgs 1024 - 1024
vol_max_rdback_sz 4194304 - (4*1024*1024)
vol_max_vol 8388608 - (8*1024*1024)
vol_maxio 256 - 256
vol_maxioctl 32768 - 32768
vol_maxkiocount 2048 - 2048
vol_maxparallelio 256 - 256
vol_maxspecialio 256 - 256
vol_maxstablebufsize 256 - 256
vol_min_lowmem_sz 524288 - (512*1024)
vol_mvr_maxround 256 - 256
vol_nm_hb_timeout 10 - (10)
vol_subdisk_num 4096 - 4096
vol_vvr_transport 1 - (1)
vol_vvr_use_nat 0 - (0)
volcvm_cluster_size 16 - 16
volcvm_smartsync 1 - 1
voldrl_max_drtregs 2048 - 2048
voldrl_min_regionsz 512 - 512
voliomem_chunk_size 65536 - (64*1024)
voliomem_maxpool_sz 4194304 - (4*1024*1024)
voliot_errbuf_dflt 16384 - 16384
voliot_iobuf_default 8192 - 8192
voliot_iobuf_limit 131072 - 131072
voliot_iobuf_max 65536 - 65536
voliot_max_open 32 - 32
volraid_rsrtransmax 1 - 1
vps_ceiling 16 - 16
vps_chatr_ceiling 1048576 - 1048576
vps_pagesize 64 - 64
vx_fancyra_enable 0 - 0
vx_maxlink 32767 - 32767
vx_ncsize 1024 - 1024
vx_ninode 0 - 0
vxfs_max_ra_kbytes 1024 - 1024
vxfs_ra_per_disk 1024 - 1024
vxtask_max_monitors 32 - 32

[Arunvijai_4]

A similar thread that may shed some lights ..

http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=855971

-Arun

[Sameer_Nirmal]

The error message given doesn't look like a standard HP-UX message, might be given by the application ,Cognos QTP in this case . I suspect there should be more error message below this error line
showing "errno" . It would signify the HP-UX error number.
The kernel parameters related to the 32-bit processes looks normal.
In this case I do suspect the problem as lack of swap space constituting the virtual memory problem.
How much system memory is present? Run and post #dmesg output.
Can you post following while running the qtp program and without it.
# vmstat 5 5
# sar -v 5 5
# sar -b 5 5
# swapinfo -tam
# top

If you have GlancePlus , you check virtual memory , swap utilization.

[Stephen Keane]

You might want to increase maxssiz as well. I think the error is basically a malloc error.

[tom quach_1]

Hi All:

Thanks for you help. I think we've found the solution for the trouble.


the upload file has 260,000 records.
in the script the programmer added a line to tell oracle commit at every 5000 records.
this is the fix because without this oracle have kept all records in memory. So when monitor with glance i could see the RSS kept growing until it hit the limit
of MAXDSIZ=1GB(32 bit app) subtract the MAXSSIZ and MAXTSIZ
â out of dynamic memory in yy_scan_buffer()â
Thanks again for your help.
Regards,
Tom

[tom quach_1]

Thank you all:

Regards,

Tom