Need help from Olympians!

[Reinhard Burger]

Hi Paul

I'm toally not an olymian and it's possible that all the specialists may be very amused about what i'm telling. But if i do not try i do not learn.
May be that some ??problems i had with an ORACLE db showing the same sympthom may give you a small idea.
What i had was a little bit the same. We were starting a job which should do a lot of changes.
This job crashed after running for 2 hours and the application died. ORACLE was still available.
Reason was : the chnages made by the job were filling up rollback segments and as there was no commit the job falied with an ORACLE errormessage which was not shown in the application. As the application was not able to handle this error it just died producing core dumps.
To fix it we added some more space to the rollback segments and reconfigured them to allow dynamicly growing and shrinking.
The default settings that has been coosen during db creation when the application has been installed were not able to handle big amount of changes. Maybe it's a idea where to look into, but maybe it's nonsense i'm telling you. In the later case i appologize for wasting your time.

Reinhard

[H.Merijn Brand (procura]

Any chance in upgrading to the latest ML? [ For the non-AIX: ML is maintainance level ], if only to rule out any OS issues.

Latest for AIX 4.3 is AIX 4.3.3.0 4330-10_AIX_ML


Since AIX is already at 5.1, chances that any 4.3 problems are solved (by IBM) are close to negative. And knowing IBM's arrogance, they'll just refuse to cooperate until you've installed all the patches to above ML, or ask you 6 digit amounts for useless help.

[paul courry]

Jim, please send me your email address to

PAUL@COURRY.COM

I have a few questions for you.....

Paul

[paul courry]

Procura,

'Any chance in upgrading to the latest ML?'

Not a hope in Hell......

This is a production system. Nuff' said.

[benoit Bruckert]

Hi Paul,
If the OS is always running fine after crashes, then you should see the app side !
ie you should try to ask to wharehouse app supplier for any support, if there's any log somewhere, and so on...
As you don't have any crashes for the OS you cannot have any information from a dump or any other OS relatives, excepts syslog (or errpt on AIX), if the app is well written !!!
hth
Benoit

[Victor BERRIDGE]

Hi Paul,
Im no olympian either...
As you suggested maybe memory problem, what is the size of your swap?
I have no more 4.3.1 but Ill check again...
I migrated my last old os last july (4 SP2 nodes- and changed PSSP level...)
to see the swap usage:
lsps -a

all the best
Victor

[nancy rippey]

AIX has a monitorying tool called 'monitor'. It can be downloaded from
http://www.transarc.ibm.com/Library/whitepapers/tg/node67.html

Here is a sample screen print from the tool
# monitor -top

AIX System monitor v2.1.7PRE 24sep1999: \ Wed Mar 22 16:19:10 2000
Uptime: 29 days, 03:00 Users: 2 of 2 active 2 remote 00:08 sleep time
CPU: User 1.1% Sys 1.0% Wait 0.0% Idle 97.9% Refresh: 10.00 s
0% 25% 50% 75% 100%


Runnable (Swap-in) processes 0.00 (0.00) load average: 0.46, 1.04, 0.93

Memory Real Virtual Paging (4kB) Process events File/TTY-IO
free 22 MB 218 MB 0.0 pgfaults 36 pswitch 0 iget
procs 90 MB 37 MB 0.0 pgin 140 syscall 16 namei
files 14 MB 0.0 pgout 7 read 0 dirblk
total 128 MB 256 MB 0.0 pgsin 0 write 19408 readch
IO (kB/s) read write busy% 0.0 pgsout 0 fork 140 writech
hdisk0 0.0 0.0 0 0 exec 0 ttyrawch
hdisk1 0.0 0.0 0 Client Server NFS/s 0 rcvint 0 ttycanch
hdisk2 0.0 0.0 0 0.0 0.0 calls 0 xmtint 140 ttyoutch
hdisk3 0.0 0.0 0 0.0 0.0 retry 0 mdmint
hdisk4 0.0 0.0 0 0.0 0.0 getattr
hdisk5 0.0 0.0 0 0.0 0.0 lookup Netw read write kB/s
cd0 0.0 0.0 0 0.0 0.0 read lo0 0.0 0.0
0.0 0.0 write tr0 0.7 0.2
0.0 0.0 other
PID USER PRI NICE SIZE RES STAT TIME CPU% COMMAND
516 root 127 21 264k 240k run 16+03:55 97.9/55.5 Kernel (wait)
1032 root 37 21 320k 276k slp 4:04:53 0.6/ 0.6 Kernel (gil)
34448 fnsw 60 0 566k 668k Fslp 0:00 0.4/ 0.7 monitor
32870 root 60 0 666k 768k Frun 0:00 0.3/ 0.6 monitor
10862 oracle 60 0 8678k 4172k slp 3:38 0.2/ 0.0 oracle
15480 oracle 60 0 8762k 4268k slp 6:58 0.0/ 0.0 oracle
15738 oracle 60 0 8706k 4268k slp 6:57 0.0/ 0.0 oracle
2156 root 60 0 1375k 488k slp 56:53 0.0/ 0.1 dtgreet
3374 root 60 0 4651k 548k slp 27:19 0.0/ 0.1 X
0 root 16 21 268k 228k slp 20:12 0.0/ 0.0 Kernel (swapper)
4406 root 60 0 349k 264k slp 20:07 0.0/ 0.0 syncd
12904 root 60 0 2531k 480k slp 15:04 0.0/ 0.0 i4lmd
15222 oracle 60 0 8698k 4268k slp 6:57 0.0/ 0.0 oracle
5498 root 60 0 577k 336k slp 6:48 0.0/ 0.0 routed

[paul courry]

Whoops!

We are on

more aix_release.level
4.3.3.0

So it looks current.

[paul courry]

Victor

dexinas5:root> lsps -a
Page Space Physical Volume Volume Group Size %Used Active Auto Type
paging00 hdisk0 rootvg 7680MB 1 yes yes lv
hd6 hdisk0 rootvg 512MB 1 yes yes lv


With 8Gb of RAM and only 1 app everything is being held in memory with 1% usage of swap.

[Victor BERRIDGE]

In aix 4.3.3
I know 2 commands:
topas and nmon4
They should help a lot