changed hostname and server hangs?

[Dennis Handly]

>I changed the tunable as follows:
Current Value 468713472

This is way too big! You have just taken 468 Mb away from maxdsiz. You should put it back to a more reasonable value like 120 Mb.

Since it still fails, you have a bug, a recursive stack overflow. And you should fire up gdb to get a stack trace.

What is the executable in question, vxsvc?

[Dennis Handly]

>Received following coredump when executing java1.3:
>core: ELF-32 core file - IA64 from 'java' - received SIGSEGV
>Is this a tunable problem?

You think it is related? Do you have enough swap? What does "swapinfo -tam" show?

For both problems, you should be talking to the Response Center. To look at your aries and java core dumps.

[Jerry_109]

ok, sounds like a good ideal. I'll a call w/ HP.

root@vulpolicyp[/sbin/rc2.d]
# ll /sbin/rc2.d/S700isisd
lrwxr-xr-x 1 root sys 18 Dec 30 11:21 /sbin/rc2.d/S700isisd -> /sbin/init.d/isisd

#########################
root@vulpolicyp[/sbin/rc2.d]
# ps -aef | grep -i vxsvc
root 2300 1 238 08:46:00 ? 397:22 /opt/VRTSob/bin/vxsvc -m
root 7233 3044 0 15:23:32 pts/0 0:00 grep -i vxsvc
root@vulpolicyp[/sbin/rc2.d]
# swapinfo -tam
Mb Mb Mb PCT START/ Mb
TYPE AVAIL USED FREE USED LIMIT RESERVE PRI NAME
dev 8192 0 8192 0% 0 - 1 /dev/vg00/swap
dev 24576 0 24576 0% 0 - 1 /dev/vg00ext/swap2
reserve - 1173 -1173
memory 24432 2854 21578 12%
total 57200 4027 53173 7% - 0 -

[Dennis Handly]

>root 2300 1 238 08:46:00 ? 397:22 /opt/VRTSob/bin/vxsvc -m

Since vxsvc is running, what was aborting? Do you have a core file?

>Total 57200 4027 53173 7%

Looks like you have enough swap.

[avizen9]

HI Jerry,
can you send me bdf -l command output and also dmesg thanks

[scifusers]

Dennis : yes there is a core file as follows :
root@vulpolicyp[/opt/java1.3]
# ll /opt/java1.3/jre/bin/core
-rw------- 1 root sys 7948220 Jan 21 15:12 /opt/java1.3/jre/bin/core
root@vulpolicyp[/opt/java1.3]
# file /opt/java1.3/jre/bin/core
/opt/java1.3/jre/bin/core: ELF-32 core file - IA64 from 'java' - received SIGSEGV

#########################################

[scifusers]

Avizena :
This is Jerry,
Here is the bdf -l & dmesg :

root@vulpolicyp[/opt/java1.3]
# bdf -l
Filesystem kbytes used avail %used Mounted on
/dev/vg00/root 4128768 429312 3670616 10% /
/dev/vg00/stand 4128768 333592 3765616 8% /stand
/dev/vgdata01/wiis 20512768 71673 19163533 0% /wiis
/dev/vg00/var 33554432 1327992 31975000 4% /var
/dev/vg00/crash 8912896 21120 8822448 0% /var/adm/crash
/dev/vg00/usr 8912896 3035896 5831136 34% /usr
/dev/vgbackup/u99 307232768 141947 287897652 0% /u99
/dev/vglog/u98 51249152 79205 47971833 0% /u98
/dev/vgdata01/u02 235536384 124374 220698767 0% /u02
/dev/vgdata01/u01 235536384 921300 219951719 0% /u01
/dev/vgdata01/u00 20512768 8838201 10944928 45% /u00
/dev/vg00/tmp 8912896 1330840 7524408 15% /tmp
/dev/vg00/scif 1048576 56024 984808 5% /scif
/dev/vg00/opt 15073280 7473216 7540800 50% /opt
/dev/vg00/home 8912896 21368 8822192 0% /home
/dev/vgdata01/edata
112656384 95128 105526183 0% /edata
/dev/vgdata01/app 10289152 20014 9627324 0% /app
DevFS 3 3 0 100% /dev/deviceFileSystem
#################################
Jan 22 08:13
Loaded ACPI revision 2.0 tables.
MMIO on this platform supports Write Coalescing.
Warning: Setting the expanded_node_host_names parameter to 1 will allow administrators to set node and host names larger than 8 and 64 chara
cters/bytes, respectively. It is strongly recommended that all related manpages and documentation be understood before setting larger names
. Larger names can cause some applications which use those names to behave incorrectly or fail.


Using /stand/ext_ioconfig

Memory Class Setup
-------------------------------------------------------------------------
Class Physmem Lockmem Swapmem
-------------------------------------------------------------------------
System : 24431 MB 24431 MB 24431 MB
Kernel : 24431 MB 24431 MB 24431 MB
User : 22995 MB 22529 MB 22535 MB
-------------------------------------------------------------------------

ktracer is off until requested.
Installing Socket Protocol families AF_INET and AF_INET6
Lowfat driver is the master here
64000/0xfa00 esvroot
Kernel EVM initialized
sec_init(): kernel RPC authentication/security initialization.
secgss_init(): kernel RPCSEC_GSS security initialization.
rpc_init(): kernel RPC initialization.
rpcmod_install(): kernel RPC STREAMS module "rpcmod" installation. ...(driver_install)
NOTICE: nfs_client_pv3_install(): nfs3 File system was registered at index 11.
NOTICE: nfs_client_pv4_install(): nfs4 File system was registered at index 12.
NOTICE: cachefsc_install: cachefs File system was registered at index 14.
btlan_load() Loaded Successfully
1 cell
1/0 sba
1/0/0 lba
Initializing the Ultra320 SCSI Controller at 1/0/0/3/0. Controller firmware version is 01.03.35.65
1/0/0/3/0 mpt
Initializing the Ultra320 SCSI Controller at 1/0/0/3/1. Controller firmware version is 01.03.35.65
1/0/0/3/1 mpt
1/0/1 lba
1/0/1/1 pci_slot
1/0/1/1/0 PCItoPCI
Initializing the Ultra320 SCSI Controller at 1/0/1/1/0/4/0. Controller firmware version is 01.03.35.69
1/0/0/3/1.0x2 estp
1/0/1/1/0/4/0 mpt
Initializing the Ultra320 SCSI Controller at 1/0/1/1/0/4/1. Controller firmware version is 01.03.35.69
1/0/1/1/0/4/1 mpt
1/0/1/1/0/6/0 iether
1/0/1/1/0/6/1 iether
1/0/2 lba
1/0/2/1 pci_slot
1/0/4 lba
1/0/4/1 pci_slot
1/0/4/1/0 PCItoPCI
fcd: Claimed HP AD194-60001 4Gb Fibre Channel port at hardware path 1/0/4/1/0/4/0 (FC Port 1 on HBA)
1/0/4/1/0/4/0 fcd
fcd: Claimed HP AD194-60001 4Gb Fibre Channel port at hardware path 1/0/4/1/0/4/1 (FC Port 2 on HBA)
1/0/4/1/0/4/1 fcd
1/0/4/1/0/6/0 iether
1/0/4/1/0/6/1 iether
1/0/6 lba
1/0/6/1 pci_slot
1/0/6/1/0 PCItoPCI
fcd: Claimed HP AD194-60001 4Gb Fibre Channel port at hardware path 1/0/6/1/0/4/0 (FC Port 1 on HBA)
1/0/6/1/0/4/0 fcd
fcd: Claimed HP AD194-60001 4Gb Fibre Channel port at hardware path 1/0/6/1/0/4/1 (FC Port 2 on HBA)
1/0/6/1/0/4/1 fcd
1/0/6/1/0/6/0 iether
1/0/6/1/0/6/1 iether
1/0/8 lba
1/0/8/1 pci_slot
1/0/10 lba
1/0/0/3/0.0x6 estp
1/0/0/3/0.0x6.0x0 eslpt
1/0/0/3/0.6 tgt
1/0/0/3/0.6.0 sdisk
1/0/10/1 pci_slot
1/0/12 lba
1/0/12/1 pci_slot
1/0/12/1/0 PCItoPCI
fcd: Claimed HP AD194-60001 4Gb Fibre Channel port at hardware path 1/0/12/1/0/4/0 (FC Port 1 on HBA)
1/0/12/1/0/4/0 fcd
fcd: Claimed HP AD194-60001 4Gb Fibre Channel port at hardware path 1/0/12/1/0/4/1 (FC Port 2 on HBA)
1/0/12/1/0/4/1 fcd
1/0/12/1/0/6/0 iether
1/0/12/1/0/6/1 iether
1/0/14 lba
1/0/14/1 pci_slot
1/0/14/1/0 PCItoPCI
fcd: Claimed HP AD194-60001 4Gb Fibre Channel port at hardware path 1/0/14/1/0/4/0 (FC Port 1 on HBA)
1/0/14/1/0/4/0 fcd
fcd: Claimed HP AD194-60001 4Gb Fibre Channel port at hardware path 1/0/14/1/0/4/1 (FC Port 2 on HBA)
1/0/14/1/0/4/1 fcd
1/0/14/1/0/6/0 iether
1/0/14/1/0/6/1 iether
1/120 processor
1/121 processor
1/122 processor
1/123 processor
1/250 pdh
1/250/0 acpi_node
1/250/1 ipmi
1/250/2 asio0
1/0/0/3/1.0x2.0x0 eslpt
1/0/0/3/1.2 tgt
1/0/0/3/1.2.0 sdisk
1/0/6/1/0/4/0.0x50060e8010037607 estp
1/0/6/1/0/4/0.0x50060e8005b26e23 estp
1/0/6/1/0/4/0.0x50060e8005b26e23.0x0 eslpt
1/0/6/1/0/4/0.0x50060e8010037607.0x0 eslpt
1/0/6/1/0/4/0.0x50060e8005b26e23.0x4000000000000000 eslpt
1/0/6/1/0/4/0.0x50060e8010037607.0x1000000000000 eslpt
1/0/6/1/0/4/0.10 fcd_fcp
1/0/6/1/0/4/0.10.121.255.0 fcd_vbus
1/0/6/1/0/4/0.10.121.255.0.0 tgt
1/0/6/1/0/4/0.10.121.255.0.0.0 sdisk
1/0/6/1/0/4/0.10.121.255.0.0.1 sdisk
1/0/6/1/0/4/0.0x50060e8005b26e23.0x4001000000000000 eslpt
1/0/6/1/0/4/0.0x50060e8005b26e23.0x4002000000000000 eslpt
1/0/6/1/0/4/0.0x50060e8005b26e23.0x4003000000000000 eslpt
1/0/6/1/0/4/0.0x50060e8005b26e23.0x4004000000000000 eslpt
1/0/6/1/0/4/0.0x50060e8005b26e23.0x4008000000000000 eslpt
1/0/6/1/0/4/0.10.123.255.0 fcd_vbus
1/0/6/1/0/4/0.10.123.255.0.0 tgt
1/0/6/1/0/4/0.10.123.255.0.0.0 sctl
1/0/6/1/0/4/0.10.123.0.0 fcd_vbus
1/0/6/1/0/4/0.10.123.0.0.0 tgt
1/0/6/1/0/4/0.10.123.0.0.0.0 sdisk
1/0/6/1/0/4/0.10.123.0.0.0.1 sdisk
1/0/6/1/0/4/0.10.123.0.0.0.2 sdisk
1/0/6/1/0/4/0.10.123.0.0.0.3 sdisk
1/0/6/1/0/4/0.10.123.0.0.0.4 sdisk
1/0/6/1/0/4/0.10.123.0.0.1 tgt
1/0/6/1/0/4/0.10.123.0.0.1.0 sdisk
1/0/1/1/0/4/1.0x6 estp
1/0/1/1/0/4/1.0x6.0x0 eslpt
1/0/1/1/0/4/1.6 tgt
1/0/1/1/0/4/1.6.0 sdisk
1/0/4/1/0/4/0.0x50060e8010037603 estp
1/0/4/1/0/4/0.0x50060e8005b26e33 estp
1/0/4/1/0/4/0.0x50060e8005b26e33.0x0 eslpt
1/0/4/1/0/4/0.0x50060e8010037603.0x0 eslpt
1/0/4/1/0/4/0.0x50060e8005b26e33.0x4000000000000000 eslpt
1/0/4/1/0/4/0.0x50060e8010037603.0x1000000000000 eslpt
1/0/4/1/0/4/0.20 fcd_fcp
1/0/4/1/0/4/0.20.121.255.0 fcd_vbus
1/0/4/1/0/4/0.20.121.255.0.0 tgt
1/0/4/1/0/4/0.20.121.255.0.0.0 sdisk
1/0/4/1/0/4/0.20.121.255.0.0.1 sdisk
1/0/4/1/0/4/0.0x50060e8005b26e33.0x4001000000000000 eslpt
1/0/4/1/0/4/0.0x50060e8005b26e33.0x4002000000000000 eslpt
1/0/4/1/0/4/0.0x50060e8005b26e33.0x4003000000000000 eslpt
1/0/4/1/0/4/0.0x50060e8005b26e33.0x4004000000000000 eslpt
1/0/4/1/0/4/0.0x50060e8005b26e33.0x4008000000000000 eslpt
1/0/4/1/0/4/0.20.123.255.0 fcd_vbus
1/0/4/1/0/4/0.20.123.255.0.0 tgt
1/0/4/1/0/4/0.20.123.255.0.0.0 sctl
1/0/4/1/0/4/0.20.123.0.0 fcd_vbus
1/0/4/1/0/4/0.20.123.0.0.0 tgt
1/0/4/1/0/4/0.20.123.0.0.0.0 sdisk
1/0/4/1/0/4/0.20.123.0.0.0.1 sdisk
1/0/4/1/0/4/0.20.123.0.0.0.2 sdisk
1/0/4/1/0/4/0.20.123.0.0.0.3 sdisk
1/0/4/1/0/4/0.20.123.0.0.0.4 sdisk
1/0/4/1/0/4/0.20.123.0.0.1 tgt
1/0/4/1/0/4/0.20.123.0.0.1.0 sdisk
64000/0xfa00/0x0 esdisk
64000/0xfa00/0x1 esdisk
64000/0xfa00/0x2 esdisk
64000/0xfa00/0x9 esctl
64000/0xfa00/0xa esdisk
64000/0xfa00/0xb esdisk
64000/0xfa00/0xc esdisk
64000/0xfa00/0xd esdisk
64000/0xfa00/0xe esdisk
64000/0xfa00/0xf esdisk
64000/0xfa00/0x10 esdisk
64000/0xfa00/0x11 esdisk
Boot device's HP-UX HW path is: 1.0.0.3.0.6.0
iether0: INITIALIZING HP AB290-60001 PCI/PCI-X 1000Base-T 2-port U320 SCSI/2-port 1000B-T Combo Adapter at hardware path 1/0/1/1/0/6/0
iether1: INITIALIZING HP AB290-60001 PCI/PCI-X 1000Base-T 2-port U320 SCSI/2-port 1000B-T Combo Adapter at hardware path 1/0/1/1/0/6/1
iether2: INITIALIZING HP AD194-60001 PCI/PCI-X 1000Base-T 2-port 4Gb FC/2-port 1000B-T Combo Adapter at hardware path 1/0/4/1/0/6/0
iether3: INITIALIZING HP AD194-60001 PCI/PCI-X 1000Base-T 2-port 4Gb FC/2-port 1000B-T Combo Adapter at hardware path 1/0/4/1/0/6/1
iether4: INITIALIZING HP AD194-60001 PCI/PCI-X 1000Base-T 2-port 4Gb FC/2-port 1000B-T Combo Adapter at hardware path 1/0/6/1/0/6/0
iether5: INITIALIZING HP AD194-60001 PCI/PCI-X 1000Base-T 2-port 4Gb FC/2-port 1000B-T Combo Adapter at hardware path 1/0/6/1/0/6/1
iether6: INITIALIZING HP AD194-60001 PCI/PCI-X 1000Base-T 2-port 4Gb FC/2-port 1000B-T Combo Adapter at hardware path 1/0/12/1/0/6/0
iether7: INITIALIZING HP AD194-60001 PCI/PCI-X 1000Base-T 2-port 4Gb FC/2-port 1000B-T Combo Adapter at hardware path 1/0/12/1/0/6/1
iether8: INITIALIZING HP AD194-60001 PCI/PCI-X 1000Base-T 2-port 4Gb FC/2-port 1000B-T Combo Adapter at hardware path 1/0/14/1/0/6/0
iether9: INITIALIZING HP AD194-60001 PCI/PCI-X 1000Base-T 2-port 4Gb FC/2-port 1000B-T Combo Adapter at hardware path 1/0/14/1/0/6/1

System Console is on the Built-In Serial Interface
AF_INET socket/streams output daemon running, pid 72
afinet_prelink: module installed
Starting the STREAMS daemons-phase 1
LVM: Root VG activated
Swap device table: (start & size given in 512-byte blocks)
entry 0 - major is 64, minor is 0x2; start = 0, size = 16777216
Dump device table: (start & size given in 1-Kbyte blocks)
entry 0000000000000000 - major is 3, minor is 0x0; start = 4643712, size = 8388544
Create STCP device files
Starting the STREAMS daemons-phase 2
$Revision: vmunix: B.11.31_LR FLAVOR=perf
Memory Information:
physical page size = 4096 bytes, logical page size = 65536 bytes
Physical: 25094912 Kbytes, lockable: 22209920 Kbytes, available: 22689792 Kbytes

[Jerry_109]

hello All,

I have opened the following case w/ HP
3604604482

[Dennis Handly]

>/opt/java1.3/jre/bin/core: ELF-32 core file - IA64 from 'java' - received SIGSEGV
>I have opened the following case with HP 3604604482

Hmm. You have an Aries abort but a IPF core file. If this hadn't happened to me this week, I would have thought it strange. It seems Aries is broken in that it doesn't produce a PA core file.

You might be able to use "strings -a core" to see something.

[Jerry_109]

I stopped and restarted the /sbin/init.d/isisd with sh-x and received the following results :
###############
root@vulpolicyp[/sbin/init.d]
# sh -x ./isisd start
+ PATH=/usr/bin:/bin:/usr/sbin:/usr/bin:/usr/ccs/bin:/usr/contrib/bin:/usr/contrib/Q4/bin:/opt/perl/bin:/opt/ipf/bin:/opt
/nettladm/bin:/opt/fcms/bin:/opt/wbem/bin:/opt/wbem/sbin:/opt/sas/bin:/opt/graphics/common/bin:/opt/atok/bin:/usr/bin/X11
:/usr/contrib/bin/X11:/opt/sec_mgmt/bastille/bin:/opt/drd/bin:/opt/dsau/bin:/opt/dsau/sbin:/opt/resmon/bin:/opt/gnome/bin
:/opt/perf/bin:/usr/contrib/kwdb/bin:/opt/firefox:/opt/mozilla:/opt/prm/bin:/opt/sfm/bin:/opt/swm/bin:/opt/sec_mgmt/spc/b
in:/opt/ssh/bin:/opt/swa/bin:/opt/hpsmh/bin:/opt/langtools/bin:/opt/wlm/bin:/opt/ignite/bin:/opt/gvsd/bin:/opt/rdma/bin:/
opt/perl_32/bin:/opt/perl_64/bin:/var/opt/netscape/server7/shared/bin:/var/opt/netscape/server7/bin:/opt/spb/bin:/opt/thu
nderbird:/opt/hpvm/bin:/opt/caliper/bin:/opt/sentinel/bin:/sbin:/home/root
+ export PATH
+ mode=start
+ BASEDIR=/opt/VRTSob
+ + echo RUNNING
RUNSTATE= RUNNING
+ + echo NOT RUNNING
NORUNSTATE= NOT RUNNING
+ + echo START PENDING
STARTPENDING= START PENDING
+ + echo STOP PENDING
STOPPENDING= STOP PENDING
+ VXSVC=/opt/VRTSob/bin/vxsvc
+ KILLCMD=/opt/VRTSob/bin/vxsvc -k
+ STATUSCMD=/opt/VRTSob/bin/vxsvc -m
+ FORCESHUTDOWN=VEA Server could not be stopped after 2 minutes. VEA Server will be stopped forcefully
+ INSTANCERUNNING=An instance of vxsvc is running. Please stop it before starting another instance.
+ SHUTDOWNMESSAGE=Stopping Veritas Enterprise Administrator Service (vxsvc)
+ STARTMESSAGE=Starting Veritas Enterprise Administrator Service (vxsvc)
+ STARTSUCCESSMESSAGE=VEA Server has successfully started
+ STOPSUCCESSMESSAGE=VEA Server was shutdown successfully
+ FAILUREMESSAGE=VEA Server has failed to start
+ VXSVCNOTFOUND= /opt/VRTSob/bin/vxsvc doesn't exist
+ VEAPORTALFILE=/var/vx/isis/vea_portal
+ VXSVC_LOCK_FILE=/var/vx/isis/vxisis.lock
+ VXSVC_SHUTDOWN_LOCK_FILE=/var/vx/isis/vxisis_shutdown.lock
+ REGFILE=/etc/vx/isis/Registry
+ REGCTL=/opt/VRTSob/bin/vxregctl
+ ps -ef
+ grep -v grep
+ grep vxsvcctrl
+ 1> /dev/null
+ [ 1 -eq 0 ]
+ startService

[HP ARIES32]: ***** Log time: Fri Jan 23 09:55:29 PST 2009 *****
[HP ARIES32]:
[HP ARIES32]: Internal Error (code : 021) [PID : 19887]
[HP ARIES32]: Got masked synchronous signal 11.
[HP ARIES32]: Aborting process!!
[HP ARIES32]:
[HP ARIES32]: ARIES Version :
[HP ARIES32]: 11.31 (PHSS_37553) Ver: 3.0.00015 [May 4, 2008 23:49:23]
[HP ARIES32]: Invoked command :
[HP ARIES32]: /opt/VRTSob/bin/vxsvc -m
###############

strings -a core :
B.11.31
HP-UX
vulpolicyp
B.11.31
ia64
2066127389
java
wR!PwR!`wR!p
wgr8
-server
-client
-hotspot
-classic
-Djava.class.path=.
wv)x
wiC`
# @(#)jvm.cfg 1.13 00/05/11
# Copyright 2000 Sun Microsystems, Inc. All rights reserved.
# Copyright 2000 Sun Microsystems, Inc. Tous droits r
serv
# This software is the proprietary information of Sun Microsystems, Inc.
# Use is subject to license terms.
# List of JVMs that can be used as the first option to java, javac, etc.
# Order is important -- first in this list is the default JVM.
-server
-client
-hotspot
-classic
11:dlsym: Unknown symbol dlsetnonuniqsymflag
wz!hwz'hwQ$pwQ*(wQ1xwQ8
wz'hwx<
wQ1xwz*
wQ*(
wo~h`
wo~h
wv"X`
wv"X`
wv"X`
wv"X`