Sam Doesn't Start... Bad Magic Number

[Rafael Mendonça Braga]

Hi All...
Well ... I'm facing a problem and I have no idea how to solve it...

Let me try to explain what we did...

We use here the system HP-UX 11i and our "sam" wasn't working very well ... We discovered that it wasn't working because when we installed the Hp Openview in our server, the DCE-KT-TOOLS that was installed with it was an older version (11.0).

In order to make sam works again, we removed (swremove) the older version of Dce and installed 11.11 version.

Now, when we try to open the sam, we get this message:

draco> sam
/usr/lib/dld.sl: Bad magic number for shared library: /usr/lib/libdcekt.1
/usr/lib/dld.sl: Exec format error
/usr/sbin/sam[220]: 20259 Abort(coredump)
draco>

What does it mean?
We can solve it without the need of an OS reintall??

Thanks.

Rafael M. Braga

[Steven E. Protter]

bdf /usr

Is the filesystem mounted?

It would appear that you might have lost a disk and /usr is not mounted.

diskinfo

dmesg

take a look at /var/adm/syslog/syslog.log for lbolt or powerfail messages.

If a disk is gone, you'll need to replace it and more than likely recover the /usr filesystem.

If you've got a make_tape_recovery backup you can boot off it. If not, you'll have to restore from other backups.

If you have no backup at all, it may be time to plan an OS install.

There are some problems with sam that are fixed with patches. Search the patch database for sam to get them. I don't think thats the problem, but quite often I'm wrong.

http://www2.itrc.hp.com/service/patch/mainPage.do

SEP

[Rafael Mendonça Braga]

I copied the outputs of the command you've posted and here are them:

draco>
draco> bdf /usr
Filesystem kbytes used avail %used Mounted on
/dev/vg00/lvol7 1540096 1319312 219144 86% /usr
draco>
draco>
draco>
draco>
draco> diskinfo /dev/rdsk/c3t6d0
SCSI describe of /dev/rdsk/c3t6d0:
vendor: HP 73.4G
product id: ATLAS10K3_73_SCA
type: direct access
size: 71687369 Kbytes
bytes per sector: 512
draco>
draco>
draco>
draco>
draco> dmesg

Oct 27 10:04
...
igured as SWAP
Logical volume 64, 0x2 configured as DUMP
Swap device table: (start & size given in 512-byte blocks)
entry 0 - major is 64, minor is 0x2; start = 0, size = 8388608
Dump device table: (start & size given in 1-Kbyte blocks)
entry 0000000000000000 - major is 31, minor is 0x6000; start = 314208, 4
Starting the STREAMS daemons-phase 1
Create STCP device files
Starting the STREAMS daemons-phase 2
$Revision: vmunix: vw: -proj selectors: CUPI80_BL$
Memory Information:
physical page size = 4096 bytes, logical page size = 4096 bytes
Physical: 4186112 Kbytes, lockable: 3115732 Kbytes, available: 3656228 Kbyts

LVM: Recovered Path (device 0x1f112700) to PV 3 in VG 1.
LVM: Restored PV 3 to VG 1.

SCSI: Write error -- dev: b 31 0x142700, errno: 126, resid: 8192,
blkno: 2721384, sectno: 5442768, offset: -1508270080, bcount: 8192.
msgcnt 1 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exten)
msgcnt 3 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exten)
msgcnt 5 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exten)
msgcnt 7 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exten)
msgcnt 9 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exten)
msgcnt 11 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 13 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 15 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 17 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 19 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 21 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 23 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 25 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 27 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 29 vxfs: mesg 001: vx_nospace - /dev/root file system full (1 block exte)
msgcnt 31 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 33 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 35 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 37 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 39 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 41 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 43 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 45 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 47 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 49 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)
msgcnt 51 vxfs: mesg 001: vx_nospace - /dev/vg00/lvol4 file system full (1 bloc)

SCSI: Read error -- dev: b 31 0x142700, errno: 126, resid: 8192,
blkno: 2395544, sectno: 4791088, offset: -1841930240, bcount: 8192.

SCSI: Read error -- dev: b 31 0x142700, errno: 126, resid: 49152,
blkno: 3094336, sectno: 6188672, offset: -1126367232, bcount: 49152.

SCSI: Read error -- dev: b 31 0x142700, errno: 126, resid: 24576,
blkno: 3094424, sectno: 6188848, offset: -1126277120, bcount: 24576.

SCSI: Read error -- dev: b 31 0x142700, errno: 126, resid: 8192,
blkno: 2716080, sectno: 5432160, offset: -1513701376, bcount: 8192.

SCSI: Read error -- dev: b 31 0x142700, errno: 126, resid: 49152,
blkno: 2716112, sectno: 5432224, offset: -1513668608, bcount: 49152.

SCSI: Read error -- dev: b 31 0x142700, errno: 126, resid: 8192,
blkno: 2716096, sectno: 5432192, offset: -1513684992, bcount: 8192.
draco>

Thanks.

Rafael M. Braga

[RAC_1]

The dld.sl is compaining that it is not getting the file - libdcekt.1.
Is that file there under /usr/lib?? If yes, compare the size of it with the one on another system. Could be that the file is corrupted.

Also, are you upto date on SAM patches??? Check that and install any SAM patches if required.

Anil

[Steven E. Protter]

Clear up the full filesystem and sam will work right. That is what my crystal ball says after reading your enhanced output.

SEP

[Rafael Mendonça Braga]

Hi Steven,

We have no full file systems anymore and our sam still doesn't working...
This full file system messages was sent to log yesterday morning... I don't know why the dmesg command shown it.

Look:

draco> bdf
Filesystem kbytes used avail %used Mounted on
/dev/vg00/lvol3 1048576 123736 918080 12% /
/dev/vg00/lvol1 298928 58936 210096 22% /stand
/dev/vg00/lvol8 6144000 4240744 1888856 69% /var
/dev/vg00/lvol7 1540096 1319280 219176 86% /usr
/dev/vg00/lvol6 1048576 3992 1037752 0% /tmp
/dev/vg02/lvol1 17670144 15824192 1817200 90% /ora01/dbsrhdes
/dev/vg01/lvol1 5939200 2500928 3223475 44% /ora01/dbslade1
/dev/vg01/lvol3 125952000 117795952 8092376 94% /ora01/dbslade1/index
/dev/vg01/lvol2 133120000 127040952 6031600 95% /ora01/dbslade1/data
/dev/vg04/lvol2 2691072 2286846 378991 86% /ora01/dboemtst
/dev/vg03/lvol1 35127296 18713808 16285384 53% /ora01/dbdwhdes
/dev/vg04/lvol1 6144000 5030679 1043794 83% /ora01/dbdsgprd
/dev/vg00/lvol5 16384000 15026456 1353216 92% /opt
/dev/vg00/lvol20 6144000 4121311 1896320 68% /openview
/dev/vg00/lvol4 1048576 549888 494992 53% /home
/dev/vg00/lvol9 24576000 56356 24136656 0% /export_temp
TAURUS.scania.se:/des29/aceite/int
4392000 1290343 3101656 29% /interface/public
/dev/dsk/c1t2d0 164312 164312 0 100% /cdrom
/dev/vg61/lvol1 5939200 2158109 3544849 38% /bcv_ora01/dbslade1
/dev/vg61/lvol2 133120000 127040952 6031600 95% /bcv_ora01/dbslade1/data
/dev/vg61/lvol3 125952000 117795952 8092376 94% /bcv_ora01/dbslade1/index
draco>

[Rafael Mendonça Braga]

Hi Steven,

We have no full file systems anymore and our sam still doesn't working...
This full file system messages was sent to log yesterday morning... I don't know why the dmesg command shown it.

Look:

draco> bdf
Filesystem kbytes used avail %used Mounted on
/dev/vg00/lvol3 1048576 123736 918080 12% /
/dev/vg00/lvol1 298928 58936 210096 22% /stand
/dev/vg00/lvol8 6144000 4240744 1888856 69% /var
/dev/vg00/lvol7 1540096 1319280 219176 86% /usr
/dev/vg00/lvol6 1048576 3992 1037752 0% /tmp
/dev/vg02/lvol1 17670144 15824192 1817200 90% /ora01/dbsrhdes
/dev/vg01/lvol1 5939200 2500928 3223475 44% /ora01/dbslade1
/dev/vg01/lvol3 125952000 117795952 8092376 94% /ora01/dbslade1/index
/dev/vg01/lvol2 133120000 127040952 6031600 95% /ora01/dbslade1/data
/dev/vg04/lvol2 2691072 2286846 378991 86% /ora01/dboemtst
/dev/vg03/lvol1 35127296 18713808 16285384 53% /ora01/dbdwhdes
/dev/vg04/lvol1 6144000 5030679 1043794 83% /ora01/dbdsgprd
/dev/vg00/lvol5 16384000 15026456 1353216 92% /opt
/dev/vg00/lvol20 6144000 4121311 1896320 68% /openview
/dev/vg00/lvol4 1048576 549888 494992 53% /home
/dev/vg00/lvol9 24576000 56356 24136656 0% /export_temp
TAURUS.scania.se:/des29/aceite/int
4392000 1290343 3101656 29% /interface/public
/dev/dsk/c1t2d0 164312 164312 0 100% /cdrom
/dev/vg61/lvol1 5939200 2158109 3544849 38% /bcv_ora01/dbslade1
/dev/vg61/lvol2 133120000 127040952 6031600 95% /bcv_ora01/dbslade1/data
/dev/vg61/lvol3 125952000 117795952 8092376 94% /bcv_ora01/dbslade1/index
draco>

Thanks Guys,

Rafael M. Braga

[Rafael Mendonça Braga]

Hi There!

Guys...
My problem is not the SAM ... The shared library: /usr/lib/libdcekt.1 that's my problem...

Some minutes ago I've tried to run the openview agents with the command "opcagt" and I got this message as an answer:

draco> opcagt
/usr/lib/dld.sl: Bad magic number for shared library: /usr/lib/libdcekt.1
/usr/lib/dld.sl: Exec format error
/opt/OV/bin/OpC/opcagt[293]: 29301 Abort(coredump)

Environment variables for NLS are probably set incorrect.
Correct ones are LC_ALL=C LANG=C
or LC_ALL=C LANG=C

See HP OpenView IT/Operations Administrator's Reference - chapter 6
for details. IT/O agent will probbably not work in such environment;
Correct upper variables and re-use this command.
Temporary LANG will be set to C
/usr/lib/dld.sl: Bad magic number for shared library: /usr/lib/libdcekt.1
/usr/lib/dld.sl: Exec format error
/opt/OV/bin/OpC/opcagt[315]: 29306 Abort(coredump)
draco> opcsv
/usr/lib/dld.sl: Bad magic number for shared library: /usr/lib/libdcekt.1
/usr/lib/dld.sl: Exec format error
/opt/OV/bin/OpC/opcsv[673]: 29774 Abort(coredump)
/usr/lib/dld.sl: Bad magic number for shared library: /usr/lib/libdcekt.1
/usr/lib/dld.sl: Exec format error
/opt/OV/bin/OpC/opcsv[674]: 29775 Abort(coredump)
draco>


There is a way that I can "fix" this library?
I really don't know what to do...
Please if You could help i'd be very Glad...

Thanks,

Rafael M. Braga

[Mark Greene_1]

have you tried to fsck /usr ?

mark

[Robert-Jan Goossens_1 · Accepted solution]

Hi Rafael,

Check this doc.

Document description: ovoareqsdr core dumped on HP-UX 11i system after deinstalling DCE_KT_TOOLS
Document id: OV-EN012536

Europe
http://www4.itrc.hp.com/service/cki/docDisplay.do?docLocale=en_US&docId=200000069402158

US
http://www2.itrc.hp.com/service/cki/docDisplay.do?docLocale=en_US&docId=200000069402158

Best regards,
Robert-Jan

[Robert-Jan Goossens_1]

Doc with more info.

DO NOT INSTALL DCE-KT-Tools on HP-UX 11i
DocId: KBRC00011973

Europe
http://www4.itrc.hp.com/service/cki/docDisplay.do?docLocale=en_US&docId=200000067229822
US
http://www2.itrc.hp.com/service/cki/docDisplay.do?docLocale=en_US&docId=200000067229822

[Rafael Mendonça Braga]

Hello!!!

Robert,
I don't Know How to Thank you...
It works!!
It seems to me that everything is workinf just fine now!!

Great man!!!

Thanks again!!

Best Regards,

Rafael M. Braga

[Rafael Mendonça Braga]

The Links that Robert have posted contains the information to solve the problem!