Hpux 11.11 panic: LVM: Configuration failure

[Frank de Vries]

Firmware Version 42.11

Duplex Console IO Dependent Code (IODC) revision 0

------------------------------------------------------------------------------
(c) Copyright 1995-1998, Hewlett-Packard Company, All rights reserved
------------------------------------------------------------------------------

Processor Speed State Coprocessor State Cache Size
--------- -------- --------------------- ----------------- ----------
0 160 MHz Active Functional 512 KB
1 160 MHz Idle Functional 512 KB

Central Bus Speed (in MHz) : 120

Model: D270/2

Available memory (bytes) : 1610592256
Good memory required (bytes): 168247296

Primary boot path: 8/4.5 (dec)
Alternate boot path: 8/4.8 (dec)
Console path: 8/16/4.0 (dec)
Keyboard path: 8/16/7.0 (dec)

Processor is booting from first available device.

To discontinue, press any key within 10 seconds.

10 seconds expired.
Proceeding...

Trying Primary Boot Path
------------------------
Booting...
Boot IO Dependent Code (IODC) revision 152


HARD Booted.

ISL Revision A.00.43 Apr 12, 2000

ISL booting hpux

Boot
: disc(8/4.5.0;0)/stand/vmunix
8213980 + 999424 + 728768 start 0x1551e8
NOTICE: autofs_link(): File system was registered at index 3.
NOTICE: cachefs_link(): File system was registered at index 5.
NOTICE: nfs3_link(): File system was registered at index 6.

System Console is on the Built-In Serial Interface
Logical volume 64, 0x3 configured as ROOT



Stored message buffer up to panic:
NOTICE: autofs_link(): File system was registered at index 3.
NOTICE: cachefs_link(): File system was registered at index 5.
NOTICE: nfs3_link(): File system was registered at index 6.
8 ccio
8/4 c720
8/4.5 tgt
8/4.5.0 sdisk
8/4.7 tgt
8/4.7.0 sctl
8/4.8 tgt
8/4.8.0 sdisk
8/4.9 tgt
8/4.9.0 sdisk
8/4.10 tgt
8/4.10.0 sdisk
8/12 c720
8/12.7 tgt
8/12.7.0 sctl
8/12.9 tgt
8/12.9.0 sdisk
8/12.10 tgt
8/12.10.0 sdisk
8/16 bus_adapter
8/16/4 asio0
8/16/5 c720
8/16/5.2 tgt
8/16/5.2.0 sdisk
8/16/5.3 tgt
8/16/5.3.0 stape
8/16/5.7 tgt
8/16/5.7.0 sctl
8/16/6 lan2
8/16/0 CentIf
ps2_readbyte_timeout: no byte after 500 uSec
ps2_readbyte_timeout: no byte after 500 uSec
8/16/7 ps2
8/20 bus_adapter
8/20/5 eisa
8/20/5/1 btlan0
8/20/2 asio0
10 ccio
32 processor
34 processor
49 memory

System Console is on the Built-In Serial Interface
btlan0: INITIALIZING: 82556 EISA 10/100BASE-TX card in slot 8/20/5/1
Logical volume 64, 0x3 configured as ROOT
LVM : Activation of root volume group failed
I/O error while reading the VGDA


-----------------------------------------------------
| |
| SYSTEM HALTING during LVM Configuration |
| |
Could not configure root VG
If new kernel,ISL> hpux -lm /stand/vmunix; pvck -y /dev/rdsk/....
| |
-----------------------------------------------------


linkstamp: Tue Jul 8 12:44:43 METDST 2003
_release_version: @(#) $Revision: vmunix: vw: -proj selectors: CUPI80_BL2000_1108 -c 'Vw for CUPI80_BL2000_1108 build' -- cupi80_bl2000_1108 'CUPI80_BL2000_1108' Wed Nov 8 19:05:38 PST 2000 $
panic: LVM: Configuration failure

PC-Offset Stack Trace (read across, top of stack is 1st):
0x00162e9c 0x00479314 0x00475d70 0x00479680 0x0027b1bc 0x003b93b4
0x00279818 0x000b0cf4 0x00155490
End Of Stack

Trap Type 15 (Data page fault):
Instruction Address (pcsq.pcoq) = 0x0.0x3c2408
Instruction (iir) = 0x48730018 (load/store)
Target Address (isr.ior) = 0x0.0x0000000c
Base Register (gr3) = 0x00000000
Savestate Ptr (ssp) = 0x2389000.0x7fff08a8
Savestate Return Pointer (ss_rp) = 0x0001a5e0

System Panic:

linkstamp: Tue Jul 8 12:44:43 METDST 2003
_release_version: @(#) $Revision: vmunix: vw: -proj selectors: CUPI80_BL2000_1108 -c 'Vw for CUPI80_BL2000_1108 build' -- cupi80_bl2000_1108 'CUPI80_BL2000_1108' Wed Nov 8 19:05:38 PST 2000 $
panic: Data page fault



*** A system crash has occurred. (See the above messages for details.)
*** The system is now preparing to dump physical memory to disk, for use
*** in debugging the crash.

ERROR: Your system crashed before I/O and dump configuration was complete.
A crash dump cannot be taken under these circumstances without
special configuration. Contact your HP support representative.

: - We can go into maintenance mode using hpux -lm
and from there can issue limited commands
# vgcfgrestore -n /dev/vg00 -l

Volume Group Configuration information in "/etc/lvmconf/vg00.conf"
VG Name /dev/vg00
---- Physical volumes : 2 ----
/dev/rdsk/c0t5d0 (Bootable)
/dev/rdsk/c0t8d0 (Bootable)
#
# lvlnboot -v

lvlnboot: Volume group not activated.
Cannot display volume group "/dev/vg00".
lvlnboot: Volume group not activated.
Cannot display volume group "/dev/vg01".
lvlnboot: Volume group not activated.
Cannot display volume group "/dev/vg02".
#
# mount /dev/vg00/lvol7 /usr

/dev/vg00/lvol7: No such device or address
#
#

When we start the kernel , it goes back into a panic and automatically restarts.

So I have acces to / and /etc (but not /usr or
/stand),
what can I do from here to fix it ?
# mount
/ on /dev/root log on Wed Jan 6 07:31:44 2010

Thx

[Torsten.]

Wow, an old D-class!

>>LVM : Activation of root volume group failed
I/O error while reading the VGDA

Bad disk? Bad cable? Bad terminator?

What gives ioscan?

[Frank de Vries]

Yes a D class , nice oldtimer ...

Ioscan itself does not report anything,
get the idea it is not hardware, or maybe
corrupted lvm header or bad blocks.
I am not sure.
Any troubleshooting tips you can give?
see ioscan attached...

[Frank de Vries]

Response from HP
The problem looks like you have a LVM corruption due a hardware failure (broken disk).

You did already try to boot from the alternate disk, and that did fail also.
A boot in lvm maintenance mode (hpux -lm) did also fail.

There is a known issue, and that looks as follows:
PHKL_34093:
( SR:8606175971 CR:JAGad45211 )
Following a system crash or reset, if a volume group has
logical volumes configured with Consistency Recovery set to
MWC, and some physical volumes are missing, then the volume
group activation may fail with an error similar to:

# vgchange -a y vg4
vgchange: Couldn't activate volume group "vg4":
I/O error while reading the VGDA.

But since the system is not up now, this install will not be possible.

A alternatieve is a retore via IgniteUX, en then check and install this patch.
But then you should be sure that both system disks are OK.

To check that try a dd from both disk:
That can be done are follows:
# dd if=/dev/rdsk/c0t5d0 of=/dev/null bs=1024k But then select you local disk ar paramerter for if.

Repeat this for both disk and if therer are no errors, then the disk are OK.

Then a IgniteUX restore can do the job.

[Robert Salter]

When HP had you try a vgchange, did you try it on /dev/vg00? The lvlnboot is saying vg00 isn't activated.

Do you have a tape drive or CD/DVD drive attached to it? If so boot off the tape/CD/DVD and then see if you can verify if the disks are any good. Then use ignite to restore it. If you have a good ignite recovery tape.

If you can get to / and /etc, what's in fstab?