HP-UX 11.23 and VxVM 4.1

[JM asks]

I have a system is running HP-UX 11.23 with VXVM 4.1, root disk mirrored with VxVM

I have read that mirroring root doesn't require a license:
http://forums13.itrc.hp.com/service/forums/questionanswer.do?admit=109447627+1291071767693+28353475&hpweb_printable=true&threadId=1123787

, and have read post where errror message indicates a licensing issue

but am having issues replace a bad root disk, using c0t12d0, getting the following:

# vxdisk list
DEVICE TYPE DISK GROUP STATUS
c0t8d0s2 auto - - error
c0t10d0s2 auto:hpdisk rootdisk01 oldroot online
c0t12d0s2 auto:none - - online invalid
c1t8d0s2 auto:hpdisk rootdisk01 rootdg online
c1t10d0s2 auto:LVM - - LVM
c2t0d1 auto:LVM - - LVM
c25t2d6 auto:LVM - - LVM
- - rootdisk02 rootdg removed was:c0t8d0s2

# /usr/lib/vxvm/bin/vxdiskunsetup -C c0t12d0s2
# /usr/lib/vxvm/bin/vxdisksetup -iB c0t12d0s2
VxVM vxdisk ERROR V-5-1-558 Disk c0t12d0: Disk not in the configuration

# vxdisk list
DEVICE TYPE DISK GROUP STATUS
c0t8d0s2 auto - - error
c0t10d0s2 auto:hpdisk rootdisk01 oldroot online
c0t12d0s2 auto:hpdisk - - online
c1t8d0s2 auto:hpdisk rootdisk01 rootdg online
c1t10d0s2 auto:LVM - - LVM
c2t0d1 auto:LVM - - LVM
c25t2d6 auto:LVM - - LVM
- - rootdisk02 rootdg removed was:c0t8d0s2

I did use vxdiskadm to remove, but found out that CLI was the way to do it with some given steps.

Can someone tell me what a license looks like for VXVM 4.1, not sure if it uses 4.0 or not.

The results running swlist and also looking for license information, not sure if ther was some upgrade done at some time . . .
B9116BA 4.1.010.1 VERITAS Volume Manager 4.1 for HP-UX
BUNDLE11i B.11.23.0409.3 Required Patch Bundle for HP-UX 11i v2 (B.11.23), September 2004
Base-VXVM B.04.10.011 Base VERITAS Volume Manager Bundle 4.1 for HP-UX
FEATURE11i B.11.23.0706.063 Feature Enablement Patches for HP-UX 11i v2, June 2007
HWEnable11i B.11.23.0706.064 Hardware Enablement Patches for HP-UX 11i v2, June 2007
QPKBASE B.11.23.0706.064 Base Quality Pack Bundle for HP-UX 11i v2, June 2007
VxVM-LIC4_1 4.1.010.1 VERITAS Volume Manager 4.1 for HP-UX


$ vxlicrep

VERITAS License Manager vxlicrep utility version 3.02.006
Copyright (C) 1996-2004 VERITAS Software Corp. All Rights reserved.

Creating a report on all VERITAS products installed on this system

-----------------***********************-----------------

License Key = ###
Product Name = VERITAS Volume Manager
Key = Invalid, Expired
License Type = DEMO
Demo End Date = Sun Jul 15 03:00:00 2007
Site License = YES

Features :=
VxVM = Enabled


-----------------***********************-----------------

License Key = ###
Product Name = VERITAS File System
Serial Number = ##
License Type = PERMANENT
OEM ID = ####

Features :=
HP_OnlineJFS = Enabled

CPU Count = Not Restricted
Platform = HP-UX
Version = 4.1
File Change Log = Enabled


-----------------***********************-----------------

License Key = ####-####-####
Product Name = VERITAS Volume Manager
Serial Number = ##
License Type = PERMANENT
OEM ID = ####

Features :=
HP_VXVM_FULL = Enabled

VxVM = Enabled
CPU Count = Not Restricted
Platform = HP-UX
Version = 4.0

[Jayakrishnan G Naik]

Hi John,

You can check the supported features in your vxvm uing a command below.This will show you whether root disk mirroring is supported or not.
Can you copy the output of this command?

# vxdctl license

Now as per the output I think the server is an Itanium Server. After replacing the disk, Have you run idisk command to create the disk layout for EFI, HPUX and HP SP partitions?

If you need a doc that helps you to do a VXVM root disk replacement, I have attached it

Thanks & Regards
Jayakrishnan G Naik

[Jayakrishnan G Naik]

Hi
Clicked submit by mistake(instead of clicking Browse) :), without attaching the document, Attaching it here.

Thanks & Regards
Jayakrishnan G Naik

[chris huys_4 · Accepted solution]

Hi John,

You were halfway through the procedure to replace a rootmirrorbootdisk. ;)

Find below the complete procedure. The procedure simulates a rootmirrorbootdisk failure and how to recover from it. (you should start at step 5, offcourse keeping in mind to adapt specific for youre system "device files etc.. ")

Greetz,
Chris
>>>>>>>>>>

1. destroy the rootmirrordisk to simulate a failure of the rootmirror

gsesrv8 # dd if=/dev/zero of=/dev/rdsk/c3t15d0 bs=256k count=100
100+0 records in
100+0 records out

2. restart vxconfigd to get rootmirrordisk in failing mode.

gsesrv8:/
gsesrv8 # vxconfigd -km enable
gsesrv8:/

gsesrv8 # vxdisk -g rootdg list
DEVICE TYPE DISK GROUP STATUS
c1t15d0 simple rootdisk01 rootdg online
- - rootdisk02 rootdg failed was:c3t15d0


3. remove the disk from the kernel (-k)

gsesrv8 # vxdg -k -g rootdg rmdisk rootdisk02

gsesrv8 # vxdisk -g rootdg list
DEVICE TYPE DISK GROUP STATUS
c1t15d0 simple rootdisk01 rootdg online
- - rootdisk02 rootdg removed was:c3t15d0

4. Run vxdiskunsetup/ vxdisksetup -iB on the new inserted rootdisk.

gsesrv8 # cd /usr/lib/vxvm/bin
gsesrv8 # ./vxdiskunsetup c3t15d0
gsesrv8 # ./vxdisksetup -iB c3t15d0

gsesrv8 # vxdisk list |grep c3t15d0
c3t15d0 simple - - online
- - rootdisk02 rootdg removed was:c3t15d0

>> CONCLUSION -- c3t15d0 comes back online, but we still have the "removed was" line.

5. add the disk back in rootdg.

gsesrv8 # vxdg -k -g rootdg adddisk rootdisk02=c3t15d0

gsesrv8 # vxdisk -g rootdg list
DEVICE TYPE DISK GROUP STATUS
c1t15d0 simple rootdisk01 rootdg online
c3t15d0 simple rootdisk02 rootdg online

6. check that all mirror rootdisk volumes are in IOFAIL state

gsesrv8 # vxprint -htr -g rootdg
DG NAME NCONFIG NLOG MINORS GROUP-ID
DM NAME DEVICE TYPE PRIVLEN PUBLEN STATE
RV NAME RLINK_CNT KSTATE STATE PRIMARY DATAVOLS SRL
RL NAME RVG KSTATE STATE REM_HOST REM_DG REM_RLNK
V NAME RVG KSTATE STATE LENGTH READPOL PREFPLEX UTYPE

PL NAME VOLUME KSTATE STATE LENGTH LAYOUT NCOL/WID MODE
SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE MODE
SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM MODE
DC NAME PARENTVOL LOGVOL
SP NAME SNAPVOL DCO

dg rootdg default default 0 1099547369.1025.gsersrv8

dm rootdisk01 c1t15d0 simple 1024 35560444 -
dm rootdisk02 c3t15d0 simple 1024 35556864 -

v homevol - ENABLED ACTIVE 20480 SELECT - fsgen

pl homevol-01 homevol ENABLED ACTIVE 20480 CONCAT - RW
sd rootdisk01-05 homevol-01 rootdisk01 4911104 20480 0 c1t15d0 ENA
pl homevol-02 homevol DISABLED IOFAIL 20480 CONCAT - RW
sd rootdisk02-05 homevol-02 rootdisk02 4911104 20480 0 c3t15d0 ENA

v optvol - ENABLED ACTIVE 1677083 SELECT - fsgen

pl optvol-01 optvol ENABLED ACTIVE 1677083 CONCAT - RW
sd rootdisk01-06 optvol-01 rootdisk01 4931584 1677083 0 c1t15d0 ENA
pl optvol-02 optvol DISABLED IOFAIL 1677083 CONCAT - RW
sd rootdisk02-06 optvol-02 rootdisk02 4931584 1677083 0 c3t15d0 ENA

v rootvol - ENABLED ACTIVE 204800 ROUND - root
pl rootvol-01 rootvol ENABLED ACTIVE 204800 CONCAT - RW
sd rootdisk01-03 rootvol-01 rootdisk01 4501504 204800 0 c1t15d0 ENA
pl rootvol-02 rootvol DISABLED IOFAIL 204800 CONCAT - RW
sd rootdisk02-03 rootvol-02 rootdisk02 4501504 204800 0 c3t15d0 ENA

v standvol - ENABLED ACTIVE 307200 ROUND - fsgen

pl standvol-01 standvol ENABLED ACTIVE 307200 CONCAT - RW
sd rootdisk01-01 standvol-01 rootdisk01 0 307200 0 c1t15d0 ENA
pl standvol-02 standvol DISABLED IOFAIL 307200 CONCAT - RW
sd rootdisk02-01 standvol-02 rootdisk02 0 307200 0 c3t15d0 ENA

v swapvol - ENABLED ACTIVE 4194304 ROUND - swap
pl swapvol-01 swapvol ENABLED ACTIVE 4194304 CONCAT - RW
sd rootdisk01-02 swapvol-01 rootdisk01 307200 4194304 0 c1t15d0 ENA
pl swapvol-02 swapvol DISABLED IOFAIL 4194304 CONCAT - RW
sd rootdisk02-02 swapvol-02 rootdisk02 307200 4194304 0 c3t15d0 ENA

v tmpvol - ENABLED ACTIVE 204800 SELECT - fsgen

pl tmpvol-01 tmpvol ENABLED ACTIVE 204800 CONCAT - RW
sd rootdisk01-04 tmpvol-01 rootdisk01 4706304 204800 0 c1t15d0 ENA
pl tmpvol-02 tmpvol DISABLED IOFAIL 204800 CONCAT - RW
sd rootdisk02-04 tmpvol-02 rootdisk02 4706304 204800 0 c3t15d0 ENA

v usrvol - ENABLED ACTIVE 2302940 SELECT - fsgen

pl usrvol-01 usrvol ENABLED ACTIVE 2302940 CONCAT - RW
sd rootdisk01-07 usrvol-01 rootdisk01 6608667 2302940 0 c1t15d0 ENA
pl usrvol-02 usrvol DISABLED IOFAIL 2302940 CONCAT - RW
sd rootdisk02-07 usrvol-02 rootdisk02 6608667 2302940 0 c3t15d0 ENA

v varvol - ENABLED ACTIVE 4706304 SELECT - fsgen

pl varvol-01 varvol ENABLED ACTIVE 4706304 CONCAT - RW
sd rootdisk01-08 varvol-01 rootdisk01 8911607 4706304 0 c1t15d0 ENA
pl varvol-02 varvol DISABLED IOFAIL 4706304 CONCAT - RW
sd rootdisk02-08 varvol-02 rootdisk02 8911607 4706304 0 c3t15d0 ENA

v vol-1 - ENABLED ACTIVE 102400 SELECT - fsgen

pl vol-1-01 vol-1 ENABLED ACTIVE 102400 CONCAT - RW
sd rootdisk01-09 vol-1-01 rootdisk01 13617911 102400 0 c1t15d0 ENA

7. Resync the mirrorrootdisk plexes back from the notfailed mirrordisk.

gsesrv8 # vxrecover -g rootdg -sb

gsesrv8 # vxtask list
TASKID PTID TYPE/STATE PCT PROGRESS
162 PARENT/R 12.50% 8/1(1) VXRECOVER
162 162 ATCOPY/R 07.62% 0/1677083/127744 PLXATT optvol optvol-02


gsesrv8 # vxprint -p -g rootdg
TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0
pl homevol-01 homevol ENABLED 20480 - ACTIVE - -
pl homevol-02 homevol ENABLED 20480 - ACTIVE - -
pl optvol-01 optvol ENABLED 1677083 - ACTIVE - -
pl optvol-02 optvol ENABLED 1677083 - STALE ATT -
pl rootvol-01 rootvol ENABLED 204800 - ACTIVE - -
pl rootvol-02 rootvol DISABLED 204800 - IOFAIL - -
pl standvol-01 standvol ENABLED 307200 - ACTIVE - -
pl standvol-02 standvol DISABLED 307200 - IOFAIL - -
pl swapvol-01 swapvol ENABLED 4194304 - ACTIVE - -
pl swapvol-02 swapvol DISABLED 4194304 - IOFAIL - -
pl tmpvol-01 tmpvol ENABLED 204800 - ACTIVE - -
pl tmpvol-02 tmpvol DISABLED 204800 - IOFAIL - -
pl usrvol-01 usrvol ENABLED 2302940 - ACTIVE - -
pl usrvol-02 usrvol DISABLED 2302940 - IOFAIL - -
pl varvol-01 varvol ENABLED 4706304 - ACTIVE - -
pl varvol-02 varvol DISABLED 4706304 - IOFAIL - -
pl vol-1-01 vol-1 ENABLED 102400 - ACTIVE - -

8. after a time all plexes will be back in ENABLED/ACTIVE state.

gsesrv8 # vxprint -p -g rootdg
TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0
pl homevol-01 homevol ENABLED 20480 - ACTIVE - -
pl homevol-02 homevol ENABLED 20480 - ACTIVE - -
pl optvol-01 optvol ENABLED 1677083 - ACTIVE - -
pl optvol-02 optvol ENABLED 1677083 - ACTIVE - -
pl rootvol-01 rootvol ENABLED 204800 - ACTIVE - -
pl rootvol-02 rootvol ENABLED 204800 - ACTIVE - -
pl standvol-01 standvol ENABLED 307200 - ACTIVE - -
pl standvol-02 standvol ENABLED 307200 - ACTIVE - -
pl swapvol-01 swapvol ENABLED 4194304 - ACTIVE - -
pl swapvol-02 swapvol ENABLED 4194304 - ACTIVE - -
pl tmpvol-01 tmpvol ENABLED 204800 - ACTIVE - -
pl tmpvol-02 tmpvol ENABLED 204800 - ACTIVE - -
pl usrvol-01 usrvol ENABLED 2302940 - ACTIVE - -
pl usrvol-02 usrvol ENABLED 2302940 - ACTIVE - -
pl varvol-01 varvol ENABLED 4706304 - ACTIVE - -
pl varvol-02 varvol ENABLED 4706304 - ACTIVE - -
pl vol-1-01 vol-1 ENABLED 102400 - ACTIVE - -

9. create the LIF files for the replace rootmirrordisk

gsesrv8 # cd /usr/lib/vxvm/bin
gsesrv8 # ./vxbootsetup rootdisk02


gsesrv8 # vxvmboot -v /dev/rdsk/c3t15d0

LIF Label File @ (1k) block # 1434 on VxVM Disk /dev/rdsk/c3t15d0:
Label Entry: 0, Boot Volume start: 3168; length: 300 MB
Label Entry: 1, Root Volume start: 4504672; length: 200 MB
Label Entry: 2, Swap Volume start: 310368; length: 4096 MB
Label Entry: 3, Dump Volume start: 310368; length: 4096 MB
gsesrv8:/usr/lib/vxvm/bin

gsesrv8 # lifls -l /dev/rdsk/c3t15d0
volume ISL10 data size 7984 directory size 8 02/05/10 16:25:44
filename type start size implement created
===============================================================
ODE -12960 584 880 0 03/10/15 11:53:05
MAPFILE -12277 1464 128 0 03/10/15 11:53:05
SYSLIB -12280 1592 353 0 03/10/15 11:53:05
CONFIGDATA -12278 1952 250 0 03/10/15 11:53:05
SLMOD2 -12276 2208 141 0 03/10/15 11:53:05
SLDEV2 -12276 2352 157 0 03/10/15 11:53:05
SLDRV2 -12276 2512 689 0 03/10/15 11:53:05
SLSCSI2 -12276 3208 121 0 03/10/15 11:53:05
MAPPER2 -12279 3336 145 0 03/10/15 11:53:05
IOTEST2 -12279 3488 877 0 03/10/15 11:53:05
PERFVER2 -12279 4368 126 0 03/10/15 11:53:05
PVCU -12801 4496 64 0 03/10/15 11:53:05
SSINFO -12286 4560 2 0 03/10/15 11:53:05
ISL -12800 4568 306 0 02/05/10 16:25:44
HPUX -12928 4880 848 0 02/05/10 16:25:44
AUTO -12289 5728 1 0 02/05/10 16:25:44
LABEL BIN 5736 8 0 04/12/17 12:49:59
>>>>>>>>..

[JM asks]

The steps were here, someone else gave them to me, but it doesn't tell you what to expect to see when you run the commands, so can't tell if the message is bad or what:

How to Replace Failed Root and Non-root VxVM Disk on Itanium Systems.

http://h10025.www1.hp.com/ewfrf/wc/document?cc=us&lc=en&dlc=en&docname=c00872222

I guess that is what experience is all about. Thanks for your help guys.

[JM asks]

Issue resolved after understanding that all was OK and completing steps