Lost veritas Disk Groups

[Darrel Louis]

Hi,

After a reboot we lost our Veritas Diskgroups.
When we try to import the diskgroup we get the following error:
Description: Import Diskgroup
Date: Thu May 12 14:54:45 2005
Command: /usr/sbin/vxdg -n dg_ora5 import 1115126037.1869.aces54
Output: vxvm:vxdg: ERROR: Disk group 1115126037.1869.aces54: import failed: Unexpected kernel error in configuration update
Exit Code: 5

And another Diskgroup dg_ora4 doesn't show when executing the command:
vxdisk -o alldgs list

Both Diskgroups are using disks from a EMC Box.
Diskgroups using the internal disks are oke.

Thanx in advanced

Darrel

[David Child_1]

Does rootdg show up okay? Can you post 'vxdisk -o alldgs list'?

Thanks,
David

[Zinky]

1. What kind of EMC array are you using?
2. Are you using PowerPath?
3. Are you using the full version of VxVM on HP-UX 11i? If so, do you have the right ASL instaled.
4. What VxVM Patch level do you have ? (Update 3?)
5. Is this a new/fresh VxVM installation?
6. Can you still see your EMC disks via the "inq" or "inquire" tool?

[Darrel Louis]

Hi,

David:
Rootdg is oke, only the diskgroups created with EMC disks are not OKE.

Nelson:
1. What kind of EMC array are you using? Symmetrix DMX2000
2. Are you using PowerPath? Yes
3. Are you using the full version of VxVM on HP-UX 11i? If so, do you have the right ASL instaled. Yes, but how to check ASL?
4. What VxVM Patch level do you have ? (Update 3?)
VxVM 3.5m Command Cumulative Patch 06 (PHCO_30834)
5. Is this a new/fresh VxVM installation?
No.
6. Can you still see your EMC disks via the "inq" or "inquire" tool? YES

Thanx

Darrel

[Suraj Singh_1]

Hi,

I would start looking from the output of ioscan.

i) Does ioscan's output shows the disks as CLAIMED?
ii) what is the o/p of "vxdisk list" ?

Regards,
Suraj

[Darrel Louis]

Hi,
The disks are claimed, seen with ioscan.

What I see is that the dg is between (), is it because it is not imported?
output:
vxdisk -o alldgs list | grep ora5
c4t0d7 simple - (dg_ora5) online
c4t4d2 simple - (dg_ora5) online
c4t4d3 simple - (dg_ora5) online
c4t4d4 simple - (dg_ora5) online
c4t4d5 simple - (dg_ora5) online
c4t4d6 simple - (dg_ora5) online
c4t4d7 simple - (dg_ora5) online
c4t5d0 simple - (dg_ora5) online
c4t5d1 simple - (dg_ora5) online
c4t5d2 simple - (dg_ora5) online
c4t5d3 simple - (dg_ora5) online
c6t0d7 simple - (dg_ora5) online
c6t4d1 simple - (dg_ora5) online
c6t4d2 simple - (dg_ora5) online
c6t4d3 simple - (dg_ora5) online
c6t4d4 simple - (dg_ora5) online
c6t4d5 simple - (dg_ora5) online
c6t4d6 simple - (dg_ora5) online
c6t4d7 simple - (dg_ora5) online
c6t5d0 simple - (dg_ora5) online
c6t5d1 simple - (dg_ora5) online
c6t5d2 simple - (dg_ora5) online
c6t5d3 simple - (dg_ora5) online

Thx

Darrel

[Suraj Singh_1]

Check the DGid of the diskgroup you are trying to import "vxdisk -s list".

Is this ID same as 1115126037.1869.aces54?

If no, there is some corruption in the DG.

Try:
vxdg -n dg_ora5 import

or,

vxdg -f import

Rgds

[Zinky]

Try doing:

vxdctl enable

and then

vxdg list
vxvol -g dg_ora04 startall

and

mount your filesystems.

Again, is this a new instllation? What VxVM patch level do you have? (show_patches|grep -i vxvm)

[Darrel Louis]

Suraj:
vxdg -f import dg_ora4
vxvm:vxdg: ERROR: Disk group dg_ora4: import failed: No valid disk found containing disk group


Nelson:
# vxdctl enable

# vxdg list
NAME STATE ID
rootdg enabled 1090498046.1025.aces54
dg_ora5 enabled 1115904057.2281.aces54

# vxvol -g dg_ora04 startall
vxvm:vxvol: ERROR: Diskgroup dg_ora04 not found

# show_patches|grep -i vxvm
PHCO_27100 HFS mkfs(1M) VxVM Rootability patch
PHCO_27101 mkboot(1M) VxVM Rootability patch
PHCO_27103 pre_init_rc enh for VxVM rootability
PHCO_30834 VxVM 3.5m Command Cumulative Patch 06
PHKL_27096 VxVM,EMC,Psets&vPar,slpq1,earlyKRS
PHKL_27177 VxVM boot support change for os loader
PHKL_29981 VxVM 3.5m Kernel Cumulative Patch 05


Darrel

[Zinky]

Hmm it appears your EMC LUNs are not visible anymore.

Can you do an inq or inquire if you have the EMC tools installed?

Until your EMC LUNs are once more visible, your EMC DG dg_ora04 will not be imported and available. Fix that EMC problem first and then you;ll be okay.

What EMC box do you use btw?

[Suraj Singh_1]

I am really starting to suspect whether all the disks are availabe to the OS?

Do you see any difference in the o/p of ioscan -fnC disk? Are some disks missing (though the possibility is less, but you never know...). You might want to check the LUN configuration on EMC.

Perform "vxdisk scandisks", and restart vxconfigd (vxconfigd -k -m enable).

Rgds

[Suraj Singh_1]

Just a sec., what is teh DG name? Is it "dg_ora5" or "dg_ora4" ??

[Darrel Louis]

Saraj,

We have two dg:
- dg_ora4
- dg_ora5

dg_ora5 was empty so we destroyed it and recreated it now.

But dg_ora4 has lots of DB's in it.

Darrel

[Zinky]

Darrel,

Are both dg_ora4 and dg_ora5 using EMC disks?

Again:

1. What is the EMC array you're using
2. Post (as an attachment) output of "ioscan -kfnC disk"
3. Output of EMC TOol "inq" or "inquire"

[Darrel Louis]

Nelson,

We've checked the lun's on the EMC box and everything seems to be oke.

See attachment, maybe you see something we're missing.

Darrel

[Darrel Louis]

ioscan output

[Zinky]

Send also the full output of "vxdisk -o alldgs list"

[Darrel Louis]

L & G,

What can be the cause of this problem?

What can cause a corruption?

Darrel

[Zinky]

Hmm.

There are no traces of oradg_04 at al in your latest vxdisk list output.

Do you have a backup copy of a vxdisk list or vxprint -Aht ?

It also appears you're VxVM configuration is not properly setup for DMP (or you're not full licensed for FULL VXVM). The alternate path to the EMC LUN does not seem to be in DMP.

Do a "vxdisk list c6t4d1".

What happened to this server? Why was it rebooted? What changes? Is this a new configuration? Do you use PowerPath?

[Darrel Louis]

Nelson don't have a copy or baclup of both.
We don't have a full lic.
Yes we use powerpath.

Attached info of a disk, that should belong to dg_ora4.

Darrel

[Darrel Louis]

L & G,

Could following explanation be the cause of our problem:

A couple of months ago disks(EMC) have been removed from the system(physically). After the remove we didn't perform the following:
- powermt check
- powermt config

A couple of weeks ago disks(EMC) has been added to the same system, and some old device files has been reused by the new disks.
Before the "powermt check" we didn't see some of the devices.
Could it be possible that there was a DISK ID conflict?

Thanx

Darrel

[Zinky]

Are you a long time admin of said machine or are you new to VxVM / PowerPath?

VxVM non-Full (hence DMP disabled) should still work with PowerPath or arrays that have their own path protection.

Do verify that you do not have a full vxvmlicense by doing:

# vxlicrep
# vxlicense -p

Yeah - I guess your problems has got to be with VxVM's dealings with PowerPath. I have never used PowerPath but just DMP to my EMC systems - and they work fine and have never any problems.

Good Luck.

[Darrel Louis]

Problem solved long time ago, but Merijn asked me to close them.

Thanks.