FS corrupt after replacement of disk array

[James Millsap_2]

Hello,

I have a j6000 machine with four 36G drives; two internal, and two external. The external drives are housed in a disk system 2100. The array had failed, and I had it replaced. All the drives remained, and were instlled in the original slot. There is only one VG, and it spans all of the drives. The system boots fine, but the one lvol that spans all four drives will not mount. When I try to mount it, I get "corrupted needs checking". when I do #fsck -F vxfs -o full /dev/vg00/lvol6. I get
log replay in progress
pass0 - checking structural files
pass1 - checking inode sanity and blocks
vxfs fsck: fsck read failure bno = -2, off = 0, len = 8192
file system check failure, aborting ...
I have check the disks with pvdisplay and they do show up as part of lvol6, and the PE seems to jive. I know this is a bit strange, but hopfully somebody may have some type of solution.
thanks in advance,
Jim

[Steven E. Protter]

Perhaps one of the instance numbers changed due to scsi settings when the array was replaced.

ioscan -fnC disk

If possible, compare this to a report taken before the failure.

SEP

[James Millsap_2]

Unfortunately there is no report availible. ioscan jives with vgdisplay -v. I have tried swaping the drives to different slots and I got the same result.

Jim

[Florian Heigl (new acc)]

check if You can still read from those disks, i.e. check there device files with lssf, the disks with diskinfo to the raw devivce, and vgdisplay -v | grep "PV Stat" if possible (I'm not sure I understand 'jive').

It really sounds like Your external disks don't really work. Do they show up in dmesg?

[James Millsap_2]

My appologies.

Vgdisplay lists the correct devices for the VG and they are availible

vgdisplay -v
--- Volume groups ---
VG Name /dev/vg00
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 6
Open LV 6
Max PV 16
Cur PV 4
Act PV 4
Max PE per PV 4350
VGDA 8
PE Size (Mbytes) 8
Total PE 17360
Alloc PE 17360
Free PE 0
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg00/lvol1
LV Status available/syncd
LV Size (Mbytes) 128
Current LE 16
Allocated PE 16
Used PV 1

LV Name /dev/vg00/lvol2
LV Status available/syncd
LV Size (Mbytes) 8192
Current LE 1024
Allocated PE 1024
Used PV 1

LV Name /dev/vg00/lvol3
LV Status available/syncd
LV Size (Mbytes) 2256
Current LE 282
Allocated PE 282
Used PV 1

LV Name /dev/vg00/lvol4
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 64
Allocated PE 64
Used PV 1

LV Name /dev/vg00/lvol5
LV Status available/syncd
LV Size (Mbytes) 2048
Current LE 256
Allocated PE 256
Used PV 1

LV Name /dev/vg00/lvol6
LV Status available/syncd
LV Size (Mbytes) 125744
Current LE 15718
Allocated PE 15718
Used PV 4


--- Physical volumes ---
PV Name /dev/dsk/c3t6d0
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c3t5d0
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c2t14d0
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c2t12d0
PV Status available
Total PE 4340
Free PE 0
Autoswitch On
lssf reports this
lghp235:/root > lssf /dev/dsk/c2t12d0
sdisk card instance 2 SCSI target 12 SCSI LUN 0 section 0 at address 10/0/15/0.1
2.0 /dev/dsk/c2t12d0
lghp235:/root > lssf /dev/dsk/c2t14d0
sdisk card instance 2 SCSI target 14 SCSI LUN 0 section 0 at address 10/0/15/0.1
4.0 /dev/dsk/c2t14d0
lghp235:/root > ioscan -fnC disk
Class I H/W Path Driver S/W State H/W Type Description
========================================================================
disk 1 10/0/15/0.12.0 sdisk CLAIMED DEVICE HP 36.4GST336704LC
/dev/dsk/c2t12d0 /dev/rdsk/c2t12d0
disk 2 10/0/15/0.14.0 sdisk CLAIMED DEVICE HP 36.4GST336704LC
/dev/dsk/c2t14d0 /dev/rdsk/c2t14d0
disk 3 10/0/15/1.5.0 sdisk CLAIMED DEVICE FUJITSU MAJ3364MC
/dev/dsk/c3t5d0 /dev/rdsk/c3t5d0
disk 4 10/0/15/1.6.0 sdisk CLAIMED DEVICE FUJITSU MAJ3364MC
/dev/dsk/c3t6d0 /dev/rdsk/c3t6d0

[TwoProc]

It sure looks to me like you've got disks out of order. The 2100 has only four slots. - so the good news is you're dealing with a small number of ways to arrange them... (compared to a larger disk set).

Make a sheet with all combinations until you've got the one that comes up. All the combinations...

1234
1243
1324
1342
1423
1432

2134
2143
2314
2341
2413
2431

3124
3142
3214
3241
3412
3421

4123
4132
4213
4231
4312
4321

There you - 24 tries until you've got it - ugh!!! Ugly.

Good Luck

[Andrew Fong]

I hate to say that your only option is to restore /dev/vg00/lvol6 from backup.
1. Recycle system and bring it up to single user mode
2. newfs -F vxfs ... /dev/vg00/rlvol6
3. frecover -xf /dev/rmt/... -i /directory name

Hope you have a good backup.

Andrew