Alternate path problem on FC60 disk array after a disk change

[James Armstrong]

Hi,
We had a disk fail on our FC60 array (RAID5)which happily re-built to the hot spare. We swapped out the faulty disk and it moved the data back to the original disk from the hot spare. So far, so good. The problem now is since this all happened an 'ioscan -fnC' disk is showing the LUNS with the c5 controller as the alternate path as NO_HW and not claimed, although we can get to the LUN down the primary path (c7) no problem. The LUNS down the c5 path as primary are fine and CLAIMED! The LUNS down teh c7 controller are all CLAIMED (We have two paths to the FC60 for resilency). The ioscan is as follows:

disk 3 0/2/0/0.8.0.4.0.0.0 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c5t0d0 /dev/rdsk/c5t0d0
disk 14 0/2/0/0.8.0.4.0.0.1 sdisk NO_HW DEVICE HP A527
7A
/dev/dsk/c5t0d1 /dev/rdsk/c5t0d1
disk 16 0/2/0/0.8.0.4.0.0.2 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c5t0d2 /dev/rdsk/c5t0d2
disk 18 0/2/0/0.8.0.4.0.0.3 sdisk NO_HW DEVICE HP A527
7A
/dev/dsk/c5t0d3 /dev/rdsk/c5t0d3
disk 20 0/2/0/0.8.0.4.0.0.4 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c5t0d4 /dev/rdsk/c5t0d4
disk 22 0/2/0/0.8.0.4.0.0.5 sdisk NO_HW DEVICE HP A527
7A
/dev/dsk/c5t0d5 /dev/rdsk/c5t0d5
disk 24 0/2/0/0.8.0.4.0.0.6 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c5t0d6 /dev/rdsk/c5t0d6
disk 26 0/2/0/0.8.0.4.0.0.7 sdisk NO_HW DEVICE HP A527
7A
/dev/dsk/c5t0d7 /dev/rdsk/c5t0d7
disk 7 1/0/0/0.8.0.5.0.0.0 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c7t0d0 /dev/rdsk/c7t0d0
disk 13 1/0/0/0.8.0.5.0.0.1 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c7t0d1 /dev/rdsk/c7t0d1
disk 15 1/0/0/0.8.0.5.0.0.2 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c7t0d2 /dev/rdsk/c7t0d2
disk 17 1/0/0/0.8.0.5.0.0.3 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c7t0d3 /dev/rdsk/c7t0d3
disk 19 1/0/0/0.8.0.5.0.0.4 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c7t0d4 /dev/rdsk/c7t0d4
disk 21 1/0/0/0.8.0.5.0.0.5 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c7t0d5 /dev/rdsk/c7t0d5
disk 23 1/0/0/0.8.0.5.0.0.6 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c7t0d6 /dev/rdsk/c7t0d6
disk 25 1/0/0/0.8.0.5.0.0.7 sdisk CLAIMED DEVICE HP A527
7A
/dev/dsk/c7t0d7 /dev/rdsk/c7t0d7

We have rebooted but to no avail. I have tried an 'ioscan -fn' followed by a 'vgchange -a y /dev/vg01' but this makes no difference. An amdsp of the FC60 shows everything ok and ready from the FC60's perspective anyway. My worry is that if we lost a primary controller we would lose access to our data as teh alternate would not kick in!

PLEASE HELP.

[bhavin asokan]

hi,

amdsp is showing O.K...


just try

insf -e

and then ioscan -fnC disk

regds,

[James Armstrong]

Tried that, makes no difference, didn't think it would as the server effectively performs an insf -e at boot.

[Shaikh Imran]

Hi,

Any Amber/orange LED's on the Disks ?
Does STM show anything ?

I assume you know the booting procedure
for FC 60 Disk array.
Like....This......
1) switch on the Disks
Wait for some time ( say 2-3 minutes)
2) Switch on the FC 60
Wait for some time ( say 4-5 ) minutes
3) switch on the server...

Now check with amdsp & ioscan..


Regards,

[James Armstrong]

Disk array has not been powered off, try not to unless we have to as kit doesn't really like getting turned off, or rather turned on again! amdsp shows no problems on the FC60, neither does logprint. All green lights on FC60.

[RAC_1]

What does fcmsutil /dev/tdx stat returns???
what does ioscan -fnC fc returns, Does it show the other controller as claimed??

Does diskinfo on those disks return OK??

Anil

[James Armstrong]

The controllers seem fine as we can see all the LUNS which use c5 as the primary controller, and these are 'claimed' in an ioscan. The problem is with LUNS using c5 as alternate. Diskinfo and fibre cards seem fine, please see outputs below.....

441 dssprod!/ # ioscan -fnC fc
Class I H/W Path Driver S/W State H/W Type Description
=================================================================
fc 2 0/2/0/0 td CLAIMED INTERFACE HP Tachyon TL/TS Fibre Chan
nel Mass Storage Adapter
/dev/td2
fc 3 1/0/0/0 td CLAIMED INTERFACE HP Tachyon TL/TS Fibre Chan
nel Mass Storage Adapter
/dev/td3

448 dssprod!/ # diskinfo /dev/rdsk/c5t0d1
SCSI describe of /dev/rdsk/c5t0d1:
vendor: HP
product id: A5277A
type: direct access
size: 71051040 Kbytes
bytes per sector: 512
449 dssprod!/ #