System Administration
cancel
Showing results for 
Search instead for 
Did you mean: 

Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

yassyboy
Frequent Advisor

Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Hi,

 

One of the Volume Group's mirrored Hard Drive is either corrupted or faulty. The Drive bay donot show any Amber or Red Light to identify the Faulty Hard Drive. 

 

But when "pvdisplay -v /dev/vgdb01" is used to query it returns with following warning:-

 

"pvdisplay : Warning: couldn't query physical volume "/dev/dsk/c4t1d0".."

 

Because there is no RED/Amber light I am assuming the physical Hard Drive is fine but the data is corrupted and could not be read. May be might require just format.

 

I have the following questions that require support

 

1 - How to identify the faulty physical hard drive on the Array System? Because there is no LED light indication. (See attached file.)

 

2 - And how to Map IOSCAN HW Path with Physical Drive (in attachment) to Pin Point the right Drive without screwing up.

 

3 - Fundamental Best Practice to replace the faulty Drive.Do I need to reduce mirror?Is it just automatic because its HOT SWAPABLE?

 

Thank you

15 REPLIES
yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Diskinfo output of the failed disk.

yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

LVSYNC Output

Torsten.
Acclaimed Contributor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

You will never see a red LED on the disk, this was never implemented. The disk is dead because of size = 0.

Follow the guide to replace the disk.

When_Good_Disks_Go_Bad_WP
http://bizsupport2.austin.hp.com/bc/docs/support/SupportManual/c01911837/c01911837.pdf


Remember, when doing "pvchange -a ..." use "-a N" because of multipath.

 

Slot 1 has ID 0, Slot 2 has ID 1 and so on, the IDs are counted 0,1,2,3, ...

 

You can even use STM and select the "A6255A" device to get more information.

 

# cstm

> map

select ID for A6255A

> sel dev xx

> info; wait;il

 

Example:

 

Hardware path: 1/0/9/0/0.8.0.255.0.15.0


    Product ID:  A6255A

Controller A
------------
       FC Loop ID: 128 (decimal)
     Enclosure ID: 0
    Hardware Path: 1/0/9/0/0.8.0.255.0.15.0
        Serial No: S43FK1404853
   WW Name (node): 50 06 0B 00 00 
   WW Name (port): 50 06 0B 00 00 
    Firmware Rev.: HP05

       Annotation:


Enclosure Status
----------------
 
Disk Modules
------------

       ------------------------------------------------------------
SLOT   | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 |10 |11 |12 |13 |14 |
BUS ID | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 |10 |11 |12 |13 |14 |
STATUS |OK |OK |OK |OK |NIN|NIN|NIN|NIN|NIN|NIN|NIN|NIN|NIN|NIN|NIN|
       -------------------------------------------------------------

        NIN - There is no disk device installed in this slot.


Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

 

Hi Toreston,

 

1- I am already reading the PDF suggested.

 

2 - The output of the CSTM is bellow, FYI.

 

Regards....

 

 

 

 

----------------------------------------------------------------------------------------------

 

Hardware path: 0/4/1/0.8.0.255.0.15.0


Product ID: A6255A


Controller B
------------
FC Loop ID: 255 (decimal)
Enclosure ID: 0
Hardware Path: 0/4/1/0.8.0.255.0.15.0
Serial No: S3BEK1400627
WW Name (node): 50 06 0B 00 00 1B B2 AF
WW Name (port): 50 06 0B 00 00 1E 49 02
Firmware Rev.: HP05

Annotation:


Enclosure Status
----------------

Disk Modules
------------

------------------------------------------------------------
SLOT     | 0    | 1  | 2    | 3  | 4   | 5   | 6   | 7   | 8 | 9 |10 |11 |12 |13 |14 |
BUS ID   | 0    | 1  | 2    | 3  | 4   | 5   | 6   | 7   | 8 | 9 |10 |11 |12 |13 |14 |
STATUS |OK |OK |OK |OK |OK |OK |OK |OK |NIN|N    IN    |NIN|NIN|NIN|NIN|NIN|
-------------------------------------------------------------

NIN - There is no disk device installed in this slot.

Torsten.
Acclaimed Contributor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

So you now know /dev/dsk/c4t1d0 is ID1, the second slot.

This is h/w path 0/4/1/0.8.0.255.0.1.0 and 0/4/1/1.8.0.255.0.1.0.

Compare with "ioscan -fn"

 

Short summary of the steps:

 

- pvchange -a N /dev/dsk/c4t1d0

- check with "vgdisplay -v ...", disk is now "unavailable"

- pull the disk

- check with "ioscan -fn", disk is now "NO_HW"

- insert new disk

- check with "ioscan -fn", disk is now "CLAIMED"

- vgcfgrestore -n <vgname> /dev/rdsk/c4t1d0

- vgchange -a y (or -a e for cluster) <vgname>

- vgdisplay -v <vgname>

- vgsync <vgname">


Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Yes Torsten, It seems its the second slot.

 

I also ran GUI STM...see attached... It also marks the second slot as RED.

yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Hi Toreston,

 

Just tried:-

"pvchange -a N /dev/dsk/c4t1d0" (See attached screen shot)

 

It gave "aN" illegal option, even with space.

 

Regards....

Torsten.
Acclaimed Contributor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

So I guess you did not patch your system since many years!

I'm not sure, but this functionality is available since maybe 2005 or 2006 ...

Workaround:

unmirror the disk
or
just rip it out (since it is already unavailable, there is no risc).

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Hi Torsten,

 

Yes its not been patched as the vendor has forbidden it and will affect the support agreement.

 

Thanks I like the second option (ripping the disk.) the first feels uncomfortable (unmirror).

 

Although the system is in Standby site there is no operations effecting. 

 

So here is what I am planning to.. correct me if I am wrong

 

1 - Switch off the the server and Har Drive Disk System.

2 - Replace the 2nd Drive

3 - Reboot the server and Raid

4 - Assuming the disk system will detect and make it part of the Mirror Raid automatically.

 

 

Will the system will sync the data automatically from the working one? Or is there still some manual intervention.

 

Regards

Torsten.
Acclaimed Contributor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

do not switch off anything. nothing is automatcally done. i told you the steps.

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Hi Torsten,

 

The First Step is not working in my case.

 

So should I skip step 1 and pull the disk (step 2) and proceed with the reamaining?

 

1- pvchange -a N /dev/dsk/c4t1d0  

2- check with "vgdisplay -v ...", disk is now "unavailable"

3- pull the disk

4- check with "ioscan -fn", disk is now "NO_HW"

5- insert new disk

6- check with "ioscan -fn", disk is now "CLAIMED"

7- vgcfgrestore -n <vgname> /dev/rdsk/c4t1d0

8- vgchange -a y (or -a e for cluster) <vgname>

9 - vgdisplay -v <vgname>

10 - vgsync <vgname">

 

Thanks 

 

Regards

 

Torsten.
Acclaimed Contributor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Please check

 

# vgdisplay -v /dev/vgdb01

 

if the disk is unavailable, then skip step 1.


Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Hi Toreston,

 

reference attached screen shot of the output.

 

It shouws it could not query the faulty drive.

 

Only one drive available and second one is stale.

 

So if one is stale should proceed with removal and replace with new 36 gig drive?

 

Regards

 

 

Torsten.
Acclaimed Contributor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Pull the disk, it is unavailable.

 

For step (8) use vgchange -a e <vg_name> because it is a shared cluster VG.


Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
yassyboy
Frequent Advisor

Re: Mirrored Disk Failure on DS 2405 - with 8 Drives connected to HPUX 11.11 Server over FC

Thanks Toreston for the support.

 

I will try that and update the results once I recive the Hard Drive from the Vendor.

 

Thank you