RAID drive failed error message

[Aamir14]

Hi,

Yes,on that server disk have three LVs .

my client told me don't delete the disk data.Its very important.

thats why i gave you different server disk details.

this server is rx3600 mention below:--

disk details are:--

appsdev2.mpmkvvcl.com#
appsdev2.mpmkvvcl.com#sautil /dev/ciss0 |more

sautil: Unrecognized device file specified: "/dev/ciss0"

sautil: Error - File open failed
sautil: No such file or directory, errno=2


******************************************************************************
****                                                                      ****
****             S A U T I L   S u p p o r t   U t i l i t y              ****
****                                                                      ****
****             for the HP SmartArray RAID Controller Family             ****
****                                                                      ****
****                           version A.02.13                            ****
****                                                                      ****
****  (C) Copyright 2003-2007 Hewlett-Packard Development Company, L.P.   ****
******************************************************************************


  RAID SA device files (/dev/cissX) found using "/usr/sbin/ioscan -kfnd ciss":


  Run "sautil run_startup_script" if you suspect that the device file is missing or corrupted.
  Run "sautil" to view usage screen.

appsdev2.mpmkvvcl.com#ioscan -m dsf
Persistent DSF           Legacy DSF(s)
========================================
/dev/rdisk/disk9         /dev/rdsk/c0t2d0
/dev/rdisk/disk10        /dev/rdsk/c0t4d0
/dev/rdisk/disk11        /dev/rdsk/c0t1d0
/dev/rdisk/disk12        /dev/rdsk/c0t3d0
/dev/rdisk/disk14        /dev/rdsk/c0t5d0
/dev/rdisk/disk15        /dev/rdsk/c0t6d0
/dev/rdisk/disk15_p1     /dev/rdsk/c0t6d0s1
/dev/rdisk/disk15_p2     /dev/rdsk/c0t6d0s2
/dev/rdisk/disk15_p3     /dev/rdsk/c0t6d0s3
appsdev2.mpmkvvcl.com#
appsdev2.mpmkvvcl.com#
appsdev2.mpmkvvcl.com#diskinfo /dev/rdisk/disk10
SCSI describe of /dev/rdisk/disk10:
             vendor: HP
         product id: DG0300BALVP
               type: direct access
               size: 292968750 Kbytes
   bytes per sector: 512
appsdev2.mpmkvvcl.com#

disk 10 have a lot of space

Process to delete lvm----

# strings /etc/lvmtab

# vgdisplay -v ...

# lvremove ...

# vgremove ...

than i Think no p400 raid controller installed on the server

So,

only delete the LVM and pull the disk ?

Thanks

aamir

[Torsten.]

OK, you now want to remoce a disk from the third server and use this disk as a replacement in the first server, right?

I already told you, remove the LVM configuration from the disk and pull the drive.

Consider to use "rmsf -x" after this to get rid of the NO_HW device.

[Aamir14]

Thanks.

after replacing a disk

Following error message are generated

prodata2#tail -1000000 /var/adm/syslog/syslog.log |grep CRITICAL
Aug  8 00:06:13 prodata2 EMS [2614]: ------ EMS Event Notification ------   Value: "CRITICAL (5)" for Resource: "/adapters/events/raid_adapter/0_6_0_0_0_0_4_0_0_0"     (Threshold:  >= " 3")    Execute the following command to obtain event details:   /opt/resmon/bin/resdata -R 171311106 -r /adapters/events/raid_adapter/0_6_0_0_0_0_4_0_0_0 -n 171311105 -a
Aug  9 00:11:39 prodata2 EMS [2614]: ------ EMS Event Notification ------   Value: "CRITICAL (5)" for Resource: "/adapters/events/raid_adapter/0_6_0_0_0_0_4_0_0_0"     (Threshold:  >= " 3")    Execute the following command to obtain event details:   /opt/resmon/bin/resdata -R 171311106 -r /adapters/events/raid_adapter/0_6_0_0_0_0_4_0_0_0 -n 171311106 -a

more /var/mail/root

>---------- End Event Monitoring Service Event Notification ----------<

From root@prodata2.mpmkvvcl.com Thu Aug  9 00:11:39 IST 2012 Received: (from root@localhost)         by prodata2.mpmkvvcl.com (@(#)Sendmail version 8.13.3 - Revision 1.001:: HP-UX11.31 - 2nd April,2008/8.13.3) id q78If dDO018729;         Thu, 9 Aug 2012 00:11:39 +0530 (IST) Date: Thu, 9 Aug 2012 00:11:39 +0530 (IST) Message-Id: <201208081841.q78IfdDO018729@prodata2.mpmkvvcl.com> To: root@prodata2.mpmkvvcl.com From: root@prodata2.mpmkvvcl.com Subject: prodata2: Event Monitor Notification

>------------ Event Monitoring Service Event Notification ------------<

Notification Time: Thu Aug  9 00:11:39 2012

prodata2 sent Event Monitor notification information:

/adapters/events/raid_adapter/0_6_0_0_0_0_4_0_0_0  is >= 3. Its current value is CRITICAL(5).

Event data from monitor:

Event Time..........: Thu Aug  9 00:11:39 2012 Severity............: CRITICAL Monitor.............: dm_raid_adapter Event #.............: 43 System..............: prodata2

Summary:      Adapter at hardware path 0/6/0/0/0/0/4/0/0/0 : CISS: Logical Drive      transitioned state.

Description of Error:

 lbolt value: 8724285

    CISS: Logical Drive Status:     CISS: Logical Drive 0 transitioned from INTERIM RECOVERY to READY FOR     RECOVERY     Drive Type : RAID 1+0 - Disk Mirroring

Probable Cause / Recommended Action:

Informational message.

Additional Event Data:      System IP Address...: 192.168.4.6      Event Id............: 0x5022b2e300000000      Monitor Version.....: B.01.00      Event Class.........: I/O      Client Configuration File...........:      /var/stm/config/tools/monitor/default_dm_raid_adapter.clcfg      Client Configuration File Version...: A.01.00           Qualification criteria met.                Number of events..: 1      Associated OS error log entry id(s):           0x5022b2e300000001      Additional System Data:           System Model Number.............: ia64 hp server rx6600           OS Version......................: B.11.31           EMS Version.....................: A.04.20.31.02           STM Version.....................: D.04.00      Latest information on this event:           http://docs.hp.com/hpux/content/hardware/ems/dm_raid_adapter.htm#43

v-v-v-v-v-v-v-v-v-v-v-v-v    D  E  T  A  I  L  S    v-v-v-v-v-v-v-v-v-v-v-v-v

I/O Log Event Data:

     Driver Status Code..................: 0x0000002B      Length of Logged Hardware Status....: 0 bytes.      Offset to Logged Manager Information: 0 bytes.      Length of Logged Manager Information: 184 bytes.

Manager-Specific Information:

Raw data from the SCSI RAID SA Controller CISS driver: 00000007 00851F3D 00000001 00000304 00000000 00000000 11165880 02000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 000016B1

>---------- End Event Monitoring Service Event Notification ----------<

prodata2#

Thanks

aamir 

[Torsten.]

Meanwhile the recovery should be finished. What is the status now?

[Torsten.]

Sorry, can't read this.

Could you try again with better format?

[Aamir14]

Hi,

This is server current status.

prodata2#sautil /dev/ciss0 |more                                 

******************************************************************************
****                                                                      ****
****             S A U T I L   S u p p o r t   U t i l i t y              ****
****                                                                      ****
****             for the HP SmartArray RAID Controller Family             ****
****                                                                      ****
****                           version A.02.13                            ****
****                                                                      ****
****  (C) Copyright 2003-2007 Hewlett-Packard Development Company, L.P.   ****
******************************************************************************



---- DRIVER INFORMATION ------------------------------------------------------

  Driver State........................ READY

---- CONTROLLER INFORMATION --------------------------------------------------

  Controller Product Number........... P400
  Controller Product Name............. HP PCIe SmartArray P400
  Hardware Path....................... 0/6/0/0/0/0/4/0/0/0
  Serial Number....................... PAFGL0R9SX81SQ
  Device File......................... /dev/ciss0
  Hardware Revision................... 'E'
  Boot Block Revision................. 0.03
  Firmware Revision (running)......... 5.20
  Firmware Revision (in ROM).......... 5.20
  Firmware Revision (inactive)........ 5.22
  # of Logical Drives................. 1
  # of Physical Disks Configured...... 2
  # of Physical Disks Detected........ 2
  Logical Drive Rebuild Priority...... 0   (low)
  Array Capacity Expansion Priority... 0   (low)
  Auto-Fail Missing Disks at Boot..... disabled
  SCSI Transfer Detection Mode........ Auto Detect
  Controller Path Selection Method.... default


---- ARRAY ACCELERATOR (CACHE) INFORMATION -----------------------------------

  Array Accelerator Board Present?.... yes
  Cache Configuration Status.......... cache enabled
  Cache Ratio......................... 25% Read / 75% Write
  Total Cache Size (MB)............... 208
    Read Cache........................ 052
    Write Cache....................... 156
    Transfer Buffer................... 000
  Battery Pack Count.................. 1
  Battery Status (pack #1)............ ok


---- LOGICAL DRIVE SUMMARY ---------------------------------------------------

       #   RAID      Size        Status   

       0   1+0      139979 MB    OK        


---- SAS/SATA DEVICE SUMMARY -------------------------------------------------

  Location  Ct Enc Bay       WWID           Type        Capacity Status

  internal  2I   1   8  0x500000e01e9a0362  DISK       146.8 GB  OK        
  internal  2I   1   7  0x5000c5000a901e69  DISK       300.0 GB  OK        


---- SAS/SATA ENCLOSURE SUMMARY ----------------------------------------------

  Location  Ct   Enc  Expander_count    Bay_count     SEP_count     

  internal  1I   1    0                 4             1              
  internal  2I   1    0                 4             1              


---- LOGICAL DRIVE 0 ---------------------------------------------------------

  Logical Drive Device File........... c0t0d0
  Fault Tolerance Mode................ RAID 1+0 (Disk Mirroring)
  Logical Drive Size.................. 139979 MB    
  Logical Drive Status................ OK        
  # of Participating Physical Disks... 2

  Participating Physical Disk(s)...... Ct:Enc:Bay:WWID
                                       2I:1:8:0x500000e01e9a0362
                                       2I:1:7:0x5000c5000a901e69

  Participating Spare Disk(s)......... Ct:Enc:Bay:WWID
                                       none

  Stripe Size......................... 128 KB
  Logical Drive Cache Status.......... cache enabled
  Configuration Signature............. 0xA9CAF724
  Media Exchange Detected?............ no
 

---- SAS/SATA DEVICE 2I:1:8:0x500000e01e9a0362 [DISK] ------------------------

  Connector Location............................... internal  
  Connector........................................ 2I
  Enclosure........................................ 1
  Bay.............................................. 8
  WWID............................................. 0x500000e01e9a0362  
  Device Type...................................... DISK       
  Disk Capacity.................................... 146.8 GB  
  Device Status.................................... OK        
  Device Vendor ID................................. HP      
  Device Product ID................................ DG146BABCF      
  Device Serial Number............................. BS05P8C0S3800851
  Device Firmware Version.......................... HPD6
  Reserved Area (cfg/status info).................. 33554.4 KB (33.6 MB)
  Block Size (bytes/sector)........................ 512 bytes
  M&P Data Stamped?................................ yes
  Last Failure Reason.............................. none

  Physical Disk Flags:
    Disk present and operational................... yes
    Non-disk device detected....................... no

    S.M.A.R.T. supported........................... yes
    S.M.A.R.T. errors (in factory M&P data)........ no
    S.M.A.R.T. enabled............................. yes
    S.M.A.R.T. errors (in powerup M&P data)........ no
    Attached to external connector................. no
    Configured in a logical drive.................. yes
    Configured as a spare disk..................... no
    Disk write cache enabled at spin up............ no

    Supports redundant controller operation........ yes
    Disk write cache enabled in current page....... no
    Disk write cache disabled in default page...... yes


 

---- SAS/SATA DEVICE 2I:1:7:0x5000c5000a901e69 [DISK] ------------------------

  Connector Location............................... internal  
  Connector........................................ 2I
  Enclosure........................................ 1
  Bay.............................................. 7
  WWID............................................. 0x5000c5000a901e69  
  Device Type...................................... DISK       
  Disk Capacity.................................... 300.0 GB  
  Device Status.................................... OK        
  Device Vendor ID................................. HP      
  Device Product ID................................ DG0300BALVP     
  Device Serial Number............................. 3SE06BR200009922NBNM
  Device Firmware Version.......................... HPD2
  Reserved Area (cfg/status info).................. 33554.4 KB (33.6 MB)
  Block Size (bytes/sector)........................ 512 bytes
  M&P Data Stamped?................................ yes
  Last Failure Reason.............................. unknown 43

  Physical Disk Flags:
    Disk present and operational................... yes
    Non-disk device detected....................... no

    S.M.A.R.T. supported........................... yes
    S.M.A.R.T. errors (in factory M&P data)........ no
    S.M.A.R.T. enabled............................. yes
    S.M.A.R.T. errors (in powerup M&P data)........ no
    Attached to external connector................. no
    Configured in a logical drive.................. yes
    Configured as a spare disk..................... no
    Disk write cache enabled at spin up............ no

    Supports redundant controller operation........ yes
    Disk write cache enabled in current page....... no
    Disk write cache disabled in default page...... yes





******************************************************************************
****                         End of SAUTIL Output                         ****
******************************************************************************
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#
prodata2#saconfig /dev/ciss0                                                                                      

******************** SmartArray RAID Controller /dev/ciss0 ********************

Auto-Fail Missing Disks at Boot     = disabled
Cache Configuration Status          = cache enabled
Cache Ratio                         = 25% Read / 75% Write

---------- PHYSICAL DRIVES ----------

Location  Ct Enc Bay       WWID           Size       Status

Internal  2I   1   8  0x500000e01e9a0362  146.8 GB   OK        
Internal  2I   1   7  0x5000c5000a901e69  300.0 GB   OK        

---------- LOGICAL DRIVE 0 ----------

Device File     = c0t0d0
RAID Level      = 1+0
Size            = 139979 MB
Stripe Size     = 128 KB
Status          = OK

Participating Physical Drive(s):

Ct  Enc  Bay         WWID           
2I    1    8  0x500000e01e9a0362
2I    1    7  0x5000c5000a901e69

Participating Spare Drive(s):

None

prodata2#

 Only two questions ?

1.mirror are uses two disks.

each disk have same data.

how to see each disk data?

2. If server disk(146 gb) failed

the server load on second disk  (new-300gb) ?

Other wise Thank You Very Much

You always help me on CRITICAL time.

Thanks

aamir

[Torsten.]

You are welcome.

This looks good now.

Here is how this controller works.

You bound 2 disks to a RAID1, this means the complete disk is mirrored to the other (now the complete smaller disk is mirrored to the bigger disk, both are using the capacity of the smaller disk)

Then on these disks is a logical drive defined (currently the complete smaller disk, but such logical drive can be even smaller, so you can have several logical drives on the same pair of disks).

The operating system does NOT see the disks, but the logical drive only.

If one disk fails, the controller is still presenting the logical drive (based on the working disk) to the OS.