hp p200 G3 Error wher recon sapre hard drive

[sadeghalmahdi]

I had a couple of days ago 1 HDs on the virtual disk failing. The virtual disk is on raid 5+0 and had a spare. After replacing the  hard drives, it started to reconstruct the Raid and looks like failed yesterday, by giving me another error and by presenting 1HDs as "Leftover". After searching on google, i cleaned the metadata of these hard drives and presented them again to the virtual disk and the reconstruction started again.
However it looks like during the night the reconstruction failed and for some reason the whole Virtual Disk went Offline!

recon operation in 80% going to failed

please help me how solved this problem

ombined SC Event Log

Event SN,      Date/Time,    Code,Sev,Ctrlr, Description
     B1  2018-08-12 09:09:42   118  I  B  Cache parameters have been changed for a volume. (volume: vm-300GB_v001, SN: 00c0ffd84a510000688b375a01000000) (cache optimization: standard, prefetch: 512KB, write-back cache: on)
     B2  2018-08-12 09:09:44    19  I  B  A rescan-bus operation was done. (number of disks that were found: 14, number of enclosures that were found: 1) (rescan reason code: 29)
     A2  2018-08-12 09:10:49    19  I  A  A rescan-bus operation was done. (number of disks that were found: 14, number of enclosures that were found: 1) (rescan reason code: 4)
     B3  2018-08-12 09:10:49    41  I  B  A spare disk drive has been added to a vdisk. (vdisk: vm-300GB) (disk: channel: 0, ID: 2, SN: Confidential Info Erased, enclosure: 1, slot: 3)
     A3  2018-08-12 09:10:51    19  I  A  A rescan-bus operation was done. (number of disks that were found: 14, number of enclosures that were found: 1) (rescan reason code: 4)
     B4  2018-08-12 09:10:51     9  I  B  A spare disk kicked in for a critical vdisk. (vdisk: vm-300GB, SN: 00c0ffd84a510000cf89375a00000000) (disk: channel: 0, ID: 2, SN: -, enclosure: 1, slot: 3)
     B5  2018-08-12 09:10:51    37  I  B  Vdisk reconstruct started. (vdisk: vm-300GB, SN: 00c0ffd84a510000cf89375a00000000) (disk: channel: 0, ID: 2, SN: -, enclosure: 1, slot: 3)
     B6  2018-08-12 11:23:57    44  W  B  Unwritable cache data exists for a volume. (volume: , SN: 00c0ffd84a510000688b375a01000000) It comprises 1% of cache space.
     B7  2018-08-12 11:23:57    18  W  B  Vdisk reconstruct failed. Command failed. (error code: 1). (vdisk: vm-300GB, SN: 00c0ffd84a510000cf89375a00000000)
     B8  2018-08-12 11:23:57   172  W  B  A vdisk was quarantined. (vdisk: vm-300GB, SN: 00c0ffd84a510000cf89375a00000000)

##*************************************##
SC Event Log -- Controller A

Event SN,      Date/Time,    Code,Sev,Ctrlr, Description
     A1  2018-08-12 09:09:44    19  I  A  A rescan-bus operation was done. (number of disks that were found: 14, number of enclosures that were found: 1) (rescan reason code: 29)
      A2  2018-08-12 09:10:49    19  I  A  A rescan-bus operation was done. (number of disks that were found: 14, number of enclosures that were found: 1) (rescan reason code: 4)
      A3  2018-08-12 09:10:51    19  I  A  A rescan-bus operation was done. (number of disks that were found: 14, number of enclosures that were found: 1) (rescan reason code: 4)
 
##*************************************##
SC Event Log -- Controller B

Event SN,      Date/Time,    Code,Sev,Ctrlr, Description
     B1  2018-08-12 09:09:42   118  I  B  Cache parameters have been changed for a volume. (volume: vm-300GB_v001, SN: 00c0ffd84a510000688b375a01000000) (cache optimization: standard, prefetch: 512KB, write-back cache: on)
      B2  2018-08-12 09:09:44    19  I  B  A rescan-bus operation was done. (number of disks that were found: 14, number of enclosures that were found: 1) (rescan reason code: 29)
      B3  2018-08-12 09:10:49    41  I  B  A spare disk drive has been added to a vdisk. (vdisk: vm-300GB) (disk: channel: 0, ID: 2, SN: -, enclosure: 1, slot: 3)
      B4  2018-08-12 09:10:51     9  I  B  A spare disk kicked in for a critical vdisk. (vdisk: vm-300GB, SN: 00c0ffd84a510000cf89375a00000000) (disk: channel: 0, ID: 2, SN: -, enclosure: 1, slot: 3)
      B5  2018-08-12 09:10:51    37  I  B  Vdisk reconstruct started. (vdisk: vm-300GB, SN: 00c0ffd84a510000cf89375a00000000) (disk: channel: 0, ID: 2, SN: -, enclosure: 1, slot: 3)
      B6  2018-08-12 11:23:57    44  W  B  Unwritable cache data exists for a volume. (volume: , SN: 00c0ffd84a510000688b375a01000000) It comprises 1% of cache space.
      B7  2018-08-12 11:23:57    18  W  B  Vdisk reconstruct failed. Command failed. (error code: 1). (vdisk: vm-300GB, SN: 00c0ffd84a510000cf89375a00000000)
      B8  2018-08-12 11:23:57   172  W  B  A vdisk was quarantined. (vdisk: vm-300GB, SN: 00c0ffd84a510000cf89375a00000000)
 
##*************************************##
SC Error/Warning Log

i uploaded the system logs

[Shawn_K]

Hello,

The first drive that failed - what slot was it in? If there was a spare drive already assigned, the vdisk should have used the spare drive to reconstruct.

Since the drive in slot 1.3 failed to reconstruct there is likely another drive that is reporting errors. There is not enough information in what you posted to be able to tell the original failed drive, the reconstuction target drive, and what drives are currently in leftover or failed.

With the cache status showing there is unwritten data, you will need to verify which vdisk that cache is for and whether it is needed or not. Be sure you can access all the volumes before you consider next steps.

If you can take a backup of the vdisks, you should do that immediately. I also suggest that instead of trying to troubleshoot such a critical issue on a forum, you should engage support so they can review logs and make further recommendations in order to protect and recover your vdisk.

I do not see any logs attach to the forum.

Cheers,

Shawn