Need help MSA 2040 + DS2700 HDD QTOF & LEFTOVR status

[Andy_ZXA]

We have MSA 2040 + DS2700 (out of warranty). One of Vdisk health is FAULT and Status is QTOF( Quarantine Offline), because the Air Con suddenly damage and maybe overheat ,so some server and storage automatically shutdown.

We config (RAID 10,16 DISKS)
12 Disks on MSA 2040 health status is OK.
4 Disks on DS2700 health status disk is LEFTOVR.

Could anyone help me please how to solve this problem ? I am sure the disk is OK . I assume because the power on enclosure 2 suddenly offline, so the VDISKS RAID 10 from 16 disks , detect 4 disks is missing, so the status became QTOF.

Should I use metadata cleanup first and use TRUST  command to add 4 disks into the VDISK , is it possible ? How about the probability I lost my data ? 

Please kindly give me some advice (step by step), how to solve this QTOF status and repair the LEFTOVR status.

Thank you very much for your kind attention.

[SUBHAJIT KHANBARMAN_1]

If you are sure that drive health is fine then you can run below command from Vdisk owning Controller CLI,

dequarantine vdisk <vdisk_name>

show vdisks

If vdisk state came back to FTOL then no need to do anything else otherwise if vdisk state came as Offline then try below,

trust enable

trust vdisk <vdisk_name>

show vdisks

Hope this helps!
Regards
Subhajit

I am an HPE employee

If you feel this was helpful please click the KUDOS! thumb below!

**********************************************************************

[Andy_ZXA]

 Hi Subhajit, 

Thank you very much for your prompt reply.

I already try your advice, but it didn't work. I assume it didn't work because 4 disks at enclosure 2 still ini LEFTOVR status or should  I  metadata cleanup first all four disk at enclosure 2, is it high risk all my data will be lost after cleanup ?  What should I do ? 

# show vdisks
Name Size Free Own Pref RAID Disks Spr Chk Status Jobs Job%
Serial Number Drive Spin Down Spin Down Delay Health Health Reason
Health Recommendation

-----------------------------------------------------------------------------------------------------------------------
Host BinDB 1798.5GB 0B B B RAID10 4 0 512k FTOL
00c0ff1aee84000034a3265700000000 Disabled 0 OK

Host BinDB 2 2398.0GB 0B B B RAID10 4 0 512k FTOL
00c0ff1aee840000626bfb5b00000000 Disabled 0 OK

Host CM 1798.5GB 0B A A RAID10 4 0 512k FTOL
00c0ff1aeb870000b7520b5700000000 Disabled 0 OK

Host SAT 1798.5GB 0B B B RAID10 4 0 512k FTOL
00c0ff1aee840000c59b555500000000 Disabled 0 OK

Host VMware NOC 7194.1GB 0B A A RAID10 16 0 512k QTOF
00c0ff1aeb8700000eadb95a00000000 Disabled 0 Fault The vdisk is quarantined.
- Look for events in the event log related to quarantine (172 or 485) and follow the recommended actions for those eve
nts.
VMWare 229 2697.8GB 0B A A RAID10 6 0 512k FTOL
00c0ff1aeb87000079d5065400000000 Disabled 0 OK

-----------------------------------------------------------------------------------------------------------------------
Success: Command completed successfully. (2020-04-17 04:02:45)

# dequarantine vdisk "Host VMware NOC"
Error: Command failed. - Vdisk Host VMware NOC was not dequarantined. (Host VMware NOC)
Error: Command failed. (Host VMware NOC) - Vdisk Host VMware NOC was not dequarantined. (2020-04-17 04:02:55)

# show disks
Location Serial Number Vendor Rev How Used Type Job% Speed (kr/min) Size Rate*(Gbit/s) SP
Recon State Copyback State Life Remaining% Health Health Reason
Health Recommendation
----------------------------------------------------------------------------------------------------------------------

2.9 HP HPD4 LEFTOVR SAS 10 900.1GB 6.0
N/A N/A N/A Degraded The disk may contain invalid metadata.
- See "Troubleshooting Steps for Leftover Drives" in the HP MSA2000/P2000 Guided Troubleshooting Best Practices.
2.10  HP HPD4 LEFTOVR SAS 10 900.1GB 6.0
N/A N/A N/A Degraded The disk may contain invalid metadata.
- See "Troubleshooting Steps for Leftover Drives" in the HP MSA2000/P2000 Guided Troubleshooting Best Practices.
2.11  HP HPD4 LEFTOVR SAS 10 900.1GB 6.0
N/A N/A N/A Degraded The disk may contain invalid metadata.
- See "Troubleshooting Steps for Leftover Drives" in the HP MSA2000/P2000 Guided Troubleshooting Best Practices.
2.12 HP HPD4 LEFTOVR SAS 10 900.1GB 6.0
N/A N/A N/A Degraded The disk may contain invalid metadata.
- See "Troubleshooting Steps for Leftover Drives" in the HP MSA2000/P2000 Guided Troubleshooting Best Practices.

----------------------------------------------------------------------------------------------------------------------
Info: * Rates may vary. This is normal behavior. (2020-04-17 04:10:00)

Success: Command completed successfully. (2020-04-17 04:10:00)

[SUBHAJIT KHANBARMAN_1]

Please remove the outputs as you shouldn't place any serial number for any of the device in public forum.

Don't even think of clearing metadata until log analysis done in detail by HPE support. As the vdisk in RAID10 so we need to check what all mirror pair disks are down. If you by mistake clear metadata of two drives which are in RAID1 sub-vdisk then you will lost your data.

So suggest you to log a case with HPE and take proper help.

Hope this helps!
Regards
Subhajit

I am an HPE employee

If you feel this was helpful please click the KUDOS! thumb below!

**********************************************************************