HPE Community read-only access December 15, 2018
This is a maintenance upgrade. You will be able to read articles and posts, but not post or reply.
Hours:
Dec 15, 4:00 am to 10:00 am UTC
Dec 14, 10:00 pm CST to Dec 15, 4:00 am CST
Dec 14, 8:00 pm PST to Dec 15, 2:00 am PST
MSA Storage
cancel
Showing results for 
Search instead for 
Did you mean: 

SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

 
Highlighted
Abdel-aiki
Frequent Visitor

SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Hi, 

I have a serious problem with the Vdisk on SAN (P2000 G3 iSCSI) , it configured with RAID 5 :

 

System Name: SAN

System Contact: IT Manager
System Location:
System Information: HP P2000 G3
Midplane Serial Number:
Vendor Name: HP StorageWorks
Product ID: P2000 G3 iSCSI
Product Brand: MSA Storage
SCSI Vendor ID: HP
SCSI Product ID: P2000 G3 iSCSI
Enclosure Count: 1
Health: Degraded
Health Reason: Vdisk 1 is Degraded.

 

All Disk show OK 

 

Location Serial Number Vendor Rev How Used Type Size Rate*(Gb/s) SP Health Health Reason
----------------------------------------------------------------------------------------------------------------------------
1.1 Z1W2A2SE00009443ALBL SEAGATE 0003 VDISK SAS 1000.2GB 6.0 OK
1.2 9WK06BP40000S017ENYH SEAGATE 0003 VDISK SAS 1000.2GB 6.0 OK
1.3 9WK071QE0000C036139Z SEAGATE 0003 VDISK SAS 1000.2GB 6.0 OK
1.4 Z1W2A1S50000C447CHP8 SEAGATE 0003 VDISK SAS 1000.2GB 6.0 OK
1.5 9WK0CE4F0000C038B5YY SEAGATE 0003 VDISK SAS 1000.2GB 6.0 OK
1.7 9WK0SMNH0000C048JZTS SEAGATE 0005 VDISK SAS 1000.2GB 6.0 OK
1.8 9WK0QPYV0000C04448HH SEAGATE 0005 VDISK SAS 1000.2GB 6.0 OK
1.9 9WK4BHQD0000C13759AK SEAGATE N004 GLOBAL SP SAS 1000.2GB 6.0 OK
1.11 9WK0CQ6E0000C038BUQC SEAGATE 0003 VDISK SAS 1000.2GB 6.0 OK
1.12 9WK07XTK0000C0364140 SEAGATE 0003 VDISK SAS 1000.2GB 6.0 OK
----------------------------------------------------------------------------------------------------------------------------

# show vdisks
Name Size Free Own Pref RAID Disks Spr Chk Status Jobs Job% Serial Number Drive Spin Down
Spin Down Delay
----------------------------------------------------------------------------------------------------------------------------------------
vd01 9991.8GB 0B A A RAID5 11 0 64k OFFL Disabled

 

i try to trust the vdisk :

# trust vdisk vd01
Error: Command failed.

 

any Idee please ?

 

 

 

12 REPLIES

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

You shouldn't try trust command without checking logs by some MSA specialist. If you have contract with HPE then log a support case with HPE

How vd01 went to offline state?

You can also check system events and find out if any drives having any hardware errors. If all drives health ok then you can run the below command,

#trust enable

#trust vdisk vd01

# show vdisks

You can also share the MSA logs with me in private chat and I can check the same.

Keep in mind that you shouldn't execute trust command multiple times on a vdisk otherwise drive metadata will get corrupted and no one can recover data from the vdisk.

 

Hope this helps!
Regards
Subhajit

If you feel this was helpful please click the KUDOS! thumb below!

***********************************************************************************

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Bundle Version: TS230P008

It looks like this MSA running with very old or expired or inactive firmware so there is no gurantee that Vdisk will come up or not.

Three drives at location 1.2, 1.11 and 1.12 shows big number of recovered errors which looks bad as well.

Anyway you can try the below commands,

#trust enable

#trust vdisk vd01

# show vdisks

Once vdisk came up. Take data backup. Then plan for downtime and stop Host IO or disconnect Host from MSA. Then upgrade MSA controllers to latest version TS252P005

Upgrade Path -> TS230 -> TS250 -> TS252

www.hpe.com/storage/MSAFirmware 

 

Then you may have to plan and replace faulty drives one by one.

 

Hope this helps!
Regards
Subhajit

If you feel this was helpful please click the KUDOS! thumb below!

***********************************************************************************

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

I forgot to mention that you need to physically re-seat drive at location 1.10 then only you can try the commands that I have suggested because 1.10 now missing and that is the last drive for which vdisk went to offline state

If even after re-seat 1.10 not coming up then there is no way to recover this vdisk

Vdisk was made with 11 drives in RAID5. Right now only 9 drives present. As you know RAID5 can't sustain more than one drive failure. Here two drive missing which are 1.6 and 1.10 so vdisk in offline state as this is RAID failed. We don't need 1.6 anymore but If we re-seat 1.10 as that is having latest data so We can try recovering this vdisk as that time we will have 10 drives in vdisk which is meeting RAID5 criteria which will help to recover the vdisk but again it depends upon in what condition 1.10 is. If controllers not able to read data from 1.10 then data recovery not possible.

1.6 failed on 30th Dec 2017 but no one replaced it.

 

Hope this helps!
Regards
Subhajit

If you feel this was helpful please click the KUDOS! thumb below!

***********************************************************************************

Abdel-aiki
Frequent Visitor

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

it s not working :

 

# trust enable
Success: Command completed successfully.

# trust vdisk vd01
Error: Command failed.

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Is 1.10 now detected by controller?

As told you before there are multiple drive having issue which will not allow to recover the vdisk

You can log support case with HPE if they can recover

 

Hope this helps!
Regards
Subhajit

If you feel this was helpful please click the KUDOS! thumb below!

***********************************************************************************

Abdel-aiki
Frequent Visitor

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Okay, i'll check it physically tomorrow because i try to solve the problem remotly 

 

Thank you so much 

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Please don't execute trust command without drive 1.10 back online again otherwise no way you can recover data. 

 

Hope this helps!
Regards
Subhajit

If you feel this was helpful please click the KUDOS! thumb below!

***********************************************************************************

Abdel-aiki
Frequent Visitor

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Its working now , Fingers Crossed for the reconstruction 

 

show vdisks
Name Size Free Own Pref RAID Disks Spr Chk Status Jobs Job% Serial Number Drive Spin Down
Spin Down Delay
----------------------------------------------------------------------------------------------------------------------------------------
vd01 9991.8GB 0B A A RAID5 11 0 64k CRIT RCON 1% 00c0ff12ada20000bb95d25900000000 Disabled
0
----------------------------------------------------------------------------------------------------------------------------------------
Success: Command completed successfully.

Shawn_K
HPE Pro

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Hello,

I highly recommend you take an immediate backup of the data. With the multiple drive failure scenario you have described the chances that reconstruction will complete successfully are extremely small. While you have access to the data, please back it all up! You will need to verify the data is valid but at least if you have a backup you can restore valid data if the reconstruction fails.

Be aware - if the reconstruction fails and the vdisk goes offline again, using trust will likely cause data integrity issues.

Cheers,
Shawn

I work for Hewlett Packard Enterprise. The comments in this post are my own and do not represent an official reply from HPE. No warranty or guarantees of any kind are expressed in my reply.

Abdel-aiki
Frequent Visitor

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Hi, 

 

Here the new situation of my case :

 

show vdisks
Name Size Free Own Pref RAID Disks Spr Chk Status Jobs Job%
Serial Number Drive Spin Down Spin Down Delay
-------------------------------------------------------------------------------
vd01 9991.8GB 0B A A RAID5 11 0 64k FTOL VRSC 42%
00c0ff12ada20000bb95d25900000000 Disabled 0
-------------------------------------------------------------------------------
Success: Command completed successfully.

 

How can i take a backup of my data on IT , i can t conncet to the Vdisk with SFTP !

 

Any Idee please ?

Shawn_K
HPE Pro

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

Hello,

 

In Protocols, do you have the correct settings set for SFTP?

Do you have the host ports connected? You can try a host based backup if you are properly configured.

Cheers,
Shawn

I work for Hewlett Packard Enterprise. The comments in this post are my own and do not represent an official reply from HPE. No warranty or guarantees of any kind are expressed in my reply.

Re: SAN (P2000 G3 iSCSI) Vdisk Raid5 offline

It's good to see that my analysis and recommendation worked and you got back your data.

Now I understand you don't have any professional backup service implemented in your environment which can automatically take data backup. Also I see your actual data not more than 1TB so you can get an external USB HDD which can be of 1TB of size and you can copy your all production data from Host system. Ideally this is pure customer choice how they want to take data backup because this requires planning and cost as well.

I would request you to mark this forum as resolved because your primary issue got resolved.

 

Hope this helps!
Regards
Subhajit

If you feel this was helpful please click the KUDOS! thumb below!

***********************************************************************************