ProLiant Servers (ML,DL,SL)
cancel
Showing results for 
Search instead for 
Did you mean: 

RAID5 Ready for rebuild?

vinz_1
Occasional Contributor

RAID5 Ready for rebuild?

I have exactlty the same problem. Have you found an explication and a solution?
Vincent.
20 REPLIES
Terry Hutchings
Honored Contributor

Re: RAID5 Ready for rebuild?

This is typically caused by a problem with one of the other drives in the array.

The best way to find out which other drive it is is to check the array diagnostic utility and look for either one of the following: "Fl Rd Recv" or "Fl Wt Recv". These correspond to failed read recovery (unable to read the recovery info off of this drive) and failed write recovery (unable to write the recovery info to this drive).

An easier way will be to look for hard read or hard write errors in the system management homepage.
The truth is out there, but I forgot the URL..
r1919
Advisor

Re: RAID5 Ready for rebuild?

How I can deside this problem?
In Array Diagnostic Report (All Array Controllers):
Fl Rd Recv 0018 0004 0000 2102

What to do further?
KarloChacon
Honored Contributor

Re: RAID5 Ready for rebuild?

hi

what you can do is upload the Array Diagnostic Utility report so we can help you to check which is the other HDDs that is causing that rebuild

regards
Didn't your momma teach you to say thanks!
r1919
Advisor

Re: RAID5 Ready for rebuild?

2Karlo
Array Diagnostic Report (All Array Controllers)
KarloChacon
Honored Contributor

Re: RAID5 Ready for rebuild?

hi

that error that Terry told you is related with every HDD so you will see that "Fl Rd Recv" a lot lot of times but that does not mean that all you hard drives are so What I found is this HDD has that error and needs to be replaced that means that HDD is not letting you continue with rebuild process
see attached picture

Errors please replace.
Port 1I, Box 1, Bay 1
Fl Rd Recv 001c
1c (Hex)-> 28 (Dec)

NO errors
Port 1I, Box 1, Bay 2
Fl Rd Recv 0000

something else backup your data because you need to recreate your RAID again unless you have RAID 6
I mean because one HDD failed and now another one needs to be replaced

Regards

Didn't your momma teach you to say thanks!
juan quesada
Respected Contributor

Re: RAID5 Ready for rebuild?

The ADU shows:
Logical Drive status Ready for recovery.
Previous rebuild aborted due to read error.

HDD in Port 1L, Box 1, Bay 1 is bad and it have to be replace ; Fl Rd Recv count amount 28, this Fl Rd Recv will not allow any other drive to rebuild.

Fault Tolerance Mode Distributed Data Guard (RAID 5).
Logical Drive with 14 hdd's (including the failed hdd excluding the online spare)

Recommendations: make a data back up, re-create the array (remember to replace both failed hddâ s), activate the online spare (you have it but is not active) and load the data from back up.
Another recommendation is when you create the new array, select raid 6 (ADG) to increase fault tolerance

Remember that you have a raid 5; only one hdd can be down, if another hdd fails you may lost data.
KarloChacon
Honored Contributor

Re: RAID5 Ready for rebuild?

hi

something else I forgot update your p400 firmware you have a very old version

Controller Firmware Rev: 1.18

and the latest for that controller is 4.12

regards
Didn't your momma teach you to say thanks!
r1919
Advisor

Re: RAID5 Ready for rebuild?

Thanks to all.

I have same Question:

1. HDD in Port 1L, Box 1, Bay 1 is broken and I have a new HDD to re-create array?

2. If I have RAID5 with Hot Spare and two disk down data don`t lost?

KarloChacon
Honored Contributor

Re: RAID5 Ready for rebuild?

hello

1. HDD in Port 1L, Box 1, Bay 1 is broken and I have a new HDD to re-create array?

2. If I have RAID5 with Hot Spare and two disk down data don`t lost?


so let response both with one answer
so insert the new HDD in that bay Port 1L, Box 1, Bay 1 if the rebuild continues your RAID is fine you dont have to backup and rebuild your RAID if you insert that new HDD is nothing happens that will mean recreate raid again.
you if you want insert new HDD and post the ADU report again

regards


Didn't your momma teach you to say thanks!
Ben Russell
Occasional Visitor

Re: RAID5 Ready for rebuild?

Dear All,

I seem to be encountering a similar issue but don't usually use HP kit. I've recently replaced a faulty HD on a DL380 and the array won't rebuild. It stays in the status waiting for rebuild.

Please find attached ADU report for the server in question.

I would appreciate any assistence in answering the following:

1. One of the drives is encountering hard read failures which in turn is preventing the rebuild? TRUE / FALSE

2. The only way to fix this is to backup the data and rebuild the array from scratch? TRUE / FALSE

Regards

Ben
Brian_Murdoch
Honored Contributor

Re: RAID5 Ready for rebuild?

Ben,

I can see from the analysed report (See attached file) that you have replaced SCSI ID 0 and that ID2 has lots of errors. This drive (SCSI ID 2) is preventing the rebuild.

You may have to rebuild the whole array from scratch, replacing drive 2 as well as drive 0 but you could try upgrading the Smart Array 6i firmware from 2.48 (very old now) and change the rebuild priority to high in ACU before trying again. Before doing anything however make sure you get a full backup of the system as it's in a bad way.

Regards,

Brian
Ben Russell
Occasional Visitor

Re: RAID5 Ready for rebuild?

I've recently upgraded the firmware on the RAID controller and changed the rebuild priority to high but am still not getting anywhere.

I am going to carryout the following in order to get the server back to a normal state and would appreciate any advice prior to carrying out these steps. I've attached the latest ADU report for review.

1. Clone the existing data from the server using Acronis or Ghost Solution suite.
2. Remove the drive with the hard read errors in SLOT 2.
3. Remove the exisiting array and data from the drives.
4. Re-create the array.
5. Clone the data back onto the drives.

Regards

Ben
j1500
Occasional Advisor

Re: RAID5 Ready for rebuild?

I have an issue where my drive starts rebuilding when I restart my server. During BIOS it prompts to press F1 to start the rebuild process or F2 to continue and assume potential data loss.

This has happened 3 times over the last month.

Is someone able to look at my Array Diagnostic Reports and see if they have any errors showing up that would lead to a replacement of a SCSI board, drive, or other component?

I really appreciate it!

I included a report which shows during rebuilding and after rebuilding.
j1500
Occasional Advisor

Re: RAID5 Ready for rebuild?

Here is the report after rebuilding.
MT19
Valued Contributor

Re: RAID5 Ready for rebuild?

Everytime I've had this issue we've always replaced the SCSI backplane, controller, sometimes systemboard, SCSI cables, updated firmware, updated Proliant Support Pack. But always in the end, none of the above worked, and we would end up rebuilding the array and doing a restore from a backup. No matter what, if something is corrupted in the array, the new drive will not be able to rebuild off it.
You can do the above so you can go back and tell the managers/server owners "I ruled out the hardware and firmware, so now it looks like we need to rebuild the array and do a restore from a backup." OR you can save some downtime and just proceed directly to rebuilding the array and conducting a restore, which is what I recommend.
MT
KarloChacon
Honored Contributor

Re: RAID5 Ready for rebuild?

yes MT19 is right that issue happens since there is another HDD that is causing the rebuild process to fail so RAID needs to be rebuild and another HDD must be replaced
Didn't your momma teach you to say thanks!
j1500
Occasional Advisor

Re: RAID5 Ready for rebuild?

It looks like the drive labeled ID 1 is reporting errors. If I replace this drive do you think the array will rebuild correctly?
KarloChacon
Honored Contributor

Re: RAID5 Ready for rebuild?

OK I took some time to check ADU report

my recommendation backup your data and replace HDD SCSI Port 2, Drive ID 1
after that recreate your RAID


since the other 2 HDDs have Fl Rd Recv (Failure Read recovery Errors) which are causing the rebuild to stop or fail


details:

SCSI Port 2, Drive ID 0
Fl Rd Recv 1

SCSI Port 2, Drive ID 1
Hrd Read 2602608
Rtry Write 234887682
Fl Wt Recv 58833
Pred Fails 234891266
Hrdw Errs 58833
Med Flrs 66
Format Err 43

SCSI Port 2, Drive ID 2
Fl Rd Recv 1


regards
Didn't your momma teach you to say thanks!
neutronstar13
Occasional Advisor

Re: RAID5 Ready for rebuild?

Raid 5 won't rebuild
I have the same issue on a DL580-G2 with a 4 disk Raid5 array. 2 disks started flashing Imminent Failure simultaneously. Tried replacing one but keep getting read errors from the other failing disk and the rebuild stops after about 4 or 5 minutes. ADU says "Ready for rebuild". Tried upgrading FirmWare, no help there.

Told the client that the array would need to be rebuilt, OS reinstalled, and data restored from backup, but we are looking for a quicker solution if one exists.

That doesn't seem likely based on what I have seen in my research, but if you have another answer I would love to hear it.
RC Custer
Occasional Visitor

Re: RAID5 Ready for rebuild?

Here's a log file from an array utility; sounds like I have another example of the issue being discussed here. I'm suspecting
Port 2I, Box 1, Bay 1
because:
"Fl Rd Recv 0024 0004 0000 2102"

BTW this is on a ML350T05