smartarray 6i RAID 1+0 find pairs for cloning

[Ruben Püttmann]

hy,

soory for the crosspost but I think it belogns to more than one forum.

I have here an Proliant DL380G3 with debian on it kernel 2.6.8.

Raid Setup:

=> controller slot=0 show detail

Smart Array 6i in Slot 0
Bus Interface: PCI
Slot: 0
RAID 6 (ADG) Status: Disabled
Controller Status: OK
Chassis Slot:
Hardware Revision: Rev B
Firmware Version: 2.36
Rebuild Priority: Low
Expand Priority: Low
Surface Scan Delay: 15 sec
Cache Board Present: True
Cache Status: OK
Accelerator Ratio: 100% Read / 0% Write
Total Cache Size: 64 MB
Battery Pack Count: 0

> controller slot=0 array A logicaldrive all show

Smart Array 6i in Slot 0

array A

logicaldrive 1 (101.7 GB, RAID 1+0, OK)
=> controller slot=0 array A logicaldrive 1 show detail

Smart Array 6i in Slot 0

array A

Logical Drive: 1
Size: 101.7 GB
Fault Tolerance: RAID 1+0
Heads: 255
Sectors Per Track: 32
Cylinders: 26148
Stripe Size: 128 KB
Status: OK
Array Accelerator: Enabled
Unique Identifier: 600508B1001FFFFFA01457B34F180002
Disk Name: /dev/cciss/c0d0
Mount Points: / 4.7 GB, none 1.9 GB, /opt 95.2 GB


=> controller slot=0 array A physicaldrive all show

Smart Array 6i in Slot 0

array A

physicaldrive 2:0 (port 2:id 0 , Parallel SCSI, 36.4 GB, OK)
physicaldrive 2:1 (port 2:id 1 , Parallel SCSI, 36.4 GB, OK)
physicaldrive 2:2 (port 2:id 2 , Parallel SCSI, 36.4 GB, OK)
physicaldrive 2:3 (port 2:id 3 , Parallel SCSI, 36.4 GB, OK)
physicaldrive 2:4 (port 2:id 4 , Parallel SCSI, 36.4 GB, OK)
physicaldrive 2:5 (port 2:id 5 , Parallel SCSI, 36.4 GB, OK)

=> controller slot=0 array A physicaldrive all show detail

Smart Array 6i in Slot 0

array A

physicaldrive 2:0
SCSI Bus: 2
SCSI ID: 0
Status: OK
Drive Type: Data Drive
Interface Type: Parallel SCSI
Transfer Mode: Ultra 320 Wide
Size: 36.4 GB
Transfer Speed: 320 MB/Sec
Rotational Speed: 15000
Firmware Revision: HPB2
Serial Number: ANL1P55062MV0521
Model: COMPAQ BF03688575
physicaldrive 2:1
SCSI Bus: 2
SCSI ID: 1
Status: OK
Drive Type: Data Drive
Interface Type: Parallel SCSI
Transfer Mode: Ultra 320 Wide
Size: 36.4 GB
Transfer Speed: 320 MB/Sec
Rotational Speed: 15000
Firmware Revision: HPB2
Serial Number: ANL1P5505UCE0520
Model: COMPAQ BF03688575
physicaldrive 2:2
SCSI Bus: 2
SCSI ID: 2
Status: OK
Drive Type: Data Drive
Interface Type: Parallel SCSI
Transfer Mode: Ultra 320 Wide
Size: 36.4 GB
Transfer Speed: 320 MB/Sec
Rotational Speed: 15000
Firmware Revision: HPB2
Serial Number: ANL1P55061YW0521
Model: COMPAQ BF03688575
physicaldrive 2:3
SCSI Bus: 2
SCSI ID: 3
Status: OK
Drive Type: Data Drive
Interface Type: Parallel SCSI
Transfer Mode: Ultra 320 Wide
Size: 36.4 GB
Transfer Speed: 320 MB/Sec
Rotational Speed: 15000
Firmware Revision: HPB2
Serial Number: ANL1P5606RN90523
Model: COMPAQ BF03688575
physicaldrive 2:4
SCSI Bus: 2
SCSI ID: 4
Status: OK
Drive Type: Data Drive
Interface Type: Parallel SCSI
Transfer Mode: Ultra 320 Wide
Size: 36.4 GB
Transfer Speed: 320 MB/Sec
Rotational Speed: 15000
Firmware Revision: HPB1
Serial Number: E20AJ7AK
Model: COMPAQ BF03687B54
physicaldrive 2:5
SCSI Bus: 2
SCSI ID: 5
Status: OK
Drive Type: Data Drive
Interface Type: Parallel SCSI
Transfer Mode: Ultra 320 Wide
Size: 36.4 GB
Transfer Speed: 320 MB/Sec
Rotational Speed: 15000
Firmware Revision: HPB2
Serial Number: E20BD6QK
Model: COMPAQ BF03687B54

=>

Now I have the problem that I want clone this System. On RAID 1+0 with 6 drive I muss have 3 pairs of drives. So I can remove 3 drives without data loss ( If I take the right ones).

So I want shutdown the system remove 3 drives put 3 new drives I it and rebuild it.

The 3 drives I have put out I will put in another DL380G3.

So the theory, but how can I find out which drive is a mirror from which drive? Why doesn't show the hpacucli the pairs?


Attached the output from hpaducli.

[John Kufrovich]

Ruben,
PD = Physical disk
PD2:0 - PD2:3
PD2:1 - PD2:4
PD2:2 - PD2:5

If your not confortable with my answer, you could run a little test. Copy a small file to the disk, something less than the stripe sized used. If you used 128k stripe, try something in the range of 64k or less, you don't want to cross stripe boundries.

I've been losing my linux skills, no time to keep refreshing my mind but I'm sure you could accomplish something similar with DD. Just put a pause after every write.

And watch the HDD LEDs.

jk

[Ruben Püttmann]

Thx i will try to get somebody in the datacenter for testing this.

I found it not good that the hp tools didn't show the pairs

[John Kufrovich]

One more item,

If you break the mirror and remove those drives, you will need to use the same original drive slots.

Example, you removed drives 3,4,5 and install them in another server, use slots 3,4,5.

jk

[TwoProc]

I believe that It won't be three drives to three drives. These drives are striped and mirrored. So, in the case of the SmartArray Controllers, I *think* your data is probably striped across all of the drives, and each extent is guaranteed to be on another different disk platter in full mirrored form - not just a parity version of the data.  I think if you had made the drives a Raid 1 set, then you'd have a 3+3 configuration like you're thinking. 

If I'm correct, then you'd have to pull one disk out of the enclosure at a time, let the array catch up, then pull the next, until all 6 are done.  Then boot the system, catch the SCSI menu at boot time, and choose the right item to tell the server to pull its array config from the drives in the trays, instead of what is defined in config memory on the controllers. 

Good luck.

PS I've not had experience on that particular machine with R0/1 sets, I've only done R1 (two disks), and R5 (4 disks) on that particular server - so my experience on what you're attempting is absolutely not definitive for your case.