Operating System - Linux
1819814 Members
2735 Online
109607 Solutions
New Discussion юеВ

how to partition a RAID hard disk....

 
iinfi1
Super Advisor

how to partition a RAID hard disk....

i have a minor query.
in a blade server say HP BL360 which has a HDD of i think 72Gb running on hardware raid 1 and SAN Luns shown to the server running vRaid5, how do you do the partitioning of the disk drives?
as per my understanding, to partition and install OS on a blade server with hardware RAID running is the same as partitioning and installing OS on a simple desktop or vmware workstation machine as once the hardware raid is done, the OS will see it as a single drive only.

is my understanding correct?
17 REPLIES 17
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....

there were two mountpoints already present in a linux server at my place.
i removed the mountpoints and created new ones just as i do in any normal linux machine and it started misbehaving. the OS didnt detect the new partitions at all.
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....



i reading this documentation now

http://doc.opensuse.org/products/draft/SLES/SLES-storage/raidroot.html

It says,
If you are using hardware RAID devices, do not attempt to run software RAIDs on top of it.


why is this so?
well as of now i am not running a s/w RAID. I was just doing a simple partitioning when i ran into trouble.


when it comes to hardware RAID devices,(say a bunch of HDDs with hardware RAID1 or RAID5) is there anything different we have to do when partitioning from OS level?
Or is it just the same as we do it on any x86 box or vmware machine.
Matti_Kurkela
Honored Contributor

Re: how to partition a RAID hard disk....

>If you are using hardware RAID devices, do not attempt to run software RAIDs on top of it.

>why is this so?

Probably because SuSE's system boot-up scripts cannot handle such a combination.

Notice that the document is about configuring the _root_ partition: it must be activated very early in the boot-up sequence, using the limited set of utilities available within the initrd file. Because of that, the root filesystem configuration may have some limitations that won't apply to other filesystems.

> when it comes to hardware RAID devices,(say a bunch of HDDs with hardware RAID1 or RAID5) is there anything different we have to do when partitioning from OS level?

With hardware RAID, you must first configure the RAID controller, or the system won't see the disks connected to the RAID controller at all. This is usually done either by accessing the RAID controller's BIOS menu by pressing a key _when prompted_ when the system is booting (typically key F8 on Proliant hardware), or using a configuration program on a bootable CD-ROM (SmartStart CD on Proliant hardware).

Usually the actual disks are called "physical disks", and the RAID sets built from them are called "logical disks" in the RAID controller configuration.

(Note: if you use LVM, what is called a "logical disk" by the RAID controller may be used as a "physical volume" by the LVM.)

On Linux, you normally expect your disks to be named like /dev/sdX, where X is a letter (or two or more letters if you have a lot of disks). On Proliant hardware, the SmartArray hardware RAID controllers use different names: SmartArray-connected disks are named like /dev/cciss/cXdY, where X is the number of the SmartArray controller, and Y is the number of configured logical disk. When a SmartArray disk is partitioned, the partitions are accessible as /dev/cciss/cXdYpZ, where Z is the partition number.

(Very old SmartArray controllers had another naming scheme: /dev/ida/cXdY and /dev/ida/cXdYpZ respectively. But all those controllers should be at least 10 years old now.)

Some hardware RAID controllers (like LSI Logic Megaraid) use the standard Linux /dev/sdX names for disks.

Other than the requirement to configure the RAID controller first, and maybe a different naming scheme, the partitioning of a hardware RAID logical disk should be no different than partitioning a single stand-alone disk.

If your OS installer sees no disks even though your RAID controller is configured, you might need an updated driver. For example, the cciss driver covers practically all modern SmartArray RAID controllers (except SmartArray B110i, see below), but it might not be able to recognize SmartArray models that are newer than the driver version. The old driver obviously can't know about hardware models that didn't exist when that driver version was created!

HP offers "driver disks" for some Linux distributions. These are newer versions of the RAID driver, packaged in a format that can be read by the distribution's installer. Although they are called "driver disks", in these days you can usually supply them to the installer using an USB stick too. For details, see the installation instructions of your Linux distribution.

-----------

Note: some of the very low-end Proliant servers currently have a disk controller that is called "SmartArray B110i". Although it's disk-format compatible with bigger SmartArray models, the B110i is *not* a true hardware RAID.

Unless a special hpahcisr driver is installed, the B110i is detected as a simple AHCI SATA controller, using the AHCI driver that is built into most modern Linux distributions. The AHCI driver won't understand SmartArray disk metadata: only the special hpahcisr driver can do that.

If you have a SmartArray B110i, read the installation instructions in the server documentation *very* carefully, and never update your Linux kernel without first checking that your hpahcisr driver version is compatible with the updated kernel version.

MK
MK
Alzhy
Honored Contributor

Re: how to partition a RAID hard disk....

Yes.

You TREAT (and partition) HW RAIDed disks as if it were any disk.



"there were two mountpoints already present in a linux server at my place.
i removed the mountpoints and created new ones just as i do in any normal linux machine and it started misbehaving. the OS didnt detect the new partitions at all."

Can you describe in detail what you have done?


And - yes, there are certain HW RAID disks that you should not additionally RAID using the md subsystem (Software RAID) under Linux. This is particularly true with some FakeRAID based controllers.

Hakuna Matata.
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....

thanks a lot for your replies

i created two threads inadvertently.

i used yast to delete two partitions on the local disk and re-create them with new sizes. yast was able re-create one partition with the new size while it cud not do the same to the second parition. suddenly it showed up an error with a message saying it cannot read /dev/sda
i used parted from the command line, and resized 4 and 5 partitions, but the OS cannot read it.
yast still doesnt have a clue while the OS is showing the old partitions.

i took a lot of time for this and had to start services on this node soon. but if there is a reboot i m sure the data on the 2 disks are gone.
oracle home and cluster software is present in these two mountpoints. i have taken a backup (it goes on on HPDP also), but not sure whether this will be useful.

Alzhy
Honored Contributor

Re: how to partition a RAID hard disk....

"Couple of partitions on the local disk had to be formatted and resized (they are not LVMs) as it was running out of space because of cluster software filling up space"

SO what kind of data did you have on sda4 and sda5? And what kind of filesystem?

Did you unmount and backup the data on them before adjusting the partition sizes?

Hakuna Matata.
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....

thanks for your reply
they were ext3 filesystems
yes i stopped the oracle cluster services and backed up the data in the filesystem using tar. (a backup also goes into HP dataprotector every day.)
the two mountpoints contained oracle home of four oracle databases running in the two node RAC and also clusterware of node2.

OCR and VotingDisks are present in other mountpoints (OCFS2)

i am planning to restart the server once this weekend. i am pretty sure the two mountpoints will disappear and so will the data. i dont know the previous night's backup on tape will be useful when it comes to cluster software (as the backup wud v happened when clusterware was running). will take a tar also.

any suggestions?
thanks
Alzhy
Honored Contributor

Re: how to partition a RAID hard disk....

Hmmm
That is indeed very strange,

COuld it be due to your IR disk being on GPT Partition Table?

Hakuna Matata.
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....

did u happen to look @ the doc i attached here
(post deleted)


kinda duplicate thread that.
see the yast error and the difference in parted and df -h screens

Alzhy
Honored Contributor

Re: how to partition a RAID hard disk....

I am not familiar with Suse at all nor Yast but have you tried doing a partprobe?
Hakuna Matata.
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....

I dont think i ever ran partprobe in this case. i have read that fdisk was removed from sles 9 in itanium release because of a potential bug causing data loss.
similarly i am not sure whether running partprobe is safe in itanium systems. i am not sure whether there is a link to both. i have heard running partprobe causes issues in SLES Itanium.
Novell support is pathetic and their testing dept is non-existent.
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....

hi little away from the topic.
can you suggest good articles on the net or good books which will help me understand things better.

http://www.amazon.com/Understanding-Linux-Kernel-Third-Daniel/dp/0596005652
is this a good book
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....


hi all,

i restarted the server today and disappointingly found that df -h doesnt show the new sizes of the partitions.

/dev/sda4 18G 16G 723M 96% /u01
/dev/sda5 12G 4.5G 6.8G 40% /u02

when i opened yast it shows the sizes of the mountpoints as (attached jpg) yast error is now gone, but the new size is not reflected in df -h

/dev/sda4 31GB and
/dev/sda5 12 GB

why is this happening even after after restart? why did it not read the correct partition sizes?

parted also shows the sizes as below
Using /dev/sda
(parted) print
Disk geometry for /dev/sda: 0kB - 147GB
Disk label type: gpt
Number Start End Size File system Name Flags
1 17kB 1129MB 1129MB fat32
2 1129MB 27GB 26GB linux-swap
3 27GB 84GB 57GB ext3
4 84GB 118GB 33GB ext3
5 118GB 131GB 13GB ext3


Alzhy
Honored Contributor

Re: how to partition a RAID hard disk....

I suggest you open a case with Novell sir.

Maybe it is the GPT partition table? And this is an Itanium server/EFI right?

Something is certainly not kool.
Hakuna Matata.
iinfi1
Super Advisor

Re: how to partition a RAID hard disk....

hi thanks a lot for ur time

how is a gpt different from normal ones?
yes its an itanium.
Alzhy
Honored Contributor

Re: how to partition a RAID hard disk....

GPT

http://en.wikipedia.org/wiki/GUID_Partition_Table

For very large "disks" - it is the new norm but causes certain disktools like fdisk, etc to have issues with it.

Hakuna Matata.
Alzhy
Honored Contributor

Re: how to partition a RAID hard disk....

So whatever version of Suse you have and the tool you used to repartition - may likely have a problem with GPT
Hakuna Matata.