Upgrade hard drives and configure raid 5

[Raoof]

Dear Torsten,

Thanks for the detail explanation.

>>> If you extend the RAID, you can either extend the logical drive within this RAID (this is the "disk" used for vg00)

If we extend the logical drive used for vg00 then can we resize the existing mount points stated below highlited in red.

mcmsdbl1@root@/>#bdf
Filesystem kbytes used avail %used Mounted on
/dev/vg00/lvol3 1048576 648752 396792 62% /
/dev/vg00/lvol1 1835008 506680 1318008 28% /stand
/dev/vg00/lvol8 8912896 6133840 2773328 69% /var
/dev/vg00/lvol7 5963776 3407832 2536096 57% /usr
/dev/vg00/lvo19 62914560 42839555 18820442 69% /u01
/dev/vg00/lvol4 524288 98712 423392 19% /tmp
/dev/vg00/lvol6 9043968 7000816 2027312 78% /opt
/dev/vg00/lvol5 131072 5432 124664 4% /home
/dev/vg00/lvo20 104857600 49634688 51771613 49% /backup

>>> or create another logical drive within the same RAID (this would be another "disk" from OS point of view.

To configure a logical drive, use the following command:
saconfig /dev/cissX -R <RAID level> [-S <Stripe size (KB)>] -p <physical drive id> [-p <physical drive id> ... ] [-s <physical drive id>] [-c <capacity (GB)>]

By running the below commond will it create a new logical drive as  "Logical Drive 1" within same RAID i.e. RAID 5 saconfig /dev/ciss0 -R 5 -S 64 -p 1l:1:1 -p 1I:1:2 -p 1l:1:3 -p 1l:1:4

I will be really thankful if you could provide me the steps to create

# saconfig /dev/ciss0 -E 1 -p 1l:1:1
# saconfig /dev/ciss0 -E 1 -p 1l:1:2
# saconfig /dev/ciss0 -E 1 -p 1l:1:3
# saconfig /dev/ciss0 -E 1 -p 1l:1:4

>>> I would extend the existing RAID (see commands above) and then create a new logical drive, if you want to use this for a new VG.

No need to restart the server after running the above commonds?

>>> You already have 22 LVOLs, maybe you want to extend your VG00 "disk"?

I Want to create a new mount points using the space from new disks, so this can be done in the same vg00 disk or we can create the new vg01 group and create the mount points in it. I will be really thankful if you could please provide me the steps in the same regards.

Thanks & Best Regards

Syed

[Torsten.]

To create a new RAID:

# saconfig /dev/ciss0 -R 5 -p 1I:1:4 -p 1I:1:3 -p 1I:1:2 -p 1I:1:1

# ioscan

# saconfig /dev/ciss0


This will give you a new disk device and you can create another VG on it.

[Raoof]

Dear Torsten,

Thanks for the response.

Current output of the below command is as follows.

mcmsdbl1@root@/># ioscan -fnC disk 

Class I H/W Path Driver S/W State H/W Type Description
=====================================================================
disk 4 0/3/0/0/0/0.1.4.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t0d1 /dev/rdsk/c3t0d1
disk 5 0/3/0/0/0/0.1.4.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t0d2 /dev/rdsk/c3t0d2
disk 6 0/3/0/0/0/0.1.4.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t0d3 /dev/rdsk/c3t0d3
disk 7 0/3/0/0/0/0.1.4.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t0d4 /dev/rdsk/c3t0d4
disk 8 0/3/0/0/0/0.1.4.0.0.0.5 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t0d5 /dev/rdsk/c3t0d5
disk 9 0/3/0/0/0/0.1.4.0.0.0.6 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t0d6 /dev/rdsk/c3t0d6
disk 10 0/3/0/0/0/0.1.4.0.0.0.7 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t0d7 /dev/rdsk/c3t0d7
disk 11 0/3/0/0/0/0.1.4.0.0.1.0 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t1d0 /dev/rdsk/c3t1d0
disk 12 0/3/0/0/0/0.1.4.0.0.1.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t1d1 /dev/rdsk/c3t1d1
disk 50 0/3/0/0/0/0.1.4.0.0.1.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c3t1d2 /dev/rdsk/c3t1d2
disk 13 0/3/0/0/0/0.1.5.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t0d1 /dev/rdsk/c5t0d1
disk 14 0/3/0/0/0/0.1.5.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t0d2 /dev/rdsk/c5t0d2
disk 15 0/3/0/0/0/0.1.5.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t0d3 /dev/rdsk/c5t0d3
disk 16 0/3/0/0/0/0.1.5.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t0d4 /dev/rdsk/c5t0d4
disk 17 0/3/0/0/0/0.1.5.0.0.0.5 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t0d5 /dev/rdsk/c5t0d5
disk 18 0/3/0/0/0/0.1.5.0.0.0.6 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t0d6 /dev/rdsk/c5t0d6
disk 19 0/3/0/0/0/0.1.5.0.0.0.7 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t0d7 /dev/rdsk/c5t0d7
disk 20 0/3/0/0/0/0.1.5.0.0.1.0 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t1d0 /dev/rdsk/c5t1d0
disk 21 0/3/0/0/0/0.1.5.0.0.1.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t1d1 /dev/rdsk/c5t1d1
disk 53 0/3/0/0/0/0.1.5.0.0.1.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c5t1d2 /dev/rdsk/c5t1d2
disk 0 0/6/0/0/0/0/4/0/0/0.0.0 sdisk CLAIMED DEVICE HP LOGICAL VOLUME
/dev/dsk/c0t0d0 /dev/dsk/c0t0d0s1 /dev/dsk/c0t0d0s2 /dev/dsk/c0t0d0s3 /dev/rdsk/c0t0d0 /dev/rdsk/c0t0d0s1 /dev/rdsk/c0t0d0s2 /dev/rdsk/c0t0d0s3
disk 22 0/7/0/0/0/0.1.4.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t0d1 /dev/rdsk/c7t0d1
disk 23 0/7/0/0/0/0.1.4.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t0d2 /dev/rdsk/c7t0d2
disk 24 0/7/0/0/0/0.1.4.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t0d3 /dev/rdsk/c7t0d3
disk 25 0/7/0/0/0/0.1.4.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t0d4 /dev/rdsk/c7t0d4
disk 26 0/7/0/0/0/0.1.4.0.0.0.5 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t0d5 /dev/rdsk/c7t0d5
disk 27 0/7/0/0/0/0.1.4.0.0.0.6 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t0d6 /dev/rdsk/c7t0d6
disk 28 0/7/0/0/0/0.1.4.0.0.0.7 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t0d7 /dev/rdsk/c7t0d7
disk 29 0/7/0/0/0/0.1.4.0.0.1.0 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t1d0 /dev/rdsk/c7t1d0
disk 30 0/7/0/0/0/0.1.4.0.0.1.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t1d1 /dev/rdsk/c7t1d1
disk 51 0/7/0/0/0/0.1.4.0.0.1.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c7t1d2 /dev/rdsk/c7t1d2
disk 31 0/7/0/0/0/0.1.5.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t0d1 /dev/rdsk/c9t0d1
disk 32 0/7/0/0/0/0.1.5.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t0d2 /dev/rdsk/c9t0d2
disk 33 0/7/0/0/0/0.1.5.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t0d3 /dev/rdsk/c9t0d3
disk 34 0/7/0/0/0/0.1.5.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t0d4 /dev/rdsk/c9t0d4
disk 35 0/7/0/0/0/0.1.5.0.0.0.5 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t0d5 /dev/rdsk/c9t0d5
disk 36 0/7/0/0/0/0.1.5.0.0.0.6 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t0d6 /dev/rdsk/c9t0d6
disk 37 0/7/0/0/0/0.1.5.0.0.0.7 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t0d7 /dev/rdsk/c9t0d7
disk 38 0/7/0/0/0/0.1.5.0.0.1.0 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t1d0 /dev/rdsk/c9t1d0
disk 39 0/7/0/0/0/0.1.5.0.0.1.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t1d1 /dev/rdsk/c9t1d1
disk 54 0/7/0/0/0/0.1.5.0.0.1.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c9t1d2 /dev/rdsk/c9t1d2
disk 2 255/1/0.0.0 sdisk CLAIMED DEVICE Optiarc DVD RW AD-5590A
/dev/dsk/c1t0d0 /dev/rdsk/c1t0d0

After creating a new RAID using below command:

# saconfig /dev/ciss0 -R 5 -p 1I:1:4 -p 1I:1:3 -p 1I:1:2 -p 1I:1:1

# ioscan

# saconfig /dev/ciss0

Will go with the following procedure for creating the volume group and logical volume.

“Please correct me if am wrong here”.

mcmsdbl1@root@/dev/vg00>#vgdisplay -v

--- Volume groups ---

VG Name                     /dev/vg00

VG Write Access             read/write    

VG Status                   available                 

Max LV                      255   

Cur LV                      11    

Open LV                     11    

Max PV                      16    

Cur PV                      1     

Act PV                      1     

Max PE per PV               4370         

VGDA                        2  

PE Size (Mbytes)            64             

Total PE                    4360   

Alloc PE                    4266   

Free PE                     94     

Total PVG                   0       

Total Spare PVs             0             

Total Spare PVs in use      0                    

VG Version                  1.0      

VG Max Size                 4370g     

VG Max Extents              69920        

   --- Logical volumes ---

   LV Name                     /dev/vg00/lvol1

   LV Status                   available/syncd          

   LV Size (Mbytes)            1792           

   Current LE                  28       

   Allocated PE                28         

   Used PV                     1       (rest I have removed from here)

   --- Physical volumes ---

   PV Name                     /dev/disk/disk1_p2

   PV Status                   available               

   Total PE                    4360   

   Free PE                     94     

   Autoswitch                  On       

   Proactive Polling           On   

mcmsdbl1@root@/dev/vg00>#bdf

Filesystem          kbytes    used   avail %used Mounted on

/dev/vg00/lvol3    1048576  648888  396656   62% /

/dev/vg00/lvol1    1835008  506680 1318008   28% /stand

/dev/vg00/lvol8    8912896 6141712 2765504   69% /var

/dev/vg00/lvol7    5963776 3407832 2536096   57% /usr

/dev/vg00/lvo19    62914560 41351019 20244409   67% /u01

/dev/vg00/lvol4     524288   98712  423392   19% /tmp

/dev/vg00/lvol6    9043968 7001184 2026944   78% /opt

/dev/vg00/lvol5     131072    5432  124664    4% /home

/dev/vg00/lvo20    104857600 49850664 51569135   49% /backup

1) Initialize the disks using pvcreate.

 # pvcreate –f /dev/rdsk/cXtXdX /dev/rdsk/cXtXdX  /dev/rdsk/cXtXdX  --------à Here I have to specify 3 disks or 4 and the disks details will get after creating RAID right? Using ioscan -fnC disk 

And what should be the PV name as I see From the output of vgdisplay PV name is defined as  “/dev/disk/disk1_p2”.

2) Create a directory for the volume group

 # mkdir –p /dev/vg01

# chown root:root /dev/vg01

# chmod 755 /dev/vg01

3) Create device file named “group”

 # mknod  /dev/vg01/group c 64 0x010000

4) Create a VG

# vgcreate -s <PE Size>) -e <max PE per PV>

# vgcreate –s 64 –e 6000 /dev/vg01 /dev/dsk/cXtXdX  /dev/dsk/cXtXdX  /dev/dsk/ cXtXdX  --------à Here I have to specify 3 disks or 4 and the disks details will get after creating RAID right? Using ioscan -fnC disk 

Volume group "/dev/vg01" has been successfully created.

 Volume Group configuration for /dev/vg01 has been saved in /etc/lvmconf/vg01.conf

5) Create LV with 300GB size (To store backup files e.g. expdp dump file)

 # lvcreate -n lv01 -L 307200 vg01

 Warning: rounding up logical volume size to extent boundary at size "xxxx" MB.

 Logical volume "/dev/vg01/lv01" has been successfully created with

 character device "/dev/vg01/rlv01".

 Logical volume "/dev/vg01/lv01" has been successfully extended.

 Volume Group configuration for /dev/vg01 has been saved in /etc/lvmconf/vg01.conf

6) Create file system with largefiles enabled

 #newfs -F vxfs -o largefiles /dev/vg01/rlv01

7) Create mount point and mount the file system.

 #mkdir /dbbackup

 #mount /dev/vg01/lv01 /dbbackup

Awaiting for your valuable repsonse.

Thanks & Best Regards,

Syed

[Torsten.]

If you created the array, please attach the ioscan and saconfig output to confirm the new logical drive is there.

[Raoof]

No i did not created the array yet. I just want to be sure about the commands and steps to proceed further.

[Torsten.]

Since you are running 11.31 you should consider to create a LVM 2.2 volume group!

This will give you more flexibility and features.

The LVM admin guide will tell you how to do this (or do "man vgcreate").

[Raoof]

---------- PHYSICAL DRIVES ----------

Location Ct Enc Bay WWID Size Status

Internal 1I 1 4 0x5000c5000bfe9b49 146.8 GB UNASSIGNED
Internal 1I 1 3 0x5000c5000bfe76e5 146.8 GB UNASSIGNED
Internal 1I 1 2 0x5000c5000c04bda5 146.8 GB UNASSIGNED
Internal 1I 1 1 0x5000c5000bfe9c85 146.8 GB UNASSIGNED
Internal 2I 1 8 0x5000c500235b646d 146.8 GB OK
Internal 2I 1 7 0x5000c500235df251 146.8 GB OK
Internal 2I 1 6 0x5000c500235e1449 146.8 GB OK
Internal 2I 1 5 0x5000c500235d1425 146.8 GB SPARE

From the below output

 mcmsdbl1@root@/>#ioscan -f -n -N -C disk
Class I H/W Path Driver S/W State H/W Type Description
===================================================================
disk 1 64000/0xfa00/0x1 esdisk CLAIMED DEVICE HP LOGICAL VOLUME
/dev/disk/disk1 /dev/disk/disk1_p1 /dev/disk/disk1_p2 /dev/disk/disk1_p3 /dev/rdisk/disk1 /dev/rdisk/disk1_p1 /dev/rdisk/disk1_p2 /dev/rdisk/disk1_p3
disk 3 64000/0xfa00/0x2 esdisk CLAIMED DEVICE Optiarc DVD RW AD-5590A
/dev/disk/disk3 /dev/rdisk/disk3
disk 40 64000/0xfa00/0x7 esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk40 /dev/rdisk/disk40
disk 41 64000/0xfa00/0x8 esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk41 /dev/rdisk/disk41
disk 42 64000/0xfa00/0x9 esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk42 /dev/rdisk/disk42
disk 43 64000/0xfa00/0xa esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk43 /dev/rdisk/disk43
disk 44 64000/0xfa00/0xb esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk44 /dev/rdisk/disk44
disk 45 64000/0xfa00/0xc esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk45 /dev/rdisk/disk45
disk 46 64000/0xfa00/0xd esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk46 /dev/rdisk/disk46
disk 47 64000/0xfa00/0xe esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk47 /dev/rdisk/disk47
disk 48 64000/0xfa00/0xf esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk48 /dev/rdisk/disk48
disk 52 64000/0xfa00/0x15 esdisk CLAIMED DEVICE HP HSV300
/dev/disk/disk52 /dev/rdisk/disk52

which disk have to use while creating the vg version 2.2.

Create a volume group version 2.2, named /dev/vg01, with unshared unit
of 4096 kilobytes, extent size of 8 megabytes and maximum total size
of 4 terabytes:

vgcreate -V 2.2 -S 4t -s 8 -U 4096 /dev/vg01 /dev/disk/?????

[Torsten.]

no device file yet until you create the raid

[Raoof]

Thanks for the response.

Before proceeding further for creating a new RAID, i would like to ask one thing that  will there be any impact on the other 4 disks i.e. 2I:5 6 7 8 ?  by creating a new RAID beacuse this server is a production database server.

---------- PHYSICAL DRIVES ----------

Location Ct Enc Bay WWID Size Status

Internal 1I 1 4 0x5000c5000bfe9b49 146.8 GB UNASSIGNED
Internal 1I 1 3 0x5000c5000bfe76e5 146.8 GB UNASSIGNED
Internal 1I 1 2 0x5000c5000c04bda5 146.8 GB UNASSIGNED
Internal 1I 1 1 0x5000c5000bfe9c85 146.8 GB UNASSIGNED
Internal 2I 1 8 0x5000c500235b646d 146.8 GB OK 
Internal 2I 1 7 0x5000c500235df251 146.8 GB OK 
Internal 2I 1 6 0x5000c500235e1449 146.8 GB OK 
Internal 2I 1 5 0x5000c500235d1425 146.8 GB SPARE

---------- LOGICAL DRIVE 0 ----------

Device File = c0t0d0
RAID Level = 5
Size = 279960 MB
Stripe Size = 64 KB
Status = OK

hope their status will not change from OK to UNASSIGNED. Reason of asking this question is just because i have gone through one document where i got to see the different outputs and details in it.

FYR,

HP Smart Array SAS Controllers for Integrity Servers Support Guide HP-UX 11i v2 and 11i v3

# saconfig /dev/ciss5

******************** SmartArray RAID Controller /dev/ciss5 ********************
Auto-Fail Missing Disks at Boot = enabled
Cache Configuration Status = cache enabled
Cache Ratio = 50% Read / 50% Write
---------- PHYSICAL DRIVES ----------
Location Ct Enc Bay WWID Size Status
Internal 1I 1 12 0x500000e01117c732 36.4 GB OK
Internal 1I 1 11 0x500000e01115c352 36.4 GB OK
Internal 1I 1 10 0x5000c5000032b839 36.4 GB OK
Internal 1I 1 9 0x5000c5000030b0c5 36.4 GB OK
Internal 2I 1 16 0x500000e011213482 36.4 GB OK
Internal 2I 1 15 0x5000c500002084c9 73.4 GB OK
Internal 2I 1 14 0x5000c5000030b9c9 36.4 GB UNASSIGNED
The saconfig configuration CLI 45
Internal 2I 1 13 0x500000e01118a7a2 36.4 GB UNASSIGNED
---------- LOGICAL DRIVE 0 ----------
Device File = c5t0d0
RAID Level = 5  ============> if am not wrong RAID 5 is (Drives with Parity) --- Minimum 3 Drives
Size = 15360 MB   ======> so out of 6 one will be as of Parity, then for remaining 5, is this will be the size???
Stripe Size = 64 KB
Status = OK
Participating Physical Drive(s):
Ct Enc Bay WWID
1I 1 12 0x500000e01117c732
1I 1 11 0x500000e01115c352
1I 1 10 0x5000c5000032b839
1I 1 9 0x5000c5000030b0c5
2I 1 16 0x500000e011213482
2I 1 15 0x5000c500002084c9
Participating Spare Drive(s):

and below once RAID 1 was created on the newly added 2 drives, other's drives status converted to UNASSIGNED from OK ( Really am very confused, please help me)

# saconfig /dev/ciss5 -R 1 -S 64 -p 2I:1:13 -p 2I:1:14 -s 2I:1:15
Logical drive 0 created
Rebuild Priority is set to High
Use the saconfig /dev/cissX command to confirm the configuration:
# saconfig /dev/ciss5
******************** SmartArray RAID Controller /dev/ciss5 ********************
Auto-Fail Missing Disks at Boot = enabled
Cache Configuration Status = cache enabled
Cache Ratio = 25% Read / 75% Write
---------- PHYSICAL DRIVES ----------
Location Ct Enc Bay WWID Size Status
Internal 1I 1 12 0x500000e01117c732 36.4 GB UNASSIGNED
Internal 1I 1 11 0x500000e01115c352 36.4 GB UNASSIGNED
Internal 1I 1 10 0x5000c5000032b839 36.4 GB UNASSIGNED
Internal 1I 1 9 0x5000c5000030b0c5 36.4 GB UNASSIGNED
Internal 2I 1 16 0x500000e011213482 36.4 GB UNASSIGNED
Internal 2I 1 15 0x5000c500002084c9 73.4 GB SPARE
Internal 2I 1 14 0x5000c5000030b9c9 36.4 GB OK
Internal 2I 1 13 0x500000e01118a7a2 36.4 GB OK
---------- LOGICAL DRIVE 0 ----------
Device File = c5t0d0
RAID Level = 1+0
Size = 34700 MB
Stripe Size = 64 KB
Status = OK
Participating Physical Drive(s):
Ct Enc Bay WWID
2I 1 14 0x5000c5000030b9c9
2I 1 13 0x500000e01118a7a2
Participating Spare Drive(s):
Ct Enc Bay WWID
2I 1 15 0x5000c500002084c9

Please help me to proceed further with the below procedure.

To create a new RAID:

# saconfig /dev/ciss0 -R 5 -p 1I:1:4 -p 1I:1:3 -p 1I:1:2 -p 1I:1:1

# ioscan

# saconfig /dev/ciss0

This will give you a new disk device and you can create another VG on it.

Thanks & Best Regards,

Syed

[Torsten.]

these are prepared examples in the manual, dont worry!