How do I start in CFS?

[Mousa55]

Hi All,

I want to create a new VG, LV and Filesystem to see it from multiple nodes, or I can mount the filesystem on multiple servers at the same time (with R/W).
by using a CFS, What is the steps to make a new VG with CFS?.
Note: I installed the HP Serviceguard Storage Management Suite for 11.23 version.

Thanks

[Michael Steele_2]

http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=1127422

I believe you want to call Symanntec as CFS, as far as I know, is a Veritas product. The above describes some relation with MC/SG but not currently available on HP servers.

But I could be wrong.

[Turgay Cavdar]

You can look at the following document:
http://docs.hp.com/en/8365/SGeRAC_10g_Sample_Config.pdf

On page 30 there is "Configuring Cluster Volume Manager (CVM)" section. It shows how to create a new file system/diskgroup in CFS.

[Stephen Doud]

CFS and LVM are not compatible - ie, CFS does not support LVM volume groups. Rather, it supports VxVM disk groups. That's not to say that you cannot create LVM-based packages, but LVM-based file systems cannot be mounted across multiple nodes simultaneously, like VxVM disk groups can with CFS.

After creating a VxVM disk group and volume, use these example steps to make it a CFS-mount:

cmruncl (a cluster must be configured first)
cfscluster config -t 900 -s (creates and starts SG-CFS-pkg)
vxdg -Cs import dg1
cfsdgadm add dg1pkg c_t_d_ all=sw
cfsdgadm activate dg1pkg
cfsmntadm add dg1pkg vol1 /cfs1 cfs1pkg all=rw
cfsmount /cfs1

/cfs1 is mounted by package cfs1pkg, which is dependent on dg1pkg which is dependency on SG-CFS-pkg.

[Mousa55]

Hi,

thanks for replay, in my case it's need to install VxVM license key. and what is seteps to Initializing the VERITAS Volume Manager?
after execute the # vxinstall command.
and i installed the "HP Serviceguard Storage Management Suite for 11.23" but the # cfscluster command is not found
"/usr/bin/ksh: cfscluster: not found

very thanks

[Sunil Sheoran]

Hi

Configure and start the basic cluster on nodes
& for CFS follow the below steps.

vxinstall
cfscluster config -t 900 -s
cfscluster status


vxdisk list
vxdisksetup -i c0t0d0
vxdg -s init oradg cxtxtx
vxdg -g oradg adddisk --------


cfsadm display -v

cfsdgadm add oradg all=sw
cfsdgadm activate dgrac
vxassist -g dgrac make vol1 300M
newfs -F vxfs /dev/vx/rdsk/dgrac/vol
cfsmount /cfs/oraclu

Thanks & regards
Sunil

[Mousa55]

Hi,

you say "Configure and start the basic cluster on nodes " But what is the value that set it here in ascii file
FIRST_CLUSTER_LOCK_VG
because i using now VxVM is not LVM

thanks

[Mousa55]

Hi,

when i try to Initializing the disk for use in VxVM, this error it's appeared
# /etc/vx/bin/vxdisksetup -i c17t3d0
VxVM vxdisksetup ERROR V-5-2-43 c17t3d0: Invalid disk device for vxdisksetup


thanks

[Michael Steele_2]

HI

Is this an alternate to the same disk already in use?

'vxdisk list'
Check 'multipath' informationl



Also, check you vxvm license for expiration

http://forums13.itrc.hp.com/service/forums/questionanswer.do?admit=109447627+1270470922435+28353475&threadId=1036163

[chris huys_4]

Hi,

> I believe you want to call Symanntec as CFS,
> as far as I know, is a Veritas product. The
> above describes some relation with MC/SG but
> not currently available on HP servers.

> But I could be wrong.

Indeed, you're wrong. ;)

The storage managements suites (sms), have integrated cfs 5.0 into MC/SG, since june 2007. First in mc/sg 11.18 for HP-UX 11iv2 and HP-UX 11iv3, aka sms 2.00, later in mc/sg 11.19 for HP-UX 11iv2 and HP-UX 11iv3, aka sms 2.01.

HP supports cfs 5.0 up to HP lablevel.

http://docs.hp.com/en/ha.html#HP%20Serviceguard%20Storage%20Management%20Suite

> thanks for replay, in my case it's need to
> install VxVM license key. and what is
> seteps to Initializing the VERITAS Volume
> Manager?
> after execute the # vxinstall command.
> and i installed the "HP Serviceguard
> Storage Management Suite for 11.23" but
> the # cfscluster command is not found

When you bought vxfs/vxvm/cfs from HP, there is no need to fill in any licenses, once youre past the (sw)installation of the products on the system. Just answer the "default" no, as answer, on the license question, of vxinstall.

There are 6 different "versions" of the sms 2.01 suite for HP-UX 11.23.

"
HP Serviceguard Storage Management Suite
Version A.02.01 for HP-UX 11i v2 Release
Notes
"

http://docs.hp.com/en/T2771-90053/T2771-90053.pdf

Check page 10.

Which sms suite was installed exactly ?

# uname -a
# swlist


> # /etc/vx/bin/vxdisksetup -i c17t3d0
> VxVM vxdisksetup ERROR V-5-2-43 c17t3d0:
> Invalid disk device for vxdisksetup

# vxdisk list c17t3d0
# vxdmpadm listctlr all
# diskinfo /dev/rdsk/
# vxdctl license

What model of diskarray is the server connected to ?

Was it checked out that the diskarray didnt need a asm, specific library, installed, to have vxvm's dynamic multipathing (dmp), correctly recognize the diskarray ?

check.

http://ftp.support.veritas.com/pub/support/products/Foundation_Suite/283161.pdf

Greetz,
Chris

[Mousa55]

Hi,

please find the attached file for output command.

> Which sms suite was installed exactly?
SGSMSupp_A.02.00_HP-UX_B.11.23_IA_PA

>What model of diskarray is the server connected to ?

it is EVA 8000

and now how to use this disk c#t3d0


thanks alot

[Sunil Sheoran]

HI

For lock vg you need to create a vg with 1 gb of disk space from your EVA storage.

Please let me know if you are configuring a SG-RAC cluster (Active/Active) I have a step-by step guide for that if you need I will fwd the same.

Thanks
Sunil

[Mousa55]

Hi,

yes i need it to configure a CFS.


you say "Configure and start the basic cluster on nodes "
when i configure the basic cluster and execute this command
# cmcheckconf -v â C cmclconfig.ascii

this error it's appeared

"# cmcheckconf -v -C cmclconfig.ascii
Begin cluster verification...
Checking cluster file: cmclconfig.ascii
Note : a NODE_TIMEOUT value of 2000000 was found in line 143. This value
is recommended if the top priority is to reform the cluster as fast
as possible in case of failure. If the top priority is to minimize
reformations, consider using a higher setting. For more information see
the cluster configuration ASCII file or the Managing Serviceguard manual.
Undefined variable FIRST_CLUSTER_LOCK_PV for node ruxdb02.
Provide first cluster lock physical volume entry.
cmcheckconf: Error found in cluster file: cmclconfig.ascii."

what is the value of FIRST_CLUSTER_LOCK_VG in VxVM and also value of
# For example:
# VOLUME_GROUP /dev/vgdatabase
# VOLUME_GROUP /dev/vg02

and NODE_TIMEOUT value

thanks

[Mousa55]

Hi Sunil Sheoran,

yes i need this guide to configuring a SG-RAC cluster (Active/Active).

and "For lock vg you need to create a vg with 1 gb of disk space from your EVA storage." this VG does not need it to export and import (vg.map) to other node

thanks

[Mousa55]

Hi,

i am create a new vg01 but This error is still
# cmcheckconf -v -C cmclconfig.ascii
Begin cluster verification...
Checking cluster file: cmclconfig.ascii
Undefined variable FIRST_CLUSTER_LOCK_PV for node ruxdb02.
Provide first cluster lock physical volume entry.
cmcheckconf: Error found in cluster file: cmclconfig.ascii.

and don't forget answer of previous question

thanks

[Doug O'Leary]

Hey;

This isn't the answer you want to hear, but it's the right one nonetheless.

You are attempting to dive into the very deepest end of the pool without knowing how to swim first. You are setting yourself up for failure.

Clustering is very complicated. Clustering with CVM/CFS is even more so. It's not something that can or should be learned (or taught) through forum posts.

Take a step back from the keyboard - and go get some training.

Most of your recent questions can be answered by the first MCSG class:

http://www.hp.com/education/courses/h6487s.html

Your questions on CVM/CFS and Oracle RAC integration can be answered by the second MCSG class:

http://www.hp.com/education/courses/u8601s.html

If you can't or won't go get the training, at least read the MCSG admin guide.

http://docs.hp.com/en/B3936-90144/index.html

This is a long version of RTFM. You are asking how to do a very complicated process and your follow on questions show you don't have the requisite knowledge to really even understand the answers.

Go get the training. This will all suddenly become much more understandable and easier.

Doug O'Leary

[Michael Steele_2]

Totally agree. Thank you Mr. O'Leary.

[chris huys_4]

Hi Nejad,

> Which sms suite was installed exactly?
> SGSMSupp_A.02.00_HP-UX_B.11.23_IA_PA

SGSMSupp is not a sms bundle.

SGSMSupp is a Supplemental bundle that includes some filesets that were forgotten after some of the sms 2.0 bundles were created.

for more info about SGSMSupp.
http://docs.hp.com/en/5992-3348/5992-3348.pdf

As the system has allready the MCOE environment installed, the sms bundle to buy, is one of the following 2.

T2796CA Includes bundle T2776CA software with the HP-UX 11i v2 Mission Critical Operating Environment
(MCOE)

T2797CA Includes bundle T2777CA software with the HP-UX 11i v2 Mission Critical Operating Environment
(MCOE)

The differences between the above 2 bundles can be found in the following release notes

"
HP Serviceguard Storage Management Suite
Version A.02.01 for HP-UX 11i v2 Release
Notes
"

http://docs.hp.com/en/T2771-90053/T2771-90053.pdf

Greetz,
Chris

[Mousa55]

Hi,

I asked specific questions And did not say I want advice.
I have completed the Active/Passive cluster successfully and I certified, but in this case
I want to mount filesystem on multiple servers at the same time (with R/W).
After searching on this topic I found should be using the CFS with VxVM, and This is the first time
I using this type, To do this requires me to Ask some questions.
For that If you have answers to these questions do not hesitate to reply, and if you do not know, please do not reply.

what is the value of FIRST_CLUSTER_LOCK_VG in ASCII file when using the VxVM and also value of

VOLUME_GROUP ?????????
FIRST_CLUSTER_LOCK_VG ?????????
NODE_TIMEOUT value of 11.18 version
FIRST_CLUSTER_LOCK_PV ?????????


Thanks & kind Regards

[Michael Steele_2]

This is the problem, sir, you are asking questions that you should already know and are now head over heels into a big mess.

a) vxvm has no cluster locking mechanism when used with MC/SG

b) vxvm is made to be used with Veritas Cluster Server.

c) in VCS you use quorum instead of lock disks

docs.hp.com/en/B3936-90048/B3936-90048.pdf

[Doug O'Leary]

Hey;

It should be self evident that any VG/PV related information is not relevant when using vxvm as your disk manager. In this case, you'll need a quorum server.

Setting one of those up is simplicity itself and is well documented in the MCSG admin guide. Search for quorum or quorum server in the admin guide to get to the section directly.

Doug O'Leary