TruCluster
Showing results for 
Search instead for 
Do you mean 

Software installation to TruCluster nodes

SOLVED
Go to Solution
Honored Contributor

Software installation to TruCluster nodes

Hi,
We have 2 nodes on TruCluster on 5.1B. I want to install software into 1 of the node. It will install into:
i) /usr/opt
ii) /var/opt

Seems both the above mountpoints are shared.
How can I install into node1 only & make it not visible in node2. Is it possible?

16 REPLIES
Honored Contributor

Re: Software installation to TruCluster nodes

Hi Jason,

I'm not sure that this is possible, as /usr and /var are clustered file systems on TruCluster.

If you need to have directories that are specific to each node, then you may want to looks at CDSLs (Cluster Dependant Symbolic Links).

Hope this helps,

Regards,

Rob
Honored Contributor

Re: Software installation to TruCluster nodes

The cluster mechanism is designed to share resources.
As result even local (not shared) disks or tapes for node1 will be "visible" to node2!

So the question as put should get the answer "not possible".

But why do you want it "not visible"?
There are many ways to make it not able to start if someone tries this on node2.
eg. modify startup-script
If it is a cluster-resource you can configure CAA not to start the resource on node2 unless manually commanded.
Honored Contributor

Re: Software installation to TruCluster nodes

Pieter, you said:

>The cluster mechanism is designed to share >resources.
>As result even local (not shared) disks or >tapes for node1 will be "visible" to node2!

I don't agree. I've used the following cluster solutions:
1) HP's MC ServiceGuard
2) IBM's HACMP
3) Sun's Cluster
4) Veritas Cluster

All of them have local disks ( /,/var,/opt,/usr etc) & they only have shared disks/mountpoints for DB or applications. Installing apps to /var/, /usr is not a problem, since they are local.

So, TruCluster seems to be the "odd man" here.
Honored Contributor

Re: Software installation to TruCluster nodes

Hi Jason,

> So, TruCluster seems to be the "odd man" here.

Depends on how you look at it. DEC "invented" clustering, so some would say that the way TruCluster does it, is the way others should...

Anyway, that's largely irrelevant. Going back to the original problem I don't see why it matters whether the second node would be able to see software installed on the first... Just because a software installation is visible to the node, it doesn't mean it has to do anything with it...

Cheers,

Rob
Honored Contributor

Re: Software installation to TruCluster nodes

Rob,
Thanks for the reply. OK, I think it is best I explain what I want to install. It is HP Operations Manager (OM8) agents. We are suppose to install it into the local disk & monitor each individual server separately.
Can you advise how we can go about it in TruCluster shared (/var/opt & /usr/opt) mount points? How can /usr/opt/OV local to each node?



Honored Contributor

Re: Software installation to TruCluster nodes

Hi Jason,

I've not got a box to test on at the moment, but a look at the man page for mkcdsl:

http://h30097.www3.hp.com/docs/base_doc/DOCUMENTATION/V51B_HTML/MAN/MAN8/0370____.HTM

suggests that you should be able to do this:

# mkdir /usr/opt/OV
# mkcdsl -a /usr/opt/OV

If you then do an ls -l on /usr/opt/OV you should see it as a symbolic link with {memb} in it...

Cheers,

Rob
Honored Contributor

Re: Software installation to TruCluster nodes

Hi Rob,
Thanks for pointing that out. I think I'll try it out & let you know how it goes.

From the "man" page:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~
To copy the existing file or directory /usr/testfile2 to all members'
/usr/cluster/members/{memb} directories and replace it with a CDSL that
points to cluster/members/{memb}/testfile2:

# mkcdsl -a /usr/testfile2

All members have a copy of the original /usr/testfile2 file.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~

I wonder what's the meaning of "All members have a copy.." I just hope if I run mkcdsl in node1, node2 doesn't have it...well will try it out when I'm back to office.

Honored Contributor

Re: Software installation to TruCluster nodes

Hi Rob,
No good.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Node1
1) mkdir /usr/opt/OV

Node2
1) Automatically /usr/opt/OV exists

Back to Node1
1) mkcdsl -a /usr/opt/OV
2) ls -al /usr/opt/OV, it points to ../cluster/members/{membr}/opt/OV

Node2
1) /usr/opt/OV still exists & points to the same
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Conclusion = didn't achieve my objective of /usr/opt/OV only exist in Node1.

Any other idea?
Frequent Advisor

Re: Software installation to TruCluster nodes

If HP Operations Manager (OM8) officially supports Tru64 then surely it's up to this product group to provide you with a cluster-aware installation.
Honored Contributor

Re: Software installation to TruCluster nodes

Thanks John,
I've logged a call to the HPOV support. The engineer still finding info on how to install in TruCluster. So, in the mean time, instead of idling, I try asking here.
Honored Contributor

Re: Software installation to TruCluster nodes

Hi Jason,

It appears to work around here. Using /usr/opt/ROB as an example:


node1 # ls -l /usr/opt/ROB
total 0

node1 # mkcdsl -a /usr/opt/ROB

node1 # cd /usr/opt
node1 # ls -l ROB
lrwxrwxrwx 1 root system 33 Oct 19 18:33 ROB -> ../cluster/members/{memb}/opt/ROB



node1 # cd /usr/opt/ROB
node1 # pwd
/usr/opt/ROB

node1 # ls -ltr
total 0

node1 # touch node1.txt
node1 # pwd
/usr/opt/ROB
node1 #
node1 #
node1 # cd /
node1 # ls -l /usr/opt/ROB
lrwxrwxrwx 1 root system 33 Oct 19 18:33 /usr/opt/ROB -> ../cluster/members/{memb}/opt/ROB
node1 # ls -l /usr/opt/ROB/*
-rw-r--r-- 1 root system 0 Oct 19 18:34 /usr/opt/ROB/node1.txt



node2 # ls -l /usr/opt/ROB
lrwxrwxrwx 1 root system 33 Oct 19 18:33 /usr/opt/ROB -> ../cluster/members/{memb}/opt/ROB


node2 # cd /usr/opt/ROB
node2 # ls -l
total 0

Hopefully the forums won't mangle the above too much, if it does I'll attach a text file !

Cheers,

Rob
Honored Contributor

Re: Software installation to TruCluster nodes

Hi Rob,
Thanks for showing in details your test results. If you checked my post, I didn't create any file after creating the /usr/opt/OV & running the mkcdsl -a in node1.
I'll test again & let you know the results.

Jason..
Honored Contributor

Re: Software installation to TruCluster nodes

Hi Rob,
Here's my test results:

Node1:
1) create /usr/opt/OV
2) mkcdsl -a /usr/opt/OV
3) create a file in /usr/opt/OV

Node2:
1) /usr/opt/OV exists
2) File in (3) above doesn't exists

So, it looks fine. Then I proceed with the software installation.

Well, during the installation, I notice a lot of directories & file created in /usr/opt/OV in node1.

Checking node2, all those files + directories exists!
The installation is using a combination of tar & setld.

Now, what should I do? Does it mean I have to run the "mkcdsl -a" on all those directories ?

Please advsie.
Honored Contributor

Re: Software installation to TruCluster nodes

Hi Jason,
have been away for a few days.
but I want to get back on your post on Oct 17, 2009 13:47:26 GMT
-----------------------------------
Pieter, you said:
>The cluster mechanism is designed to share >resources.
>As result even local (not shared) disks or >tapes for node1 will be "visible" to node2!

I don't agree. I've used the following
.....
So, TruCluster seems to be the "odd man" here.
-----------------------------------

This is a TruCluster forum, so from my pouint of view I was referring to Tru64/TruCluster environment.
where /usr and /var are cluster resources

typhoon2 (system)> mount
cluster_root#root on / type advfs (rw)
root2_domain#root on /cluster/members/member2/boot_partition type advfs (rw)
root1_domain#root on /cluster/members/member1/boot_partition type advfs (rw)
cluster_usr#usr on /usr type advfs (rw)
cluster_var#var on /var type advfs (rw)


=============================
now back to the original problem
I don't think in our cluster environment any specific trick has been done to make the agents node-specific.

Allthough it seems not version 8 yet, I cant't imagine the installation is so much different.
typhoon2 (system)> setld -i |grep -i Agent
CPQIM360 installed HP Insight Management Agents V3.6 for Tru64 UNIX
OPCAGT000 installed HP ITO Agent software version A.07.31

The installation directory is made member specific by using cdsl's
typhoon2 (system)> ls -l /var/opt/OV
lrwxrwxrwx 1 root system 32 Feb 22 2007 /var/opt/OV -> ../cluster/members/{memb}/opt/OV

So you may be looking for a problem that doesn't exist.
Honored Contributor

Re: Software installation to TruCluster nodes

Pieter,
Thanks for your reply. You are right in a certain way, but you really have to upgrade to OVO8 to "see" the problem. Anyways, we are running OVO7.31 like you without any problem.
BTW, for OVO8, agents will not work if /proc is not mounted. Is the /proc in your clusters mounted?

Honored Contributor

Re: Software installation to TruCluster nodes

Hi Jason,
Yes, /proc is mounted.
=> /proc on /proc type procfs (rw)
I,ve not listed all our mounted filesystems.
/proc is crucial for all "interprocess communication" the system cannot run normal without it.
//Add this to "OnDomLoad" event