MC/SG NIC hardware move from one slot to another

[Keith Lapidus]

Scenario: I have a 3 node cluster running SG 11.09. I need to install two new fibre channel cards in each server. To do this, I need to move two NICs(sitting in twin turbo slots) to different slots(non twin turbo). The networks will remain the same, but the NICs will obviously change from lanX to lanY when they are moved.
Question: Can I modify the cluster while it is running to allow for the lanX to lanY changes? Again, No IP is changing, just the location of the NIC in the server.

[Dietmar Konermann]

Generally, most network configuration changes cannot be done while the cluster is running. But you can remove/re-add nodes from running clusters... and when re-adding a node the new configuration is discovered.

I hope you use a cluster lock disk or a quorum server.. otherwise removing a node from a 3-node cluster is not possible.

Best regards...
Dietmar.

[A. Clay Stephenson]

The honest answer is I don't know BUT if may work if you play exactly by the rules.

On the first node, I would move any running packages to an adoptive node. Next halt that node. I would then edit /etc/rc.config.d/cmcluster and set AUTOSTART_CMCLD=0 so that the node does not try to join the cluster when restarted.

Do a lanscan | lp before shutting down so that you know what interface is associated with lan1, lan2 ...

Now shutdown and move your cards. You will stand a better chance if your preserve the HARDWARE path order. If, for example, NIC 'A' has a lower hardware path than NIC 'B' then preserve that relationship when you move to the new slots. That will give you the best hope than lan2 will again be lan2.

Boot the box and do a lanscan. If the new lan2 matches the old lan2 (i.e eventhough the hardware path has changed the card that WAS lan2 is still lan2) (and all others match as well), you are home free. Start the node.

If not, then you will need to halt the cluster.
The fundamental problem is that the cluster config file expects the heartbeat on a given lan, e.g. lan1 on Node A. If lan1 ain't lan1 no more then you've got to shutdown the cluster.

[Keith Lapidus]

Here is the current config: N4000

twin turbo 6 0/2 fcms1
twin turbo 5 0/10 lan4 10.16.127.0
twin turbo 4 0/8 lan3 10.196.8.0
twin turbo 3 0/12 lan5 10.29.10.0
turbo 2 0/4
turbo 1 0/5
twin turbo 12 1/0 fcms2
twin turbo 11 1/8 lan8 stby 10.16.127.0
twin turbo 10 1/2 lan6 10.16.126.0
twin turbo 9 1/4 lan7 10.196.254.6
turbo 8 1/8 lan9 stby 10.196.254.0
lan10 stby 10.16.126.0
lan11 stby 10.29.10.0
lan12 stby 10.196.8.0
turbo 7 1/12 lan13 10.16.254.0

I want to move lan4 and lan8 to slots 2 - 0/4 and 1 - 0/5.
Do you think that if I move these two nics that the lan number will change? My guess is it will.

[Sridhar Bhaskarla]

Hi,


The best way is to halt the cluster, delete the configuration and then apply the configuration with the changes.

You can get away with the node add/remove procedure. However, if you have packages running, you will need to move the packages anyway. So, Instead of taking your application down multiple times, I would suggest to do it in a cleanway.

Otherwise, you can follow this procedure.

Backup the directory /etc/cmcluster. Choose one node. Move the package from that node to the other. Edit all package configuration files and remove the references of that node. Apply the package configurations. Edit the cluster configuration file and remove the lines corresponding to that node. Apply the configuration. Now this node is out of the cluster. Do the maintenance. Edit cluster configuration file and make changes to reflect the new configuration. Apply the cluster and package configurations. Repeat the process for other nodes. I am assuming that you didn't configure a cluster lock here as it is not a must for a 3 node cluster.

-Sri

[Sridhar Bhaskarla]

Hi,

I didn't read your last message at first.

Yes. The instance numbers hence the device files will change once you move the cards across the slots as the ioconfig file will have instances 4 and 8 mapped to 0/8 and 1/8 already. You can use "ioinit" to change the instance numbers hence the device files back.

-Sri

[Sunil Sharma_1]

Hi,
You can not make any change in Node if it's part of cluster.
You have 3 node cluster so best way to do it is one by one.
logically steps will be like this
1. move pakages from 1st server (node1) to adaptive node.
2. take node1 out of cluster.
3. shut it down.
4. make necessary changes in this server like card movement and all.
5. boot up server and configure it as a part of cluster.

HTH
Sunil