topic Re: Multiple IP on two NIC in Operating System - HP-UX

Multiple IP on two NIC

raver_1 — Thu, 13 Jun 2002 07:27:06 GMT

Hi all,

I had two L1000 servers with 2 NIC each.
I'm trying to configure 2 heartbeat links on the cards on top of the physical and virtual IP.

i.e.

Host A
------
lan0 (host IP)
137.130.10.11/255.255.255.244
lan0:1 (virtual IP)
137.130.11.10/255.255.255.244
lan0:2 (heartbeat 2)
10.11.1.11/255.255.0.0
lan2 (heartbeat 1)
10.12.1.11/255.255.0.0

Host B
------
lan0 (host IP)
137.130.10.12/255.255.255.244
lan0:2 (heartbeat 2)
10.11.1.12/255.255.0.0
lan2 (heartbeat 1)
10.12.1.12/255.255.0.0

From Host A, I'm able to ping lan0 and lan0:2 IP of Host B EXCEPT lan2.

Same from Host B, cannot ping lan2 IP of Host A.

Pls advice.

Jayce

Re: Multiple IP on two NIC

Duncan Edmonstone — Thu, 13 Jun 2002 07:54:44 GMT

Jayce,

Not sure why this sin't working - everything here looks good as far as I can tell, can you post the output of:

netstat -in
netstat -rn

for both machines

This might help us diagnose your problem.

As an aside what are you trying to acheive here? Why add an extra hearbeat IP address on an existing LAN interface, why not just use heartbeart over the existing IP subnet? If this is for MC/ServiceGuard, I'm not convinced what you are trying to do would be supported.

Also may I respctfully suggest to get more responses to this post, you should consider assigning some points to your older posts - if you thought the posts were not helpful, you can assign a point score of zero:

http://forums.itrc.hp.com/cm/TopSolutions/1,,CA748472!1!questions,00.html

HTH

Duncan

Re: Multiple IP on two NIC

raver_1 — Thu, 13 Jun 2002 08:11:16 GMT

Re: Multiple IP on two NIC

Santosh Nair_1 — Thu, 13 Jun 2002 08:36:16 GMT

Actually there is a problem with the above configuration in that you have two IP addresses on DIFFERENT subnets bound to the same lan card. As far as I know, that's not good.

I understand you're trying to set up two heartbeats, but you should be able to use the primary lan connection, i.e. lan0 as a secondary heartbeat without assigning another IP address to it.

Keep in mind that recommendations are not requirements, so while they recommend that you have two dedicated heartbeats, they don't require it. Check their minimum requirements to see if they require two dedicated heartbeats.

Hope this helps.

-Santosh

Re: Multiple IP on two NIC

Duncan Edmonstone — Thu, 13 Jun 2002 08:41:04 GMT

Santosh,

What Jayce is attempting should work - this is from the man page for ifconfig:

Multiple IP addresses assigned to the same interface may be in
different subnets. An example of an interface name without an IP
index number is lan0. An example of an interface name with a IP index
number is lan0:1. Note: specifying lan0:0 is equivalent to lan0.

Cheers

Duncan

Re: Multiple IP on two NIC

U.SivaKumar_2 — Thu, 13 Jun 2002 08:57:59 GMT

Hi,
You have to specify broadcast addresses for 10.11.0.0 network as 10.11.255.255 and 10.12.0.0 network as 10.12.255.255 and try again.

regards,
U.SivaKumar

Re: Multiple IP on two NIC

raver_1 — Thu, 13 Jun 2002 10:17:45 GMT

Hi Santosh,

I understand that they is no need to specify an IP for heartbeat.
I just wanted to make sure the two cards can "see" each other between the two servers.

U.SivaKumar,
I tried that before, but to no avail.

Anymore suggestion???

Re: Multiple IP on two NIC

Sanjay_6 — Thu, 13 Jun 2002 11:29:12 GMT

Hi Jayce,

Try ifalias command to set multiple ip's on the same card.

http://support1.itrc.hp.com/service/cki/docDisplay.do?docLocale=en_US&docId=200000053199190

Hope this helps.

Regds

Re: Multiple IP on two NIC

raver_1 — Thu, 13 Jun 2002 11:41:58 GMT

Hi Sanjay,

Tried your suggestion. But still the same.

Pls note that there's no problem pinging the IPs on lan0 between the two servers.

Only lan2 is giving problems.

Thanks

Re: Multiple IP on two NIC

Duncan Edmonstone — Thu, 13 Jun 2002 12:24:13 GMT

Can you confirm that the lan2 NICs can talk to each other at link level:

On node A use 'lanscan' to find out the MAC address of lan2

On Node B, attempt a link level ping to lan2 on node A, out of lan2:

linkloop -i 2 0x

The repeat in the opposite direction

HTH

Duncan

Re: Multiple IP on two NIC

Tim D Fulford — Thu, 13 Jun 2002 12:40:09 GMT

You are missing the [1] set of stuff in your netconf file

e.g.

INTERFACE_NAME[1]="lan0"
:
:
INTERFACE_NAME[2]="lan0:2"

You MUST use continously incring numbers to do this...

I have a few other comments
o why are you using lan0 then lan0:2 & missing lano:1? - I suspect you reserved it for the package but I'm pritty sure it will come out on lan0:3...
o Why do you want to put the heart beat over lan0 interface but on another subnet? You have two heart beats

Tim

Re: Multiple IP on two NIC

Tim D Fulford — Thu, 13 Jun 2002 12:47:42 GMT

oh I forgot, ifalias is a HP-UX 10.20 thing for HP-UX 11.00 use

# ifconfig lan[:] netmask up

to check use ifconfig lan[:]

The networks & subnets you have chosen are OK BUT there is a problem when subnetting addresses with zeros in it, like 10.0.0.12 with netmask like 255.255.255.0 or 255.255.0.0 you get an error. I think this has been fixed but I do not know the patch that does it. All Ive done in the past is use 10.1.1.12 instead.

Tim

Re: Multiple IP on two NIC

raver_1 — Thu, 13 Jun 2002 13:08:54 GMT

Duncan,
I'll try your suggestion tommorrow when I get back to work.

Tim,
You're right, I'm reserving lan0:1 for the virtual IP after this heartbeat issue is resolve.

As for why two heartbeats? It is a minimum requirement for Veritas Cluster Server (VCS). Basically it works in a round-robin fashion.

BTW, the two servers were previously configured with MCSG. Heard that MCSG can configure to bring-up a "sleeping" NIC if the default is to fail.

May I know how to check if it is being configured and hpw to disable it?

Thanks.

Re: Multiple IP on two NIC

Santosh Nair_1 — Thu, 13 Jun 2002 13:46:09 GMT

Duncan,

I know that its possible to assign multiple IP addresses to the same physical LAN card, but I was under the impression that the IP addresses had to be on the same subnet. So I guess I stand corrected.

-Santosh

Re: Multiple IP on two NIC

Duncan Edmonstone — Thu, 13 Jun 2002 13:50:12 GMT

Just ensure MC/ServiceGuard is stopped, and that it won't restart on reboot:

on both nodes:

cmhaltcl -f

then

edit /etc/rc.config.d/cmcluster, and change env. variable to 0.

HTH

Duncan

Re: Multiple IP on two NIC

Aashish Raj — Thu, 13 Jun 2002 18:49:47 GMT

Try with
ROUTE_COUNT[3]=1 in netconf

AR

Re: Multiple IP on two NIC

Tim D Fulford — Fri, 14 Jun 2002 11:57:34 GMT

Jayce

My fingers are made of sausage. I mistyped part of my response

you are missing INTERFACE_NAME[1]=lan... (..[1] set of environment variables) in the netconf file on host A. You have ..[0] ..[1] & ..[2] variables. This will mean when booting it will stop at assigning lan0; as defined by ..[0]; and will not do lan0:2 (..[2]) & lan2 (..[3]). The variable (array) numbers must not have any gaps & start at [0]

That is what I was trying to say which migfht be why you cant ping lan0:2 etc

Tim

Re: Multiple IP on two NIC

Duncan Edmonstone — Fri, 14 Jun 2002 12:43:49 GMT

Tim,

I don't think missing out an array index in the way Jayce has will matter - if you take a look at the actual code that reads this file in /sbin/init.d/net you will find that the script actually figures out the highest index value in the netconf file, and then loops thro each index until it reaches the maximum value - any empty indexes just get ignored. This is born out by the fact that Jayce's routing tables on node A do contain entries for lan0:2 and lan2.

That said, it won't hurt to change them as you suggest...

HTH

Duncan

Re: Multiple IP on two NIC

raver_1 — Sat, 15 Jun 2002 04:51:56 GMT

Hi all,

Hit the following errors issuing linkloop command.

Note that I had try using a cross-cable but are getting the same results.

Pls advice.

----

Host A
========
# linkloop 0x001083FD767E (lan0 of Host B)
Link connectivity to LAN station: 0x001083FD767E
-- OK

# linkloop 0x001083FC2360 (lan2 of Host B)
Link connectivity to LAN station: 0x001083FC2360
error: get_msg2 getmsg failed, errno = 4
-- FAILED
frames sent : 1
frames received correctly : 0
reads that timed out : 1

# linkloop -i 2 0x001083FC2360 (lan2 of Host B)
Link connectivity to LAN station: 0x001083FC2360
error: expected primitive 0x30, got DL_ERROR_ACK
dl_error_primitive = 0x2d
dl_errno = 0x04
dl_unix_errno = 57
error - did not receive data part of message

Host B
========
# linkloop 0x001083FDB6C6 (lan0 of Host A)
Link connectivity to LAN station: 0x001083FDB6C6
-- OK

# linkloop 0x001083FC235B (lan2 of Host A)
Link connectivity to LAN station: 0x001083FC235B
error: get_msg2 getmsg failed, errno = 4
-- FAILED
frames sent : 1
frames received correctly : 0
reads that timed out : 1

# linkloop -i 2 0x001083FC235B (lan2 of Host A)
Link connectivity to LAN station: 0x001083FC235B
error: expected primitive 0x30, got DL_ERROR_ACK
dl_error_primitive = 0x2d
dl_errno = 0x04
dl_unix_errno = 57
error - did not receive data part of message

Re: Multiple IP on two NIC

U.SivaKumar_2 — Sat, 15 Jun 2002 05:36:29 GMT

Hi,
Please Try this-
#ifconfig lan0:1 up
#ifconfig lan0:2 up
and test the connection again

regards,
U.SivaKumar