topic Re: Missing LAN0 and LAN3 on an rx6600 in Operating System - HP-UX

Missing LAN0 and LAN3 on an rx6600

Telia BackOffice — Mon, 27 Apr 2009 12:49:17 GMT

Hi

I migrated a couple of disks from one rx6600 to another rx6600 today. I exchanged only the disks. Nothing more.

Big was my surprise when I discoved that the two machines doesn't handle LAN interfaces in the same way. Machine A has a dualport NIC and two FC/NIC combo cards, yielding 4 NIC ports LAN0..3

The other has a dual port NIC, and 2 quad port NICs yielding 10 NIC ports enummerated:

LAN1..2, LAN4..11

Where did LAN0 and LAN3 go?

iether4: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/2/1/0/4/0
iether5: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/2/1/0/4/1
iether6: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/2/1/0/6/0
iether7: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/2/1/0/6/1
iether1: INITIALIZING HP AB352-60003 PCI/PCI-X 1000Base-T Dual-port Core at hardware path 0/4/2/0
iether8: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/6/1/0/4/0
iether9: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/6/1/0/4/1
iether10: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/6/1/0/6/0
iether11: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/6/1/0/6/1
iether2: INITIALIZING HP AB352-60003 PCI/PCI-X 1000Base-T Dual-port Core at hardware path 0/4/2/1

Re: Missing LAN0 and LAN3 on an rx6600

Ganesan R — Mon, 27 Apr 2009 13:07:10 GMT

Hi,

I couldn't really understand your question infact.

>>The other has a dual port NIC, and 2 quad port NICs yielding 10 NIC ports enummerated:<<

So there are 10 LAN devices listed in your output.

Did you mean why LAN0 and LAN3 names are assigned to the devices?

If so, it depends on the instance numbers available with kernel at that point of time.
In your case instance numbers 0 and 3 might have assigned to some other NIC ports when you install the quad port cards and later those device might have removed.

Re: Missing LAN0 and LAN3 on an rx6600

Telia BackOffice — Mon, 27 Apr 2009 13:35:20 GMT

I am wondering where why lan0 and lan3 isn't used when mapping the hw to the OS representation. As you can see above HPUX (11.31) disovers all 10 ports but maps them to lan1,2,4,5,6,7,8,9,10,11

What prevents it from using lan0,1,2,3,4,5,6,8,9?

It would seem more logical to do that.

Other rx6600s I have maps it in the straightforward, logical order. But then again, they do not contain quad port NICs.

thosan@lore|pts/2:/home/thosan$ sudo lanscan
Password:
Last successful login: Mon Apr 27 15:49:03 METDST 2009 lore.prod.telia.dk
Last authentication failure: Tue Apr 21 12:05:57 METDST 2009
Hardware Station Crd Hdw Net-Interface NM MAC HP-DLPI DLPI
Path Address In# State NamePPA ID Type Support Mjr#
0/2/1/0/4/0 0x00127943C04C 4 UP lan4 snap4 1 ETHER Yes 119
0/2/1/0/4/1 0x00127943C04D 5 UP lan5 snap5 2 ETHER Yes 119
0/2/1/0/6/0 0x00127943C04E 6 UP lan6 snap6 3 ETHER Yes 119
0/2/1/0/6/1 0x00127943C04F 7 UP lan7 snap7 4 ETHER Yes 119
0/6/1/0/4/0 0x00127943C174 8 UP lan8 snap8 6 ETHER Yes 119
0/6/1/0/4/1 0x00127943C175 9 UP lan9 snap9 7 ETHER Yes 119
0/6/1/0/6/0 0x00127943C176 10 UP lan10 snap10 8 ETHER Yes 119
0/6/1/0/6/1 0x00127943C177 11 UP lan11 snap11 9 ETHER Yes 119
0/4/2/1 0x0017A4512EE1 2 UP lan2 snap2 10 ETHER Yes 119
LinkAgg0 0x0017A4512EE0 900 UP lan900 snap900 12 ETHER Yes 119
LinkAgg1 0x000000000000 901 DOWN lan901 snap901 13 ETHER Yes 119
LinkAgg2 0x000000000000 902 DOWN lan902 snap902 14 ETHER Yes 119
LinkAgg3 0x000000000000 903 DOWN lan903 snap903 15 ETHER Yes 119
LinkAgg4 0x000000000000 904 DOWN lan904 snap904 16 ETHER Yes 119

Re: Missing LAN0 and LAN3 on an rx6600

Steven E. Protter — Mon, 27 Apr 2009 13:36:21 GMT

Shalom,

You have two machines with different LAN cards and expected them to be detected the same way.

That is simply a case of unreasonable expectations.

rx class servers assign lan numbers in the order they are detected and based on positions on the bus. Some positions will always detect ahead of others.

So even with the exact some hardware, its possible due to installation order to get the same lan card at the same position to be different lan numbers in the system.

ioscan ouptut from both systems might be helpful in providing you further assistance.

SEP

Re: Missing LAN0 and LAN3 on an rx6600

Telia BackOffice — Mon, 27 Apr 2009 13:39:38 GMT

thosan@lore|pts/2:/home/thosan$ sudo ioscan -funC lan
Last successful login: Mon Apr 27 16:38:48 METDST 2009 lore.prod.telia.dk
Last authentication failure: Tue Apr 21 12:05:57 METDST 2009
Class I H/W Path Driver S/W State H/W Type Description
======================================================================
lan 4 0/2/1/0/4/0 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 5 0/2/1/0/4/1 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 6 0/2/1/0/6/0 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 7 0/2/1/0/6/1 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 1 0/4/2/0 iether CLAIMED INTERFACE HP AB352-60003 PCI/PCI-X 1000Base-T Dual-port Core
lan 2 0/4/2/1 iether CLAIMED INTERFACE HP AB352-60003 PCI/PCI-X 1000Base-T Dual-port Core
lan 8 0/6/1/0/4/0 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 9 0/6/1/0/4/1 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 10 0/6/1/0/6/0 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 11 0/6/1/0/6/1 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter

Re: Missing LAN0 and LAN3 on an rx6600

Torsten. — Mon, 27 Apr 2009 14:31:33 GMT

I guess lan0 and lan3 are bound to lan900 via APA.

Re: Missing LAN0 and LAN3 on an rx6600

Fabio Ettore — Mon, 27 Apr 2009 14:51:06 GMT

I agree with Torsten, check by

lanscan -q

I'd suppose you'll see a line like follows:

900 0 3

that means lan0 and lan3 aggregated in lan900 and so it's normal you cannot see them by lanscan.

Best regards,
Fabio

Re: Missing LAN0 and LAN3 on an rx6600

Telia BackOffice — Tue, 28 Apr 2009 06:23:33 GMT

thosan@lore|pts/3:/home/thosan$ lanscan -q

4
5
6
7
8
9
10
11
2
900 1
901
902
903
904

So no. LAN0 and LAN3 simply isn't there. I ofcourse discovered the problem when migrating the disks as the old server had APA configured to let LAN900 be configured using LAN0 and LAN1. To my surprise only LAN1 was usable in the new server. I will just reconfigure APA, but I would like to understand why it is so.

Re: Missing LAN0 and LAN3 on an rx6600

Duncan Edmonstone — Tue, 28 Apr 2009 07:06:42 GMT

Sorry, I don't think this is anything to do with APA - APA doesn't prevent you from seeing LAN instance numbers - if I aggregate lan0 and lan1 into lan900, I can still see lan0 and lan1 in an ioscan or lanscan output...

Was one box ignited from another using a golden image, or has the HW configuration of one box changed? HP-UX tracks all hardware (including HW that has since been disconnected) in the ioconfig file, so that when a faulty piece of HW is replaced, the new HW comes back with the same instanhce number (that's the idea anyway). So in this case there are obviously entries for lan0 and lan3 in the ioconfig file at a certain HW path, even though there's no actual HW at that location.

As you are at 11.31, you should be able to get these re-assigned by using:

ioinit -rC lan

WARNING! - this will cause the system to reboot immediately, so mnake sure you have apps stopped and filesystems dismounted as appropriate before running!

SECOND WARNING! - as lan instances may get re-assigned, nyou may find IP adrresses are now bound to different cards and APA aggregates are made up of the wrong instances, so make a note of all LAN instance to HW relationships (lanscan) as well as IP configurations (netstat -in) before rebooting so you can fix this, and make sure you have console access...

HTH

Duncan

Re: Missing LAN0 and LAN3 on an rx6600

Telia BackOffice — Tue, 28 Apr 2009 07:52:29 GMT

Hi Duncan

That made a lot of sense. I moved the root disks physically from one server to another (both rx6600s, same fw level and stuff like that)

I will try to follow your advice when the storage team is done migrating the SAN zone information.

I'll keep you posted about the success/failure of issuing the commands.

Thomas

Re: Missing LAN0 and LAN3 on an rx6600

Telia BackOffice — Tue, 28 Apr 2009 12:47:35 GMT

Duncan was spot on.

After A ioinit -rC lan I got

# ioinit -rC lan
ioinit:Rebooting the system to reassign instance numbers for class lan
Shutdown at 10:16 (in 0 minutes)
System shutdown time has arrived
Terminated

System Console is on the Built-In Serial Interface
iether0: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/2/1/0/4/0
iether1: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/2/1/0/4/1
iether2: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/2/1/0/6/0
iether3: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/2/1/0/6/1
iether4: INITIALIZING HP AB352-60003 PCI/PCI-X 1000Base-T Dual-port Core at hardware path 0/4/2/0
iether6: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/6/1/0/4/0
iether7: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/6/1/0/4/1
iether8: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/6/1/0/6/0
iether9: INITIALIZING HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter at hardware path 0/6/1/0/6/1
iether5: INITIALIZING HP AB352-60003 PCI/PCI-X 1000Base-T Dual-port Core at hardware path 0/4/2/1

Thanks for the explanation