rx6600 won't boot over network ...

[Sergej_5]

HI!
I got problems to boot integrity virtual machines running on rx6600.

We got installed C.7.4.157 ignite-ux on HP-UX 11.11.

All procceses required for booting over network are running:

/usr/sbin/rbootd
bootpd

THe strange thing is that i can manage to boot other machines over LAN successfuly but just this particular virtual machines makes me headache :(

In bootptab i got the following:

IADEF:\
ht=ethernet:\
hn:\
bf=/opt/ignite/boot/nbp.efi:\
bs=48:\
bp=10.17.11.188:\
sm=255.255.0.0:\
gw=10.17.250.250:\
ds=10.17.100.100:\
vm=rfc1048:

daka:tc=IADEF:ip=10.17.13.41:ha=00306EF38B73:
dakini:tc=IADEF:ip=10.17.13.42:ha=0013215BA67E:
karuna:tc=IADEF:ip=10.17.13.78:ha=0016353EECF4:
glimpse:tc=IADEF:ip=10.17.13.79:ha=0016353EDD2:
flor1:tc=IADEF:ip=10.17.16.133:ha=62720d1c13e8:
flor2:tc=IADEF:ip=10.17.16.134:ha=2EA8A88750D2:

The last two (flor1 and flor2) just won't boot :((
I am sure that MAC addresses are correct ...

Any help would be appreciated ...

Any ideas?

Brgds,
Sergej

[Oliver Zell_1]

I would be interested to know the error the boot fails with and how do you start the process?

[Sergej_5]

Like the other IA64 machines in EFI.
I 've added boot option to boot from LAN card.

EFI Boot Manager ver 1.10 [14.62] [Build: Mon Jan 22 11:13:36 2007]

Please select a boot option

EFI Shell [Built-in]
Lan boot
Boot option maintenance menu


Use ^ and v to change option(s). Use Enter to select an option
Loading.: Lan boot
Running LoadFile()

CLIENT MAC ADDR: 2E A8 A8 87 50 D2

PXE-E16: Valid PXE offer not received.
Load of Lan boot failed: Not Found
Paused - press any key to continue

[Ivelin Kerchev]

Hi Sergej,

ignite-ux release C.7.4.157 is not able to install Integrity systems running HP-UX 11.11

You can check out ignite release notes at http://docs.hp.com/en/IUX/docs/Cver_release_note.html

[Sergej_5]

Hi!
It is not problem for installing at all ... but in boot proccess ...

I was able to boot some IA64 machine from network ...but these particular VM images installed on RX6600 cannot find DHCP request packages from network at all ...

I always get the following error:
PXE-E16: Valid PXE offer not received.
Load of LAN failed: Not Found
Paused - press any key to continue

[wittie]

well, HPUX 11.11 is officially not supported with Itanium architectures. And Ignite does not support it. At least HPUX 11.23 must be used.

[Eric SAUBIGNAC]

Bonjour Sergej,

Ivelin, wittie, an HPUX 11.11 ignite server is OK for storing / delivering ignite Image to any 11.X serveur, Itanium or PA-RISC. The problem of course is not there.

There is just a known problem wich is fixed is the latest version of ignite when the client is a VM and the server is a PA-RISC. The problem is in the tftp transfer of the boot image, so AFTER a valide PXE has been received. The proble is still not there.

Sergej, did you validate your bootptab file with "dhcptools -v". If no do it.

If still not good, verify that your Ignite server receive the bootp query :

- start the VM and stop at EFI
- On the server, kill bootpd
- On the server, tail -f /var/adm/syslog/syslog.log
- On the VM, lan boot

You should see some lines in syslog.log.

If not, should troubleshoot at the ethernet level itself : are you on the same network, does switch block broadcast, etc ...

If OK, and still not work, add verbose option to bootpd :

- edit /etc/inetd.conf and add "-d 2" to the bootps line. It should look like :

bootps dgram udp wait root /usr/lbin/bootpd bootpd -d 2

- restart inetd : inetd -c
- Re-do the procedure. You should have more informations in syslog.log

Here is link to "Troubleshooting BOOTP and TFTP Servers" : http://docs.hp.com/en/5991-6548/ch03s05.html

Hope this will help

Regards

Eric

[Eric SAUBIGNAC]

I forgot ... you can also validate the bootp server from an other HP-UX box. It think it also should work from a VM. If the server is correctly configured "bootpquery 2EA8A88750D2" should give an answer. It doesn't work on the server itself.

And why do you have configured a bootp server relay since the IP and subnet mask let think that every node is on the same network ?

Eric

[wittie]

i can only wish you luck :) i'm pretty sure HPUX 11.11 is not supported with Integrity systems. Neither does Ignite support it. Sergej, are you really sure it's rx6600 running HP-UX 11.11? Because you must have done a magic if so.

[Eric SAUBIGNAC]

wittie -6> You are perfectly right.

But Sergej said

< I got problems to boot integrity virtual machines running on rx6600> --> Normal, HP VM on Integrity is OK

< We got installed C.7.4.157 ignite-ux on HP-UX 11.11 > --> Since HP VM can't work with 11.11 as host system or VM system, that's simply means the Integrity server is a PA-RISC box.

wittie < Neither does Ignite support it > Until recent days, yes it does. May be it has recently changed.

Eric

[Sergej_5]

Eric!

You totaly understand the problem!
I will try to troubleshot the server side and will try with -d 2 option in inetd.conf ...

Will reply what will happend :)

Thanks for the nice explanation :)

Brgds,
Sergej

[Torsten.]

You may also have a look at this document, maybe it can help you:

http://docs.hp.com/en/5992-1959/ch06s06.html

(Direct Boot Profiles for Itanium-based Systems)

[Sergej_5]

I forget to mention it ...but already tried with dbprofile command in EFI ... still got no result :(

Brgds,
Sergej

PS: Like i said above i have to try Eric suggesstion and will post the results ...

[Sergej_5]

Hi there!

I tried what you've suggested but ... still no luck :((

In log file i get after restart of inetd.conf:
Jan 14 11:04:18 bazooka inetd[726]: Rereading configuration
Jan 14 11:04:18 bazooka inetd[726]: Thru with configuration
Jan 14 11:04:18 bazooka inetd[726]: Configuration complete

No errors no nothing ...
No infos in log file at all about new connection even if i've added -d 2 in bootpd line in /etc/inetd.conf

I also tried troubleshooting bootps and tftp ...but everything seems to run smoothly ...

Brgds,
Sergej

[Sergej_5]

Hi, guess i 've found something in log file:

Jan 14 11:09:12 bazooka bootpd[28134]: reading new "/etc/bootptab"
Jan 14 11:09:12 bazooka bootpd[28134]: read 46 entries from "/etc/bootptab"
Jan 14 11:09:12 bazooka bootpd[28134]: reading "/etc/dhcpdeny"
Jan 14 11:09:12 bazooka bootpd[28134]: error opening "/etc/dhcpdeny": No such file or directory

What does it mean?

Brgds,
Sergej

[Sergej_5]

I tried all you 've suggested ...but no luck :(

I tried troubleshooting also but everythings seems to run smoothly ...

Any more ideas?

Brgds,
Sergej

[Sergej_5]

bootptab looks like:

IADEF:\
ht=ethernet:\
hn:\
bf=/opt/ignite/boot/nbp.efi:\
bs=48:\
sm=255.255.0.0:\
gw=10.17.250.250:\
ds=10.17.150.150:
dn=hermes.si:\
vm=rfc1048:
daka:tc=IADEF:ip=10.17.13.41:ha=00306EF38B73:
dakini:tc=IADEF:ip=10.17.13.42:ha=0013215BA67E:
karuna:tc=IADEF:ip=10.17.13.78:ha=0016353EECF4:
glimpse:tc=IADEF:ip=10.17.13.79:ha=0016353EDD24:
flor5:tc=IADEF:ip=10.17.16.137:ha=DEB885759203:
flor3:tc=IADEF:ip=10.17.16.135:ha=F69A7AB087A3:

inetd.conf:

tftp dgram udp wait root /usr/lbin/tftpd tftpd\
/opt/ignite\
/var/opt/ignite
bootps dgram udp wait root /usr/lbin/bootpd bootpd -d 3

Any ideas?
Brgds,
Sergej

[Eric SAUBIGNAC]

Sergej,

Good news :

Jan 14 11:09:12 bazooka bootpd[28134]: reading new "/etc/bootptab"
Jan 14 11:09:12 bazooka bootpd[28134]: read 46 entries from "/etc/bootptab"
Jan 14 11:09:12 bazooka bootpd[28134]: reading "/etc/dhcpdeny"
Jan 14 11:09:12 bazooka bootpd[28134]: error opening "/etc/dhcpdeny": No such file or directory

If it appeared when you did a "lan boot" from the VM, that means that a bootpquery as reached your ignite server. Thats is good. And don't worry about dhcpdeny : it is not mandatory.

But I find that bootpd is not very verbose. Maybe you should try with "-d 3" instead of "-d 2" ...

Did you tried the test with "bootpquery" ? I must apologize on this : it does not work well without "-f" option (Specify that bootpd should broadcast the reply back).

I suggest you test it from the rx6600. Since you can manage the others VM, you can first validate with "bootpquery 00306EF38B73 -f" (VM daka). It must work ! Then continue with "bootpquery 2EA8A88750D2 -f" (VM flor2). Does it work ?

I would suppress lines "bp=10.17.11.188:\
" (no need for a bootp relay as ignite server and vm are on the same subnet) and "vm=rfc1048:" (never used, always OK). Don't forget to kill bootpd after each modification of bootptab.

On the Ignite server, you can also test "dhcptools -d", then you find what you are waiting for in "/tmp/dhcp.dump.bootptab".

Regards

Eric

[Sergej_5]

HI Eric!

if i bootpquery:

bind: Address already in use
I get this for each query of MAC's noted in bootptab file.

In /tmp/dhcp.dump.other've found interesting version infos:

/usr/lbin/bootpd:
$Revision: 92453-07 linker linker crt0.o B.11.16 000601 $
$Revision: 1.4.214.1 $
$Date: 96/10/08 12:47:00 $
$Revision: 1.2.112.4 $
$Date: 96/02/13 16:54:54 $
/usr/lib/libdhcp.sl:
$Revision: 1.4.214.1 $
$Date: 96/10/08 12:47:00 $
$Revision: 1.2.112.4 $
$Date: 96/02/13 16:54:54 $
$Header: libdhcp.c,v 1.1.112.7 98/07/29 23:56:42 bt Exp $
/usr/sbin/dhcptools:
$Revision: 92453-07 linker linker crt0.o B.11.16 000601 $
$Header: dhcptools.c,v 1.1.112.6 96/02/13 16:54:04 bhm Exp $
/usr/sbin/bootpquery:
$Revision: vw: cheriv_JAGad35417 selectors: CUPI80_BL2000_1025 'cup_cheriv_jagad35417' \n @(
#) Thu Oct 26 23:10:46 PDT 2000 $
$Revision: 92453-07 linker linker crt0.o B.11.16 000601 $

Seems to me that all versions are so old :))

In /tmp/dhcp.dump.bootptab i can see those clients i would like to boot. ie:

flor3:\
ip=10.17.16.135:\
ht=ethernet:\
ha=F69A7AB087A3:\
sm=255.255.0.0:\
bf=/opt/ignite/boot/nbp.efi:\
bs=48:\
ds=10.17.150.150:\
gw=10.17.250.250:\
hn:

[Sergej_5]

ps -ef |grep -i boot
root 1095 1 0 Jan 10 ? 0:00 /usr/sbin/rbootd
root 28697 726 0 11:36:20 ? 0:00 bootpd -d 3

[Sergej_5]

Just for info ...
Also the phisycal machine where the Integrity VM's are running cannot boot from Ignite-UX server ...

[Sergej_5]

With -d 3 i get the following at the log file:

Jan 14 12:44:25 bazooka bootpd[28697]: stat on "/etc/dhcptab": No such file or directory
Jan 14 12:44:25 bazooka bootpd[28697]: Received DHCPREQUEST creating DHCPACK. Request data: ci = 010
004230AC7E3, req IP not sent, ciaddr 10.80.17.32, giaddr 0.0.0.0, broadcast reply off, server id not
sent.
Jan 14 12:44:25 bazooka bootpd[28697]: ACK not sent: reason = 316
Jan 14 12:43:44 bazooka bootpd[28697]: not ICMP packet
Jan 14 12:44:47 bazooka above message repeats 4 times
Jan 14 12:44:47 bazooka bootpd[28697]: Received DHCPDISCOVER creating DHCPOFFER. Request data: ci =
010004230AC7E3, req IP 10.80.17.32, ciaddr 0.0.0.0, giaddr 0.0.0.0, broadcast reply on, server id no
t sent.
Jan 14 12:44:47 bazooka bootpd[28697]: offer freed
Jan 14 12:45:09 bazooka bootpd[28697]: not ICMP packet
Jan 14 12:47:37 bazooka bootpd[28697]: Received DHCPINFORM creating DHCPACK. Request data: ci = 0100
13216964E6, req IP not sent, ciaddr 10.17.12.177, giaddr 0.0.0.0, broadcast reply off, server id not
sent.
Jan 14 12:47:42 bazooka bootpd[28697]: Received DHCPINFORM creating DHCPACK. Request data: ci = 0100
023F1F5D8F, req IP not sent, ciaddr 10.17.10.73, giaddr 0.0.0.0, broadcast reply off, server id not
sent.
Jan 14 12:47:40 bazooka bootpd[28697]: Received DHCPINFORM creating DHCPACK. Request data: ci = 0100
13216964E6, req IP not sent, ciaddr 10.17.12.177, giaddr 0.0.0.0, broadcast reply off, server id not
sent.
Jan 14 12:47:37 bazooka bootpd[28697]: stat on "/etc/dhcptab": No such file or directory
Jan 14 12:48:23 bazooka above message repeats 2 times
Jan 14 12:47:45 bazooka bootpd[28697]: Received DHCPINFORM creating DHCPACK. Request data: ci = 0100
023F1F5D8F, req IP not sent, ciaddr 10.17.10.73, giaddr 0.0.0.0, broadcast reply off, server id not
sent.
Jan 14 12:47:50 bazooka bootpd[28697]: not ICMP packet
Jan 14 12:48:23 bazooka above message repeats 8 times
Jan 14 12:48:39 bazooka bootpd[28697]: not ICMP packet

[Eric SAUBIGNAC]

Bonsoir Sergej,


Sorry for the time to answer, but out of office ...



I think you should fix that first ! If you can't start a bootp/tftp process from the harware box, I don't see how it could work with VM ...

There is a problem with your syslog file : too many informations. They probably come from Windows Clients. Anyway I can find in this log nothing interesting, I mean nothing that match your bootptab configuration.

So I think we should start again the debug session :

- From a first window, reboot the rx6600 and go to EFI SHELL.
- Open a second telnet window on PA-RISC box and issue a tail -f of /var/adm/syslog/syslog.log
- In a third telnet windows on the PA-RISC box, limit configuration in bootptab to the only rx6600 box, ensure that "-d 3" option is active with bootpd, kill bootpd.
- once you are ready, have the first 2 windows visible a the same time.
- from EFI shell, type "lanboot select" and select the appropriate interface. You should see some new data from the tail -f in the second window.
- Once boot sequence finishes, stop tail -f, issue "dhcptools -d" and post :

--- data from tail -f
--- /tmp/dhcp.dump.bootptab from dhcptools

Eric

[Eric SAUBIGNAC]

I forgot : Attached file contains some data from a successfull test I did.

Eric

[rick jones]

Just for grins I'll toss-in a few random things:

*) is the rx6600 - and the LAN card - up to date on patches?

*) you are *absolutely* certain of the MAC address(es) involved? IIRC the "core" interface of an rx6600 is a dual-port, so there could be the second MAC when doing a bare-metal. I cannot recall what HP VM does for MAC's for virtual machines.

*) The systems are on the same subnet - no routers or whatnot between them?

*) You might try sniffing the network on the hypervisor/host to see if it is indeed sending bootp/dhcp requests.