Cloning fails

[larstr]

CMU 4.2.1

I've installed a master node with RHEL5.5 and the backup works fine. However, when I'm trying to clone the image it fails:

[10-Feb-2011_00:10:48] [CerbereClient] Extracting Backup Image
[10-Feb-2011_00:10:48] [CerbereClImg] Extracting image default
[10-Feb-2011_00:10:48] [CerbereClient] Sends status CERBST_EXTRACTING_BACKUP_IMAGE for node xxyy-xyzyx-n2
[10-Feb-2011_00:10:48] [CerbereClImg] Extracting from /opt/cmu/mnt/c1d0p1/partarchi-c1d0p1.tar.bz2 to cciss/c1d0p1
[10-Feb-2011_00:10:48] [CerbereClImg] Executing: cd /opt/cmu/mnt/c1d0p1 ; /usr/bin/pbzip2 -d -c /opt/cmu/mnt/c1d0p1/partarchi-c1d0p1.tar.bz2 | /bin/tar
xpsS -f -
[10-Feb-2011_00:10:49] [CerbereClImg] Restoring permissions to /opt/cmu/mnt/c1d0p1/partarchi-c1d0p1.tar.bz2
[10-Feb-2011_00:10:49] [CerbereClImg] Command (cd /opt/cmu/mnt/c1d0p1; /opt/cmu/tools/changepermissions.sh /opt/cmu/mnt/c1d0p1/partarchi-c1d0p1.tar.bz2
/opt/cmu/mnt/c1d0p1) Build
[10-Feb-2011_00:10:49] [CerbereClImg] Executing: cd /opt/cmu/mnt/c1d0p1; /opt/cmu/tools/changepermissions.sh /opt/cmu/mnt/c1d0p1/partarchi-c1d0p1.tar.b
z2 /opt/cmu/mnt/c1d0p1
[10-Feb-2011_00:10:49] [CerbereClImg] Extracting from /opt/cmu/mnt/c1d0p2/partarchi-c1d0p2.tar.bz2 to cciss/c1d0p2
[10-Feb-2011_00:10:49] [CerbereClImg] Executing: cd /opt/cmu/mnt/c1d0p2 ; /usr/bin/pbzip2 -d -c /opt/cmu/mnt/c1d0p2/partarchi-c1d0p2.tar.bz2 | /bin/tar
xpsS -f -
[10-Feb-2011_00:11:29] [CerbereClImg] Restoring permissions to /opt/cmu/mnt/c1d0p2/partarchi-c1d0p2.tar.bz2
[10-Feb-2011_00:11:29] [CerbereClImg] Command (cd /opt/cmu/mnt/c1d0p2; /opt/cmu/tools/changepermissions.sh /opt/cmu/mnt/c1d0p2/partarchi-c1d0p2.tar.bz2
/opt/cmu/mnt/c1d0p2) Build
[10-Feb-2011_00:11:29] [CerbereClImg] Executing: cd /opt/cmu/mnt/c1d0p2; /opt/cmu/tools/changepermissions.sh /opt/cmu/mnt/c1d0p2/partarchi-c1d0p2.tar.b
z2 /opt/cmu/mnt/c1d0p2
[10-Feb-2011_00:11:29] [CerbereClient] Reconfiguring
[10-Feb-2011_00:11:29] [CerbereClient] Sends status CERBST_EXECUTING_POST_RECONF for node xxyy-xyzyx-n2
[10-Feb-2011_00:11:29] [CerbereRcfg] No reconfiguration specified
[10-Feb-2011_00:11:29] [CerbereClient] Fstab-label file does not exist
[10-Feb-2011_00:11:29] [CerbereClient] No label reconfiguration needed
[10-Feb-2011_00:11:29] [CerbereClient] Fstab-id file does not exist
[10-Feb-2011_00:11:29] [CerbereClient] No id reconfiguration needed
[10-Feb-2011_00:11:29] [CerbereRcfg] Reconfiguring with script "/opt/cmu/tools/cmu_post_cloning"
[10-Feb-2011_00:11:29] [CerbereRcfg] Executing "/opt/cmu/tools/cmu_post_cloning "/opt/cmu/mnt/c1d0p1" "xxyy-xyzyx-n2" "(none)" 10.20.30.102 255.255.2
55.0"
[10-Feb-2011_00:11:29] [CerbereClient] Set the boot: Configuring Bootloader
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 rm -f /etc/mtab CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CMUTools ] about to run: -->chroot /opt/cmu/mnt/c1d0p1 rm -f /etc/mtab &> /opt/cmu/tmp/CMU_TEMPO_FILE_PoFmCG<-- cm
u_system_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `rm': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 rm -f /etc/mtab ), not fatal CMUCrbrInstallBootLoade
r
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 mv /etc/fstab /etc/fstab.cmu.labels CMUCrbrInstallBootLoader
O_FILE_GVm2lb<-- cmu_system_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `mv': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 mv /etc/fstab /etc/fstab.cmu.labels ), not fatal CMU
CrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 touch /etc/fstab CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CMUTools ] about to run: -->chroot /opt/cmu/mnt/c1d0p1 touch /etc/fstab &> /opt/cmu/tmp/CMU_TEMPO_FILE_D378yG<-- c
mu_system_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `touch': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 touch /etc/fstab ), not fatal CMUCrbrInstallBootLoad
er
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 mount -f /dev/cciss/c1d0p1 / CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CMUTools ] about to run: -->chroot /opt/cmu/mnt/c1d0p1 mount -f /dev/cciss/c1d0p1 / &> /opt/cmu/tmp/CMU_TEMPO_FILE_
eoBkYe<-- cmu_system_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `mount': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 mount -f /dev/cciss/c1d0p1 / ), not fatal CMUCrbrIns
tallBootLoader
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 mv /etc/fstab.cmu.labels /etc/fstab CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CMUTools ] about to run: -->chroot /opt/cmu/mnt/c1d0p1 mv /etc/fstab.cmu.labels /etc/fstab &> /opt/cmu/tmp/CMU_TEMP
O_FILE_3Fvg1L<-- cmu_system_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `mv': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 mv /etc/fstab.cmu.labels /etc/fstab ), not fatal CMU
CrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 mount /proc CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CMUTools ] about to run: -->chroot /opt/cmu/mnt/c1d0p1 mount /proc &> /opt/cmu/tmp/CMU_TEMPO_FILE_0H9ICj<-- cmu_sy
stem_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `mount': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 mount /proc ), not fatal CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 mount /boot CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CMUTools ] about to run: -->chroot /opt/cmu/mnt/c1d0p1 mount /boot &> /opt/cmu/tmp/CMU_TEMPO_FILE_xofm5T<-- cmu_sy
stem_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `mount': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 mount /boot ), may not be fatal if you don't have a
separate /boot CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 mount /usr CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CMUTools ] about to run: -->chroot /opt/cmu/mnt/c1d0p1 mount /usr &> /opt/cmu/tmp/CMU_TEMPO_FILE_IZxm1u<-- cmu_sys
tem_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `mount': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 mount /usr ), not fatal if /usr is not a separate pa
rtition CMUCrbrInstallBootLoader
[10-Feb-2011_00:11:29] [CerbereClient] (info) -->/opt/cmu/mnt/c1d0p1//etc/lilo.conf<-- file does not exist CMUCheckFileExists
[10-Feb-2011_00:11:29] [CerbereClient] (info) -->/opt/cmu/mnt/c1d0p1//boot/grub/menu.lst<-- file does not exist CMUCheckFileExists
[10-Feb-2011_00:11:29] [CerbereClient] Executing: chroot /opt/cmu/mnt/c1d0p1 /sbin/lilo CMUInstallLilo
[10-Feb-2011_00:11:29] [CMUTools ] about to run: -->chroot /opt/cmu/mnt/c1d0p1 /sbin/lilo &> /opt/cmu/tmp/CMU_TEMPO_FILE_ZfKXe4<-- cmu_sys
tem_helper
[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `/sbin/lilo': No such file or directory

[10-Feb-2011_00:11:29] [CerbereClient] Non zero returned status: 32512 (chroot /opt/cmu/mnt/c1d0p1 /sbin/lilo ) CMUInstallLilo
[10-Feb-2011_00:11:29] [CerbereClient] Error while extracting Backup Image
[10-Feb-2011_00:11:29] [CerbereClient] Error in Cerbere Secondary Client
[10-Feb-2011_00:11:29] [CerbereClient] Sends status CERBST_ERROR for node xxyy-xyzyx-n2
[10-Feb-2011_00:11:29] [CerbereServer] Error in Cerbere Secondary Server Boot phase
[10-Feb-2011_00:11:29] [CerbereNB] Netboot cleaning (/etc)
[10-Feb-2011_00:11:29] [CerbereNB] Netboot opens /etc/exports
[10-Feb-2011_00:11:29] [CerbereNB] Removing netboot tags in file /etc/exports
[10-Feb-2011_00:11:29] [CerbereServer] Error while registering server2 as producer
[10-Feb-2011_00:11:30] [CerbereNB] Netboot cleaning (/etc)
[10-Feb-2011_00:11:30] [CerbereNB] Netboot opens /etc/exports
[10-Feb-2011_00:11:30] [CerbereNB] Removing netboot tags in file /etc/exports
[10-Feb-2011_00:11:30] [CerbereDB] Database report:
[10-Feb-2011_00:11:30] [CerbereDB] | cloned | error | unknown
[10-Feb-2011_00:11:30] [CerbereDB] xyzyx-net1 | 0 | 0 | 0
[10-Feb-2011_00:11:30] [CerbereDB] Total | 0 | 0 | 0
[10-Feb-2011_00:11:30] [CerbereTypes] Delete Cerbere Data
[10-Feb-2011_00:11:30] [CerbereTypes] Delete Cerbere Data - Stage 0
[10-Feb-2011_00:11:30] [CerbereTypes] Delete Cerbere Data - Stage 1
[10-Feb-2011_00:11:30] [CerbereTypes] Delete Cerbere Data - Stage 2
[10-Feb-2011_00:11:30] [CerbereTypes] Delete Cerbere Data - Stage 3
[10-Feb-2011_00:11:30] Cerbere is terminating with status 0

Any ideas?

Lars

[larstr]

If I boot the RHEL55 CD in rescue mode and mount the partitions I'm fully able to chroot into the install. Why CMU is unable to do so is a big question....

[Alzhy]

Whoa.. yer building an HPC Cluster?

Hopefully some HPC afficionado is lurking here. Else, suggest you hit http://hp.com/go/cmu and check if there is anything out of of spec to what you are trying to do and if RHEL 5.5 is even supported.

This too:
http://h20338.www2.hp.com/HPC/cache/618125-0-0-0-121.html

You using Myrinet? or HP's brand of Innfiniband?

[narenc]

Hello,

>>about to run: -->chroot /opt/cmu/mnt/c1d0p1 touch /etc/fstab &> /opt/cmu/tmp/CMU_TEMPO_FILE_D378yG<-- c
mu_system_helper
>>[10-Feb-2011_00:11:29] [CMUTools ] log:chroot: cannot run command `touch': No such file or directory

Looks like the nodes undergoing cloning are not able to access the commands in the "/"
partition of the backup image.

Have you specified the correct device name for the root partition during backup/cloning?

This forum is for generic cmu questions/discussions
only. These sort of issues must
be escalated through standard HP support
channels.

-Naren.

[larstr]

We figured this out. We were trying to clone using the default logical group. The solution was to use a different logical group.


..and yes, we're building a HPC cluster. Hope to see increased activity in this forum. :)

Lars

[Chris Holmes (CMU)]

This is fixed now. CMU v5.1 will now error if you attempt to clone with the 'default' logical group.

Hope you got your HPC cluster up and running!