topic Re: Hot Adding Disk to Virtualized Guest in Operating System - Linux

Hot Adding Disk to Virtualized Guest

Eric Singer — Thu, 21 Jan 2010 17:55:07 GMT

This year one of my projects is to move our production application environment into a VM. One of the problems I've foreseen using our current Xen based Virutalization is that I can not add a disk into a running Guest VM. So far the only way I've been able to add disks to any of our guest VMs is to shut them down, add the disks to the configuration file and start the VM.

Our current traditional server based environment allows me to add disks on the fly, but I haven't seen a Linux virtualization solution that will allow this.

Does anyone know how to add disks hot into a Xen guest, or does the new KVM based virtualization allow you to do this?

Thanks
Eric Singer

Re: Hot Adding Disk to Virtualized Guest

Steven E. Protter — Thu, 21 Jan 2010 19:51:08 GMT

Shalom Eric,

Every solution I've seen requires you to down the system before adding disk.

If your system has access to a Fiber Channel adapter, a LUN can be presented to the World Wide Name (WWN) of the Fiber Channel adapter and additional space may be able to be added via LVM without a boot.

SEP

Re: Hot Adding Disk to Virtualized Guest

Eric Singer — Thu, 21 Jan 2010 20:07:21 GMT

We are using Fiber Channel adapters to our servers. Adding and removing disks to Dom0 by way of SCSI bus scans is pretty easy, however adding that disk to a running DomU is problematic.

In todayâ s non-virtual environment I do not have to bring down our production environment to add diskspace. Just presented the LUN and scan the scsi bus, no downtime taken and nobody notices a thing. Iâ d very much like that in our new virtual environment.

Thanks

Re: Hot Adding Disk to Virtualized Guest

J. Maestre — Fri, 22 Jan 2010 08:54:36 GMT

Apparently you can to that with the "xm block-attach" command.

Re: Hot Adding Disk to Virtualized Guest

Eric Singer — Fri, 22 Jan 2010 12:23:46 GMT

Thank you very much! I'll test that out.

Re: Hot Adding Disk to Virtualized Guest

westb — Fri, 22 Jan 2010 13:17:00 GMT

This is what we do:
1. Create a new lun, get the WWN and create an entry in /etc/multipath.conf. Use friendly names, easier to keep track of things.
2. Present the new lun to dom0
3. On dom0, scan for the new disk using:
echo "- - -" > /sys/class/scsi_host/host0/scan
echo "- - -" > /sys/class/scsi_host/host1/scan
4. Attach the new disk to the running domU using:
xm block-attach domU_name phy:/dev/mapper/new_disk xvdm w

In this example, the new disk on the domU will be named xvdm. Then you can put it into an existing VG and dynamically grow a filesystem.

There are a couple of gotchas using this method:
1. You need to modify the domU config file and add in the new disk or it won't be there the next time you start it.
2. Attaching the new disk using xm is not very forgiving; i.e. wrong disk name, attach wrong disk etc. You can also do this with virt-manager and also using virsh.

Re: Hot Adding Disk to Virtualized Guest

Eric Singer — Fri, 22 Jan 2010 13:44:19 GMT

Fantastic! I was able to hot add and remove a test disk.

[root@rllxovf5 ~]# xm block-attach 426_rloveric phy:/dev/mapper/Eric_Test_Disk1 sda w

[root@rloveric ~]# mkfs -t ext3 /dev/sda1
[root@rloveric ~]# mkdir /test
[root@rloveric ~]# mount /dev/sda1 /test
[root@rloveric ~]# umount /test

[root@rllxovf5 ~]# xm block-detach 426_rloveric sda

Thank you for all your help!
Eric Singer

Re: Hot Adding Disk to Virtualized Guest

Eric Singer — Fri, 22 Jan 2010 13:45:12 GMT

Solution Found, closing thread.