Method and system for the transparent migration of virtual machines storage

• US 20080222375A1
• Filed: 02/20/2008
• Published: 09/11/2008
• Est. Priority Date: 02/21/2007
• Status: Active Grant

• Current Assignee: Zimory GmbH
• Original Assignee: Deutsche Telekom AG, Technische Universitã¤T Berlin (Tu)
• Inventors: Bradford, Robert, Kotsovinos, Evangelos
• Granted Patent: US 7,900,005 B2
• Time in Patent Office: Days
• US Class Current: 711/162
• CPC Class Codes: G06F 2003/0697 device management, e.g. handlers, drivers, I/O schedulers
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 3/0601 Interfaces specially adapted for storage systems
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system

Abstract

Method for transferring storage data of a virtual machine to be migrated from a first host device to a second host device via a communication network, including: running the virtual machine on the first host device; storing, on a local storage device of the first host device, a disk image used by the virtual machine; detecting, while the virtual machine is running on the first host device, any changes made to the disk image used by the virtual machine; establishing a connection over the communication network from the first host device to the second host device; transferring, to the second host device while the virtual machine is running on the first host device, the disk image used by the virtual machine and the detected any changes made; modifying the disk image transferred to the second host device in response to the detected any changes transferred to the second host device; and starting, using the modified disk image, a migrated virtual machine on the second host device at a current state of the virtual machine running on the first host device.

Claims

1. A method for transferring storage data of a virtual machine to be migrated from a first host device to a second host device via a communication network, the method comprising:

a) running the virtual machine on the first host device;

b) storing, on a local storage device of the first host device, a disk image used by the virtual machine;

c) detecting, while the virtual machine is running on the first host device, any changes made to the disk image used by the virtual machine;

d) establishing a connection over the communication network from the first host device to the second host device;

e) transferring, to the second host device while the virtual machine is running on the first host device, the disk image used by the virtual machine and the detected any changes made;

f) modifying the disk image transferred to the second host device in response to the detected any changes transferred to the second host device; and

g) starting, using the modified disk image, a migrated virtual machine on the second host device at a current state of the virtual machine running on the first host device.

2. The method according to claim 1, wherein step c) includes intercepting, at least during the transfer of the disk image from the first host device to the second host device, any write operations that occur on the disk image used by the virtual machine of the first host device and generating a plurality of parameters which represent the modifications of the disk image resulting from the respective write operations, and wherein step e) includes transferring the plurality of parameters from the first host device to the second host device, wherein the plurality of parameters are queued at the second host device in the order in which they have been generated by the virtual machine running on the first host device.

3. The method according to claim 2, wherein the parameters queued at the second host device are applied to the disk image transferred to the second host device in the order in which they occurred at the first host device.

4. The method according to claim 1, wherein step e) includes transferring a memory state of the virtual machine running on the first host device to the second host device without interrupting the virtual machine running on the first host device.

5. The method according to claim 4, wherein the memory state is transferred after completion of the transferring of the disk image.

6. The method according to claim 5, wherein step c) includes intercepting, during the transfer of the disk image and the memory state from the first host device to the second host device, any write operation that occur on the disk image used by the virtual machine running on the first host device and generating a plurality of parameters which represent the modifications of the disk image resulting form the respective write operations.

7. The method according to claim 6, wherein after the transfer of the memory state the virtual machine running on the first host device is paused and the migrated virtual machine is started at the second host device.

8. The method according to claim 1, wherein the communication network includes at least one of a TCP/IP based computer network and another network configured for in-order and reliable end-to-end delivery of transmitted information, and wherein step e) includes transferring at least data of the disk image block-wise from the first host device to the second host device.

9. The method according to claim 1, further comprising defining a threshold for a number of write operations which can be executed by the virtual machine running on the first host device during a predetermined time period and delaying by an adjustable delay value the write operations exceeding the threshold.

10. The method according to claim 1, wherein the method is performed in a Xen environment.

11. A computer system for transferring over a communication network storage data of a virtual machine to be migrated, the system comprising:

a source host device configured to run the virtual machine thereon, the source host device including;

a local storage device configured to store a disk image used by the virtual machine;

a detecting arrangement configured to detect any changes made to the disk image while the virtual machine is running on the source host device;

a migration arrangement configured to establish a connection to the destination host device over the communication network;

a copying arrangement configured to pre-copy, to the destination host device, the stored disk image without stopping the virtual machine; and

a destination host device including;

a storage arrangement configured to store the transferred disk image and the detected any changes made; and

a starting arrangement configured to start a migrated virtual machine at a current state of the virtual machine running on the source host device.

12. The computer system according to claim 11, wherein the detecting arrangement is configured to intercept, at least during the transfer of the disk image from the source host device to the destination host device, any write operation that occur on the disk image used by the virtual machine of the source host device and to generate a plurality of parameters which represent the changes of the disk image resulting from the respective write operations, and wherein the transferring arrangement is configured to transfer the plurality of parameters from the source host device to the destination host device, and wherein the plurality of parameters are queued at the storage arrangement of the destination host device in the order in which they have been generated by the at least one virtual machine running on the source host device.

13. The computer system according to claim 11, wherein the source host device includes a storage arrangement configured to store a memory state of the virtual machine running on the source host device, and wherein the transferring arrangement is configured to transfer the memory state to the destination host device without interrupting the virtual machine running on the source host device.

14. The computer system according to claim 11, wherein the communication network includes at least one of a TCP/IP based computer network and another network configured for in-order and reliable end-to-end delivery of transmitted information, and wherein at least disk image data is transferred block-wise from the source host device to the destination second host device.

15. The computer system according to claim 11, wherein at least one of the source and destination hosts include a host running Xen or a XenoServer.

16. A computer-readable medium having stored thereon a set of instructions that are executable by a control unit to perform a method for transferring storage data of a virtual machine to be migrated from a first host device to a second host device via a communication network, and including:

a) running the virtual machine on the first host device;

b) storing, on a local storage device of the first host device, a disk image used by the virtual machine;

c) detecting, while the virtual machine is running on the first host device, any changes made to the disk image used by the virtual machine;

d) establishing a connection over the communication network from the first host device to the second host device;

e) transferring, to the second host device while the virtual machine is running on the first host device, the disk image used by the virtual machine and the detected any changes made;

f) modifying the disk image transferred to the second host device in response to the detected any changes transferred to the second host device; and

g) starting, using the modified disk image, a migrated virtual machine on the second host device at a current state of the virtual machine running on the first host device.