ON DEMAND VIRTUAL MACHINE IMAGE STREAMING

• US 20120066677A1
• Filed: 09/10/2010
• Published: 03/15/2012
• Est. Priority Date: 09/10/2010
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Tang, Chunqiang
• Granted Patent: US 8,490,088 B2
• Time in Patent Office: Days
• US Class Current: 718/1
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 9/4856 resumption being on a different machine, e.g. task migration, virtual machine migration G06F9/5088 takes precedence

Abstract

On demand image streaming (ODS), in one aspect, may perform both copy-on-write and copy-on-read to gradually bring data on remote storage server to a host'"'"'s local disk. Prefetching may be performed during the time the resources are otherwise idle to bring in data from the remote storage server to the host'"'"'s local disk. A new image format and the corresponding block device driver for a hypervisor or the like may be also provided. ODS'"'"' image format may include a header and a bitmap that indicates whether the data sectors are on local disk or remote storage server, and an image content, for instance, stored in raw format.

Claims

1. A method for on demand virtual machine image streaming, comprising:

copying, from a storage server storing one or more image templates corresponding respectively to one or more virtual machines, an image metadata associated with a selected virtual machine to a host computer'"'"'s local storage, wherein the host computer'"'"'s local storage initially does not include an image of the selected virtual machine;

booting the selected virtual machine at the host computer using the copied image metadata;

allowing the selected virtual machine to read data from the image template on the storage server needed to continue executing the selected virtual machine at the host computer, if the needed data are not stored on the host computer'"'"'s local storage;

copying the read data of the image template to the host computer'"'"'s local storage from the storage server, if the read data of the image template are not stored on the host computer'"'"'s local storage, wherein subsequent reads to the same data are done from the host computer'"'"'s local storage;

setting a bit in a bitmap to indicate that the read data are stored on the host computer'"'"'s local storage; and

utilizing resource idle time to prefetch data of the image template associated with the selected virtual machine from the storage server to the host computer'"'"'s local storage.

2. The method of claim 1, wherein the image metadata initially includes a reference to the image template and the bitmap that maps a bit to a corresponding sector of the image template.

3. The method of claim 1, wherein response times are monitored during image prefetching and prefetching is temporarily paused if a response time exceeds a threshold value.

4. The method of claim 1, wherein the size of the bitmap is proportional to the size of the image template on the storage server rather than the size of the corresponding image stored on the host computer'"'"'s local storage.

5. The method of claim 1, wherein a complete copy of the bitmap can be kept in memory.

6. The method of claim 1, wherein the selected virtual machine'"'"'s read and/or write requests for a sector whose logical block address is beyond the size of the image template on the storage server are handled by reading and/or writing the sector directly in the host computer'"'"'s local storage without checking the bitmap and/or without updating the bitmap.

7. The method of claim 1, wherein after the prefetching finishes, one or more disk read and/or write requests issued by the selected virtual machine are executed using image data stored on the host computer'"'"'s local storage directly, without checking the bitmap and/or updating the bitmap.

8. The method of claim 1, the bitmap is kept in memory and on disk at the host computer and wherein a copy-on-read operation only updates the in-memory bitmap and does not immediately update the on-disk bitmap.

9. The method of claim 1, wherein a copy-on-read operation is not on the critical path of returning the data to the VM, and the data are saved to the ODS image asynchronously in the background while the VM continues to process the data read from the backing image.

10. The method of claim 1, wherein if a data sector in the image template on the storage server is completely filled with zeros, initial state of the data sector in the bitmap stored on host computer'"'"'s local storage is set as if the data sector is already copied to the host computer'"'"'s local storage.

11. The method of claim 1, wherein the method is implemented in a hypervisor, providing functionalities of the hypervisor without modifications to the selected virtual machine.

12. A method for on demand virtual machine image streaming, comprising:

copying an image metadata associated with a virtual machine, from a source computer storing an image template corresponding to the virtual machine to a target computer, wherein the target computer initially does not include the image template of the virtual machine;

booting the virtual machine at the target computer using the copied image metadata;

allowing the virtual machine at the target computer to read data of the image template on the source computer needed to continue executing the virtual machine at the target computer, if the needed data of the image template are not stored on the target computer;

copying the read data of the image template from the source computer to the target computer, if the read data of the image template are not stored on the target computer wherein subsequent reads of the same data read the copied data at the target computer; and

setting a bit in a bit map to indicate that the read data are stored on the target computer.

13. The method of claim 12, wherein the image metadata initially includes a reference to the image template and the bitmap that maps a bit to a corresponding sector of the image template.

14. The method of claim 12, further including determining whether the data needed to run the virtual machine is stored on the target computer by checking the bit in the bit map, wherein depending on the bit in the bit map, the virtual machine reads data from the source computer or from the target computer.

15. The method of claim 12, further including utilizing resource idle time to prefetch data of the image template associated with the virtual machine from the source computer to the target computer.

16. The method of claim 12, wherein the steps are performed for live migration of the virtual machine from the source computer to the target computer wherein a separate storage server is not utilized.

17. A computer readable storage medium storing a program of instructions executable by a machine to perform a method for on demand virtual machine image streaming, comprising:

copying, from a storage server storing one or more image templates corresponding respectively to one or more virtual machines, an image metadata associated with a selected virtual machine to a host computer'"'"'s local storage, wherein the host computer'"'"'s local storage initially does not include an image template of the selected virtual machine;

booting the selected virtual machine at the host computer using the copied image metadata;

allowing the selected virtual machine to read data from the image template on the storage server needed to continue executing the selected virtual machine at the host computer, if the needed data are not stored on the host computer'"'"'s local storage;

copying the read data of the image template to the host computer'"'"'s local storage from the storage server, if the read data of the image template are not stored on the host computer'"'"'s local storage, wherein subsequent reads to the same data are done from the host computer'"'"'s local storage; and

setting a bit in a bitmap to indicate that the read data are stored on the host computer'"'"'s local storage.

18. The computer readable storage medium of claim 17, wherein the image metadata initially includes a reference to the image template.

19. The computer readable storage medium claim 18, wherein the image metadata further includes the bitmap that maps a bit to a corresponding sector of the image template.

20. The computer readable storage medium of claim 17, further including determining whether the data of the image template needed to run the selected virtual machine is stored on the host computer'"'"'s local storage by checking the bit in the bit map, wherein depending on the bit in the bit map, the selected virtual machine reads the image template on the storage server or copied image template on the host computer'"'"'s local storage.

21. The computer readable storage medium of claim 17, further including utilizing resource idle time to prefetch data of the image template associated with the selected virtual machine from the storage server to the host computer'"'"'s local storage.

22. A system on demand virtual machine image streaming, comprising:

a target computer operable to copy an image metadata associated with a virtual machine, from a source computer storing an image template corresponding to the virtual machine, wherein the target computer initially does not include the image template of the virtual machine; and

a storage device locally attached to the target computer,

the target computer further operable to boot the virtual machine at the target computer using the copied image metadata and allow the virtual machine at the target computer to read data of the image template on the source computer needed to continue executing the virtual machine at the target computer, if the needed data of the image template are not stored on the target computer,

the target computer further operable to copy the read data of the image template from the source computer to the storage device locally attached to the target computer, if the read data of the image template are not stored on the target computer, wherein subsequent reads of the same data are done from the storage device locally attached to the target computer,

the target computer further operable to set a bit in a bit map to indicate that the read data are stored on the target computer.

23. The system of claim 22, wherein the image metadata initially includes a reference to the image template.

24. The system of claim 23, wherein the image metadata further includes the bitmap that maps a bit to a corresponding sector of the image template.

25. The system of claim 22, further including utilizing resource idle time to prefetch data of the image template associated with the virtual machine from the source computer to the target computer.