System and method for storing server images in a hosting system

• US 8,601,226 B1
• Filed: 07/21/2010
• Issued: 12/03/2013
• Est. Priority Date: 05/20/2010
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: GoGrid LLC (Apollo Global Management, Inc.)
• Inventors: Keagy, John M., Lappas, Paul, Kitagawa, Justin
• Primary Examiner(s): Thai, Tuan
• Assistant Examiner(s): LI, ZHUO H
• Application Number:
  US12/841,150
• Time in Patent Office: 1,231 Days
• Field of Search: 711/118, 711/163, 711/216, 711/E12.001, 711/E12.093, 709/203, 709/227, 709/238
• US Class Current: 711/162
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

Some embodiments provide a method for creating an image of a virtual machine. The method identifies a particular computer system operating as a virtual machine with a particular configuration on a hardware resource of a hosting system that includes several hardware resources. The method captures data representing the particular computer system. Capturing the data includes copying a particular section of the data, computing a checksum for the particular section of the data, and streaming the particular section with the computed checksum to a storage.

Claims

1. A method for creating an image of a virtual machine, the method comprising:

at a first virtual machine operating on a hardware resource of a hosting system that comprises a plurality of hardware resources, identifying a particular computer system operating as a second virtual machine with a particular configuration on the hardware resource; and

capturing data representing the particular computer system at the first virtual machine, wherein capturing the data comprises;

copying a particular section of the data;

computing a checksum for the particular section of the data; and

streaming the particular section along with the computed checksum from the first virtual machine to an image file in a storage, wherein the image file stores both the particular section and the checksum for the particular section.

2. The method of claim 1, wherein the particular section of the data is a first section, wherein the capturing further comprises:

copying a second section of the data;

computing a second checksum for the second section of the data; and

streaming the second section along with the second checksum to the image file in the storage.

3. The method of claim 1, wherein the capturing further comprises iteratively copying a section of the data, computing a checksum for the section, and streaming the section with its checksum to the image file in the storage until all of the data representing the particular computer system is streamed to the image file in the storage.

4. The method of claim 3 further comprising writing over the data representing the particular computer system with random data after all of the data is streamed to the image file in the storage.

5. The method of claim 1, wherein the image file is for use in a later deployment of a second computer system operating as a virtual machine with the particular configuration.

6. The method of claim 5, wherein the second computer system operating as a virtual machine is also on a hardware resource of the hosting system.

7. The method of claim 1, wherein the image file is stored in a compressed format.

8. The method of claim 1, wherein the particular section and the computed checksum are streamed through a caching network that comprises a plurality of cache servers.

9. The method of claim 1, wherein the storage is an external storage.

10. The method of claim 9, wherein the external storage is a cloud storage cluster.

11. The method of claim 1, wherein the first virtual machine is a utility management module that interfaces with an external caching network, an external module for managing the hosting system, a hypervisor on the hardware resource, and the particular computer system operating as a virtual machine.

12. A hosting and storage system for hosting a plurality of virtual machine configurations for a plurality of users and for storing images of the virtual machine configurations, the system comprising:

a plurality of nodes, each particular node comprising resources for hosting at least one user specified virtual machine; and

a utility management module operating using a first set of resources of a particular node, the utility management module for (i) copying data that specifies a particular computer system operating as a virtual machine on the particular node from a disk volume of the particular node, (ii) calculating checksums for sections of the data, (iii) appending the checksums to the sections of the data, and (iv) streaming the sections of the data with the appended checksums to an external storage.

13. The hosting and storage system of claim 12 further comprising the external storage for storing the data and checksums as a single image file.

14. The hosting and storage system of claim 13, wherein the data and checksums are stored with each checksum directly after the section of data for which it was calculated.

15. The hosting and storage system of claim 13 further comprising a caching network through which the sections of the data and appended checksums are streamed, the caching network for segregating the external storage and the plurality of nodes.

16. The hosting and storage system of claim 12, wherein each section of data has a size of 1 Mb.

17. The hosting and storage system of claim 12 further comprising a system management module for sending instructions to the utility management module to perform the copying, calculating, appending, and streaming.

18. A non-transitory computer readable medium storing a utility virtual machine which, when executed by at least one processing nit of a hardware resource of a hosting system, creates an image of a user virtual machine operating on the hardware resource, the utility virtual machine comprising sets of instructions for:

identifying a particular computer system operating as the user virtual machine with a particular configuration on the hardware resource of the hosting system, the hosting system comprising a plurality of hardware resources; and

capturing data representing the particular computer system, wherein the set of instructions for capturing the data comprises sets of instructions for;

copying a particular section of the data;

computing a checksum for the particular section of the data;

appending the computed checksum to the particular section; and

streaming the particular section with the appended checksum to a single image file at a storage.

19. The non-transitory computer readable medium of claim 18, wherein the set of instructions for capturing further comprises sets of instructions for iteratively copying a section of the data, computing a checksum for the section, appending the computed checksum to the section and streaming the section with its appended checksum to the single image file at the storage until all of the data representing the particular computer system is streamed to the storage.

20. The non-transitory computer readable medium of claim 19, wherein the single image file stores all of the sections of the particular computer system along with the checksums for each section.

21. The non-transitory computer readable medium of claim 20, wherein the checksum for each section of the data is stored directly after the section of data for which it was calculated.