Bandwidth-efficient virtual machine image delivery

• US 9,424,061 B2
• Filed: 04/30/2013
• Issued: 08/23/2016
• Est. Priority Date: 04/30/2013
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Freimuth, Douglas M., Wong, Ho Yin Starsky, Zafer, Murtaza
• Primary Examiner(s): WU, BENJAMIN C
• Application Number:
  US13/873,337
• Publication Number:
  US 20140325505A1
• Time in Patent Office: 1,211 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/14 Error detection or correction of the data by redundancy in operation G06F11/16 takes precedence
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

A mechanism is provided for bandwidth-efficient virtual machine image delivery. Responsive to a request to generate a virtual machine (VM) in a node using an existing virtual machine image (VMI) file, a set of file chunks that constitute the VMI file is identified. The set of file chunks are retrieved from within a set of distributed nodes by establishing an optimized plan for retrieving the set of file chunks in a bandwidth-efficient manner. Responsive to retrieving the set of file chunks from within the distributed nodes, the set of file chunks are reassembled into the VMI file for generation of the VM.

Claims

1. A computer program product comprising a non-transitory computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to:

responsive to a request to generate a virtual machine (VM) in a node using an existing virtual machine image (VMI) file, identify a set of file chunks that constitute the VMI file;

retrieve the set of file chunks from within a set of distributed nodes, wherein retrieving the set of file chunks from within the set of distributed nodes comprises establishing an optimized plan for retrieving the set of file chunks in a bandwidth-efficient manner, wherein the optimized plan is established by the computer readable program further causing the computing device to;

for each file chunk in the set of file chunks, determine whether the file chunk exists in a local storage device;

responsive to the file chunk existing in the local storage device, retrieve the file chunk from the local storage device; and

responsive to the file chunk failing to exist in the local storage device;

identify one or more locations of the file chunk in one or more other nodes within the set of distributed nodes;

responsive to the file chunk existing in more than one node of the one or more other nodes, identify an optimal node to retrieve the file chunk based on a set of criteria associated with each of the more than one other node, wherein the set of criteria comprises historical data associated with accessing the node, priority of accessing the node, grouping of the file chunk with other file chunks to be retrieved from the node, and access-control policies associated with accessing file chunks in the one or more other nodes; and

responsive to identifying an optimal node, retrieve the file chunk from a storage device associated with the optimal node; and

responsive to retrieving the set of file chunks from within the set of distributed nodes, reassemble the set of file chunks into the VMI file for generation of the VM.

2. The computer program product of claim 1, wherein the set of criteria further comprises bandwidth access to the node and how the file chunk is stored with other file chunks in the node.

3. The computer program product of claim 1, wherein a location of each file chunk failing to exist in the local storage device is identified from a metadata table, wherein the metadata table comprises information about each file chunk, and wherein the information comprises one or more of a chunk-hash, a size, a start-offset in the VMI file, or original file-name where the file chunk belongs.

4. The comp ter program product of claim 3, wherein the location of each file chunk failing to exist in the local storage device is identified from metadata that is aggregated into the metadata table from the one or more other nodes.

5. The computer program product of claim 4, wherein the metadata is aggregated into the metadata table when a new VMI file is generated, at periodic intervals, or at scheduled intervals.

6. The computer program product of claim 1, wherein the set of file chunks that constitute the VMI file are identified from a manifest file associated with the VMI file.

7. The computer program product of claim 6, wherein the manifest file is generated in at least one of the node where the VM is being generated or another node of the one or more other nodes and wherein, responsive to the manifest file being generated in the other node of the one or more other nodes then the manifest file is aggregated into the node where the VM is being generated.

8. An apparatus comprising:

a processor; and

a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to;

responsive to a request to generate a virtual machine (VM) in a node using an existing virtual machine image (VMI) file, identify a set of file chunks that constitute the VMI file;

retrieve the set of file chunks from within a set of distributed nodes, wherein retrieving the set of file chunks from within the set of distributed nodes comprises establishing an optimized plan for retrieving the set of file chunks in a bandwidth-efficient manner, wherein the optimized plan is established by the instructions further causing the processor to;

for each file chunk in the set of file chunks, determine whether the file chunk exists in a local storage device;

responsive to the file chunk existing in the local storage device, retrieve the file chunk from the local storage device; and

responsive to the file chunk failing to exist in the local storage device;

identify one or more locations of the file chunk in one or more other nodes within the set of distributed nodes;

responsive to the file chunk existing in more than one node of the one or more other nodes, identify an optimal node to retrieve the file chunk based on a set of criteria associated with each of the more than one other node, wherein the set of criteria comprises historical data associated with accessing the node, priority of accessing the node, grouping of the file chunk with other file chunks to be retrieved from the node and access-control policies associated with accessing file chunks in the one or more other nodes; and

responsive to identifying an optimal node, retrieve the file chunk from a storage device associated with the optimal node; and

responsive to retrieving the set of file chunks from within the set of distributed nodes, reassemble the set of file chunks into the VMI file for generation of the VM.

9. The apparatus of claim 8, wherein the set of criteria further comprises bandwidth access to the node and how the file chunk is stored with other file chunks in the node.

10. The apparatus of claim 8, wherein a location of each file chunk failing to exist in the local storage device is identified from a metadata table, wherein the metadata table comprises information about each file chunk, and wherein the information comprises one or more of a chunk-hash, a size, a start-offset in the VMI file, or original file-name where the file chunk belongs.

11. The apparatus of claim 10, wherein the location of each file chunk failing to exist in the local storage device is identified from metadata that is aggregated into the metadata table from the one or more other nodes.

12. The apparatus of claim 11, wherein the metadata is aggregated into the metadata table when a new VMI file is generated, at periodic intervals, or at scheduled intervals.

13. The apparatus of claim 8, wherein the set of file chunks that constitute the VMI file are identified from a manifest file associated with the VMI file.

14. The apparatus of claim 13, wherein the manifest file is generated in at least one of the node where the VM is being generated or another node of the one or more other nodes and wherein, responsive to the manifest file being generated in the other node of the one or more other nodes then the manifest file is aggregated into the node where the VM is being generated.