System and method for efficiently building virtual appliances in a hosted environment

• US 8,176,094 B2
• Filed: 06/01/2009
• Issued: 05/08/2012
• Est. Priority Date: 05/30/2008
• Status: Active Grant

• Current Assignee: SUSE, LLC (SUSE Software Solutions Germany GmbH)
• Original Assignee: Novell Incorporated (Open Text Corporation)
• Inventors: Friedman, Nathaniel
• Primary Examiner(s): SYED, FARHAN M
• Application Number:
  US12/476,196
• Publication Number:
  US 20090300057A1
• Time in Patent Office: 1,072 Days
• Field of Search: None
• US Class Current: 707/803
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software

Abstract

A system and method for efficiently building virtual appliances in a hosted environment is provided. In particular, a plurality of image archives may be stored in a build database, with each image archive including a file system having a directory structure and a plurality of files installed within the directory structure. In response to a build request containing an image description, a build engine may create a file system layout defining a directory structure for an image. The build engine may then copy the file system for one of the image archives to the file system layout for the image, wherein the copied file system may provide a subset of the file system for the image. The build engine may then build the image, which may include a file system having various files installed within various directories in accordance with the directory structure defined for the image.

Claims

1. A system for efficiently building virtual appliances in a hosted environment, comprising:

a build database configured to store reusable image archives having file systems with one or more files installed in one or more directories, wherein the reusable image archives collect all the files installed in the one or more directories and preserve information relating to the one or more directories associated with the file systems;

a build engine configured to;

associate the reusable image archives stored in the build database with manifest files that list unique identifiers associated with one or more software components corresponding to all the files installed in the one or more directories associated with the reusable image archive file systems;

receive a build request that includes an image description associated with a virtual appliance;

create, from the image description associated with the virtual appliance, a root file system having a root directory structure that defines a layout associated with all files and directories to install in an operating system image associated with the virtual appliance;

add all the files in the file system associated with one of the reusable image archives that provides a perfect subset of the root file system to the root directory structure in the operating system image associated with the virtual appliance, wherein the one of the reusable image archives provides the perfect subset of the root file system when all the files in the file system associated therewith are to be installed in the operating system image associated with the virtual appliance; and

build the operating system image associated with the virtual appliance, wherein the operating system image includes all the files and directories installed therein in accordance with the root directory structure that defines the layout associated therewith;

a repository metadata server configured to detect an update to one or more software components stored in one or more source repositories; and

a virtualization environment configured to;

invalidate all the reusable image archives associated with manifest files that list unique identifiers associated with the one or more updated software components; and

invoke the build engine to rebuild the file systems associated with the invalidated reusable image archives, wherein the rebuilt file systems have one or more files corresponding to the one or more updated software components installed in the one or more directories associated therewith.

2. The system of claim 1, wherein the build engine is further configured to:

create, from the image description associated with the virtual appliance, a boot file system having a boot directory structure that defines a layout associated with all files and directories to install in a boot image associated with the virtual appliance;

add all the files in the file system associated with another one of the reusable image archives that provides a perfect subset of the boot file system to the boot directory structure in the boot image associated with the virtual appliance;

build the boot image associated with the virtual appliance, wherein the boot image includes all the files and directories installed therein in accordance with the boot directory structure that defines the layout associated therewith; and

build an appliance image corresponding to the virtual appliance, wherein the appliance image includes the operating system image and the boot image.

3. The system of claim 2, wherein the build engine is further configured to:

identify at least one personalization option in the build request that applies a custom graphic to a boot screen associated with the virtual appliance, wherein the files the file system associated with the other reusable image archive include a boot screen graphic file; and

replace the boot screen graphic file in the file system associated with the other reusable image archive with the custom graphic prior to adding all the files in the file system associated with the other reusable image archive to the boot directory structure in the boot image associated with the virtual appliance.

4. The system of claim 1, wherein the build engine is further configured to reference the manifest files associated with the reusable image archives to identify the one of the reusable image archives that provides the perfect subset of the root file system created from the image description associated with the virtual appliance.

5. The system of claim 1, wherein the build engine is further configured to determine that more than one of the reusable image archives provide the perfect subset of the root file system created from the image description associated with the virtual appliance, wherein the one of the reusable image archives used to add all the files in the file system associated therewith comprises the largest reusable image archive among the more than one reusable image archives.

6. The system of claim 1, wherein the build engine is further configured to:

identify one or more remaining files to install in the operating system image associated with the virtual appliance subsequent to all the files in the file system associated with the one of the reusable image archives having been added to the root directory structure in the operating system image associated with the virtual appliance;

retrieve the one or more remaining files from one or more source repositories, wherein the image description associated with the virtual appliance identifies the one or more source repositories that store the one or more remaining files; and

install the one or more remaining files retrieved from the one or more source repositories in the operating system image associated with the virtual appliance in accordance with the root directory structure that defines the layout associated therewith.

7. The system of claim 1, further comprising a virtualization environment configured to:

identify one or more popular or highly rated public appliances based on one or more statistics or metrics that relate to cloning, usage, and voting activity in the virtualization environment;

invoke the build engine to create appliance images that correspond to the one or more popular or highly rated public appliances; and

add archived file systems associated with the appliance images that correspond to the one or more popular or highly rated public appliances to the reusable image archives stored in the build database, wherein the archived file systems added to the reusable image archives collect every file installed in the one or more popular or highly rated public appliances and preserve information relating to a directory structure associated with the one or more popular or highly rated public appliances.

8. The system of claim 1, further comprising a virtualization environment configured to:

identify one or more of the reusable image archives stored in the build database that have not been referenced in a predetermined amount of time; and

delete the one or more reusable image archives that have not been referenced in the predetermined amount of time from the build database.

9. The system of claim 1, wherein the root directory structure further defines locations in the one or more directories where all the files associated with the operating system image are to be installed.

10. The system of claim 1, wherein the reusable image archives stored in the build database comprise individual tarball files that collect all the files installed in the one or more directories associated therewith and preserve the information relating to the one or more directories associated therewith.

11. The system of claim 1, wherein the image description associated with the virtual appliance lists unique identifiers associated with one or more software components that correspond to all the files to install in the operating system image associated with the virtual appliance and identifies one or more source repositories that store the one or more software components associated with the unique identifiers listed in the image description.

12. The system of claim 1, wherein the build engine is further configured to add an archive corresponding to the root file system associated with the built operating image to the reusable image archives stored in the build database, wherein the archived root file system comprises an individual tarball file that collects all the files installed in the built operating system image and preserves information relating to the root directory structure that defines the layout associated therewith.

13. The system of claim 12, wherein the build engine is further configured to add all the files collected in the individual tarball file that corresponds to the archived root file system to the root directory structure in a subsequent version associated with the virtual appliance to rebuild the operating system image associated therewith if the archived root file system represents a perfect subset of the root directory structure in the subsequent version associated with the virtual appliance.

14. A computer-implemented method for efficiently building virtual appliances in a hosted environment, comprising:

storing, in a build database reusable image archives having file systems with one or more files installed in one or more directories, wherein the reusable image archives collect all the files installed in the one or more directories and preserve information relating to the one or more directories associated with the file systems;

associating the reusable image archives stored in the build database with manifest files that list unique identifiers associated with one or more software components that correspond to all the files installed in the one or more directories associated with the reusable image archive file systems;

receiving a build request at a build engine, wherein the build request includes an image description associated with a virtual appliance;

creating, from the image description associated with the virtual appliance using the build engine, a root file system having a root directory structure that defines a layout associated with all files and directories to install in an operating system image associated with the virtual appliance;

adding all the files in the file system associated with one of the reusable image archives stored in the build database that provides a perfect subset of the root file system to the root directory structure in the operating system image associated with the virtual appliance, wherein the one of the reusable image archives provides the perfect subset of the root file system when all the files in the file system associated therewith are to be installed in the operating system image associated with the virtual appliance;

building the operating system image associated with the virtual appliance using the build engine, wherein the operating system image includes all the files and directories installed therein in accordance with the root directory structure that defines the layout associated therewith;

detecting, at a repository metadata server, an update to one or more software components stored in one or more source repositories;

invalidating all the reusable image archives stored in the build database associated with manifest files that list unique identifiers associated with the one or more updated software components; and

invoking the build engine to rebuild the file systems associated with the invalidated reusable image archives, wherein the rebuilt file systems have one or more files corresponding to the one or more updated software components installed in the one or more directories associated therewith.

15. The method of claim 14, further comprising:

creating, from the image description associated with the virtual appliance using the build engine, a boot file system having a boot directory structure that defines a layout associated with all files and directories to install in a boot image associated with the virtual appliance;

adding all the files in the file system associated with another one of the reusable image archives stored in the build database that provides a perfect subset of the boot file system to the boot directory structure in the boot image associated with the virtual appliance;

building the boot image associated with the virtual appliance using the build engine, wherein the boot image includes all the files and directories installed therein in accordance with the boot directory structure that defines the layout associated therewith; and

building an appliance image corresponding to the virtual appliance using the build engine, wherein the appliance image includes the operating system image and the boot image.

16. The method of claim 15, further comprising:

identifying at least one personalization option in the build request that applies a custom graphic to a boot screen associated with the virtual appliance, wherein the files the file system associated with the other reusable image archive include a boot screen graphic file; and

replacing the boot screen graphic file in the file system associated with the other reusable image archive with the custom graphic prior to adding all the files in the file system associated with the other reusable image archive to the boot directory structure in the boot image associated with the virtual appliance.

17. The method of claim 14, further comprising referencing the manifest files associated with the reusable image archives stored in the build database to identify the one of the reusable image archives that provides the perfect subset of the root file system created from the image description associated with the virtual appliance.

18. The method of claim 14, wherein adding all the files in the file system associated with the one of the reusable image archives to the root directory structure in the operating system image associated with the virtual appliance includes:

determining, at the build engine, that more than one of the reusable image archives provide the perfect subset of the root file system created from the image description associated with the virtual appliance; and

selecting the one of the reusable image archives used to add all the files in the file system associated therewith to the root directory structure associated with the virtual appliance comprises the largest reusable image archive among the more than one reusable image archives.

19. The method of claim 14, further comprising:

identifying one or more remaining files to install in the operating system image associated with the virtual appliance subsequent to all the files in the file system associated with the one of the reusable image archives having been added to the root directory structure in the operating system image associated with the virtual appliance;

retrieving the one or more remaining files from one or more source repositories, wherein the image description associated with the virtual appliance identifies the one or more source repositories that store the one or more remaining files; and

installing the one or more remaining files from the one or more source repositories in the operating system image associated with the virtual appliance in accordance with the root directory structure that defines the layout associated therewith.

20. The method of claim 14, wherein the reusable image archives stored in the build database comprise individual tarball files that collect all the files installed in the one or more directories associated therewith and preserve the information relating to the one or more directories associated therewith.

21. The method of claim 14, further comprising:

identifying one or more popular or highly rated in a virtualization environment associated with the build engine based on one or more statistics or metrics that relate to cloning, usage, and voting activity in the virtualization environment;

invoking the build engine to create appliance images that correspond to the one or more popular or highly rated public appliances;

adding archived file systems associated with the appliance images that correspond to the one or more popular or highly rated public appliances to the reusable image archives stored in the build database, wherein the archived file systems added to the reusable image archives collect every file installed in the one or more popular or highly rated public appliances and preserve information relating to a directory structure associated with the one or more popular or highly rated public appliances.

22. The method of claim 14, further comprising:

identifying one or more of the reusable image archives stored in the build database that have not been referenced in a predetermined amount of time; and

deleting the one or more reusable image archives that have not been referenced in the predetermined amount of time from the build database.

23. A computer-implemented method for efficiently building virtual appliances in a hosted environment, comprising:

building a file system corresponding to a base appliance using a build engine, wherein the file system corresponding to the base appliance includes one or more files installed in one or more directories;

associating the base appliance with a manifest file that lists unique identifiers associated with one or more software components that correspond to the one or more files installed in the one or more directories associated with the base appliance file system;

invalidating the base appliance in response to a repository metadata server detecting an update to the one or more software components associated with the unique identifiers listed in the manifest file associated with the base appliance;

invoking the build engine to rebuild the file system corresponding to the invalidated base appliance, wherein the one or more files installed in the one or more directories associated with the rebuilt file system correspond to the one or more updated software components associated with the unique identifiers listed in the manifest file;

receiving a build request at the build engine, wherein the build request includes an image description associated with a virtual appliance derived from the base appliance;

creating, at the build engine from the image description associated with the virtual appliance derived from the base appliance, a root file system having a root directory structure that defines a layout associated with all files and directories to install in an image associated with the virtual appliance derived from the base appliance;

adding all the files in the rebuilt file system corresponding to the base appliance to the root directory structure in the image associated with the virtual appliance derived from the base appliance if the rebuilt file system corresponding to the base appliance represents a perfect subset of the root directory structure in the image associated with the derived virtual appliance, wherein the rebuilt file system represents the perfect subset of the root directory structure when all the files in the rebuilt file system are to be installed in the image associated with the virtual appliance derived from the base appliance;

installing one or more additional files remaining to be installed in the image associated with the derived virtual appliance subsequent to adding all the files in the rebuilt file system corresponding to the base appliance to the root directory structure in the image associated with the derived virtual appliance; and

building the image associated with the derived virtual appliance using the build engine, wherein the image associated with the derived virtual appliance has all the files in the rebuilt file system corresponding to the base appliance and the one or more additional files installed in the directories in accordance with the root directory structure that defines the layout associated therewith.

24. The method of claim 23, further comprising adding an archive corresponding to the root file system in the image associated with the derived virtual appliance to a build database, wherein the build engine can use the archived root file system added to the build database to reduce a time to build subsequent appliances that derive the base appliance or the virtual appliance derived from the base appliance.