Deployment system for multi-node applications

• US 9,015,710 B2
• Filed: 03/23/2012
• Issued: 04/21/2015
• Est. Priority Date: 04/12/2011
• Status: Active Grant

• Current Assignee: Pivotal Software, Inc. (Broadcom, Inc.)
• Original Assignee: Pivotal Software, Inc. (Broadcom, Inc.)
• Inventors: Spivak, Vadim, Skaar, Kent, Shaldibin, Oleg
• Primary Examiner(s): Puente, Emerson
• Assistant Examiner(s): DO, STEVEN M
• Application Number:
  US13/428,109
• Publication Number:
  US 20120266168A1
• Time in Patent Office: 1,124 Days
• Field of Search: 718/1
• US Class Current: 718/1
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: G06F 8/658 Incremental updates; Differential updates
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5055 considering software capabilities, i.e. software resources associated or available to the machine
• CPC Class Codes: H04L 41/0806 for initial configuration or provisioning, e.g. plug-and-play
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

A deployment system provides the ability to deploy a multi-node distributed application, such as a cloud computing platform application, which has a plurality of interconnected nodes performing specialized jobs. The deployment system includes a deployment director that provisions an infrastructure that includes one or more virtual machines (VMs) for hosting the plurality of nodes of the cloud computing platform application. The deployment director distributes a plurality of jobs (e.g., application packages and configurations) to deployment agents executing on the provisioned VMs, based on a mapping in the deployment manifest between the infrastructure and the plurality of specialized jobs to be performed by the cloud computing platform application. The deployment agents apply the jobs to their respective VM (e.g., launching applications), thereby deploying the cloud computing platform application.

Claims

1. A method for deploying an application having a plurality of functional components that are executed on a plurality of different nodes, the method comprising:

receiving, by a deployment module, a specification for the application, wherein the specification specifies (i) a number of instances of each functional component of the application that is to be deployed, and (ii) hardware properties that would be required by any node executing any one of the functional components;

requesting a virtual infrastructure platform to launch a plurality of virtual machines (VMs) that is sufficient to execute each instance of a functional component in a separate VM, wherein each of the VMs (i) is configured to support hardware properties required by at least one of the functional components, and (ii) includes an agent component configured to communicate with the deployment module;

requesting the virtual infrastructure platform to launch a plurality of ancillary virtual machines according to a number of ancillary virtual machines specified by the specification, wherein each of the ancillary virtual machines in the plurality of ancillary virtual machines corresponds to at least one of the functional components and is configured to enable compilation of software to be executed by the corresponding functional component;

directing at least one of the ancillary virtual machines to compile machine architecture independent code into code executable by each of the VMs to execute as one of the instances of the functional components of the application; and

directing each of the agent components in each of the VMs to install the code compiled by the at least one ancillary virtual machine in the VM that implements one of the functional components that is compatible with the hardware properties of the VM, thereby causing the VM to execute as one of the instances of the functional components of the application.

2. The method of claim 1, wherein the directing each of the agent components to install code further comprises:

directing each of the agent components in each of the VMs to install a package of computer-executable instructions specified by the specification for each functional component, and configured to, when executed by each VM, perform operations of the functional component.

3. The method of claim 1, wherein the specification for the application to be deployed specifies network properties that would be required by any node executing any one of the functional components;

and wherein each of the VMs is configured according to the network properties required by at least one of the functional components.

4. The method of claim 1, wherein the specification specifies a plurality of configuration settings for any one of the functional components;

and wherein directing each of the agent components to install code further comprises;

retrieving a configuration file for one of the functional components, wherein the configuration file specifies at least one configuration setting having a variable that references one of the plurality of configuration settings in the specification;

modifying the configuration file to replace the variable with a value of the referenced configuration setting provided by the specification; and

providing the modified configuration file to each of the agent components in each of the VMs that host an instance of the functional component corresponding to the modified configuration file.

5. The method of claim 1, wherein the requesting the virtual infrastructure platform to launch the plurality of VMs further comprises:

requesting provision of each of the VMs using a template that specifies a disk image having a guest operating system and the agent component installed thereon.

6. The method of claim 1, wherein the plurality of functional components for the application are configured to coordinate to provide cloud computing services to host one or more web applications.

18. The method of claim 1, wherein the deployment module further comprises a health monitor configured to:

monitor communications from agents running on VMs launched by the virtual infrastructure platform; and

re-start a failed VM if a lack of communication from the VM is detected.

21. The method of claim 1, wherein ancillary virtual machines within the plurality of ancillary virtual machines are configured with a virtual hardware specification and architecture that is identical to the functional component.

7. A non-transitory computer-readable storage medium comprising instructions that, when executed in a computing device, deploy an application having a plurality of functional components that are executed on a plurality of different nodes, by performing the steps of:

receiving, by a deployment module, a specification for the application, wherein the specification specifies (i) a number of instances of each functional component of the application that is to be deployed, and (ii) hardware properties that would be required by any node executing any one of the functional components;

requesting a virtual infrastructure platform to launch a plurality of virtual machines (VMs) that is sufficient to execute each instance of a functional component in a separate VM, wherein each of the VMs (i) is configured to support hardware properties required by at least one of the functional components, and (ii) includes an agent component configured to communicate with the deployment module;

requesting the virtual infrastructure platform to launch a plurality of ancillary virtual machines according to a number of ancillary virtual machines specified by the specification, wherein each of the ancillary virtual machines in the plurality of ancillary virtual machines corresponds to at least one of the functional components and is configured to enable compilation of software to be executed by the corresponding functional component;

directing at least one of the ancillary virtual machines to compile machine architecture independent code into code executable by each of the VMs to execute as one of the instances of the functional components of the application; and

directing each of the agent components in each of the VMs to install the code compiled by the at least one ancillary virtual machine in the VM that implements one of the functional components that is compatible with the hardware properties of the VM, thereby causing the VM to execute as one of the instances of the functional components of the application.

8. The non-transitory computer-readable storage medium of claim 7, wherein the instructions for directing each of the agent components to install code further comprise instructions for:

directing each of the agent components in each of the VMs to install a package of computer-executable instructions specified by the specification for each functional component, and configured to, when executed by each VM, perform operations of the functional component.

9. The non-transitory computer-readable storage medium of claim 7, wherein the specification for the application to be deployed specifies network properties that would be required by any node executing any one of the functional components;

and wherein each of the VMs is configured according to the network properties required by at least one of the functional components.

10. The non-transitory computer-readable storage medium of claim 7, wherein the specification specifies a plurality of configuration settings for any one of the functional components;

and wherein the instructions for directing each of the agent components to install code further comprise instructions for;

retrieving a configuration file for one of the functional components, wherein the configuration file specifies at least one configuration setting having a variable that references one of the plurality of configuration settings in the specification;

modifying the configuration file to replace the variable with a value of the referenced configuration setting provided by the specification; and

providing the modified configuration file to each of the agent components in each of the VMs that host an instance of the functional component corresponding to the modified configuration file.

11. The non-transitory computer-readable storage medium of claim 7, wherein the instructions for requesting the virtual infrastructure platform to launch the plurality of VMs further comprising instructions for:

requesting provision of each of the VMs using a template that specifies a disk image having a guest operating system and the agent component installed thereon.

12. The non-transitory computer-readable storage medium of claim 7, wherein the plurality of functional components for the application are configured to coordinate to provide cloud computing services to host one or more web applications.

19. The non-transitory computer-readable storage medium of claim 7, wherein the deployment module further comprises a health monitor configured to:

monitor communications from agents running on VMs launched by the virtual infrastructure platform; and

re-start a failed VM if a lack of communication from the VM is detected.

22. The non-transitory computer-readable storage medium of claim 7, wherein ancillary virtual machines within the plurality of ancillary virtual machines are configured with a virtual hardware specification and architecture that is identical to the functional component.

13. A computer system for deploying an application having a plurality of functional components that are executed on a plurality of different nodes, the computer system comprising a system memory and a processor programmed to carry out the steps of:

receiving, by a deployment module, a specification for the application, wherein the specification specifies (i) a number of instances of each functional component of the application that is to be deployed, and (ii) hardware properties that would be required by any node executing any one of the functional components;

requesting a virtual infrastructure platform to launch a plurality of virtual machines (VMs) that is sufficient to execute each instance of a functional component in a separate VM, wherein each of the VMs (i) is configured to support hardware properties required by at least one of the functional components, and (ii) includes an agent component configured to communicate with the deployment module;

requesting the virtual infrastructure platform to launch a plurality of ancillary virtual machines according to a number of ancillary virtual machines specified by the specification, wherein each of the ancillary virtual machines in the plurality of ancillary virtual machines corresponds to at least one of the functional components and is configured to enable compilation of software to be executed by the corresponding functional component;

directing at least one of the ancillary virtual machines to compile machine architecture independent code into code executable by each of the VMs to execute as one of the instances of the functional components of the application; and

directing each of the agent components in each of the VMs to install the code compiled by the at least one ancillary virtual machine in the VM that implements one of the functional components that is compatible with the hardware properties of the VM, thereby causing the VM to execute as one of the instances of the functional components of the application.

14. The computer system of claim 13, wherein the processor is further programmed to carry out the step of:

directing each of the agent components in each of the VMs to install a package of computer-executable instructions specified by the specification for each functional component, and configured to, when executed by each VM, perform operations of the functional component.

15. The computer system of claim 13, wherein the specification for the application to be deployed specifies network properties that would be required by any node executing any one of the functional components;

and wherein each of the VMs is configured according to the network properties required by at least one of the functional components.

16. The computer system of claim 13, wherein the specification specifies a plurality of configuration settings for any one of the functional components;

and wherein the processor is further programmed to carry out the step of;

retrieving a configuration file for one of the functional components, wherein the configuration file specifies at least one configuration setting having a variable that references one of the plurality of configuration settings in the specification;

modifying the configuration file to replace the variable with a value of the referenced configuration setting provided by the specification; and

providing the modified configuration file to each of the agent components in each of the VMs that host an instance of the functional component corresponding to the modified configuration file.

17. The computer system of claim 13, wherein the plurality of functional components for the application are configured to coordinate to provide cloud computing services to host one or more web applications.

20. The computer system of claim 13, wherein the deployment module further comprises a health monitor configured to:

monitor communications from agents running on VMs launched by the virtual infrastructure platform; and

re-start a failed VM if a lack of communication from the VM is detected.

23. The computer system of claim 13, wherein ancillary virtual machines within the plurality of ancillary virtual machines are configured with a virtual hardware specification and architecture that is identical to the functional component.