Maintaining deployment pipelines for a production computing service using live pipeline templates

• US 10,162,650 B2
• Filed: 05/26/2017
• Issued: 12/25/2018
• Est. Priority Date: 12/21/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Frank, Martin Robert, Mosher, Ian Aird, Jodoin, Felix Walter Blue, Mansour, Mark Sidney James, Gu, Sixiang
• Primary Examiner(s): Brophy, Matthew J
• Application Number:
  US15/607,237
• Publication Number:
  US 20170262298A1
• Time in Patent Office: 578 Days
• Field of Search: None
• CPC Class Codes: G06F 16/173 Customisation support for file systems, e.g. localisation, multi-language support, personalisation
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management
• CPC Class Codes: G06F 9/44536 Selecting among different versions
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

Techniques are presented for managing a deployment pipeline using an inheritable and extensible source code template—generally referred to as a live pipeline template (LPT). As described, live pipeline templates may be used to manage deployment pipelines which, in turn, are used to launch, maintain, and update the services and systems used to host and provide computing services.

Claims

1. A system comprising:

a memory storing one or more instructions that, when executed by one or more computer processors, cause the system to at least;

invoke performance of a code deployment pipeline associated with one or more computing services;

invoke performance of a meta-pipeline to update one or more portions of the code deployment pipeline, based at least in part on a change to source code of a live pipeline template (LPT), wherein the LPT is configured to specialize one or more base pipeline templates with parameters specific to the code deployment pipeline; and

generate an application using the code deployment pipeline having the one or more updated portions.

2. The system of claim 1, wherein an application definition of the LPT provides a fully-specified configuration of the one or more computing services.

3. The system of claim 2, wherein the meta-pipeline updates the application definition based on the change to the LPT.

4. The system of claim 2, wherein the application definition is specified using a machine readable interchange format.

5. The system of claim 1, wherein the code deployment pipeline invokes a pipeline synthesis driver to configure a first of the one or more computing services based on the change to the LPT.

6. The system of claim 1, wherein the code deployment pipeline modifies a first of the one or more computing services in a cloud computing region specified in the LPT.

7. The system of claim 1, wherein the parameters associated with the code deployment pipeline includes at least one of a service name, an administrative contact, and a run-as username for one of the one or more computing services associated with the code deployment pipeline.

8. A method comprising:

detecting a change in a live pipeline template (LPT), wherein a configuration of a deployment pipeline for a computing service is controlled based on the LPT;

reconfiguring the deployment pipeline based at least in part on the detected change in the LPT; and

generating an application by operation of one or more computer processors and based at least in part on the reconfigured deployment pipeline.

9. The method of claim 8, wherein reconfiguring the deployment pipeline includes:

updating an application definition based on the detected change to the LPT, wherein the application definition provides a fully-specified configuration of the application; and

propagating updates to the deployment pipeline according to the fully-specified configuration.

10. The method of claim 8, further comprising:

identifying a current configuration of at least a first service included in the deployment pipeline;

determining whether the current configuration of the first service is modified as a result of the detected change in the LPT; and

invoking a pipeline synthesis driver associated with the first service to configure the first service.

11. The method of claim 10, wherein the pipeline synthesis driver is at least one of a pipeline driver, a deployment driver, a host driver, a network driver, a security driver, an identity and access management driver, a performance monitor driver, and an alarm driver.

12. The method of claim 8, wherein the LPT specifies a set of configuration parameters for one or more deployment stages of the deployment pipeline.

13. The method of claim 8, wherein detecting the change to the LPT comprises:

monitoring a version control system for an updated version of the LPT committed to the version control system.

14. The method of claim 8, wherein the LPT inherits configuration data of the deployment pipeline from at least a second LPT.

15. A system, comprising:

a memory storing one or more instructions that, when executed by one or more computer processors, cause the system to at least;

configure a deployment pipeline according to a first application definition generated from a live pipeline template (LPT) instance, wherein the first application definition specifies a first configuration for a first computing service that is used in the deployment pipeline;

generate a second application definition based on a change to the LPT instance; and

reconfigure the first computing service from the first configuration to a second configuration, based on the second application definition.

16. The system of claim 15, wherein the first and second application definition provide a fully-specified configuration for the first computing service.

17. The system of claim 15, wherein the LPT instance comprises source code including a plurality of pipeline templates.

18. The system of claim 17, wherein at least a first one of the pipeline templates specializes a second pipeline template with parameters for the deployment pipeline.

19. The system of claim 15, wherein the first configuration of the first computing service specified in the first application definition differs from the second configuration of the first computing service specified in the second application definition.

20. The system of claim 15, wherein the one or more instructions further cause the system to:

invoke a pipeline synthesis driver for the first computing service to reconfigure the first computing service according to the second application definition.