Architecture for incremental deployment

• US 8,726,264 B1
• Filed: 11/02/2011
• Issued: 05/13/2014
• Est. Priority Date: 11/02/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Allen, Nicholas A., Dykhno, Elena
• Primary Examiner(s): Deng, Anna
• Application Number:
  US13/287,860
• Time in Patent Office: 923 Days
• Field of Search: 717168-173
• US Class Current: 717/168
• CPC Class Codes: G06F 8/60 Software deployment
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: G06F 8/658 Incremental updates; Differential updates
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata

Abstract

A deploy service is provided to determine a set of software artifacts that needs to be transmitted to a target machine upon receiving an application deployment request from a user of a client device. For instance, the deploy service may compare versions of software artifacts on the target machine with the software artifacts of the application that the user desires to deploy to determine the set of software artifacts that needs to be transmitted. Instead of having to transmit the entire application, some embodiments transmit only a small portion that is reflective of what has been changed between the old version of the application and the new version of the application. This enables the transfer of large files across the Internet to be more efficient.

Claims

1. A system for performing incremental deployment of an application on a target machine, the system comprising:

one or more processors;

a deployment proxy server; and

a deploy service;

wherein the deployment proxy server;

receives, from a client, a request to upload one or more software artifacts of an application to a target machine, the one or more software artifacts comprising at least a partial update to the application;

sends a first set of software artifacts of the one or more software artifacts of the application to a proxy repository based at least in part on the request, the first set of software artifacts being a portion of the application less than the whole application;

determines, based at least in part on the request from the client, a continuation deployment action for a deploy service to perform;

selects, based at least in part on the request from the client, the deploy service from a plurality of deploy services in a distributed system that is capable of performing the continuation deployment action;

forwards, based at least in part on the continuation deployment action, the request to the deploy service, and

wherein the deploy service;

receives the continuation deployment action from the deployment proxy server;

receives, from the proxy repository, a complete set of software artifacts, each of the complete set being an up-to-date version of the software artifact;

stores the complete set of software artifacts in a deployment repository; and

enables the target machine to obtain a second set of software artifacts from the deployment repository upon determining that each reference identifier for each of the second set of software artifacts stored in a local repository of the target machine is different from each reference identifier for each of the second set of software artifacts stored in the deployment repository,

wherein the first set of software artifacts uploaded from the client is different from the second set of software artifacts downloaded to the target machine.

2. The system of claim 1, wherein the deploy service further sends a notification that the complete set of software artifacts is capable of being deployed on the target machine.

3. The system of claim 1, wherein the deploy service further sends a message to a particular location that can be polled by the target machine, wherein the message is for notifying the target machine that the complete set of software artifacts is capable of being deployed on the target machine.

4. The system of claim 1, wherein the deployment repository is operable to receive requests to retrieve software artifacts for the application, wherein the deployment repository provides consistency and atomicity guarantees such that further deployments for other applications or the same application do not interfere with information in the deployment repository.

5. A computer-implemented method of enabling incremental deployment of an application on a target machine, the method comprising:

under control of one or more computer systems configured with executable instructions,

receiving, from a client, a request to upload one or more software artifacts of an application to a target machine;

receiving a first set of software artifacts of the one or more software artifacts of the application from the client based at least in part on the request, the first set of software artifacts being a portion of the application;

storing the first set of software artifacts to a proxy repository;

determining, based at least in part on the request from the client, a continuation deployment action for a deploy service to perform;

selecting, based at least in part on the request from the client, the deploy service from a plurality of deploy services in a distributed system that is capable of performing the continuation deployment action; and

forwarding the continuation deployment action to the selected deploy service,

wherein the deploy service retrieves a complete set of software artifacts from the proxy repository and stores the complete set of software artifacts in a deployment repository that causes the target machine to determine a second set of software artifacts necessary for deployment, the first set of software artifacts being different from the second set.

6. The method of claim 5, wherein the one or more software artifacts includes a complete collection of software artifacts for the application.

7. The method of claim 5, wherein storing the first set of software artifacts to the proxy repository comprises:

storing the first set of software artifacts along with a third set of software artifacts that corresponds to the first set of software artifacts in the proxy repository, each of the third set of software artifacts being a different version compared to the corresponding software artifact in the first set, wherein the third set of software artifacts are stored in the proxy repository prior to the proxy repository receiving the first set of software artifacts.

8. The method of claim 5, wherein the first set of software artifacts comprises a partial update to the application, wherein the first set of software artifacts is determined based at least in part on version differences between each of a set of software artifacts stored on a local repository of the client and each of another set of software artifacts corresponding to the set of software artifacts stored on the proxy repository.

9. The method of claim 5, wherein the proxy repository deletes information in the proxy repository in response to the deploy service retrieving the complete set of software artifacts, the information including at least older versions of software artifacts.

10. The method of claim 5, wherein the deployment repository is the same data store as the proxy repository.

11. The method of claim 5, wherein the first set of software artifacts is received upon determining a corresponding set of software artifacts that needs to be updated to a newer version in the proxy repository.

12. The method of claim 5, wherein the notification is sent through a network connection with the target machine.

13. An electronic device, comprising:

at least one processor; and

a memory device including instructions that, when executed by the at least one processor, cause the electronic device to, at least;

receive from a client, a request to upload one or more software artifacts of an application to a target machine;

receive a set of software artifacts of the one or more software artifacts of the application from the client based at least in part on the request, the set of software artifacts being a portion of the application;

store the set of software artifacts to a proxy repository;

determine, based at least in part on the request from the client, a continuation deployment action that for a deploy service to perform, the continuation deployment action specifying a target machine on which to deploy the application;

locate, based at least in part on the request from the client, the deploy service from a plurality of deploy services in a distributed system that is capable of performing the continuation deployment action; and

invoke the located deploy service to perform the continuation deployment action for the application,

wherein the deploy service retrieves a complete set of software artifacts from the proxy repository and stores the complete set of software artifacts in a deployment repository that causes the target machine to determine a second set of software artifacts necessary for deployment, the set of software artifacts being different from the second set of software artifacts.

14. The electronic device of claim 13, wherein the deploy service sends, to a target machine, a notification that the application is capable of being deployed on the target machine when the located deploy service is invoked.

15. The electronic device of claim 13, wherein the request from the client includes a uniform resource locator (URL) usable to determine the continuation deployment action.

16. The electronic device of claim 13, wherein the set of software artifacts comprises a partial update to the application, wherein the set of software artifacts is determined based at least in part on version differences between each of a set of software artifacts stored on a local repository of the client and each of another set of software artifacts corresponding to the set of software artifacts stored on the proxy repository.

17. The electronic device of claim 13, wherein the proxy repository deletes information in the proxy repository in response to the deploy service retrieving the complete set of software artifacts, the information including at least older versions of software artifacts.

18. The electronic device of claim 13, wherein the deploy service sends a message to a particular location that can be polled by the target machine, wherein the message is for notifying the target machine that a complete set of software artifacts of the application is capable of being deployed on the target machine.

19. The electronic device of claim 13, wherein the set of software artifacts is received upon determining a corresponding set of software artifacts that needs to be updated to a newer version in the proxy repository.

20. A non-transitory computer-readable storage medium including instructions for identifying items, the instructions when executed by at least one processor of at least one computing device causing the at least one computing device to collectively, at least:

receive, from a client, a request to upload one or more software artifacts of an application to a target machine;

receive a first set of software artifacts of the one or more software artifacts of the application from the client based at least in part on the request, the first set of software artifacts being a portion of the application;

store the first set of software artifacts to a proxy repository;

determine, based at least in part on the request from the client, a continuation deployment action for a deploy service to perform;

select, based at least in part on the request from the client, the deploy service from a plurality of deploy services in a distributed system that is capable of performing the continuation deployment action; and

forward the continuation deployment action to the selected deploy service,

wherein the deploy service retrieves a complete set of software artifacts from the proxy repository and stores the complete set of software artifacts in a deployment repository that causes the target machine to determine a second set of software artifacts necessary for deployment, the first set of software artifacts being different from the second set.

21. The non-transitory computer-readable storage medium of claim 20, wherein the deploy service sends, to a target machine, a notification that the application is capable of being deployed on the target machine when the located deploy service is invoked.

22. The non-transitory computer-readable storage medium of claim 20, wherein the notification is sent through a network connection with the target machine.

23. The non-transitory computer-readable storage medium of claim 20, wherein the set of software artifacts comprises a partial update to the application, wherein the set of software artifacts is determined based at least in part on version differences between each of a set of software artifacts stored on a local repository of the client and each of another set of software artifacts corresponding to the set of software artifacts stored on the proxy repository.

24. The non-transitory computer-readable storage medium of claim 20, wherein the proxy repository deletes information in the proxy repository in response to the deploy service retrieving the complete set of software artifacts, the information including at least older versions of software artifacts.

25. The non-transitory computer-readable storage medium of claim 20, wherein the deploy service sends a message to a particular location that can be polled by the target machine, wherein the message is for notifying the target machine that a complete set of software artifacts of the application is capable of being deployed on the target machine.