DYNAMIC CODE DEPLOYMENT AND VERSIONING

• US 20160092250A1
• Filed: 09/30/2014
• Published: 03/31/2016
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen, Reque, Sean Philip, Manwaring, Derek Steven, Zhao, Xin, Thomas, Dylan Chandler
• Granted Patent: US 9,715,402 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 9/44536 Selecting among different versions
• CPC Class Codes: G06F 9/44552 Conflict resolution, i.e. enabling coexistence of conflicting executables
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

A system for providing dynamic code deployment and versioning is provided. The system may be configured to receive a first request to execute a newer program code on a virtual compute system, determine, based on the first request, that the newer program code is a newer version of an older program code loaded onto an existing container on a virtual machine instance on the virtual compute system, initiate a download of the newer program code onto a second container on the same virtual machine instance, and causing the first request to be processed with the older program code in the existing container.

Claims

1. A system for providing low-latency computational capacity from a virtual compute fleet, the system comprising:

an electronic data store configured to store at least a program code of a user; and

a virtual compute system comprising one or more hardware computing devices executing specific computer-executable instructions, said virtual compute system in communication with the data store, and configured to at least;

maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprise;

a warming pool comprising virtual machine instances having one or more software components loaded thereon and waiting to be assigned to a user; and

an active pool comprising virtual machine instances currently assigned to one or more users;

receive a first code execution request to execute a first program code on the virtual compute system;

determine, based on the first code execution request, that the first program code is a newer version of a second program code loaded onto a container created on a particular instance of the virtual machine instances in the active pool;

initiate a download of the first program code onto at least one of the internal data store, a code cache of the particular instance, and the container; and

process the code execution request with the second program code.

2. The system of claim 1, wherein the virtual compute system is further configured to:

receive a second code execution request to execute the first program code on the virtual compute system; and

cause the second request to be processed with the first program code while the container is executing the second program code.

3. The system of claim 1, wherein the virtual compute system is further configured to:

associate the internal data store of the virtual compute system with multiple virtual machine instances in the active pool, each of said multiple virtual machine instances having access to data stored on the internal data store; and

cause one or more program codes that are loaded onto any one of said multiple virtual machine instances to be automatically loaded onto the internal data store.

4. A system, comprising:

a virtual compute system comprising one or more hardware computing devices executing specific computer-executable instructions and configured to at least;

receive a first request associated with a newer program code,

determine, based on the first request, that the newer program code is a newer version of an older program code previously loaded onto an existing container created on a virtual machine instance on the virtual compute system;

initiate a download of the newer program code onto at least one of a new container created on the virtual machine instance, an internal data store of the virtual compute system, and a code cache of the virtual machine instance; and

cause the first request to be processed with the older program code in the existing container.

5. The system of claim 4, wherein the virtual compute system is further configured to:

determine that the older program code has been updated; and

cause the newer program code to be downloaded onto the virtual compute system before any request associated with the newer program code is received.

6. The system of claim 4, wherein the virtual compute system is further configured to:

receive a second request associated with the newer program code; and

cause the second request to be processed with the newer program code in the new container while the existing container is executing the older program code.

7. The system of claim 4, wherein the first request includes an indication that phasing in the newer program code is not urgent, and wherein the virtual compute system is further configured to continue processing additional requests associated with the newer program code using the older program code while the newer program code is being downloaded.

8. The system of claim 4, wherein the first request includes an indication that phasing in the newer program code is urgent, and wherein the virtual compute system is further configured to prevent any additional requests associated with the newer program code from being processed with the older program code.

9. The system of claim 4, wherein the virtual compute system comprises an active pool of virtual machine instances configured to execute user code in one or more containers created thereon, and wherein the virtual compute system is further configured to:

associate the internal data store of the virtual compute system with multiple virtual machine instances in the active pool, each of said multiple virtual machine instances having access to data stored on the internal data store; and

cause one or more program codes that are loaded onto any one of said multiple virtual machine instances to be automatically loaded onto the internal data store.

10. The system of claim 9, wherein the internal data store is configured to, after the particular virtual machine instance is terminated, terminate an association between the particular virtual machine instance and any data previously associated with the particular virtual machine instance on the internal data store while retaining said any data on the internal data store.

11. A computer-implemented method comprising:

as implemented by one or more computing devices configured with specific executable instructions,

receiving a first request to execute a newer program code on a virtual compute system;

determining, based on the first request, that the newer program code is a newer version of an older program code loaded onto an existing container created on a virtual machine instance on the virtual compute system;

initiating a download of the newer program code onto at least one of a new container created on the virtual machine instance, an internal data store of the virtual compute system, and a code cache of the virtual machine instance; and

causing the first request to be processed with the older program code in the existing container.

12. The computer-implemented method of claim 11, wherein the method further comprises:

determining that the older program code has been updated; and

causing the newer program code to be downloaded onto the virtual compute system before any request associated with the newer program code is received.

13. The computer-implemented method of claim 11, wherein the method further comprises:

receiving a second request to execute the newer program code on the virtual compute system; and

causing the second request to be processed with the newer program code while the existing container is executing the older program code.

14. The computer-implemented method of claim 11, wherein the first request includes an indication that phasing in the newer program code is urgent, and wherein the method further comprises preventing any additional requests associated with the newer program code from being processed with the older program code.

15. The computer-implemented method of claim 11, wherein the virtual compute system comprises an active pool of virtual machine instances configured to execute user code in one or more containers created thereon, and wherein the method further comprises;

associating the internal data store of the virtual compute system with multiple virtual machine instances in the active pool, each of said multiple virtual machine instances having access to data stored on the internal data store; and

causing one or more program codes that are loaded onto any one of said multiple virtual machine instances to be automatically loaded onto the internal data store.

16. A computer-readable, non-transitory storage medium storing computer executable instructions that, when executed by one or more computing devices, configure the one or more computing devices to perform operations comprising:

receiving a first request to execute a newer program code on a virtual compute system;

determining, based on the first request, that the newer program code is a newer version of an older program code loaded onto an existing container created on a virtual machine instance on the virtual compute system;

initiating a download of the newer program code onto at least one of a new container created on the virtual machine instance, an internal data store of the virtual compute system, and a code cache of the virtual machine instance; and

causing the first request to be processed with the older program code in the existing container.

17. The computer-readable, non-transitory storage medium of claim 16, wherein the operations further comprise:

determining that the older program code has been updated; and

causing the newer program code to be downloaded onto the virtual compute system before any request associated with the newer program code is received.

18. The computer-readable, non-transitory storage medium of claim 16, wherein the operations further comprise:

receiving a second request to execute the newer program code on the virtual compute system; and

causing the second request to be processed with the newer program code while the existing container is executing the older program code.

19. The computer-readable, non-transitory storage medium of claim 16, wherein the first request includes an indication that phasing in the newer program code is urgent, and wherein the operations further comprise preventing any additional requests associated with the newer program code from being processed with the older program code.

20. The computer-readable, non-transitory storage medium of claim 16, wherein the virtual compute system comprises an active pool of virtual machine instances configured to execute user code in one or more containers created thereon, and wherein the operations further comprise:

associating the internal data store of the virtual compute system with multiple virtual machine instances in the active pool, each of said multiple virtual machine instances having access to data stored on the internal data store, and

causing one or more program codes that are loaded onto any one of said multiple virtual machine instances to be automatically loaded onto the internal data store.