Dynamic code deployment and versioning

• US 10,592,269 B2
• Filed: 07/24/2017
• Issued: 03/17/2020
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen, Reque, Sean Philip, Manwaring, Derek Steven, Zhao, Xin, Thomas, Dylan Chandler
• Primary Examiner(s): Brophy, Matthew J
• Application Number:
  US15/658,038
• Publication Number:
  US 20180039506A1
• Time in Patent Office: 967 Days
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 9/44536 Selecting among different versions
• CPC Class Codes: G06F 9/44552 Conflict resolution, i.e. enabling coexistence of conflicting executables
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

A system for providing dynamic code deployment and versioning is provided. The system may be configured to receive a first request to execute a newer program code on a virtual compute system, determine, based on the first request, that the newer program code is a newer version of an older program code loaded onto an existing container on a virtual machine instance on the virtual compute system, initiate a download of the newer program code onto a second container on the same virtual machine instance, and causing the first request to be processed with the older program code in the existing container.

Claims

1. A system, comprising:

one or more processors; and

one or more memories, the one or more memories having stored thereon instructions, which, when executed by the one or more processors, cause the one or more processors to;

receive a first request to execute a first program code, the first request including (i) an identifier that uniquely identifies the first program code and (ii) one or more execution parameters for executing the first program code;

initiate, using the identifier included in the first request to execute the first program code, a download of the first program code onto at least one of a virtual machine instance or a data store associated with the virtual machine instance;

determine that a second program code different from the first program code is loaded on the virtual machine instance or the data store; and

prior to completion of the download of the first program code, cause the second program code to be executed using the one or more execution parameters included in the first request to execute the first program code despite the identifier identifying the first program code and not the second program code.

2. The system of claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

receive a second request to execute the first program code, the second request including the identifier identifying the first program code and one or more execution parameters for executing the first program code; and

cause the first program code to be executed using the one or more execution parameters included in the second request without downloading another copy of the first program code.

3. The system of claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

receive a second request to execute the first program code, the second request including the identifier identifying the first program code; and

determine that the download of the first program code has not been completed; and

cause the second program code to be executed using the one or more execution parameters included in the second request.

4. The system of claim 1, wherein the first program code is a newer version of the second program code.

5. The system of claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to initiate a download of the second program code onto the at least one of the virtual machine instance or the data store in response to receiving a second request to execute the second program code, wherein the second request is received prior to the first request.

6. The system of claim 1, wherein the second program code is stored in a container created on the virtual machine instance, the instructions, when executed by the one or more processors, further causing the one or more processors to cause the second program code to be executed inside the container.

7. The system of claim 6, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

receive a second request to execute the first program code, the second request including the identifier identifying the first program code; and

subsequent to completion of the download of the first program code, cause the first program code to be copied onto the container; and

cause the first program code to be executed inside the container.

8. The system of claim 6, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

receive a second request to execute the first program code, the second request including the identifier identifying the first program code; and

subsequent to completion of the download of the first program code, cause the first program code to be copied onto a second container created on the virtual machine instance; and

cause the first program code to be executed inside the second container.

9. A computer-implemented method comprising:

receiving a first request to execute a first program code, the first request including (i) an identifier that uniquely identifies the first program code and (ii) one or more execution parameters for executing the first program code;

initiating, using the identifier included in the first request to execute the first program code, a download of the first program code onto at least one of a virtual machine instance or a data store associated with the virtual machine instance;

determining that a second program code different from the first program code is loaded on the virtual machine instance or the data store; and

prior to completion of the download of the first program code, executing the second program code using the one or more execution parameters included in the first request to execute the first program code despite the identifier identifying the first program code and not the second program code.

10. The computer-implemented method of claim 9, further comprising:

downloading the first program code onto an internal data store accessible by the virtual machine instance and at least one other virtual machine instance;

subsequent to completion of the download, copying the first program code from the internal data store onto a container created on the virtual machine instance; and

executing the first program code inside the container.

11. The computer-implemented method of claim 9, further comprising:

downloading the first program code onto a code cache of the virtual machine instance, wherein the code cache is not accessible by any virtual machine instance other than the virtual machine instance;

subsequent to completion of the download, copying the first program code onto a container created on the virtual machine instance; and

executing the first program code inside the container.

12. The computer-implemented method of claim 11, further comprising:

determining that the second program code is no longer needed; and

removing the second program code from the code cache of the virtual machine instance.

13. The computer-implemented method of claim 9, further comprising:

downloading the first program code onto a container created on the virtual machine instance; and

subsequent to completion of the download, executing the first program code inside the container.

14. The computer-implemented method of claim 9, further comprising:

determining that a first container of the virtual machine instance having the first program code loaded thereon is busy;

determining that a second container of the virtual machine instance having the second program code loaded thereon is not busy; and

executing the second program code inside the container.

15. The computer-implemented method of claim 9, further comprising:

determining that the first program code is a newer version of the second program code stored on the virtual machine instance and that the virtual machine instance does not have the first program code loaded thereon; and

executing the second program code on the virtual machine instance.

16. The computer-implemented method of claim 9, further comprising:

determining that the first program code is a newer version of the second program code stored on the virtual machine instance and that the virtual machine instance has a container in which the second program code is being executed; and

subsequent to completion of the execution of the second program code in the container, loading the first program code onto the container.

17. Non-transitory physical computer storage storing instructions, which, when executed by one or more processors, cause the one or more processors to:

receive a first request to execute a first program code, the first request including (i) a identifier that uniquely identifies the first program code and one or more execution parameters for executing the first program code;

initiate, using the identifier included in the first request to execute the first program code, a download of the first program code onto at least one of a virtual machine instance or a data store associated with the virtual machine instance;

determine that a second program code different from the first program code is loaded on the virtual machine instance or the data store; and

prior to completion of the download of the first program code, cause the second program code to be executed on the virtual machine instance using the one or more execution parameters included in the first request to execute the first program code despite the identifier identifying the first program code and not the second program code.

18. The non-transitory physical computer storage of claim 17, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to, based at least on a size of the first program code, cause the second program code to be executed on the virtual machine instance.

19. The non-transitory physical computer storage of claim 17, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to, based on an indication that the second program code can be executed instead of the first program code, cause the second program code to be executed on the virtual machine instance.

20. The non-transitory physical computer storage of claim 17, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

receive a second request to execute the first program code, the second request including the identifier identifying the first program code and one or more execution parameters for executing the first program code; and

determine that the virtual machine instance does not have any container usable for executing the second program code using the one or more execution parameters included in the second request; and

subsequent to completion of the download of the first program code, cause the first program code to be executed using the one or more execution parameters included in the second request inside a container created on the virtual machine instance.