LOW LATENCY COMPUTATIONAL CAPACITY PROVISIONING

• US 20170199766A1
• Filed: 03/24/2017
• Published: 07/13/2017
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Thomas, Dylan Chandler, Reque, Sean Philip, Wagner, Timothy Allen
• Granted Patent: US 10,108,443 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 9/44521 Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45545 Guest-host, i.e. hypervisor is an application program itself, e.g. VirtualBox
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

A system for providing low latency computational capacity is provided. The system may be configured to maintain a pool of virtual machine instances, which may be assigned to users to service the requests associated with the users. The system may further be configured to receive a request to acquire compute capacity for executing a program code associated with a particular user, determine whether the pool of virtual machine instances includes a container that may be used to execute the program code therein, and cause the program code of the particular user to be executed in the container.

Claims

1. A system, comprising:

one or more hardware computing devices configured to execute computer-executable instructions to at least;

receive a request to execute a first program code, the request indicative of (i) one or more arguments to be used for the execution of the first program code and (ii) a first amount of computing resources to be allocated for the execution of the first program code;

determine that a first virtual machine instance of a plurality of virtual machine instances includes the first program code and includes at least the first amount of computing resources; and

cause the first program code to be executed, using the one or more arguments, in a container created on the first virtual machine instance and having at least the first amount of computing resources.

2. The system of claim 1, wherein the request does not specify the first amount of computing resources, and the one or more hardware computing devices are further configured to determine the first amount of computing resources to be allocated for the execution of the first program code by accessing a resource constraint associated with the first program code.

3. The system of claim 1, wherein the container on the first virtual machine instance includes the first program code at a time that the request is received.

4. The system of claim 1, wherein the first virtual machine instance includes the first program code at a time that the request is received.

5. The system of claim 1, further comprising a code cache configured to store program codes, wherein the one or more hardware computing devices are configured to store the first program code in the code cache.

6. The system of claim 1, wherein the one or more hardware computing devices are further configured to determine, based on a request volume associated with the first program code, that the container is to be kept alive even after the execution of the first program code has been completed.

7. The system of claim 1, wherein the one or more hardware computing devices are further configured to search for an identifier (ID) value associated with the first program code in a plurality of virtual machine instances.

8. A computer-implemented method, as implemented by one or more computing devices configured with specific executable instructions, comprising:

receiving a request to execute a first program code, the request indicative of (i) one or more arguments to be used for the execution of the first program code and (ii) a first amount of computing resources to be allocated for the execution of the first program code;

determining that a first virtual machine instance of a plurality of virtual machine instances includes the first program code and includes at least the first amount of computing resources; and

executing the first program code, using the one or more arguments, in a container created on the first virtual machine instance and having at least the first amount of computing resources.

9. The computer-implemented method of claim 8, wherein the request does not specify the first amount of computing resources, the computer-implemented method further comprising determining the first amount of computing resources to be allocated for the execution of the first program code by accessing a resource constraint associated with the first program code.

10. The computer-implemented method of claim 8, wherein the container on the first virtual machine instance includes the first program code at a time that the request is received.

11. The computer-implemented method of claim 8, wherein the first virtual machine instance includes the first program code at a time that the request is received.

12. The computer-implemented method of claim 8, further comprising storing the first program code in a code cache configured to store program codes.

13. The computer-implemented method of claim 8, further comprising determining, based on a request volume associated with the first program code, that the container is to be kept alive even after the execution of the first program code has been completed.

14. The computer-implemented method of claim 8, further comprising searching for an identifier (ID) value associated with the first program code in a plurality of virtual machine instances.

15. Non-transitory physical computer storage storing computer-executable instructions that, when executed by one or more computing devices, configure the one or more computing devices to:

receive a request to execute a first program code, the request indicative of (i) one or more arguments to be used for the execution of the first program code and (ii) a first amount of computing resources to be allocated for the execution of the first program code;

determine that a first virtual machine instance of a plurality of virtual machine instances includes the first program code and includes at least the first amount of computing resources; and

cause the first program code to be executed, using the one or more arguments, in a container created on the first virtual machine instance and having at least the first amount of computing resources.

16. The non-transitory physical computer storage of claim 15, wherein the request does not specify the first amount of computing resources, and the computer-executable instructions further cause the one or more hardware computing devices to determine the first amount of computing resources to be allocated for the execution of the first program code by accessing a resource constraint associated with the first program code.

17. The non-transitory physical computer storage of claim 15, wherein at least one of the first virtual machine instance or the container on the first virtual machine instance includes the first program code at a time that the request is received.

18. The non-transitory physical computer storage of claim 15, wherein the computer-executable instructions further cause the one or more hardware computing devices to store the first program code in a code cache configured to store program codes.

19. The non-transitory physical computer storage of claim 15, wherein the computer-executable instructions further cause the one or more hardware computing devices to determine, based on a request volume associated with the first program code, that the container is to be kept alive even after the execution of the first program code has been completed.

20. The non-transitory physical computer storage of claim 15, wherein the computer-executable instructions further cause the one or more hardware computing devices to search for an identifier (ID) value associated with the first program code in a plurality of virtual machine instances.