Code execution request routing
First Claim
Patent Images
1. A system for providing low-latency computational capacity, the system comprising:
- an external database service configured to store a plurality of key-value pairs;
a virtual compute system comprising one or more hardware computing devices executing specific computer-executable instructions, the virtual compute system in communication with the external database service and configured to at least;
maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprises;
a warming pool comprising virtual machine instances having one or more software components loaded thereon and waiting to be assigned to a user; and
an active pool comprising virtual machine instances currently assigned to one or more users;
process a first request to execute a first program code associated with a first user on the virtual compute system, the first request including an identity of the first user, and one or more first execution parameters to be used for executing the first program code;
execute the first program code in a first container created on a first virtual machine instance in the active pool using the one or more first execution parameters, the execution of the program code causing one or more key-value pairs of the plurality of key-value pairs to be retrieved from the external database service and stored locally within the first container;
process a second request to execute the first program code on the virtual compute system, the second request including the identity of the first user, one or more second execution parameters to be used for executing the first program code, and a user indication that the second request is to be handled using the first container previously used for handling the first request; and
based on the user indication that the second request is to be handled using the first container, execute the first program code in the first container using the one or more second execution parameters, the execution of the first program code accessing the one or more key-value pairs locally stored within the first container such that a latency associated with the execution of the first program code based on the one or more second execution parameters is reduced.
1 Assignment
0 Petitions
Accused Products
Abstract
A system for providing low-latency compute capacity is provided. The system may be configured to route incoming code execution requests based on user indications to use specific containers running on a plurality of virtual machine instances. The system may be configured to process a code execution request, identify, based on the user indication that a specific container previously used to handle a request of similar type is to be used for handling the code execution request, and cause the code execution request to be handled using the specific container.
-
Citations
20 Claims
-
1. A system for providing low-latency computational capacity, the system comprising:
-
an external database service configured to store a plurality of key-value pairs; a virtual compute system comprising one or more hardware computing devices executing specific computer-executable instructions, the virtual compute system in communication with the external database service and configured to at least; maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprises; a warming pool comprising virtual machine instances having one or more software components loaded thereon and waiting to be assigned to a user; and an active pool comprising virtual machine instances currently assigned to one or more users; process a first request to execute a first program code associated with a first user on the virtual compute system, the first request including an identity of the first user, and one or more first execution parameters to be used for executing the first program code; execute the first program code in a first container created on a first virtual machine instance in the active pool using the one or more first execution parameters, the execution of the program code causing one or more key-value pairs of the plurality of key-value pairs to be retrieved from the external database service and stored locally within the first container; process a second request to execute the first program code on the virtual compute system, the second request including the identity of the first user, one or more second execution parameters to be used for executing the first program code, and a user indication that the second request is to be handled using the first container previously used for handling the first request; and based on the user indication that the second request is to be handled using the first container, execute the first program code in the first container using the one or more second execution parameters, the execution of the first program code accessing the one or more key-value pairs locally stored within the first container such that a latency associated with the execution of the first program code based on the one or more second execution parameters is reduced. - View Dependent Claims (2, 3, 4)
-
-
5. A system comprising:
-
a virtual compute system comprising one or more hardware computing devices executing specific computer-executable instructions and configured to at least; maintain a plurality of virtual machine instances on one or more physical computing devices; process a first request to execute a first program code on the virtual compute system, the first request including account information, one or more parameters to be used for executing the first program code, and an indication that the first program code is to be executed based on data associated with a prior execution of the first program code; identify a first container storing first data associated with one or more computing operations performed by a specific prior execution of the first program code, wherein the first container is on one of the plurality of virtual machine instances; and cause the first program code to be executed in the first container based on the first data and without subsequently performing the one or more computing operations previously performed by the specific prior execution of the first program code. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer-implemented method comprising:
-
as implemented by one or more computing devices configured with specific executable instructions, maintaining a plurality of virtual machine instances on one or more physical computing devices; processing a first request to execute a first program code on a virtual compute system, the first request including account information, one or more parameters to be used for executing the first program code, and an indication that the first program code is to be executed based on data associated with a prior execution of the first program code; identifying a first container storing first data associated with one or more computing operations performed by a specific prior execution of the first program code, wherein the first container is on one of the plurality of virtual machine instances; and causing the first program code to be executed in the first container based on the first data and without subsequently performing the one or more computing operations previously performed by the specific prior execution of the first program code. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification