Efficient region selection system for executing request-driven code

• US 10,372,499 B1
• Filed: 12/27/2016
• Issued: 08/06/2019
• Est. Priority Date: 12/27/2016
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Radhakrishnan, Manigandan, Brooker, Marc John, Cecen, Yilmaz Can, Dunlap, David Alexander, Howard, Craig Wesley, Katiyar, Shubham, Nair, Ajay, Vijayaraghavan, Venkatesh, Vuong, Vo, Vembusubramanian, Meenakshi
• Primary Examiner(s): Kim, Sisley N
• Application Number:
  US15/391,696
• Time in Patent Office: 952 Days
• CPC Class Codes: G06F 2209/549 Remote execution
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5033 considering data affinity
• CPC Class Codes: G06F 9/5044 considering hardware capabilities

Abstract

An on-demand code execution environment present in points of presence (POPs) and in regions serviced by the POPs is provided herein. For example, a POP may receive a request to execute a task associated with user-defined code. If the POP determines that the computing resources necessary to execute a received task are not available or that the POP should not execute the received task for another reason (e.g., the task is not commonly received and the computing resources needed to execute the task are therefore best allocated for other requests), the POP can identify a region suitable for executing the task and forward the task to the identified region. An on-demand code execution environment present in the identified region can execute the task and forward the results of the execution to the POP for distribution back to a user device that requested the task execution.

Claims

1. A computer-implemented method of selecting a location at which to execute user-defined code, the method comprising:

receiving a first set of user-defined code that is generated by a user for execution on a first on-demand code execution environment at a point of presence (POP), wherein the first on-demand code execution environment comprises a plurality of virtual machine instances executing an initialized operating system and awaiting requests to execute user-defined code within that operating system;

replicating the first set of user-defined code to a first set of geographic regions in a plurality of geographic regions;

receiving, from a user device associated with the user that generated the first set of user-defined code, a request to execute a task, wherein execution of the task comprises execution of the first set of user-defined code, and wherein the request comprises an argument for use in execution of the first set of user-defined code;

determining that the task should not be executed by the first on-demand code execution environment;

determining that a current version of the first set of user-defined code is replicated to the first set of geographic regions in the plurality of geographic regions;

selecting a first geographic region in the first set of geographic regions to execute the task based at least in part on requests to execute the task previously received by a second on-demand code execution environment located in the first geographic region;

transmitting the request to execute the task to the first geographic region such that the task is executed by the second on-demand code execution environment, wherein the first on-demand code execution environment is located at a geographic location different than the first geographic region; and

transmitting results of execution of the task to the user device.

2. The computer-implemented method of claim 1, wherein the first set of geographic regions comprises a second geographic region, and wherein the method further comprises instructing the second geographic region to provision a virtual machine instance for executing the task.

3. The computer-implemented method of claim 2, further comprising:

receiving an indication that the virtual machine instance is provisioned;

receiving, from a second user device, a second request to execute the task;

determining that the task should not be executed by the first on-demand code execution environment;

selecting the second geographic region to execute the task;

transmitting the second request to execute the task to the second geographic region such that the task is executed by a third on-demand code execution environment; and

transmitting second results of execution of the task to the second user device.

4. The computer-implemented method of claim 1, wherein the second on-demand code execution environment comprises a first virtual machine instance that executes the task by processing the current version of the first set of user-defined code.

5. The computer-implemented method of claim 1, wherein that the task should not be executed by the first on-demand code execution environment further comprises determining that the task should not be executed by the first on-demand code execution environment based on at least one of an amount of computing resources available to the one or more computing devices, how often the one or more computing devices are requested to execute the task, a duration of time to execute the task by the first on-demand code execution environment, a duration of time to execute the task by the second on-demand code execution environment, a historical volume of requests received from the user device, a time of day that the request to execute the task is received, a latency-sensitivity of the task, or properties of the task.

6. A system for selecting a location at which to execute user-defined code, the system comprising:

a first on-demand code execution environment that comprises a first computing device configured to execute code at a point of presence (POP); and

a second computing device comprising a processor in communication with the first on-demand code execution environment and configured with specific computer-executable instructions to;

receive a first set of user-defined code that is generated by a user for execution on the first on-demand code execution environment;

receive, from a user device associated with the user that generated the first set of user-defined code, a request to execute a task, wherein execution of the task comprises execution of the first set of user-defined code;

determine that the task should not be executed by the first on-demand code execution environment;

receive an indication that a copy of the first set of user-defined code is replicated to a first set of geographic regions in a plurality of geographic regions;

select a first geographic region in the first set of geographic regions to execute the task based at least in part on the first geographic region having a current version of the first set of user-defined code, wherein a second on-demand code execution environment is located in the first geographic region;

transmit the request to execute the task to the first geographic region such that the task is executed by the second on-demand code execution environment; and

transmit results of execution of the task to the user device.

7. The system of claim 6, wherein the first set of geographic regions comprises a second geographic region, and wherein second computing device is further configured with specific computer-executable instructions to instruct the second geographic region to provision a virtual machine instance for executing the task.

8. The system of claim 7, wherein second computing device is further configured with specific computer-executable instructions to:

receive an indication that the virtual machine instance is provisioned;

receive, from a second user device, a second request to execute the task;

determine that the task should not be executed by the first on-demand code execution environment;

select the second geographic region to execute the task;

transmit the second request to execute the task to the second geographic region such that the task is executed by a third on-demand code execution environment; and

transmit second results of execution of the task to the second user device.

9. The system of claim 6, wherein the first computing device is at least one of a virtual machine instance or a physical computing device.

10. The system of claim 6, wherein the second on-demand code execution environment comprises a first virtual machine instance that executes the task by processing the copy of the first set of user-defined code.

11. The system of claim 6, wherein the second computing device is further configured with specific computer-executable instructions to determine that the task should not be executed by the first on-demand code execution environment based on at least one of an amount of computing resources available to the system, how often the system is requested to execute the task, a duration of time to execute the task by the first on-demand code execution environment, a duration of time to execute the task by the second on-demand code execution environment, a historical volume of requests received from the user device, a time of day that the request to execute the task is received, a latency-sensitivity of the task, or properties of the task.

12. The system of claim 6, wherein the second computing device is further configured with specific computer-executable instructions to select the first geographic region in the first set of geographic regions to execute the task based on at least one of the first geographic region having a current version of the user-defined code stored therein, the first geographic region having a virtual machine instance provisioned to execute the task, or the first geographic region having previously received a second request to execute the task.

13. The system of claim 6, wherein the POP services the first geographic region.

14. The system of claim 13, wherein the POP services the first geographic region and a second geographic region in the plurality of geographic regions, and wherein a third on-demand code execution environment is located in the second geographic region.

15. The system of claim 14, wherein the first set of user-defined code is associated with a third geographic region in the plurality of geographic regions, and wherein the current version of the first set of user-defined code has not been replicated to the second geographic region.

16. Non-transitory, computer-readable storage media comprising computer-executable instructions for selecting a location at which to execute code, wherein the computer-executable instructions, when executed by a computer system at a point of presence (POP), cause the computer system to:

receive a first set of user-defined code that is generated by a user for execution on a first on-demand code execution environment, wherein the first on-demand code execution environment comprises a first computing device configured to execute code;

receive a request to execute a task, wherein execution of the task comprises execution of the first set of user-defined code;

determine that the task should not be executed by the first on-demand code execution environment;

receive an indication that a copy of the first set of user-defined code is replicated to a first set of geographic regions in a plurality of geographic regions;

select a first geographic region in the first set of geographic regions to execute the task based at least in part on the first geographic region having a current version of the first set of user-defined code, wherein a second on-demand code execution environment is located in the first geographic region; and

transmit the request to execute the task to the first geographic region such that the task is executed by the second on-demand code execution environment.

17. The non-transitory, computer-readable storage media of claim 16, wherein the first set of geographic regions comprises a second geographic region, and wherein the computer-executable instructions further cause the computer system to:

instruct the second geographic region to provision a virtual machine instance for executing the task;

receive an indication that the virtual machine instance is provisioned;

receive, from a second user device, a second request to execute the task;

determine that the task should not be executed by the first on-demand code execution environment;

select the second geographic region to execute the task;

transmit the second request to execute the task to the second geographic region such that the task is executed by a third on-demand code execution environment; and

transmit second results of execution of the task to the second user device.

18. The non-transitory, computer-readable storage media of claim 16, wherein the computer-executable instructions further cause the computer system to transmit results of execution of the task to a user device.

19. The non-transitory, computer-readable storage media of claim 16, wherein the POP services the first geographic region and a second geographic region in the plurality of geographic regions.

20. The non-transitory, computer-readable storage media of claim 19, wherein the first set of user-defined code is associated with a third geographic region in the plurality of geographic regions, and wherein the current version of the first set of user-defined code has not been replicated to the second geographic region.