Executing user-defined code in response to determining that resources expected to be utilized comply with resource restrictions

• US 10,754,701 B1
• Filed: 12/16/2015
• Issued: 08/25/2020
• Est. Priority Date: 12/16/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen
• Primary Examiner(s): An, Meng Ai T
• Assistant Examiner(s): Ayers, Michael W
• Application Number:
  US14/971,794
• Time in Patent Office: 1,714 Days
• CPC Class Codes: G06F 9/5055 considering software capabilities, i.e. software resources associated or available to the machine
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

Systems and methods are described for determining a location in an on-demand code execution environment to execute user-specified code. The on-demand code execution environment may include many points of presence (POPs), some of which have limited computing resources. An execution profile for a set of user-specified code can be determined that indicates the resources likely to be used during execution of the code. Each POP of the environment may compare that execution profile to resource restrictions of the POP, to determine whether execution of the code should be permitted. In some instances, where execution of the code should not be permitted at a given POP, an alternative POP may be selected to execute the code.

Claims

1. A computer-implemented method of selecting an execution location in an on-demand code execution environment, the on-demand code execution environment comprising a plurality of points of presence (POPs) on which user-defined code may be executed, the method comprising:

as implemented by one or more computing devices configured with specific computer-executable instructions,

generating an execution profile for a task associated with the on-demand code execution environment and generated by a user of the on-demand code execution environment, the task represented by at least a first set of user-defined executable code, wherein the execution profile indicates amounts of individual computing resources, from a set of computing resources, that an execution of the first set of user-defined executable code representing the task on the on-demand code execution environment is expected to utilize;

obtaining, from a client computing device distinct from a first POP of the plurality of POPs, a request for the first POP to execute the first set of user-defined executable code representing the task on behalf of the client computing device;

prior to satisfying the request by executing the first set of user-defined executable code representing the task at the first POP on behalf of the client computing device, comparing the execution profile of the task to a set of resource restrictions associated with the first POP, indicating at least a maximum time in which execution of the first set of user-defined executable code representing the task is expected to complete, to determine that the amounts of individual computing resources, from the set of computing resources, expected to be utilized during execution of the first set of user-defined executable code representing the task at the first POP comply with the resource restrictions of the first POP; and

causing the first POP to execute the first set of user-defined executable code representing the task on behalf of the client computing device in response to determining that the amounts of individual computing resources expected to be utilized complies with the resource restrictions of the first POP.

2. The computer-implemented method of claim 1, wherein causing the first POP to execute the task comprises selecting a virtual machine, from a plurality of virtual machines implemented at the first POP, on which to execute the task.

3. The computer-implemented method of claim 2, wherein the virtual machine is pre-initialized with an operating environment on which to execute the task.

4. The computer-implemented method of claim 1, wherein the execution profile for the task is determined based at least in part on at least one of static analysis of the first set of user-defined executable code or dynamic analysis of executions of the first set of user-defined executable code, wherein static analysis comprises analysis of the first set of user-defined executable code independent of execution of the code, and where dynamic analysis comprises analysis of information regarding the executions of the first set of user-defined executable code.

5. The computer-implemented method of claim 1, wherein the execution profile for the task is determined based at least in part on at least one of function calls included within the first set of user-defined executable code, libraries referenced within the first set of user-defined executable code, or permissions requested for execution of the first set of user-defined code.

6. The computer-implemented method of claim 1, wherein the execution profile for the task is generated based at least in part on static analysis of the first set of user defined executable code, wherein static analysis comprises analysis of content of the first set of user-defined executable code independent of execution of the code.

7. A system for selecting an execution location in an on-demand code execution environment, the on-demand code execution environment comprising a plurality of points of presence (POPs) on which user-defined code may be executed, the system comprising:

a non-transitory data store including an execution profile for a task associated with the on-demand code execution environment and generated by a user of the on-demand code execution environment, the task represented by at least a set of user-defined executable code, wherein the execution profile indicates individual computing resources, from a set of computing resources, that an execution of the set of user-defined executable code representing the task on the on-demand code execution environment is expected to utilize; and

a computing device implementing functionalities of a first POP from the plurality of POPs, the computing device comprising a processor in communication with the non-transitory data store and configured with specific computer-executable instructions to;

obtain, from a client computing device distinct from the first POP, a request for the first POP to execute the set of user-defined executable code representing the task_i

prior to satisfying the request by executing the set of user-defined executable code representing the task at the first POP, compare the execution profile of the task to a set of resource restrictions associated with the first POP, indicating at least a maximum time in which execution of the set of user-defined executable code representing the task is expected to complete, to determine that the individual computing resources, from the set of computing resources, expected to be utilized during execution of the set of user-defined executable code representing the task at the first POP comply with the set of resource restrictions of the first POP; and

cause the first POP to execute the set of user-defined executable code representing the task in response to determining that the amounts of individual computing resources expected to be utilized complies with the resource restrictions of the first POP.

8. The system of claim 7, wherein the request to execute the set of user-defined executable code representing the task corresponds to at least one of an application programming interface (API) call, a hypertext transport protocol (HTTP) request, a request generated by execution of another task on the on-demand code execution environment, or a request generated by the on-demand code execution environment based on data obtained from an auxiliary service.

9. The system of claim 7, wherein the set of resource restrictions associated with the first POP are determined based at least in part on a set of other tasks assigned for execution at the first POP.

10. The system of claim 7, wherein the computing device is further configured with specific computer-executable instructions to:

obtain a request to execute, at the first POP, a second set of user-defined executable code representing a second task;

compare an execution profile of the second task to the set of resource restrictions associated with the first POP to determine that the individual computing resources, from the set of computing resources, expected to be utilized during execution of the second set of user-defined executable code representing the second task do not comply with the set of resource restrictions; and

transmit the request to execute the second set of user-defined executable code representing the second task to a second POP from the plurality of POPs.

11. The system of claim 10, wherein the computing device is further configured with specific computer-executable instructions to select the second POP from the plurality of POPs based at least in part on a set of resource restrictions associated with the second POP.

12. The system of claim 7, wherein the computing resources expected to be utilized during execution of the set of user-defined executable code representing the task include at least one of computing resources local to computing device that implements a virtual machine instance executing the set of user-defined executable code representing the task or computing resources external to the computing device.

13. The system of claim 10, wherein the second POP is associated with lower resource restrictions than the first POP.

14. The system of claim 10, wherein the second POP is not configured to enforce resource restrictions.

15. Non-transitory, computer-readable storage media comprising computer executable instructions for selecting an execution location in an on-demand code execution environment, the on-demand code execution environment comprising a plurality of points of presence (POPs) on which user-defined code may be executed, wherein the computer-executable instructions, when executed by a computer system, cause the computer system to:

obtain, from a client computing device distinct from a first POP of the plurality of POPs, a request for the first POP to execute a set of user-defined executable code representing a task at the first POP;

prior to satisfying the request by executing the set of user-defined executable code representing the task at the first POP, determine that an execution profile for the task complies with a set of resource restrictions on the first POP indicating at least a maximum time in which execution of the set of user-defined executable code representing the task is expected to complete, wherein the execution profile indicates individual computing resources, from a set of computing resources, that an execution of the set of user-defined executable code representing the task on the on-demand code execution environment is expected to utilize, and wherein compliance with the set of resource restrictions indicates that the amounts of individual computing resources, from the set of computing resources, expected to be utilized during execution of the set of user-defined executable code representing the task at the first POP fall within threshold limits established within the resource restrictions on the first POP; and

cause the first POP to execute the set of user-defined executable code representing the task in response to determining that the amounts of individual computing resources expected to be utilized complies with the resource restrictions of the first POP.

16. The non-transitory, computer-readable storage media of claim 15, wherein the set of user-defined executable code is executed by a pre-initialized virtual machine instance of the first POP.

17. The non-transitory, computer-readable storage media of claim 15, wherein the set of resource restrictions associated with the first POP are determined based at least in part on a set of other tasks assigned for execution at the first POP.

18. The non-transitory, computer-readable storage media of claim 15, wherein the computer-executable instructions further cause the computer system to:

obtain a request to execute, at the first POP, a second set of user-defined executable code representing a second task;

compare an execution profile of the second task to the set of resource restrictions associated with the first POP to determine that the individual computing resources, from the set of computing resources, expected to be utilized during execution of the second set of user-defined executable code representing the second task do not comply with the set of resource restrictions; and

transmit the request to execute the second set of user-defined executable code representing the second task to a second POP from the plurality of POPs.

19. The non-transitory, computer-readable storage media of claim 18, wherein the computer-executable instructions further cause the computer system to select the second POP from the plurality of POPs based at least in part on a set of resource restrictions associated with the second POP.

20. The non-transitory, computer-readable storage media of claim 15, wherein the computing resources expected to be utilized during execution of the set of user-defined executable code representing the task include at least one of computing resources local to a computing device that implements a virtual machine instance executing the set of user defined executable code representing the task or computing resources external to the computing device.