Idempotent task execution in on-demand network code execution systems

• US 10,061,613 B1
• Filed: 09/23/2016
• Issued: 08/28/2018
• Est. Priority Date: 09/23/2016
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Brooker, Marc John, Wagner, Timothy Allen, Nair, Ajay
• Primary Examiner(s): Kim, Dong
• Application Number:
  US15/275,228
• Time in Patent Office: 704 Days
• Field of Search: None
• CPC Class Codes: G06F 9/445 Program loading or initiating bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57
• CPC Class Codes: G06F 9/5005 to service a request

Abstract

Systems and methods are described for handling requests to execute idempotent code in an on-demand code execution system or other distributed code execution environment. Idempotent code can generally include code that produces the same outcome even when executed multiple times, so long as dependencies for the code are in the same state as during a prior execution. Due to this feature, multiple executions of idempotent code may inefficiently use computing resources, particularly in on-demand code execution system (which may require, for example, generation and provisioning of an appropriate execution environment for the code). Aspects of the present disclosure enable the on-demand code execution system to process requests to execute code by verifying whether dependency states associated with the code have changed since a prior execution. If dependency states have not changed, no execution need occur, and the overall computing resource us of the on-demand code execution system is decreased.

Claims

1. A system to handle requests to execute tasks on an on-demand code execution system, the system comprising:

a non-transitory data store configured to store an execution record of a task, wherein the task is associated with code executable to implement functionality corresponding to the task on the on-demand code execution system, wherein execution of the task is dependent on a data resource external to the on-demand code execution system and on the code associated with the task, and wherein the execution record indicates, for a prior execution of the task, a state of the external data resource during the prior execution and a state of the code during the prior execution; and

one or more processors configured with computer-executable instructions to;

obtain a request to execute the task;

transmit a request to an auxiliary service to obtain a current state of the data resource external to the on-demand code execution system;

conduct a comparison of the current state of the data resource and the state of the external data resource during the prior execution;

obtain a current state of the code associated with the task;

conduct a comparison the current state of the code and the state of the code during the prior execution;

determine, as a result of the comparisons, that a state of at least one of the data resource or the code has changed since the prior execution; and

in response to determining that the state of at least one of the data resource or the code has changed since the prior execution;

generate an execution environment for the task on the on-demand code execution system;

provision the execution environment with the code; and

execute the code within the execution environment.

2. The system of claim 1, wherein the one or more processors are further configured with computer-executable instructions to update the execution record to reflect execution of the code, the current state of the code, and the current state of the external data resource.

3. The system of claim 2, wherein the one or more processors are further configured with computer-executable instructions to:

obtain a second request to execute the task;

determine an updated current state of the code;

determine an updated current state of the data resource;

conduct a comparison the updated current state of the code and the updated current state of the data resource with respective states recorded in the execution record to determine that no change in state of the code or the data resource has occurred; and

decline to execute the code in response to the second request.

4. The system of claim 3, wherein the one or more processors are further configured with computer-executable instructions to notify a user associated with the task that the second request to execute the task is satisfied without execution of the code in response to the second request.

5. The system of claim 4, wherein the notification includes a result of the execution of the code.

6. A computer-implemented method to handle requests to execute tasks an on-demand code execution system, the computer-implemented method comprising:

obtaining a request to execute a task, wherein the task is associated with code executable by the on-demand code execution system to implement functionality corresponding to the task, and wherein execution of the task is dependent on a set of resources;

obtaining an execution record for the task, wherein the execution record indicates states of respective resources, within the set of resources, associated with a prior execution of the task;

for individual resources of the set of resources on which execution of the task is dependent;

obtaining current states of the individual resources; and

comparing current states of the individual resources and the states in the execution record;

determining that the current state of at least one resource, from the set of resources, does not match the state of the at least one resource recorded in the execution record; and

in response to determining that the current state of the at least one resource does not match the state of the at least one resource recorded in the execution record;

generating an execution environment for the task on the on-demand code execution system, wherein generating the execution environment comprises provisioning the execution environment with the code; and

executing the code within the execution environment to implement functionality corresponding to the task.

7. The computer-implemented method of claim 6, wherein the set of resources include at least one of the code associated with the task, a resource referenced by a parameter passed within the request, or a resource referenced by the code associated with the task.

8. The computer-implemented method of claim 6 further comprising determining at least one resource of the set of resources by conducting at least one of static or dynamic analysis of the code associated with the task.

9. The computer-implemented method of claim 6 further comprising receiving, from a user associated with the task, a designation of at least one resource of the set of resources.

10. The computer-implemented method of claim 6, wherein the execution record indicates states of respective resources, within the set of resources, during a plurality of prior executions of the task.

11. The computer-implemented method of claim 10, wherein determining that the current state of at least one resource, from the set of resources, does not match the state of the at least one resource recorded in the execution record as associated with the prior execution of the task comprises determining that the current state of the at least one resource does not match the state of the at least one resource recorded in the execution record as associated with any prior execution of the task.

12. The computer-implemented method of claim 10, wherein determining that the current state of at least one resource, from the set of resources, does not match the state of the at least one resource recorded in the execution record as associated with the prior execution of the task comprises determining that the current state of the at least one resource does not match the state of the at least one resource recorded in the execution record as associated with an immediately preceding execution of the task.

13. The computer-implemented method of claim 6 further comprising updating the execution record to reflect execution of the code and the current states of the individual resources within the set of resources.

14. The computer-implemented method of claim 13 further comprising:

obtaining a second request to execute the task;

for individual resources of the set of resources on which execution of the task is dependent;

obtaining updated current states of the individual resources; and

comparing updated current states of the individual resources and the states of the respective resources recorded in the execution record to determine that no change in the states of the individual resources has occurred; and

declining to execute the code in response to the second request.

15. Non-transitory computer-readable storage media including computer-executable instructions that, when executed by a computing system, cause the computing system to:

obtain a request to execute a task, wherein the task is associated with code executable by the on-demand code execution system to implement functionality corresponding to the task, and wherein execution of the task is dependent on a set of resources;

obtain an execution record for a task, wherein the execution record indicates states of respective resources, within the set of resources, associated with a prior execution of the task;

for individual resources of the set of resources on which execution of the task is dependent, compare current states of the individual resources and the corresponding states in the execution record;

determine that the current state of at least one resource, from the set of resources, does not match the state of the at least one resource in the execution record; and

in response to a determination that the current state of the at least one resource does not match the state of the at least one resource recorded in the execution record;

generate an execution environment for the task on the on-demand code execution system at least partly by provisioning the execution environment with the code; and

execute the code within the execution environment on-demand code execution system to implement functionality corresponding to the task.

16. The non-transitory computer-readable storage media of claim 15, wherein at least one resource of the set of resources is provided by an external service, wherein the computer-executable instructions cause the computing system to compare current states of the individual resources and the states of the respective resources associated with the prior execution of the task at least in part by transmitting a request to the external service to respond with a notification of whether a state of the at least one resource has changed, and wherein the computer-executable instructions cause the computing system to determine that the current state of at least one resource, from the set of resources, does not match the state of the resource associated with the prior execution of the task at least partly by processing the notification of whether the state of the at least one resource has changed.

17. The non-transitory computer-readable storage media of claim 15, wherein the computer-executable instructions cause the computing system to compare current states of the individual resources and the states of the respective resources associated with the prior execution of the task at least in part according to a comparison operation designated by a user associated with the task.

18. The non-transitory computer-readable storage media of claim 17, wherein the comparison operation includes at least one of execution of a second task or transmission of a request to an external service.

19. The non-transitory computer-readable storage media of claim 17, wherein execution record indicates a state of at least one resource, of the set of resources, by use of at least one of a content of the at least one resource, a hash value of the content, a version number of the at least one resource, or a modification time of the at least one resource.

20. The non-transitory computer-readable storage media of claim 15, wherein the computer-executable instructions further cause the computing system to:

update the execution record to reflect the current states of the individual resources within the set of resources;

obtain a second request to execute the task;

for individual resources of the set of resources on which execution of the task is dependent, compare updated current states of the individual resources and the states of the respective resources reflected in the execution record to determine that no change in the states of the individual resources has occurred; and

decline to execute the code in response to the second request.