Predictive management of on-demand code execution

• US 10,365,985 B2
• Filed: 11/06/2017
• Issued: 07/30/2019
• Est. Priority Date: 12/16/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen
• Primary Examiner(s): Swift, Charles M
• Application Number:
  US15/804,761
• Publication Number:
  US 20180157568A1
• Time in Patent Office: 631 Days
• CPC Class Codes: G06F 11/30 Monitoring
• CPC Class Codes: G06F 11/3003 Monitoring arrangements specially adapted to the computing system or computing system component being monitored
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/301 where the computing system is a virtual computing platform, e.g. logically partitioned systems virtual machines G06F9/45533; logical partitioning of resources G06F9/5077
• CPC Class Codes: G06F 11/302 where the computing system component is a software system
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3636 by tracing the execution of the program
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: G06F 8/43 Checking; Contextual analysis
• CPC Class Codes: G06F 8/433 Dependency analysis; Data or control flow analysis
• CPC Class Codes: G06F 8/443 Optimisation
• CPC Class Codes: G06F 8/4441 Reducing the execution time required by the program code
• CPC Class Codes: G06F 9/455 Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
• CPC Class Codes: G06F 9/45516 Runtime code conversion or optimisation
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/54 Interprogram communication

Abstract

Systems and methods are described for monitoring code execution within an on-demand code execution environment or other distributed code execution environment. The distributed, asynchronous nature of such environment can make determining the interactions between code executions difficult relative to traditional, non-distributed systems. The present disclosure enables the interrelations between code executions to be monitored by injecting monitoring information into the calls between those code executions. The monitoring information may be propagated through calls, such that a “path” or “trace” of code executions and calls can be determined. Data generated based on the monitoring information can be used to generate a profile for a set of code, so that a developer or other user may easily debug or optimize execution of the code.

Claims

1. A system comprising:

a computing device comprising a processor coupled to a memory, the memory including specific instructions to cause the computing device to;

determine a task on a distributed code execution environment to be actively monitored, wherein the task corresponds to a set of user-defined code executable within the distributed code execution environment;

during an individual execution of the task on the distributed code execution environment, modify one or more service calls, generated by the individual execution of the task, to include active monitoring information identifying the individual execution;

identify a service call, received at the distributed code execution environment, that includes the active monitoring information; and

generate a task profile based at least in part on the individual execution of the task and on the service call that includes the active monitoring information, wherein the task profile indicates a relationship between the individual execution and the service call that includes the active monitoring information.

2. The system of claim 1, wherein the service call invokes at least one of an external service or the distributed code execution environment.

3. The system of claim 1, wherein the computing device is further configured to transmit the task profile to a computing device of a requesting user for display to the requesting user.

4. The system of claim 1, wherein the service call received at the distributed code execution environment is distinct from the one or more service calls generated by the individual execution of the task.

5. The system of claim 1, wherein the specific instructions further cause the computer device to repeatedly update the task profile as new service calls that include the active monitoring information are obtained.

6. The system of claim 1, wherein the individual execution of the task corresponds to a first individual execution of the task, and wherein the specific instructions further cause the computing device to:

identify a second individual execution of the task on the distributed code execution environment that is not associated with the active monitoring information;

modify a service call generated by the second individual execution of the task to include second active monitoring information, wherein the second active monitoring information identifies the second individual execution of the task as unrelated to the first individual execution of the task;

identify a service call received at the distributed code execution environment that includes the second active monitoring information; and

associate the service call that includes the second active monitoring information with the second individual execution of the task.

7. A computer-implemented method comprising:

determining a task on a distributed code execution environment to be actively monitored, wherein the task corresponds to a set of user-defined code executable within the distributed code execution environment;

during an individual execution of the task on the distributed code execution environment, modifying one or more service calls, generated by the individual execution of the task, to include active monitoring information identifying the individual execution;

identifying a service call, received at the distributed code execution environment, that includes the active monitoring information; and

generating a task profile based at least in part on the individual execution of the task and on the service call that includes the active monitoring information, wherein the task profile indicates a relationship between the individual execution and the service call that includes the active monitoring information.

8. The computer-implemented method of claim 7 further comprising repeatedly updating the task profile as new service calls that include the active monitoring information are obtained.

9. The computer-implemented method of claim 7, wherein the individual execution of the task corresponds to a first individual execution of the task, and wherein the computer-implemented method further comprises:

identifying a second individual execution of the task on the distributed code execution environment that is not associated with the active monitoring information;

modifying a service call generated by the second individual execution of the task to include second active monitoring information, wherein the second active monitoring information identifies the second individual execution of the task as unrelated to the first individual execution of the task;

identifying a service call received at the distributed code execution environment that includes the second active monitoring information; and

associating the service call that includes the second active monitoring information with the second individual execution of the task.

10. The computer-implemented method of claim 7, wherein the active monitoring information includes an identifier assigned to the individual execution of the task and to additional executions of tasks caused by the individual execution.

11. The computer-implemented method of claim 7, wherein the active monitoring information includes historical information regarding the individual execution of the task.

12. The computer-implemented method of claim 11, wherein the prior service calls are identified within the historical information by a pattern identifier corresponding to the prior service calls.

13. Non-transitory computer-readable media comprising computer-executable instructions that, when executed by a computing system, cause the system to:

determine a task on a distributed code execution environment to be actively monitored, wherein the task corresponds to a set of user-defined code executable within the distributed code execution environment;

during an individual execution of the task on the distributed code execution environment, modify one or more service calls, generated by the individual execution of the task, to include active monitoring information identifying the individual execution;

identify a service call, received at the distributed code execution environment, that includes the active monitoring information; and

generate a task profile based at least in part on the individual execution of the task and on the service call that includes the active monitoring information, wherein the task profile indicates a relationship between the individual execution and the service call that includes the active monitoring information.

14. The non-transitory, computer-readable storage media of claim 13, wherein the computer-executable instructions cause the computer system to repeatedly update the task profile as new service calls that include the active monitoring information are obtained.

15. The non-transitory, computer-readable storage media of claim 13, wherein the task profile indicates a set of service calls made based on a plurality of executions of the task, and wherein the task profile indicates a probability that a given execution of the task will result in an individual service call from the set of service calls made based on the plurality of executions of the task.

16. The non-transitory, computer-readable storage media of claim 13, wherein the computer-executable instructions cause the computer system to modify the one or more service calls, generated by the individual execution of the task, to include the active monitoring information at least in part by at least one of modifying code corresponding to the task, modifying a library referenced by the code, or intercepting the one or more service calls generated by the individual execution of the task to insert monitoring information into the one or more service calls.

17. The non-transitory, computer-readable storage media of claim 13, wherein the task to be actively monitored is identified based at least in part on one or more of an identifier of the task, a source from which calls to the task are received, credentials used to call the task, a timing of calls to the task, parameters included within calls to the task, or information associated with the set of user-defined code corresponding to the task.

18. The non-transitory, computer-readable storage media of claim 13, wherein the task profile includes a directed graph identifying the individual execution of the task and additional executions of tasks caused by the individual execution.

19. The non-transitory, computer-readable storage media of claim 18, wherein nodes of the directed graph identify at least one of individual tasks on the on-demand code execution environment or individual services external to the on-demand code execution environment, and wherein edges of the directed graph indicate calls between the respective individual tasks or individual services.

20. The non-transitory, computer-readable storage media of claim 19, wherein the task profile indicates a probability that a given execution of the task will result in an individual service call from the set of service calls made based on the plurality of executions of the task.