Predictive management of on-demand code execution

• US 9,811,434 B1
• Filed: 12/16/2015
• Issued: 11/07/2017
• Est. Priority Date: 12/16/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen
• Primary Examiner(s): Swift, Charles
• Application Number:
  US14/971,882
• Time in Patent Office: 692 Days
• Field of Search: None
• CPC Class Codes: G06F 11/30 Monitoring
• CPC Class Codes: G06F 11/3003 Monitoring arrangements specially adapted to the computing system or computing system component being monitored
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/301 where the computing system is a virtual computing platform, e.g. logically partitioned systems virtual machines G06F9/45533; logical partitioning of resources G06F9/5077
• CPC Class Codes: G06F 11/302 where the computing system component is a software system
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3636 by tracing the execution of the program
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: G06F 8/43 Checking; Contextual analysis
• CPC Class Codes: G06F 8/433 Dependency analysis; Data or control flow analysis
• CPC Class Codes: G06F 8/443 Optimisation
• CPC Class Codes: G06F 8/4441 Reducing the execution time required by the program code
• CPC Class Codes: G06F 9/455 Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
• CPC Class Codes: G06F 9/45516 Runtime code conversion or optimisation
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/54 Interprogram communication

Abstract

Systems and methods are described for monitoring code execution within an on-demand code execution environment or other distributed code execution environment. The distributed, asynchronous nature of such environment can make determining the interactions between code executions difficult relative to traditional, non-distributed systems. The present disclosure enables the interrelations between code executions to be monitored by injecting monitoring information into the calls between those code executions. The monitoring information may be propagated through calls, such that a “path” or “trace” of code executions and calls can be determined. Data generated based on the monitoring information can be used to generate a profile for a set of code, so that a developer or other user may easily debug or optimize execution of the code.

Claims

1. A computer-implemented method for monitoring code execution in an on-demand code execution environment, the on-demand code execution environment comprising at least one virtual machine instance executing an initialized operating system and awaiting requests to execute user-specified code within that operating system, the method comprising:

as implemented by one or more computing devices configured with specific computer-executable instructions,

determining a task on the on-demand code execution environment to be actively monitored, wherein the task corresponds to a set of user-defined code executable by the virtual machine instance, and wherein the task is determined based at least in part on a frequency of service calls to the task received at the on-demand code execution environment, each service call requesting execution of the task at the on-demand code execution environment;

associating an individual execution of the task on the on-demand code execution environment with active monitoring information, wherein the active monitoring information identifies the individual execution of the task;

modifying a service call, generated by the individual execution of the task, to include the active monitoring information, wherein the service call invokes at least one of an external service or the on-demand code execution environment;

identifying subsequent service calls, received at the on-demand code execution environment, that include the active monitoring information;

associating the subsequent service calls that include the active monitoring information with the individual execution of the task;

receiving a request to generate a profile from the task;

generating a task profile based at least in part on the individual execution of the task and on the subsequent service calls that include the active monitoring information, wherein the task profile indicates a relationship between the individual execution and the subsequent service calls; and

transmitting the task profile to a computing device of a requesting user for display to the requesting user.

2. The computer-implemented method of claim 1, wherein the task to be actively monitored is identified based at least in part on one or more of an identifier of the task, a source from which calls to the task are received, credentials used to call the task, a timing of calls to the task, parameters included within calls to the task, or information associated with the set of user-defined code corresponding to the task.

3. The computer-implemented method of claim 1, wherein the active monitoring information includes an identifier assigned to the individual execution of the task and to additional executions of tasks caused by the individual execution.

4. The computer-implemented method of claim 1, wherein the active monitoring information includes historical information regarding the individual execution of the task.

5. The computer-implemented method of claim 4, wherein the historical information includes at least one of a source from which a call causing the individual execution was received, prior service calls related to the call to the individual execution, a timing of the prior service calls, or parameters included within the call causing the individual execution.

6. The computer-implemented method of claim 4, wherein the prior service calls are identified within the historical information by a pattern identifier corresponding to the prior service calls.

7. The computer-implemented method of claim 1, wherein the task profile includes a directed graph identifying the individual execution of the task and additional executions of tasks caused by the individual execution.

8. The computer-implemented method of claim 7, wherein nodes of the directed graph identify at least one of individual tasks on the on-demand code execution environment or individual services external to the on-demand code execution environment, and wherein edges of the directed graph indicate calls between the respective individual tasks or individual services.

9. The computer-implemented method of claim 7, wherein at least one node of the directed graph identifies a pattern of calls to one or more tasks on the on-demand code execution environment, one or more services external to the on-demand code execution environment, or a combination thereof.

10. A system for monitoring code execution in a distributed code execution environment, the system comprising:

a computing device comprising a processor coupled to a memory, the memory including specific instructions to cause the computing system to;

determine a task on the distributed code execution environment to be actively monitored, wherein the task corresponds to a set of user-defined code executable within the distributed code execution environment;

associate an individual execution of the task on the distributed code execution environment with active monitoring information, wherein the active monitoring information identifies the individual execution of the task;

modify a service call, generated by the individual execution of the task, to include the active monitoring information, wherein the service call invokes at least one of an external service or the distributed code execution environment;

identify subsequent service calls, received at the distributed code execution environment, that include the active monitoring information;

associate the subsequent service calls that include the active monitoring information with the individual execution of the task;

receive a request to generate a profile from the task;

generate a task profile based at least in part on the individual execution of the task and on the subsequent service calls that include the active monitoring information, wherein the task profile indicates a relationship between the individual execution and the subsequent service calls; and

transmit the task profile to a computing device of a requesting user for display to the requesting user.

11. The system of claim 10, wherein the specific instructions further cause the computing device to identify the task based at least in part on instructions from the requesting user to initiate active monitoring on the task.

12. The system of claim 10, wherein the specific instructions further cause the computing device to identify the task based at least in part on a frequency of service calls to the task.

13. The system of claim 10, wherein the individual execution of the task corresponds to a first individual execution of the task, and wherein the specific instructions further cause the computing device to:

identify a second individual execution of the task on the distributed code execution environment;

determine that the second individual execution of the task is not associated with the active monitoring information;

associate the second individual execution of the task with second active monitoring information, wherein the second active monitoring information identifies the second individual execution of the task as unrelated to the first individual execution of the task;

modify a service call generated by the second individual execution of the task to include the second active monitoring information;

identify subsequent service calls, received at the distributed code execution environment, that include the second active monitoring information; and

associate the subsequent service calls that include the second active monitoring information with the second individual execution of the task.

14. The system of claim 13, wherein the task profile is further generated based at least in part on the second individual execution of the task and on the subsequent service calls that include the second active monitoring information, and indicates a relationship between the second individual execution and the subsequent service calls that include the second active monitoring information.

15. The system of claim 10, wherein the task profile indicates a set of service calls made based on a plurality of executions of the task.

16. The system of claim 10, wherein the task profile indicates a probability that a given execution of the task will result in an individual service call from the set of service calls made based on the plurality of executions of the task.

17. Non-transitory, computer-readable storage media comprising computer-executable instructions for monitoring code execution in a distributed code execution environment, wherein the computer-executable instructions, when executed by a computer system, cause the computer system to:

determine a task on the distributed code execution environment to be actively monitored, wherein the task corresponds to a set of user-defined code executable within the distributed code execution environment;

associate an individual execution of the task on the distributed code execution environment with active monitoring information, wherein the active monitoring information identifies the individual execution of the task;

modify a service call, generated by the individual execution of the task, to include the active monitoring information, wherein the service call invokes at least one of an external service or the distributed code execution environment;

associate subsequent service calls, received at the distributed code execution environment, that include the active monitoring information with the individual execution of the task;

generate a task profile based at least in part on the individual execution of the task and on the subsequent service calls that include the active monitoring information, wherein the task profile indicates a relationship between the individual execution and the subsequent service calls; and

transmit the task profile to a computing device of a requesting user for display to the requesting user.

18. The non-transitory, computer-readable storage media of claim 17, wherein the task profile is generated based on a request from the computing device of the requesting user.

19. The non-transitory, computer-readable storage media of claim 17, wherein the computer-executable instructions cause the computer system to repeatedly update the task profile as new service calls that include the active monitoring information are obtained, and repeatedly transmit updates to the task profile to the computing device of the requesting user.

20. The non-transitory, computer-readable storage media of claim 17, wherein the individual execution of the task corresponds to a first individual execution of the task, and wherein the computer-executable instructions further cause the computer system:

identify a second individual execution of the task on the distributed code execution environment;

determine that the second individual execution of the task is not associated with the active monitoring information;

associate the second individual execution of the task with second active monitoring information, wherein the second active monitoring information identifies the second individual execution of the task as unrelated to the first individual execution of the task;

modify a service call generated by the second individual execution of the task to include the second active monitoring information;

identify subsequent service calls, received at the distributed code execution environment, that include the second active monitoring information; and

associate the subsequent service calls that include the second active monitoring information with the second individual execution of the task.

21. The non-transitory, computer-readable storage media of claim 20, wherein the task profile is further generated based at least in part on the second individual execution of the task and on the subsequent service calls that include the second active monitoring information, and indicates a relationship between the second individual execution and the subsequent service calls that include the second active monitoring information.

22. The non-transitory, computer-readable storage media of claim 17, wherein the task profile indicates a set of service calls made based on a plurality of executions of the task, and wherein the task profile indicates a probability that a given execution of the task will result in an individual service call from the set of service calls made based on the plurality of executions of the task.

23. The non-transitory, computer-readable storage media of claim 17, wherein the computer-executable instructions cause the computer system to modify the service call, generated by the individual execution of the task, to include the active monitoring information at least in part by at least one of modifying code corresponding to the task, modifying a library referenced by the code, or intercepting the service call generated by the individual execution of the task to insert monitoring information into the service call.