Logging endpoint in an on-demand code execution system

• US 10,776,091 B1
• Filed: 02/26/2018
• Issued: 09/15/2020
• Est. Priority Date: 02/26/2018
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen, Brooker, Marc John, Moffatt, Bryan Nicholas, Rodrigues dos Santos, Robison, Jayakar, Niranjan
• Primary Examiner(s): Nguyen, Duy Khuong T
• Application Number:
  US15/905,342
• Time in Patent Office: 932 Days
• CPC Class Codes: G06F 17/40 Data acquisition and logging for input to computer G06F3/00
• CPC Class Codes: G06F 2009/45591 Monitoring or debugging support
• CPC Class Codes: G06F 2209/5011 Pool
• CPC Class Codes: G06F 8/4441 Reducing the execution time required by the program code
• CPC Class Codes: G06F 8/447 Target code generation
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

Systems and methods are described for providing logging functionalities to code executing in an on-demand code execution system while minimizing the need to define such functionalities within the code. A logging endpoint is provided that can be called by an execution of code and passed information for logging. The logging endpoint can enrich the information with additional information, such as information regarding a state of an execution environment for the code (which additional information may not be accessible to the execution of code itself). The logging endpoint can then facilitate storage of the enriched logging information, such as by handling authentication to a storage endpoint. Thus, users of the system may author code that provides robust logging functionalities while minimizing the implementation of such functionalities within the authored code.

Claims

1. A system comprising:

a non-transitory data store including user-submitted code executable within an isolated execution environment on an on-demand code execution system, wherein the code includes a reference to a logging endpoint;

a computing device providing the isolated execution environment and configured to execute the user-submitted code, wherein execution of the user-submitted code causes the one or more computing devices to generate log data regarding the execution within the isolated execution environment and to transmit the log data to the logging endpoint;

a computing device comprising a processor and implementing the logging endpoint, wherein implementation of the logging endpoint is causes the computing device to;

receive the log data from the execution of the user-submitted code within the isolated execution environment;

in response to receiving the log data;

determine state information regarding a state of the on-demand code execution system at a time of receiving the log data from the execution of the user-submitted code within the isolated execution environment, the state information being inaccessible to the execution of the of the user-submitted code;

combine the received log data with the state information regarding the state of the on-demand code execution system at the time of receiving the log data to result in enriched log data;

determine an output location for the enriched log data; and

store the enriched log data at the determined output location.

2. The system of claim 1, wherein the state information regarding a state of the on-demand code execution system at the time of receiving the log data comprises at least one of a state of a software container representing the isolated execution environment, a state of a virtual machine instance including the isolated execution environment, a state of a physical host computing device including the isolated execution environment, or a state of an auxiliary service in communication with the isolated execution environment.

3. The system of claim 1, wherein the state information includes at least one of a time of generation of the log data, resource usage of the isolated execution environment, computing resources available to the isolated execution environment, a number of executions of user-submitted code occurring within the isolated execution environment, or a number of other execution environments hosted by a physical host computing device hosting the isolated execution environment.

4. The system of claim 3, wherein the time of generation of the log data is inferred based on a time of reception of the log data at the logging endpoint.

5. The system of claim 1, wherein the computing device providing the isolated execution environment and the computing device implementing the logging endpoint are the same computing device.

6. A computer-implemented method comprising:

executing, within an isolated execution environment of an on-demand code execution system, user-submitted code, wherein the code includes a reference to a logging endpoint, and wherein execution of the user-submitted code causes generation of log data regarding the execution within the isolated execution environment and transmission of the log data to the logging endpoint;

receiving, at the logging endpoint, the log data regarding the execution of the user-submitted code within the isolated execution environment;

in response to receiving the log data;

determining, at the logging endpoint, state information regarding a state of the on-demand code execution system at a time of receiving the log data from the execution of the user-submitted code within the isolated execution environment;

combining, at the logging endpoint, the received log data with the state information regarding the state of the on-demand code execution system at the time of receiving the log data to result in enriched log data; and

transmitting, from the logging endpoint, the enriched log data to an output location.

7. The computer-implemented method of claim 6, wherein the reference to the logging endpoint within the user-submitted code includes a uniform resource identifier (URI) associated with a plurality of logging endpoints, and wherein the computer-implemented method further comprises:

receiving from the execution of the user-submitted code a domain name system (DNS) query requesting resolution of the URI;

identifying the logging endpoint from the plurality of logging endpoints based on a physical host computing device hosting both the logging endpoint and the execution environment; and

returning to the execution of the user-submitted code a network address of the logging endpoint.

8. The computer-implemented method of claim 6, wherein at least a portion of the state information is inaccessible to the execution of the user-submitted code.

9. The computer-implemented method of claim 6, wherein the log data is received via a call to an application programming interface (API).

10. The computer-implemented method of claim 9, wherein the API is a hypertext transport protocol (HTTP) API.

11. The computer-implemented method of claim 9, wherein the call to the API specifies a type of state information to be included within the state information.

12. The computer-implemented method of claim 6, wherein a type of state information to be included within the state information is specified as metadata for the user-submitted code.

13. The computer-implemented method of claim 6 further comprising authenticating the logging endpoint to the output location based at least partly on authentication information specified as metadata for the user-submitted code.

14. Non-transitory computer-readable media comprising computer-executable instructions that, when executed on an on-demand code execution system comprising a processor, cause the on-demand code execution system to implement a logging endpoint configured to:

obtain log data transmitted from an isolated execution environment of the on-demand code execution system during execution of user-submitted code within the execution environment, wherein the user-submitted code includes a reference to a logging endpoint, and wherein execution of the user-submitted code causes generation of the log data regarding the execution within the isolated execution environment and transmission of the log data to the logging endpoint;

in response to receiving the log data;

determine state information regarding a state of the on-demand code execution system at a time of receiving the log data from the execution of the user-submitted code within the isolated execution environment;

combine the received log data with the state information regarding the state of the on-demand code execution system at the time of receiving the log data to result in enriched log data; and

transmit the enriched log data to an output location.

15. The non-transitory computer-readable media of claim 14, wherein the isolated execution environment includes at least one of a software container, a virtual machine instance, or a physical computing device.

16. The non-transitory computer-readable media of claim 14, wherein the user-submitted code is first user-submitted code, and wherein the output location is an execution of second user-submitted code on the on-demand code execution system.

17. The non-transitory computer-readable media of claim 16, wherein the execution of second user-submitted code on the on-demand code execution system is configured to format the enriched log data for storage at a network-accessible storage service and store the enriched log data at the network-accessible storage service.

18. The non-transitory computer-readable media of claim 17, wherein the execution of second user-submitted code on the on-demand code execution system is further configured to authenticate the second user-submitted code with the network-accessible storage service on behalf of the first user-submitted code.

19. The non-transitory computer-readable media of claim 14, wherein the logging endpoint is further configured to:

obtain second log data transmitted from the execution environment of the on-demand code execution system during execution of the user-submitted code;

determine second state information regarding the state of the on-demand code execution system during the execution of the user-submitted code; and

enrich the second log data with the second state information to result in second enriched log data; and

wherein transmission of the enriched log data to the output location further includes transmission of the second enriched log data.

20. The non-transitory computer-readable media of claim 14, wherein transmission of the enriched log data to the output location occurs subsequent to halting of the execution of the user-submitted code.