Processing event messages for user requests to execute program code

• US 10,162,688 B2
• Filed: 11/01/2016
• Issued: 12/25/2018
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen
• Primary Examiner(s): Wathen, Brian W
• Assistant Examiner(s): Seye, Abdou K
• Application Number:
  US15/340,825
• Publication Number:
  US 20170116051A1
• Time in Patent Office: 784 Days
• Field of Search: None
• CPC Class Codes: G06F 2209/5011 Pool
• CPC Class Codes: G06F 2209/549 Remote execution
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues

Abstract

A service manages a plurality of virtual machine instances for low latency execution of user codes. The service can provide the capability to execute user code in response to events triggered on an auxillary service to provide implicit and automatic rate matching and scaling between events being triggered on the auxiliary service and the corresponding execution of user code on various virtual machine instances. An auxiliary service may be configured as an event triggering service to detect events and generate event messages for execution of the user codes. The service can request, receive, or poll for event messages directly from the auxiliary service or via an intermediary message service. Event messages can be rapidly converted to requests to execute user code on the service. The time from processing the event message to initiating a request to begin code execution is less than a predetermined duration, for example, 100 ms.

Claims

1. A system for processing event messages to cause execution of program codes on one or more virtual machine instances, the system comprising:

a front end computing system comprising one or more hardware computing devices executing specific computer-executable instructions, said front end computing system in communication with (i) a message queue system configured to store event messages and (ii) a virtual compute system configured to execute program codes, the front end computing system configured to at least;

retrieve, from the message queue system, a first event message including event data relating to a first triggering event;

identify, based on the event data included in the first event message, (i) a first program code to be executed by the virtual compute system and (ii) one or more input parameters to the first program code; and

cause the virtual compute system to execute the first program code using the one or more input parameters.

2. The system of claim 1, wherein the first triggering event comprises a data file being uploaded to a remote storage system in communication with the message queue system.

3. The system of claim 1, wherein the first triggering event comprises a database table being updated in a database system in communication with the message queue system.

4. The system of claim 1, wherein the event data comprises one or more of (i) a user account identifier identifying a user account associated with the first program code, (ii) a program code identifier associated with the first program code, and (iii) one or more input parameter identifiers identifying the one or more input parameters to the first program code.

5. The system of claim 1, wherein the message queue system is separate and distinct from the virtual compute system.

6. The system of claim 1, wherein the event data is indicative of one or more of (i) an operating system on which the first program code is to be executed and (ii) a program language in which the first program code is written.

7. A computer-implemented method for executing program codes in response to triggering events comprising:

as implemented by one or more computing devices configured with specific executable instructions,

receiving an event message including event data relating to a first triggering event;

identifying, based on the event data included in the event message, (i) a first program code to be executed by a virtual compute system configured to execute program codes on one or more virtual machine instances and (ii) one or more input parameters to the first program code, the first program code configured to be executed in response to an occurrence of the first triggering event;

identifying a virtual machine instance to be used to execute the first program code; and

executing the first program code on the virtual machine instance using the one or more input parameters.

8. The computer-implemented method of claim 7, wherein the event message includes one or more of (i) a user account identifier identifying a user account associated with the first program code, (ii) a program code identifier associated with the first program code, and (iii) one or more input parameter identifiers identifying the one or more input parameters to the first program code.

9. The computer-implemented method of claim 7, wherein the event message includes an indication that the event message was generated in response to the occurrence of the first triggering event.

10. The computer-implemented method of claim 7, wherein the event message includes an indication of an event source environment in which the first triggering event occurred.

11. The computer-implemented method of claim 7, wherein the first triggering event comprises a first file being uploaded onto a file storage system configured to store data files, wherein the first program code is configured to generate a second file based on a content of the first file.

12. The computer-implemented method of claim 7, wherein the first triggering event comprises a first file being uploaded onto a file storage system configured to store data files, wherein the virtual compute system is further configured to execute the first program code with the first file as an input to the first program code.

13. The computer-implemented method of claim 7, wherein the virtual compute system is further configured to identify the first program code based on a mapping configured to map a given event message to one or more of a plurality of program codes.

14. The computer-implemented method of claim 7, wherein the event message is an aggregate event message associated with multiple program codes, wherein the virtual compute system is further configured to determine, prior to causing one or more second ones of the multiple program codes to be execute, that a first one of the multiple program codes has finished executing, wherein the first one of the multiple program codes is different from any of the one or more second ones of the multiple program codes.

15. The computer-implemented method of claim 7, further comprising receiving the event message from an event source that is provided by a computing system separate and distinct from the virtual compute system.

16. The computer-implemented method of claim 7, further comprising causing the first program code to be executed inside a container created on the virtual machine instance assigned to a user account associated with the first program code.

17. Non-transitory physical computer storage comprising computer executable instructions that, when executed by one or more hardware processors, configure the one or more hardware processors to:

access an event message including event data relating to a triggering event;

identify, based on the event data included in the event message, (i) a first program code to be executed by a virtual compute system configured to execute program codes on one or more virtual machine instances and (ii) one or more input parameters to the first program code;

identify a virtual machine instance on which to execute the first program code; and

cause the first program code to be executed on the virtual machine instance using the one or more input parameters.

18. The non-transitory physical computer storage of claim 17, wherein the computer executable instructions further cause the one or more hardware processors to access the event message at an auxiliary service configured to store event messages generated in response to respective triggering events, wherein the auxiliary service is provided by a computing system that is separate and distinct from the virtual compute system.

19. The non-transitory physical computer storage of claim 17, wherein the event data is indicative of one or more of (i) an operating system on which the first program code is to be executed and (ii) a program language in which the first program code is written.

20. The computer-readable, non-transitory storage medium of claim 17, wherein the computer executable instructions further cause the one or more hardware processors to cause the first program code to be executed inside a container created on the virtual machine instance assigned to a user account associated with the first program code.