PROGRAMMATIC EVENT DETECTION AND MESSAGE GENERATION FOR REQUESTS TO EXECUTE PROGRAM CODE

• US 20160092251A1
• Filed: 09/30/2014
• Published: 03/31/2016
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen
• Granted Patent: US 9,323,556 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/301 where the computing system is a virtual computing platform, e.g. logically partitioned systems virtual machines G06F9/45533; logical partitioning of resources G06F9/5077
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 2209/544 Remote
• CPC Class Codes: G06F 2209/548 Queue
• CPC Class Codes: G06F 9/45508 Runtime interpretation or emulation, e g. emulator loops, bytecode interpretation
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06F 9/547 Remote procedure calls [RPC]; Web services
• CPC Class Codes: H04L 41/06 Management of faults, events, alarms or notifications

Abstract

A service manages a plurality of virtual machine instances for low latency execution of user codes. The service can provide the capability to execute user code in response to events triggered on an auxillary service to provide implicit and automatic rate matching and scaling between events being triggered on the auxiliary service and the corresponding execution of user code on various virtual machine instances. An auxiliary service may be configured as an event triggering service to detect events and generate event messages for execution of the user codes. The service can request, receive, or poll for event messages directly from the auxiliary service or via an intermediary message service. Event messages can be rapidly converted to requests to execute user code on the service. The time from processing the event message to initiating a request to begin code execution is less than a predetermined duration, for example, 100 ms.

Claims

1. A system for providing event messages for requests to execute program code on a virtual compute system, the system comprising:

an electronic data store configured to store at least programmatic event handling information related to a program code of a user; and

an event triggering computing system comprising one or more hardware computing devices executing specific computer-executable instructions said event triggering computing system in communication with a message queue system, the event triggering computing system configured to at least;

detect an event on the event triggering computing system, wherein the event is detected at a first time;

determine, based on the programmatic event handling information related to the program code of the user, whether the event is designated to trigger execution of the program code of the user on the virtual compute system, said programmatic event handling information accessed from the electronic data store, wherein the virtual compute system is configured to begin executing the program code at a second time, wherein a time period determined as a difference between the first time and the second time is shorter than a predetermined duration;

in response to determining that the event is designated to trigger execution of the program code of the user, generate an event message based at least in part on the programmatic event handling information related to the program code of the user accessed from the electronic data store, wherein the event message comprises at least a user account identifier and programmatic information organized in a schema usable for execution of the program code on behalf of the user on a container on an instance on the virtual compute system, said programmatic information indicating at least (1) a function of the program code to execute in response to the detected event and (2) one or more event message parameters for execution of the program code; and

provide the event message to an intermediary message queue system, wherein the intermediary message queue system is further in communication with the virtual compute system.

2. The system of claim 1, wherein the event triggering system is a remote storage system, and wherein the event message is generated in response to a data file being uploaded to the remote storage system.

3. The system of claim 1, wherein the event triggering system is a database system, and wherein the event message is generated in response to a database table being updated in the database system.

4. The system of claim 1, wherein the predetermined duration is 100 ms.

5. A system, comprising:

an auxiliary computing system comprising one or more hardware computing devices executing specific computer-executable instructions and configured to at least;

detect an event designated to trigger execution of a program code of a user on a virtual compute system, wherein the event is detected at a first time;

in response to detection of the event, generate an event message based at least in part on programmatic event handling information related to the program code of the user accessed from an electronic data store, wherein the event message comprises at least a user account identifier and event metadata for execution of the program code on the virtual compute system, said event metadata identifying a function of the program code to execute and one or more input parameters to the function, wherein the virtual compute system is configured to begin executing the program code at a second time, wherein a time period determined as a difference between the first time and the second time is shorter than a predetermined duration; and

provide the event message to an intermediary message queue system, wherein the intermediary message queue system is further in communication with the virtual compute system.

6. The system of claim 5, wherein the auxiliary computing system is a remote storage system, and wherein the detected event is a data file being uploaded to the remote storage system.

7. The system of claim 5, wherein the auxiliary computing system is a database system, and wherein the detected event is a database table update operation in the database system.

8. The system of claim 5, wherein the auxiliary computing system is a third party computing system separate and distinct from the virtual compute system.

9. The system of claim 5, wherein the event metadata is formatted according to a shared schema used by both the auxiliary computing system and the virtual compute system to process event messages related to the function of the program code to execute.

10. The system of claim 9, wherein the shared schema is in the form of a remote procedure call.

11. The system of claim 5, wherein the event metadata includes an indicator of at least (1) an operating system on which the program code is to be executed and (2) a program language in which the program code is written.

12. A computer-implemented method comprising:

as implemented by one or more computing devices configured with specific executable instructions,

detecting an event on an event triggering service, said event designated to trigger execution of a program code of a user on a virtual compute system said detecting occurring at a first time;

in response to detecting the event, generating an event message based at least in part on programmatic event handling information related to the program code of the user accessed from an electronic data store, wherein the event message comprises at least a user account identifier and event metadata usable for execution of the program code on the virtual compute system; and

providing the event message to the virtual compute system, wherein the virtual compute system is configured to begin executing the program code at a second time, wherein a time period determined as a difference between the first time and the second time is shorter than a predetermined duration.

13. The computer-implemented method of claim 12, wherein the event triggering service is provided by a third party computing system separate and distinct from the virtual compute system.

14. The computer-implemented method of claim 12, wherein the detected event is one of (i) a data file being uploaded to a remote storage system or (ii) a database table being updated in the database system.

15. The computer-implemented method of claim 12, wherein the event message is provided directly to the virtual compute system in response to a request from the virtual compute system.

16. The computer-implemented method of claim 12, wherein the event message is provided indirectly to the virtual compute system by an intermediary message queue.

17. A computer-readable, non-transitory storage medium storing computer executable instructions that, when executed by one or more computing devices, configure the one or more computing devices to perform operations comprising:

detecting, at a first time, an event on an auxiliary service, said event designated to trigger execution of a program code of a user on a virtual compute system;

in response to detecting the event, generating an event message based at least in part on event handling information related to the program code of the user, said event handling information accessed from an electronic data store, wherein the event message comprises at least a user account identifier and event metadata for execution of a program code on the virtual compute system, said event metadata comprising data usable by the virtual compute system to determine a function of the program code to execute and one or more input parameters to the function; and

providing the event message for execution of the program code on the virtual compute system, wherein the virtual compute system is configured to begin executing the program code at a second time, wherein a time period determined as a difference between the first time and the second time is shorter than a predetermined duration.

18. The computer-readable, non-transitory storage medium of claim 17, wherein the auxiliary service is provided by a third party computing system separate and distinct from the virtual compute system.

19. The computer-readable, non-transitory storage medium of claim 17, wherein the auxiliary service is a remote storage system, wherein the event is a data file upload event on the remote storage system, and wherein the function of the program code to execute is a file upload event handler designated to be executed in response to detection of the data file upload event on the remote storage system.

20. The computer-readable, non-transitory storage medium of claim 17, wherein the event metadata is formatted according to a shared schema used by both the auxiliary service and the virtual compute system to process event messages related to the function of the program code to execute.