PROGRAMMATIC EVENT DETECTION AND MESSAGE GENERATION FOR REQUESTS TO EXECUTE PROGRAM CODE

• US 20160239318A1
• Filed: 04/22/2016
• Published: 08/18/2016
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen
• Granted Patent: US 9,760,387 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/301 where the computing system is a virtual computing platform, e.g. logically partitioned systems virtual machines G06F9/45533; logical partitioning of resources G06F9/5077
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 2209/544 Remote
• CPC Class Codes: G06F 2209/548 Queue
• CPC Class Codes: G06F 9/45508 Runtime interpretation or emulation, e g. emulator loops, bytecode interpretation
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06F 9/547 Remote procedure calls [RPC]; Web services
• CPC Class Codes: H04L 41/06 Management of faults, events, alarms or notifications

Abstract

A service manages a plurality of virtual machine instances for low latency execution of user codes. The service can provide the capability to execute user code in response to events triggered on an auxiliary service to provide implicit and automatic rate matching and scaling between events being triggered on the auxiliary service and the corresponding execution of user code on various virtual machine instances. An auxiliary service may be configured as an event triggering service to detect events and generate event messages for execution of the user codes. The service can request, receive, or poll for event messages directly from the auxiliary service or via an intermediary message service. Event messages can be rapidly converted to requests to execute user code on the service. The time from processing the event message to initiating a request to begin code execution is less than a predetermined duration, for example, 100 ms.

Claims

1. A system for providing event messages for requests to execute program code on a virtual compute system, the system comprising:

an electronic data store configured to store at least programmatic event handling information; and

an event triggering computing system comprising one or more hardware computing devices executing specific computer-executable instructions, said event triggering computing system in communication with a message queue system, the event triggering computing system configured to at least;

detect an event on the event triggering computing system;

determine, based on the programmatic event handling information stored on the electronic data store, whether the event is designated to trigger execution of a program code of a user on a virtual compute system;

in response to determining that the event is designated to trigger execution of the program code of the user, generate an event message comprising at least a user account identifier and programmatic information organized in a schema usable for executing the program code on behalf of the user in a container created on a virtual machine instance on the virtual compute system; and

provide the event message to the message queue system, wherein the message queue system is further in communication with the virtual compute system.

2. The system of claim 1, wherein the event triggering computing system is a remote storage system, and wherein the event message is generated in response to a data file being uploaded to the remote storage system.

3. The system of claim 1, wherein the event triggering computing system is a database system, and wherein the event message is generated in response to a database table being updated in the database system

4. The system of claim 1, wherein a time period between a first time at which the event is detected and a second time at which the virtual compute system begins executing the program code is shorter than 100 ms.

5. A system, comprising:

a computing system comprising one or more hardware computing devices executing specific computer-executable instructions and configured to at least;

detect an event designated to trigger execution of a program code of a user on a virtual compute system;

in response to detection of the event, generate an event message comprising at least a user account identifier and event metadata usable for executing the program code on the virtual compute system, said event metadata identifying the program code to be executed on the virtual compute system in response to the detected event and one or more input parameters of the program code; and

provide the event message to an intermediary message queue system in communication with the virtual compute system.

6. The system of claim 5, wherein the computing system is a remote storage system, the computing system further configured to generate the event message for executing the program code on the virtual compute system upon detecting that a data file has been uploaded to the remote storage system.

7. The system of claim 5, wherein the computing system is a database system, the computing system further configured to generate the event message for executing the program code on the virtual compute system upon detecting that a database table in the database system has been updated.

8. The system of claim 5, wherein the computing system is a third party computing system separate and distinct from the virtual compute system.

9. The system of claim 5, wherein the event metadata is formatted according to a shared schema used by both the computing system and the virtual compute system to process event messages related to the program code to be executed on the virtual compute system.

10. The system of claim 9, wherein the shared schema is in the form of a remote procedure call.

11. The system of claim 5, wherein the event metadata identifies at least (1) an operating system on which the program code is to be executed and (2) a program language in which the program code is written.

12. A computer-implemented method comprising:

as implemented by one or more computing devices configured with specific executable instructions,

detecting an event on an event triggering service, said event designated to trigger execution of a program code of a user on a virtual compute system;

in response to detecting the event, generating an event message comprising at least a user account identifier and event metadata usable for executing the program code on the virtual compute system, said event metadata identifying the program code to be executed on the virtual compute system in response to the detected event and one or more input parameters of the program code; and

providing the event message to the virtual compute system.

13. The computer-implemented method of claim 12, wherein the event triggering service is provided by a third party computing system separate and distinct from the virtual compute system.

14. The computer-implemented method of claim 12, wherein the virtual compute system is configured to, in response to the event detected at a first time, begin executing the program code at a second time, wherein a time period between the first time and the second time is shorter than a predetermined duration.

15. The computer-implemented method of claim 14, wherein the event message is provided to the virtual compute system in response to a request from the virtual compute system.

16. The computer-implemented method of claim 12, wherein the event message is provided indirectly to the virtual compute system via an intermediary message queue system.

17. Non-transitory physical computer storage storing instructions that, when executed by one or more processors, configure the one or more processors to:

detect an event on an auxiliary service, said event designated to trigger execution of a program code of a user on a virtual compute system;

in response to detection of the event, generate an event message comprising at least a user account identifier and event metadata usable for executing the program code on the virtual compute system, said event metadata identifying the program code to be executed on the virtual compute system in response to the detected event and one or more input parameters of the program code; and

provide the event message to the virtual compute system.

18. The computer-readable, non-transitory storage medium of claim 17, wherein the auxiliary service is provided by a third party computing system separate and distinct from the virtual compute system.

19. The computer-readable, non-transitory storage medium of claim 17, wherein the auxiliary service is a remote storage system, wherein the instructions further configure the one or more processors to generate the event message for executing the program code on the virtual compute system upon detecting that a data file has been uploaded on the remote storage system.

20. The computer-readable, non-transitory storage medium of claim 17, wherein the event metadata is formatted according to a shared schema used by both the auxiliary service and the virtual compute system to process event messages related to the program code to be executed on the virtual compute system.