ENDPOINT MANAGEMENT SYSTEM AND VIRTUAL COMPUTE SYSTEM

• US 20160299790A1
• Filed: 04/08/2015
• Published: 10/13/2016
• Est. Priority Date: 04/08/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Wagner, Timothy Allen, Thompson, Jonathan Paul
• Granted Patent: US 9,785,476 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1484 involving virtual machines
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2209/501 Performance criteria
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/5055 considering software capabilities, i.e. software resources associated or available to the machine
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06F 9/54 Interprogram communication

Abstract

A system for integrating an endpoint management system and a virtual compute system is provided. The system may be configured to receive a first request to execute a proxy application programming interface (API) associated with a first resource of a plurality of resources maintained by the endpoint management system, determine, based at least in part on the first request and the proxy API, an API mapping definition associated with the proxy API, output a second request to execute a program code on the virtual compute system based on the API mapping definition associated with the proxy API, wherein the second request contains information associated with the first resource, receive a first response from the virtual compute system, wherein the first response contains information regarding the first resource, and output a second response based on the first response received from the virtual compute system.

Claims

1. A system adapted to provide low-latency computational capacity from a virtual compute fleet, the system comprising:

an endpoint management system comprising one or more hardware computing devices adapted to execute specific computer-executable instructions and in communication with a virtual compute system configured to provide low-latency computational capacity, wherein the endpoint management system is configured to at least;

receive from a caller a request to access a first resource of a plurality of resources maintained by the endpoint management system, wherein the request contains one or more request parameters and a uniform resource identifier (URI) associated with the first resource,

generate a code execution request to execute a program code associated with the first resource, wherein the code execution request contains information identifying the program code and the caller;

send the generated code execution request to the virtual compute system to cause the virtual compute system to execute the program code identified by the code execution request;

receive a response from the virtual compute system, wherein the response is based on executing the program code associated with the first resource;

process the received response based on a pattern matching definition made available to the endpoint management system prior to the receipt of the request to access the first resource, wherein the pattern matching definition comprises a plurality of conditional checks configured to determine whether a corresponding plurality of strings are contained in the received response; and

send a return response to the caller based on a result of the processing based on the pattern matching definition.

2. The system of claim 1, wherein the virtual compute system is further configured to:

maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprise a warming pool comprising virtual machine instances having one or more software components loaded thereon and waiting to be assigned to a user, and an active pool comprising virtual machine instances currently assigned to one or more users;

receive a request associated with a caller to execute a program code on the virtual compute system, wherein the program code is defined by a customer of the virtual compute system, wherein the request includes information identifying the program code, the caller initiating the request, and an amount of computing resources to be used for executing the program code;

select from the warming pool or the active pool a virtual machine instance to execute the program code;

create a container in the selected virtual machine instance based on the identified amount of computing resources; and

cause the identified program code to be loaded from an electronic data store in communication with the virtual compute system onto the container and to be executed in the container.

3. The system of claim 1, wherein the endpoint management system is further configured to:

determine that the received response contains a success string indicating a successful execution of the program code, wherein the success string is searched in the received response as part of one of the plurality of conditional checks;

transform the success string into an error string that is compatible with the caller, wherein the error string is associated with an execution error during the execution of the program code; and

generate the return response based on the error string, wherein the return response indicates that the execution of the program code resulted in the execution error.

4. A system, comprising:

an endpoint management system comprising one or more hardware computing devices adapted to execute specific computer-executable instructions and in communication with an electronic data store configured to store application programming interface (API) mapping definitions and in communication with a virtual compute system configured to provide request-based computational capacity and execute a program code in a container created thereon, wherein the endpoint management system is configured to at least;

receive a first request to execute a proxy API associated with a first resource of a plurality of resources maintained by the endpoint management system;

determine, based at least in part on the first request and the proxy API, an API mapping definition associated with the proxy API;

output a second request to execute a program code on the virtual compute system based on the API mapping definition associated with the proxy API, wherein the second request contains information associated with the first resource;

receive a first response from the virtual compute system, wherein the first response contains information regarding the first resource; and

output a second response based on the first response received from the virtual compute system.

5. The system of claim 4, wherein the first request specifies the program code and a plurality of data storage systems that each store data objects, wherein the endpoint management system is further configured to cause the virtual compute system to execute the program code on each data object stored in the plurality of data storage systems.

6. The system of claim 4, wherein the endpoint management system is further configured to process the first response using a pattern matching definition stored in the endpoint management system to access the first resource, wherein the pattern matching definition comprises a plurality of conditional checks configured to determine whether a corresponding plurality of strings are contained in the first response.

7. The system of claim 6, wherein the endpoint management system is further configured to:

determine, based on the processing of the first response using the pattern matching definition, that the first response is free of errors; and

in response to a determination that the first response is free of errors, output a third request to a backend system, wherein the third request contains information associated with the program code to be executed by the backend system.

8. The system of claim 6, wherein the endpoint management system if further configured to:

determine that the first response contains a success string indicating a successful execution of the program code by the virtual compute system, wherein the success string is searched in the first response as part of one of the plurality of conditional checks;

transform the success string into an error string that is compatible with a caller initiating the first request, wherein the error string is associated with an execution error during the execution of the program code by the virtual compute system; and

generate the second response based on the error string, wherein the second response indicates that the execution of the program code resulted in the execution error.

9. The system of claim 4, wherein the virtual compute system is further configured to, in response to receiving the second request from the endpoint management system, execute the program code identified by the second request,

wherein the first response contains a first portion that is identical to a second portion of the second response, wherein the first and second portions represent data processed during the execution of the program code by the virtual compute system.

10. The system of claim 4, wherein the virtual compute system is further configured to:

maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprise a warming pool comprising virtual machine instances having one or more software components loaded thereon and waiting to be assigned to a user, and an active pool comprising virtual machine instances currently assigned to one or more users;

receive a request associated with a caller to execute a program code associated with a user on the virtual compute system, wherein the program code is defined by a customer of the virtual compute system, wherein the request includes information identifying the program code, the caller initiating the request, and an amount of computing resources to be used for executing the program code;

select from the warming pool or the active pool a virtual machine instance to execute the program code;

create a container in the selected virtual machine instance based on the identified amount of computing resources; and

cause the identified program code to be loaded from an electronic data store in communication with the virtual compute system onto the container and to be executed in the container.

22. The system of claim 4, wherein the second request contains information identifying at least one of (i) a caller initiating the first request, (ii) a user associated with the program code, or (iii) the endpoint management system.

11. A computer-implemented method comprising:

as implemented by one or more computing devices configured with specific executable instructions,

receiving a first request to execute a proxy application programming interface (API) associated with a first resource of a plurality of resources maintained by an endpoint management system;

determining, based at least in part on the first request and the proxy API, an API mapping definition associated with the proxy API;

outputting a second request to execute a program code on a virtual compute system configured to provide request-based computational capacity and execute a program code in a container created thereon, wherein the second request is based on the API mapping definition associated with the proxy API and contains information associated with the first resource;

receiving a first response from the virtual compute system, wherein the first response contains information regarding the first resource; and

outputting a second response based on the first response received from the virtual compute system.

12. The computer-implemented method of claim 11, further comprising causing the virtual compute system to execute the program code on each data object stored in a plurality of data storage systems, wherein the first request specifies the program code and the plurality of data storage systems that each store data objects.

13. The computer-implemented method of claim 11, further comprising processing the first response using a pattern matching definition stored in the endpoint management system to access the first resource, wherein the pattern matching definition comprises a plurality of conditional checks configured to determine whether a corresponding plurality of strings are contained in the first response.

14. The computer-implemented method of claim 13, further comprising:

determining, based on the processing of the first response using the pattern matching definition, that the first response is free of errors; and

in response to a determination that the first response is free of errors, outputting a third request to a backend system, wherein the third request contains information associated with the program code to be executed by the backend system.

15. The computer-implemented method of claim 13, further comprising:

determining that the first response contains a success string indicating a successful execution of the program code by the virtual compute system, wherein the success string is searched in the first response as part of one of the plurality of conditional checks;

transforming the success string into an error string that is compatible with a caller initiating the first request, wherein the error string is associated with an execution error during the execution of the program code by the virtual compute system; and

generating the second response based on the error string, wherein the second response indicates that the execution of the program code resulted in the execution error.

16. A computer-readable, non-transitory storage medium storing computer executable instructions that, when executed by one or more computing devices, configure the one or more computing devices to perform operations comprising:

receiving a first request to execute a proxy application programming interface (API) associated with a first resource of a plurality of resources maintained by an endpoint management system;

determining, based at least in part on the first request and the proxy API, an API mapping definition associated with the proxy API;

outputting a second request to execute a program code on a virtual compute system configured to provide request-based computational capacity and execute a program code in a container created therein, wherein the second request is based on the API mapping definition associated with the proxy API and contains information associated with the first resource;

receiving a first response from the virtual compute system, wherein the first response contains information regarding the first resource; and

outputting a second response based on the first response received from the virtual compute system.

17. The computer-readable, non-transitory storage medium of claim 16, wherein the operations further comprise causing the virtual compute system to execute the program code on each data object stored in a plurality of data storage systems, wherein the first request specifies the program code and the plurality of data storage systems that each store data objects.

18. The computer-readable, non-transitory storage medium of claim 17, wherein the operations further comprise providing a result of the execution of the program code to a second program code, wherein the program code is supplied by the second request and the second program code is supplied by a request different from the second request.

19. The computer-readable, non-transitory storage medium of claim 16, wherein the operations further comprise processing the first response using a pattern matching definition stored in the endpoint management system to access the first resource, wherein the pattern matching definition comprises a plurality of conditional checks configured to determine whether a corresponding plurality of strings are contained in the first response.

20. The computer-readable, non-transitory storage medium of claim 19, wherein the operations further comprise:

determining, based on the processing of the first response using the pattern matching definition, that the first response is free of errors; and

in response to a determination that the first response is free of errors, outputting a third request to a backend system, wherein the third request contains information associated with a program code to be executed by the backend system.

21. The computer-readable, non-transitory storage medium of claim 19, wherein the operations further comprise:

determining that the first response contains a success string indicating a successful execution of the program code by the virtual compute system, wherein the success string is searched in the first response as part of one of the plurality of conditional checks;

transforming the success string into an error string that is compatible with a caller initiating the first request, wherein the error string is associated with an execution error during the execution of the program code by the virtual compute system; and

generating the second response based on the error string, wherein the second response indicates that the execution of the program code resulted in the execution error.