ON-DEMAND CODE EXECUTION IN A LOCALIZED DEVICE COORDINATOR

• US 20180150325A1
• Filed: 11/28/2016
• Published: 05/31/2018
• Est. Priority Date: 11/28/2016
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Kuo, Calvin Yue-Ren, Amin, Rudresh, Chen, Yen-Lin, Turow, Jonathan I., Pan, Cheng, Brooker, Marc John, Sorenson, III, James Christopher, McClenahan, Weili Zhong
• Granted Patent: US 10,452,439 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 9/4843 by program, e.g. task dispatcher, supervisor, operating system
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/505 considering the load

Abstract

Systems and methods are described for implementing a coordinator within a coordinated environment, which environment includes set of coordinated devices managed by the coordinator. The coordinator can be provisioned with a set of tasks, each task corresponding to a segment of code that can be executed by the coordinator, such as to manage the coordinated devices. To assist in execution of the tasks, the coordinator can include a resource manager that generates execution environments corresponding to an individual task execution, which environments may be isolated from other execution environments. The coordinator can further include a scheduler to obtain calls to execute tasks, and implement a queue from which to select tasks for execution. On selecting a task, the scheduler may interact with the resource manager to generate an execution environment for the task, and cause execution of the task within the execution environment.

Claims

1. A system for managing resources within a coordinator computing device configured to manage one or more coordinated devices within a coordinated environment, the system comprising:

a non-transitory data store including computer executable instructions corresponding to;

a scheduler that, when executed, implements a queue of calls to execute one or more tasks on the coordinator, wherein individual tasks of the one or more tasks correspond to code executable by the coordinator computing device to manage operation of the one or more coordinated devices within the coordinated environment;

a resource manager that, when executed, generates execution environments in which to execute the one or more tasks;

a processor in communication with the non-transitory data store and configured to execute the scheduler, wherein execution of the scheduler causes the processor to;

enqueue a set of task calls within the queue, individual task calls corresponding to a call to execute a task of the one or more tasks;

obtain an availability of compute resources on the coordinator from the resource manager;

apply a scheduling algorithm to the queue based at least in part on the availability of compute resources to select at least one task call of the set of task calls for processing;

instruct the resource manager to select an execution environment in which to execute a task corresponding to the at least one task call; and

execute the task corresponding to the at least one task call within the execution environment;

wherein the processor is further configured to execute the resource manager in order to generate the execution environment in which to execute the task corresponding to the at least one task call, and wherein generation of the execution environment includes provisioning the execution environment with a data resource required to execute the task corresponding to the at least one task call.

2. The system of claim 1, wherein the coordinated devices comprise at least one of a general purpose computing device, a thin device, or an embedded device associated with an alternative primary function.

3. The system of claim 1, wherein provisioning the execution environment with a data resource required to execute the task corresponding to the at least one task call includes provisioning the execution environment with the executable code corresponding to the task.

4. The system of claim 1, wherein provisioning the execution environment with a data resource required to execute the task corresponding to the at least one task call includes provisioning the execution environment with at least one of a driver, a code library, data corresponding to a runtime environment, or a code utility.

5. The system of claim 1, wherein the execution environment corresponds to a software container.

6. The system of claim 4, wherein the data resource is stored external to the software container, and wherein provisioning the execution environment with a data resource required to execute the task corresponding to the at least one task call includes associating the software container with read-only access to the data resource.

7. The system of claim 6, wherein associating the software container with read-only access to the data resource comprises generating a union mount combining read-only access to the data resource and read/write access to an additional memory space while presenting to the execution environment a combined view of the data resource and the additional memory space.

8. The system of claim 1, wherein the execution environment is a first execution environment, and wherein execution of the resource manager further causes the processor to:

obtain a request for a second execution environment in which to execute a second task;

detect that the first task has ceased execution; and

select the first execution environment to fulfill the request.

9. Non-transitory computer readable media including computer-executable instructions comprising:

first instructions executable by a computing system to implement a resource manager, wherein implementation of the resource manager causes the computing system to;

obtain a request for an execution environment in which to execute a first task of one or more tasks, wherein individual tasks of the one or more tasks correspond to code executable by the computing system;

determine a set of data resources required for execution of the task; and

generate an execution environment for execution of the task at least in part by provisioning the execution environment with access to the set of data resources;

second instructions executable by the computing system to implement scheduler, wherein implementation of the scheduler causes the computing system to;

enqueue a set of task calls within a queue, individual task calls corresponding to a call to execute a task of the one or more tasks;

obtain an availability of compute resources on the computing system;

apply a scheduling algorithm to the queue based at least in part on the availability of compute resources to select a task call of the set of task calls for processing, wherein the task call corresponds to a call to execute the first task;

transmit the request for the execution environment in which to execute the first task; and

execute the first task within the execution environment.

10. The non-transitory computer-readable media of claim 9, wherein the execution environment is a first execution environment, and wherein implementation of the resource manager further causes the computing system to:

obtain a request for a second execution environment in which to execute a second task;

detect that the first task has ceased execution; and

select the first execution environment to fulfill the request.

11. The non-transitory computer-readable media of claim 10, wherein the first execution environment is selected based at least in part on detecting that the second task and the first task correspond to the same task.

12. The non-transitory computer-readable media of claim 10, wherein the first execution environment is selected based at least in part on detecting that the second task depends on a data resource available to the first execution environment.

13. The non-transitory computer-readable media of claim 10, wherein implementation of the resource manager further causes the computing system to:

determine an availability of a compute resource required by the execution environment is below a threshold level; and

suspend a second execution environment associated with usage of the compute resource.

14. The non-transitory computer-readable media of claim 11, wherein the compute resource includes at least one of processor availability, memory availability, or network bandwidth availability.

15. The non-transitory computer-readable media of claim 11, wherein suspension of the second execution environment includes at least one of generating snapshot image data of the second execution environment or saving a state of the second execution environment to a device shadow.

16. The non-transitory computer-readable media of claim 9, wherein implementation of the resource manager further causes the computing system to generate the execution environment, and wherein generating the execution environment comprises generating a union mount combining read-only access to the set of data resources and read/write access to an additional memory space while presenting to the execution environment a combined view of the set of data resources and the additional memory space.

18. The computer-implemented method of claim 16, wherein the set of data resources includes at least one of data resources or compute resources.

19. The computer-implemented method of claim 16, wherein the execution environment corresponds to a software container, and wherein provisioning the execution environment with access to the set of data resources comprises associating the software container with read-only access to the set of data resources.

20. The computer-implemented method of claim 18, wherein associating the software container with read-only access to the set of data resources comprises generating a union mount combining read-only access to the set of data resources and read/write access to an additional memory space while presenting to the execution environment a combined view of the set of data resources and the additional memory space.

21. The computer-implemented method of claim 16, wherein the execution environment is a first execution environment, and wherein the computer-implemented method further comprises:

obtaining a request for a second execution environment in which to execute a second task;

detecting that the first task has ceased execution; and

selecting the first execution environment to fulfill the request.

22. The computer-implemented method of claim 19, wherein the first execution environment is selected based at least in part on detecting at least one of that the second task and the first task correspond to the same task or that the second task depends on a data resource available to the first execution environment.

23. The computer-implemented method of claim 20 further comprising:

determining an availability of a compute resource required by the execution environment is below a threshold level; and

suspending a second execution environment associated with usage of the compute resource.

24. The computer-implemented method of claim 20, wherein suspending the second execution environment includes at least one of generating snapshot image data of the second execution environment or saving a state of the second execution environment to a device shadow.

25. The computer-implemented method of claim 20 further comprising:

enqueing a call to resume an execution the second execution environment within the queue; and

processing the queue based at least in part on an availability of the compute resources to select the call to resume the execution of the second execution environment; and

resuming the execution of the second execution environment.

17. A computer-implemented method comprising:

enqueuing a set of task calls within a queue, individual task calls corresponding to a call to execute a task of the one or more tasks;

obtaining an availability of compute resources on the computing system;

applying a scheduling algorithm to the queue based at least in part on the availability of compute resources to select a task call of the set of task calls for processing, wherein the task call corresponds to a call to execute the first task;

determining a set of data resources required for execution of the task; and

generating an execution environment for execution of the task at least in part by provisioning the execution environment with access to the set of data resources;

executing the first task within the execution environment.