System for managing and scheduling containers

• US 9,256,467 B1
• Filed: 11/11/2014
• Issued: 02/09/2016
• Est. Priority Date: 11/11/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Meduri, Kiran Kumar, Azad, Muhammad Umer, Singh, Deepak, Suarez, Anthony Joseph, Thurston, William Andrew, Aithal, Anirudh Balachandra, Gerdesmeier, Daniel Robert, Kemp, Euan Skyler
• Primary Examiner(s): Rampuria, Satish
• Application Number:
  US14/538,663
• Time in Patent Office: 455 Days
• Field of Search: 718101-108
• US Class Current: 1/1
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/5055 considering software capabilities, i.e. software resources associated or available to the machine
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

A system and method for a container service that obtains a software image of a software container that has been configured to be executed within a computer system instance registered to a cluster by one or more processors. The container service is configured to receive a request to launch the software image in accordance with a task definition, wherein the task definition specifies an allocation of resources for the software container. The container service may then determine, according to a placement scheme, a subset of a set of container instances registered to the cluster in which to launch the software image in accordance with the task definition. Upon determining the subset of the set of container instances, the container service may launch the software image as one or more running software containers in the set of container instances in accordance with the task definition.

Claims

1. A computer-implemented method, comprising:

under the control of one or more computer systems configured with executable instructions,

creating a cluster and a cluster identifier that identifies the cluster, wherein the cluster represents a set of container instances associated with a customer of a computing resource service provider that are registered to the cluster and configured to run one or more software containers;

obtaining an image of a software container configured to execute within a computer system instance, wherein the software container comprises data and one or more processes which, when executed in the computer system instance, are isolated from other processes running within the computer system instance, and wherein the image is an entire copy of a particular state of the software container at a time the image was generated;

receiving a request to launch a set of images, including the image of the software container, in accordance with a task definition, wherein the task definition identifies a set of software containers, including the software container, that are assigned to start as a group and specifies an allocation of resources to the set of software containers, wherein the request specifies the cluster identifier of the cluster; and

in response to the request to launch the one or more images,

determining a subset of the set of container instances represented by the cluster specified by the cluster identifier in which to launch the set of software containers, wherein one or more container instances are determined according to a placement scheme; and

launching the set of images to yield running software containers within the subset of the set of container instances so that the running software containers are allocated resources in accordance with the allocation of resources specified in the task definition.

2. The computer-implemented method of claim 1, wherein the subset of the set of container instances is determined by a multitenant scheduler service configured to determine the subset of the set of container instances based at least in part on the placement scheme and the task definition.

3. The computer-implemented method of claim 1, wherein the set of images are caused to be launched by individual container agents running within the subset of the set of container instances, wherein the individual container agents are software applications each configured to run in respective container instances and act as intermediaries between the running software containers and entities external to the respective container instances.

4. The computer-implemented method of claim 1, wherein the method further comprises providing metrics and log information about the running software containers to a telemetry service, wherein the telemetry service is configurable to aggregate the metrics and log information and provide the aggregated metrics and log information to a resource monitoring service.

5. A system, comprising:

one or more processors;

memory including instructions that, when executed by the one or more processors, cause the system to implement at least;

a backend service that;

receives placement requests for a set of container instances, wherein the set of container instances host a corresponding set of container agents,

receives a task definition that specifies, for the set of containers, locations of software images for individual containers of the set of containers and resources to be allocated to the individual containers of the set of containers,

ensures that the resources specified by the task definition are available within the set of container instances, and

receives information from the set of container agents about states of a set of running containers in the set of container instances,

provides the information to a scheduler; and

the scheduler that, based at least in part on a placement scheme, the task definition, and the information provided by the backend service;

determines a subset of the set of container instances registered to a cluster within which to place individual containers of the set of containers, the subset determined based at least in part on the resources to be allocated to the individual containers of the set of containers and amounts of available resources within individual container instances of the set of container instances registered to the cluster,

notifies the container agent to allocate resources for the individual containers within the subset according to the resources to be allocated to the individual containers specified by the task definition, and

notifies the container agent to launch, within the subset and from locations of the software images specified by the task definition, the set of containers as the set of running containers.

6. The system of claim 5, wherein the subset of the set of container instances is determined by a multitenant scheduler service of a computing resource service provider.

7. The system of claim 5, wherein the subset of the set of container instances is determined by a scheduler application installed by a customer of a computing resource service provider.

8. The system of claim 5, wherein the instructions further include instructions that, when executed by the one or more processors, cause the system to implement a telemetry agent that collects data for a telemetry service about processes running within the set of running containers, wherein the telemetry service aggregates the data and provides the aggregated data to a resource monitoring service.

9. The system of claim 5, wherein the instructions further include instructions that, when executed by the one or more processors, cause the system to implement the set of container agents running within the set of container instances that:

register the set of container instances with the cluster,

allocate the resources for the set of container instances in response to a notification from the scheduler to allocate the resources,

launch the set of containers as the set of running containers in response to a notification from the scheduler to launch the set of containers,

monitor the states of the set of running containers in the set of container instances, and

provide the information about the states to the backend service.

10. The system of claim 9, wherein the set of container agents are further configured to provide one or more of periodic signals to indicate normal operation of the individual containers, statuses of the individual containers, and occurrences of errors by the individual containers.

11. The system of claim 9, wherein the instructions that implement the set of container agents further include instructions that, when executed by the one or more processors, cause the system to implement the set of container agents to:

stop the set of running containers from running;

deregister the set of container instances from the cluster; and

delete the cluster.

12. A non-transitory computer-readable storage medium having stored thereon executable instructions that, when executed by one or more processors of a computer system, cause the computer system to at least:

obtain a software image of a software container of a set of software containers configured to execute within a computer system instance;

receive a task definition specifying, for the set of containers, locations of the software images for individual containers of the set of containers and resources to be allocated to individual containers of the set of containers;

receive a request to launch the software image in accordance with the task definition;

determine a set of container instances in which to launch the software image in accordance with the task definition, wherein the set of container instances are determined according to a placement scheme, the placement scheme depending at least in part on the resources to be allocated to the individual containers of the set of containers and amounts of available resources within individual container instances of the set of container instances; and

launch the software image as one or more running software containers in the set of container instances in accordance with the task definition.

13. The non-transitory computer-readable storage medium of claim 12, wherein the placement scheme is one of a round robin placement scheme or a stochastically assigned placement scheme.

14. The non-transitory computer-readable storage medium of claim 12, wherein the instructions further comprise instructions that, when executed by the one or more processors, cause the computer system to, in response to an application programming interface call, create a cluster for representing a set of computer system instances wherein the computer system instance is a member of the set.

15. The non-transitory computer-readable storage medium of claim 12, wherein the instructions that cause the computer system to determine the set of container instances further include instructions that, when executed by the one or more processors, cause the computer system to determine the set of container instances based at least in part on one or security groups or security roles assigned to the software image.

16. The non-transitory computer-readable storage medium of claim 12, wherein the instructions further comprise instructions that, when executed by the one or more processors, cause the computer system to, in response to an application programming interface call, register the computer system instance with a cluster representing a set of computer system instances.

17. The non-transitory computer-readable storage medium of claim 12, wherein the instructions further comprise instructions that, when executed by the one or more processors, cause the computer system to, in response to an application programming interface call, register the task definition with an account of a customer of a computing resource service provider.

18. The non-transitory computer-readable storage medium of claim 12, wherein the request to launch the software image is a request received through an application programming interface call to launch the software image in accordance with the task definition.

19. The non-transitory computer-readable storage medium of claim 12, wherein the set of container instances is a subset of container instances registered to a cluster and the instructions further comprise instructions that, when executed by the one or more processors, cause the computer system to, in response to an application programming interface call, return information about what software images are running in the container instances registered to the cluster and what resources are available in the container instances registered to the cluster.