Distributed computing system node management

• US 10,826,971 B1
• Filed: 12/23/2014
• Issued: 11/03/2020
• Est. Priority Date: 12/23/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Zgraggen, Guido Beat, Mhley, Christopher Ryan, Alton, Darren James, Villalobos, Adam Julio, Merritt, Eric Benjamin, Zeng, Xiao
• Primary Examiner(s): Survillo, Oleg
• Application Number:
  US14/582,038
• Time in Patent Office: 2,142 Days
• Field of Search: 709204
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30

Abstract

Techniques for distributed computing system node management are described herein. In some cases, internal compute nodes (i.e., compute nodes that are allocated to the distributed system) may be mutually trusted such that they may freely establish communications with one another. By contrast, external compute nodes (i.e., compute nodes that aren'"'"'t allocated to the distributed computing system) may be untrusted such that their access to the distributed system may be regulated. In some cases, one or more of the compute nodes within the distributed computing system may maintain respective collections of system view information. Each respective collection of system view information may include, for example, information associated with the corresponding compute node'"'"'s view of the distributed computing system based on information that is available to the corresponding compute node.

Claims

1. A computer-implemented method for exchanging information associated with a distributed computing system comprising:

maintaining, by each of a plurality of compute nodes in the distributed computing system, a respective collection of latency information for communicating with one or more services executing on each other computing node in the distributed computing system, the plurality of compute nodes comprising a first compute node executing a first service and two or more other compute nodes that execute a plurality of at least partially redundant services, wherein the latency information is exchanged between the plurality of compute nodes using an epidemic protocol; and

using, by the first service on the first compute node, a first collection of the latency information maintained by the first compute node to select, from the plurality of at least partially redundant services, a second service executing on a second compute node with which to interact.

2. The computer-implemented method of claim 1, wherein locations of two or more services within the distributed computing system are determined based, at least in part, on a frequency associated with communications between the two or more services.

3. The computer-implemented method of claim 1, wherein the first service comprises at least one micro-service.

4. The computer-implemented method of claim 1, wherein one or more semantics are enforced for services executing on each of the plurality of compute nodes.

5. A distributed computing system comprising:

one or more processors;

one or more memories to store a set of instructions, which if executed by the one or more processors, causes the one or more processors to perform operations comprising;

maintaining, by each of a plurality of compute nodes in the distributed computing system, a respective collection of latency information for communicating with one or more services executing on each other computing node in the distributed computing system, the plurality of compute nodes comprising a first compute node executing a first service and two or more other compute nodes that execute a plurality of at least partially redundant services wherein the latency information is exchanged between the plurality of compute nodes using an epidemic protocol; and

using, by the first service on the first compute node, a first collection of the latency information maintained by the first compute node to select, from the plurality of at least partially redundant services, a second service executing on a second compute node with which to interact.

6. The distributed computing system of claim 5, wherein locations of two or more services within the distributed computing system are determined based, at least in part, on a frequency associated with communications between the two or more services.

7. The distributed computing system of claim 5, wherein the first service comprises at least one micro-service.

8. The distributed computing system of claim 5, wherein one or more semantics are enforced for services executing on each of the plurality of compute nodes.

9. One or more non-transitory computer-readable storage media having stored thereon instructions that, upon execution by one or more computing devices, cause the one or more computing devices to perform operations comprising:

maintaining, by each of a plurality of compute nodes within a distributed computing system a respective collection of latency information for communicating with one or more services executing on each other computing node in the distributed computing system, the plurality of compute nodes comprising a first compute node executing a first service and two or more other compute nodes that execute a plurality of at least partially redundant services wherein the latency information is exchanged between the plurality of compute nodes using an epidemic protocol; and

using, by the first service on the first compute node, a first collection of the latency information maintained by the first compute node to select, from the plurality of at least partially redundant services, a second service executing on a second compute node with which to interact.

10. The one or more non-transitory computer-readable storage media of claim 9, wherein locations of two or more services within the distributed computing system are determined based, at least in part, on a frequency associated with communications between the two or more services.

11. The one or more non-transitory computer-readable storage media of claim 9, wherein the first service comprises at least one micro-service.

12. The one or more non-transitory computer-readable storage media of claim 9, wherein one or more semantics are enforced for services executing on each of the plurality of compute nodes.