Centralized networking configuration in distributed systems

• US 10,599,456 B2
• Filed: 06/18/2018
• Issued: 03/24/2020
• Est. Priority Date: 11/04/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Lissack, Avichai Mendle
• Primary Examiner(s): Abu Roumi, Mahran Y
• Application Number:
  US16/010,713
• Publication Number:
  US 20180365040A1
• Time in Patent Office: 645 Days
• Field of Search: 709223
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0894 Policy-based network configuration management
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 41/5022 by giving priorities, e.g. assigning classes of service
• CPC Class Codes: H04L 41/5054 Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components

Abstract

Methods and apparatus for centralized networking configuration in distributed systems are disclosed. Networking related metrics from a plurality of sources within a distributed system are obtained at a networking configuration server. A set of rules to be used to apply a network configuration option to a particular category of traffic associated with a node of the distributed system is determined based on the collected metrics and on networking management policies. A representation of the set of rules is transmitted to the node of the distributed system to schedule network transmissions in accordance with the networking configuration option.

Claims

1. A system, comprising:

a plurality of computing devices comprising one or more hardware processors and memory and configured to;

obtain, at a networking configuration service, metrics from a plurality of sources, including network traffic metrics collected at a set of nodes associated with a network-accessible service of a provider network;

select, at the networking configuration service, based at least in part on the network traffic metrics, a procedure to be applied to a category of network traffic associated with one of the respective instances of the network-accessible service at a node of the set of nodes and a different procedure to be applied to a different category of traffic associated with a different one of the respective instances of the network-accessible service at a different node of the set of nodes, wherein the procedure indicates at least a bandwidth limit, a latency requirement, a packet fragmentation configuration setting, or a configuration setting dependent at least in part on packet size, and the different procedure indicates at least a different bandwidth limit, a different latency requirement, a different packet fragmentation configuration setting, or a different configuration setting dependent at least in part on packet size;

transmit, from the networking configuration service;

a representation of the procedure to the node of the set of nodes; and

a representation of the different procedure to the different node of the set of nodes;

determine at the node that one or more units of network traffic are within the category of network traffic;

schedule one or more network transmissions of the one or more units of network traffic at the node of the set of nodes according to the procedure responsive to the determination at the node that the one or more units of network traffic are within the category of network traffic;

determine at the different node that one or more different units of network traffic are within the different category of network traffic; and

schedule one or more network transmissions of the one or more different units of network traffic at the different node of the set of nodes according to the different procedure selected at the network configuration service responsive to the determination at the different node that the one or more different units are within the different category of network traffic.

2. The system as recited in claim 1, wherein the plurality of sources include one or more of:

(a) a denial-of-service detector, (b) a per-network-address traffic metric aggregation service, or (c) a per-client traffic metric aggregation service.

3. The system as recited in claim 1, wherein the representation of the procedure is transmitted based at least in part on one of:

(a) a pre-determined schedule, (b) an occurrence of a triggering event, or (c) a request from the node.

4. The system as recited in claim 1, wherein the procedure selected at the networking configuration server comprises one or more rules to be used to classify a unit of network traffic into the category based at least in part on one of:

(a) a network endpoint address associated with the unit of network traffic, (b) a client on whose behalf the unit of network traffic is generated, or (c) an application on behalf of which the unit of network traffic is generated.

5. The system as recited in claim 1, wherein the plurality of computing devices are further configured to:

receive an indication of a configuration request submitted by one of;

(a) a client of the network-accessible service or (b) an administrator of the network-accessible service; and

modify one or more elements of the procedure in accordance with the configuration request.

6. A method, comprising:

performing, by a plurality of computing devices;

obtaining, at a networking configuration server, network traffic metrics from a plurality of sources associated with a network-accessible service of a provider network;

selecting, at the networking configuration server, based at least in part on the network traffic metrics, a procedure to be applied to a category of network traffic associated with an instance of the network-accessible service and a different procedure to be applied to a different category of traffic associated with a different instance of the network-accessible service, wherein the procedure indicates at least a bandwidth limit, a latency requirement, a packet fragmentation configuration setting, or a configuration setting dependent at least in part on packet size, and the different procedure indicates at least a different bandwidth limit, a different latency requirement, a different packet fragmentation configuration setting, or a different configuration setting dependent at least in part on packet size;

transmitting, from the networking configuration server;

an indication of the procedure to a node of the provider network associated with the instance, and an indication of the different procedure to a different node of the provider network;

determining at the node that one or more units of network traffic are within the category of network traffic;

scheduling, at the node, one or more network transmissions of one or more units of network traffic at the node according to the procedure selected at the networking configuration server responsive to determining at the node that the one or more units are within the category of network traffic;

determining at the different node that one or more different units of network traffic are within the different category of network traffic; and

scheduling one or more network transmissions of the one or more different units of network traffic at the different node of the set of nodes according to the different procedure selected at the network configuration service responsive to the determination at the different node that the one or more different units are within the different category of network traffic.

7. The method as recited in claim 6, wherein the plurality of sources include one or more of:

(a) the node, (b) a denial-of-service detector, (c) a per-network-address traffic aggregation service, or (d) a per-client traffic aggregation service.

8. The method as recited in claim 6, wherein said transmitting the indication of the procedure is initiated based at least in part on one of:

(a) a pre-determined schedule, (b) an occurrence of a triggering event, or (c) a request from the node.

9. The method as recited in claim 6, wherein the procedure selected at the networking configuration server comprises one or more rules to be used to classify a unit of network traffic into the category based at least in part on one of:

(a) a network endpoint address associated with the unit of network traffic, (b) a client on whose behalf the unit of network traffic is generated, or (c) an application on behalf of which the unit of network traffic is generated.

10. The method as recited in claim 6, wherein the provider network comprises a plurality of availability containers with respective failure profiles, further comprising performing, by the plurality of computing devices:

configuring at least one networking configuration server at each availability container of the plurality of availability containers.

11. The method as recited in claim 6, further comprising performing, by the plurality of computing devices:

determining a number of networking configuration servers to be instantiated based at least in part on a performance requirement associated with a time interval between a detection of an event that leads to transmission of the indication of the procedure, and an implementation of the procedure.

12. The method as recited in claim 6, wherein said selecting the procedure is performed in response to a request from one of:

(a) a client of the network-accessible service or (b) an administrator of the network-accessible service.

13. The method as recited in claim 6, wherein the node to which the representation of the procedure is transmitted comprises one of:

(a) an instance host configurable to implement a service unit of the network-accessible service, (b) a switch, (c) a router, (d) a gateway (e) a load-balancer, or (f) a storage device.

14. The method as recited in claim 6, further comprising performing, by the plurality of computing devices:

providing, via one or more programmatic interfaces, a consolidated view of a networking status of a plurality of nodes configurable to support the network-accessible service.

15. The method as recited in claim 6, further comprising performing, by the plurality of computing devices:

providing, from the networking configuration server to an instance placement component associated with the network-accessible service, an indication of networking status information of a plurality of instance hosts of the network-accessible service, wherein the instance placement component is configured to utilize the indication to select an instance host at which a service instance of the network-accessible service is to be launched.

16. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors:

obtain, at a network configuration service, networking-related traffic metrics from a plurality of sources;

select, at the network configuration service based at least in part on the networking-related traffic metrics, a set of rules to be used to apply to a category of traffic associated with a computing device and a different set of rules to be used to apply to a different category of traffic associated with a different computing device, wherein the set of rules indicates at least a bandwidth limit, a latency requirement, a packet fragmentation configuration setting, or a configuration setting dependent at least in part on packet size, and the different set of rules indicates at least a different bandwidth limit, a different latency requirement, a different packet fragmentation configuration setting, or a different configuration setting dependent at least in part on packet size;

transmit an indication of the procedure to the computing device for scheduling one or more network transmissions at the computing device according to the set of rules selected at the network configuration service;

transmit an indication of the different procedure to the different computing device for scheduling one or more network transmissions at the different computing device according to the different set of rules selected at the network configuration service;

determine at the node that one or more units of network traffic are within the category of network traffic; and

schedule one or more network transmissions of the one or more units of network traffic at the node of the set of nodes according to the procedure responsive to the determination at the node that the one or more units of network traffic are within the category of network traffic.

17. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the plurality of sources include one or more of:

(a) the computing device, (b) a denial-of-service detector, (c) a per-network-address traffic aggregation service, or (d) a per-client traffic aggregation service.

18. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the set of rules and the different set of rules are selected at the network configuration service in accordance with one or more networking management policies.

19. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the set of rules comprises one or more rules to be used to classify a unit of network traffic into the category based at least in part on one of:

(a) a network endpoint address associated with the unit of network traffic, (b) a client on whose behalf the unit of network traffic is generated, or (c) an application on behalf of which the unit of network traffic is generated.

20. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the computing device is configured to implement a service instance of a network-accessible service comprising one of:

(a) a virtualized computing service, (b) a storage service, or (c) a database service.