Encoding traffic classification information for networking configuration

• US 9,712,390 B2
• Filed: 11/04/2013
• Issued: 07/18/2017
• Est. Priority Date: 11/04/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Lissack, Avichai Mendle
• Primary Examiner(s): Abu Roumi, Mahran
• Application Number:
  US14/071,328
• Publication Number:
  US 20150127789A1
• Time in Patent Office: 1,352 Days
• Field of Search: 370230, 709221
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0894 Policy-based network configuration management
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/14 Network analysis or design
• CPC Class Codes: H04L 41/5022 by giving priorities, e.g. assigning classes of service
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 63/1416 Event detection, e.g. attack signature detection
• CPC Class Codes: H04L 63/1458 Denial of Service

Abstract

Methods and apparatus for encoding traffic classification information for a networking configuration system are disclosed. At a networking configuration server, a hierarchy of network traffic categories and corresponding networking configuration options are generated. In addition, steps of a procedure usable to classify network traffic units into the categories are determined. Data structures to represent the hierarchy and the procedure are constructed at the networking configuration server and provided to a computing device of a distributed system to be used to schedule network transmissions.

Claims

1. A system, comprising:

a plurality of computing devices comprising one or more respective processors and memory and configured to;

establish, at a networking configuration server, based at least in part on a networking management policy of a distributed system, a particular hierarchy of network traffic categories and respective networking configuration options associated with the network traffic categories of the particular hierarchy to be applied at a particular computing device of the distributed system, and a different hierarchy of network traffic categories and respective networking configuration options associated with the network traffic categories of the different hierarchy to be applied at a different computing device of the distributed system;

determine, at the networking configuration server, one or more steps of a particular procedure usable to classify network traffic units at the particular computing device into network traffic categories of the particular hierarchy and one or more steps of a different procedure usable to classify network traffic units at a different computing device into network traffic categories of the different hierarchy;

transmit, from the networking configuration server to the particular computing device, respective representations of a first data structure indicative of the particular hierarchy and a second data structure indicative of the particular procedure and transmit, from the networking configuration server to the different computing device, respective representations of a third data structure indicative of the different hierarchy and a fourth data structure indicative of the different procedure;

identify, using the particular procedure indicated in the second data structure at the particular computing device, a particular network traffic category of the particular hierarchy to which a particular network traffic unit belongs; and

transmit the particular network traffic unit in accordance with a particular networking configuration option indicated in the first data structure for the particular network traffic category.

2. The system as recited in claim 1, wherein the particular networking configuration option comprises one or more of:

(a) a bandwidth limit, (b) a latency constraint, (c) a quality-of-service goal, (d) a packet fragmentation configuration setting, or (e) a configuration setting dependent at least in part on packet size.

3. The system as recited in claim 1, wherein the first data structure comprises a tree including a particular parent node with a plurality of child nodes, wherein in accordance with a bandwidth summing policy associated with the tree, a sum of the actual transfer rates of traffic associated with the plurality of child nodes during a particular time interval is not to exceed a bandwidth limit indicated for the particular parent node.

4. The system as recited in claim 1, wherein the particular hierarchy of categories comprises another network traffic category that differs from the particular network traffic category in at least one of:

(a) one or more network endpoint addresses of the network traffic, (b) one or more properties indicated by a client on whose behalf the traffic is generated, or (c) an application category for which the traffic is generated.

5. The system as recited in claim 1, wherein the second data structure comprises a plurality of decision nodes arranged in a sequence representing successively narrower classification categories of the hierarchy.

6. The system as recited in claim 1, wherein the second data structure comprises at least one decision node representing a lookup table with a plurality of entries indexed based on one or more properties of the network traffic units that are to be classified using the second data structure.

7. A method, comprising:

performing, by a plurality of computing devices;

generating, at a networking configuration server, a particular hierarchy of network traffic categories comprising one or more levels, and respective network configuration options associated with the network traffic categories of the particular hierarchy, and a different hierarchy of network traffic categories and respective networking configuration options associated with the network traffic categories of the different hierarchy;

determining, at the networking configuration server, one or more steps of a particular procedure usable to classify network traffic units into network traffic categories of the particular hierarchy and one or more steps of a different procedure usable to classify network traffic units into network traffic categories of the different hierarchy;

providing, from the networking configuration server to a particular computing device of a distributed system, respective representations of one or more data structures indicative of the particular hierarchy and the particular procedure, and providing from the networking configuration server to a different computing device of the distributed system, respective representations of one or more different data structures indicative of the different hierarchy and the different procedure; and

transmitting, from the particular computing device, a network traffic unit whose network traffic category is determined at the particular computing device using the particular procedure, in accordance with a particular network configuration option indicated for the network traffic category in the particular hierarchy.

8. The method as recited in claim 7, wherein the particular networking configuration option comprises one or more of:

(a) a bandwidth limit, (b) a latency constraint, (c) a quality-of-service goal, (d) a packet fragmentation configuration setting, or (e) a configuration setting dependent at least in part on packet size.

9. The method as recited in claim 7, wherein the one or more data structures comprise a first data structure indicative of the particular hierarchy, and wherein the first data structure comprises a tree including a particular parent node with a plurality of child nodes, wherein in accordance with a bandwidth summing policy associated with the tree, a sum of the actual transfer rates of traffic associated with the plurality of child nodes during a particular time interval is not to exceed a bandwidth limit indicated for the particular parent node.

10. The method as recited in claim 7, wherein the particular hierarchy of categories comprises another network traffic category that differs from the particular network traffic category in at least one of:

(a) one or more network endpoint addresses of the network traffic, (b) one or more properties indicated by a client on whose behalf the traffic is generated, (c) an application category for which the traffic is generated, or (d) an indication of a network-accessible service for which the traffic is generated.

11. The method as recited in claim 7, wherein the one or more data structures comprise a particular data structure that includes a plurality of decision nodes arranged in a sequence representing successively narrower classification categories of the particular hierarchy.

12. The method as recited in claim 11, wherein the particular data structure comprises at least one decision node that includes a lookup table with a plurality of entries indexed based on one or more properties of the network traffic units that are to be classified using the particular data structure.

13. The method as recited in claim 12, wherein the one or more properties include one of:

(a) at least a portion of a destination IP address, (b) at least a portion of a source IP address, (c) at least a portion of a header, (d) at least a portion of body contents, or (e) at least a portion of a client identifier associated with a network traffic unit.

14. The method as recited in claim 12, wherein a particular entry of the plurality of entries comprises an indication of a different decision node to be used to classify a network traffic unit that meets a criterion associated with the particular entry.

15. The method as recited in claim 7, wherein the representations of the one or more data structures are provided to the particular computing device based at least in part on one of:

(a) a pre-determined schedule, (b) an occurrence of a triggering event, or (c) a request from the particular computing device.

16. The method as recited in claim 7, wherein said one or more data structures are generated in response to metrics received from one or more of:

(a) a denial-of-service detector, (b) a per-network-address traffic metric aggregation service, (c) a per-client traffic metric aggregation service, or (d) a plurality of computing devices of the distributed system.

17. The method as recited in claim 7, wherein the representations of the one or more data structures are formatted in accordance with one of:

(a) JSON (JavaScipt Object Notation), (b) YAML, (c) XML (Extensible Markup Language) or (d) a proprietary encoding scheme.

18. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors:

generate, at a networking configuration server, a particular classification of network traffic categories and respective networking configuration options associated with the network traffic categories of the particular classification, and a different classification of network traffic categories and respective networking configuration options associated with the network traffic categories of the different classification;

determine, at the networking configuration server, one or more steps of a particular procedure usable to classify network traffic units into network traffic categories of the particular classification, and one or more steps of a different procedure usable to classify network traffic units into network traffic categories of the different classification;

construct, at the networking configuration server, one or more particular data structures indicative of the particular classification and the particular procedure and one or more different data structures indicative of the different classification and the different procedure; and

provide, from the networking configuration server to a particular computing device, representations of the one or more particular data structures to be used to schedule network transmissions at the particular computing device and provide from the networking configuration server to a different computing device, representations of the one or more different data structures to be used to schedule network transmissions at the different computing device.

19. The non-transitory computer-accessible storage medium as recited in claim 18, wherein a particular networking configuration option associated with a network traffic category of the particular classification comprises one or more of:

(a) a bandwidth limit, (b) a latency constraint, (c) a quality-of-service goal, (d) a packet fragmentation configuration setting, or (e) a configuration setting dependent at least in part on packet size.

20. The non-transitory computer-accessible storage medium as recited in claim 18, wherein the one or more particular data structures comprise a tree including a particular parent node with a plurality of child nodes, wherein in accordance with a bandwidth summing policy associated with the tree, a sum of the actual transfer rates of traffic associated with the plurality of child nodes during a particular time interval is not to exceed a bandwidth limit indicated for the particular parent node.

21. The non-transitory computer-accessible storage medium as recited in claim 18, wherein the particular classification comprises a first network traffic category and a second network traffic category, wherein the first network traffic category differs from the second network traffic category in at least one of:

(a) one or more network endpoint addresses of the network traffic, (b) one or more properties indicated by a client on whose behalf the traffic is generated, (c) an application category for which the traffic is generated, or (d) an indication of a network-accessible service for which the traffic is generated.

22. The non-transitory computer-accessible storage medium as recited in claim 18, wherein the one or more particular data structures comprise a plurality of decision nodes arranged in a sequence representing successively narrower classification categories of a hierarchy.

23. The non-transitory computer-accessible storage medium as recited in claim 18, wherein the representations of the one or more data particular structures are formatted in accordance with one of:

(a) JSON (JavaScipt Object Notation), (b) YAML, (c) XML (Extensible Markup Language) or (d) a proprietary encoding scheme.