Customer defined bandwidth limitations in distributed systems

• US 10,027,559 B1
• Filed: 06/24/2015
• Issued: 07/17/2018
• Est. Priority Date: 06/24/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Kerl, John Robert, Santoso, Yohanes, Lissack, Avichai Mendle, Nikolayev, Leonid Valentinovich, Royalty, Nolen Clark, Akers, Kyle Tailor, Voegele, Michael Siaosi, McCarriar, Daniel L.
• Primary Examiner(s): Swearingen, Jeffrey R
• Application Number:
  US14/749,363
• Time in Patent Office: 1,119 Days
• Field of Search: None
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/0897 by horizontal or vertical scaling of resources, or by migrating entities, e.g. virtual resources or entities
• CPC Class Codes: H04L 47/2425 for supporting services specification, e.g. SLA
• CPC Class Codes: H04L 47/2441 relying on flow classification, e.g. using integrated services [IntServ]
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions

Abstract

A centralized networking configuration in a distributed system includes a plurality of computing devices implementing a networking configuration server and a plurality of nodes of a service provider network. The computing devices are configured to obtain, at the networking configuration server, client input throttling instructions and client billing information, determine, at the networking configuration server, based on the client input throttling instruction and client billing information, to apply a networking configuration option provided by the client input throttling instructions to a particular category of traffic associated with a service instance of a network-accessible service of the service provider network, transmit, from the networking configuration server to a particular node of the provider network, the networking configuration option, and implement, at the particular node, the networking configuration option.

Claims

1. A non-transitory computer-readable medium storing instructions that when executed on a computing system cause the computing system to:

obtain, at a centralized server of a networking configuration service, client input throttling instructions and a current cycle client account balance;

determine, at the networking configuration service, based on the current cycle client account balance exceeding a threshold amount disclosed in the client input throttling instructions, to apply a networking configuration option disclosed in the client input throttling instructions to a category of network traffic specified by the client input throttling instructions and associated with a virtual machine instance of a of the client, wherein the virtual machine instance runs on a node of a set of nodes configured to implement a network-accessible service of a service provider network;

transmit, to a control module running on the node, based on the determination, metadata used to apply the networking configuration option;

configure, at the node, a packet queue for each category of network traffic specified in the network configuration option;

categorize, at the node, each packet of network traffic directed to the virtual machine instance in accordance with categories of network traffic specified in the network configuration option;

store each packet of the network traffic in one of the packet queues in accordance with the category of the packet; and

reduce a rate of network traffic to the virtual machine instance by throttling a transfer rate of each packet queue in accordance with a transfer rate specified in the network configuration option for the category of network traffic stored in the packet queue.

2. The computer-readable medium of claim 1, wherein the networking configuration option specifies a reduction of a data transmission rate from the node.

3. The computer-readable medium of claim 2, wherein the data transmission rate comprises a rate at which a plurality of data packets is transmitted from a queue in which the plurality of data packets is stored.

4. A system comprising:

a plurality of computing devices implementing a networking configuration server and a plurality of nodes of a service provider network, each of the plurality of computing devices comprising a processor and memory coupled to the processor, wherein the computing devices are configured to;

obtain, at the networking configuration server, client input throttling instructions and client billing information;

determine, at the networking configuration server, based on the client input throttling instruction and client billing information, to apply a networking configuration option provided by the client input throttling instructions to a particular category of network traffic associated with a virtual machine instance of the client, wherein the virtual machine instance runs on a node of a set of nodes configured to implement a network-accessible service of the service provider network;

transmit, from the networking configuration server to the node, the networking configuration option;

configure, at the node, a packet queue for each category of network traffic specified in the network configuration option;

categorize, at the node, each packet of network traffic directed to the virtual machine instance in accordance with categories of network traffic specified in the network configuration option;

store each packet of the network traffic in one of the packet queues in accordance with the category of the packet; and

reduce a rate of network traffic to the virtual machine instance by throttling a transfer rate of each packet queue in accordance with a transfer rate specified in the network configuration option for the category of network traffic stored in the packet queue.

5. The system of claim 4, wherein the client billing information comprises a current cycle account balance.

6. The system of claim 5, wherein the determination to apply the networking configuration option is further based on the current cycle account balance exceeding a threshold amount provided by the client input throttling instructions.

7. The system of claim 4, wherein the networking configuration option specifies a reduction of a data transmission rate from the node.

8. The system of claim 7, wherein the data transmission rate comprises a rate at which a plurality of data packets is transmitted from a queue in which the plurality of data packets is stored.

9. The system of claim 8, wherein, the plurality of computing devices are further configured to, based on the plurality of data packets exceeding a size limitation of the queue, drop one or more of the plurality of data packets.

10. The system of claim 4, wherein the networking configuration option comprises specifies a reduction of a data transmission rate into the node for each of a plurality of different network traffic categories.

11. The system of claim 4, wherein:

the plurality of computing devices further implements a billing node, and

the network configuration server is configured to obtain the client input throttling instructions and client billing information from the billing node.

12. The system of claim 11, wherein the billing node is configured to obtain, from a client, the client input throttling instructions.

13. The system of claim 4, wherein the plurality of computing devices are further configured to, based on the determination to apply the networking configuration option, transmit a notice that the networking configuration option is to be implemented to a client.

14. The system of claim 4, wherein the plurality of computing devices are further configured to:

obtain, at the networking configuration server, a client override request;

based on obtaining the client override request, transmit, from the networking configuration server to the node of the provider network, the client override request; and

cancel, at the node, the networking configuration option.

15. A method, comprising:

obtaining, by a first computing device, client input throttling instructions;

determining client billing information;

determining, in accordance with the client input throttling instructions and based on the client billing information, a networking configuration option for a particular category of network traffic associated with a second computing device;

transmitting, to the second computing device from a networking configuration server, the networking configuration option;

configuring, at the second computing device, a packet queue for each category of network traffic specified in the network configuration option;

categorizing, at the second computing device, each packet of network traffic directed to a service instance associated with the second computing device in accordance with categories of network traffic specified in the network configuration option;

storing each packet of the network traffic in one of the packet queues in accordance with the category of the packet; and

reducing a rate of network traffic to the service instance by throttling a transfer rate of each packet queue in accordance with a transfer rate specified in the network configuration option for the category of network traffic stored in the packet queue.

16. The method of claim 15, further comprising, transmitting a notice that the networking configuration option has been implemented to a client.

17. The method of claim 16, further comprising, canceling, at the second computing device, the networking configuration option based on an override request.

18. The method of claim 15, further comprising, determining that the client billing information comprises a current cycle account balance that exceeds a threshold amount disclosed in the client input throttling instructions.

19. The method of claim 15, wherein the obtaining client input throttling instructions comprises:

receiving, from a client, a current cycle threshold amount;

listing a plurality of service instances to which the client has access; and

receiving, from the client, throttle limits for at least one of the plurality of service instances.

20. The method of claim 19, wherein the throttle limits include:

(a) limits for receiving packets of data, (b) limits for transmitting packets of data, (c) limits as to which geographic region data is transmitted, or (d) limits as to what type of service data is transmitted.

21. The method of claim 15, further comprising, decreasing, at the second computing device, a rate at which a plurality of data packets is transmitted from a queue in which the plurality of data packets is stored.

22. The method of claim 21, further comprising, dropping, based on the plurality of data packets exceeding a size limitation of the queue, one or more of the plurality of data packets.