Customer-directed networking limits in distributed systems

• US 9,647,904 B2
• Filed: 11/25/2013
• Issued: 05/09/2017
• Est. Priority Date: 11/25/2013
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Lissack, Avichai Mendle
• Primary Examiner(s): Mejia, Anthony
• Application Number:
  US14/089,224
• Publication Number:
  US 20150149631A1
• Time in Patent Office: 1,261 Days
• Field of Search: 709226
• CPC Class Codes: H04L 41/5051 Service on demand, e.g. definition and deployment of services in real time
• CPC Class Codes: H04L 43/0894 Packet rate
• CPC Class Codes: H04L 43/16 Threshold monitoring

Abstract

Methods and apparatus for supporting customer-directed networking limits in distributed systems are disclosed. A client request is received via a programmatic interface, indicating a particular lower resource usage limit to be imposed on at least one category of network traffic at a particular instance of a network-accessible service. Resource usage metrics for one or more categories of network traffic at the particular instance are obtained. In response to a determination that resource usage at the particular instance has reached a threshold level, one or more responsive actions are initiated.

Claims

1. A system, comprising:

a plurality of computing devices configured to;

implement one or more programmatic interfaces enabling a client to request an imposition, during at least a time interval, of a lower resource usage limit than an existing resource usage limit in effect at the time of the request at one or more service instances of a multi-tenant network-accessible service of a provider network, wherein the lower resource usage limit is to be applied to at least one category of network traffic with a resource usage dependent pricing policy;

receive a client request, via a particular interface of the one or more programmatic interfaces, indicating a particular lower resource usage limit to be imposed on the at least one category of network traffic at a particular service instance of the multi-tenant network-accessible service, wherein the particular lower resource usage limit indicated by the client request is lower than a particular existing resource usage limit in effect at the time of the client request that is imposed on the at least one category of network traffic at the particular service instance of the multi-tenant network-accessible service;

obtain resource usage metrics corresponding to one or more categories of network traffic at the particular service instance; and

in response to a determination that resource usage associated with network traffic at the particular service instance has reached a threshold level determined at least in part from the particular lower resource usage limit, initiate one or more responsive actions including a generation of a notification.

2. The system as recited in claim 1, wherein the particular lower resource usage limit comprises an indication of one of:

(a) an average traffic transmission rate that is not to be exceeded, (b) a peak traffic transmission rate that is not to be exceeded, (c) an upper limit to a number of bytes of data transferred, or (d) an upper limit on the number of network messages transferred.

3. The system as recited in claim 1, wherein the client request indicates a particular category of network traffic to which the particular lower resource usage limit is to be applied, wherein the particular category is selected from a plurality of categories of network traffic associated with the service including one or more of:

(a) traffic flowing over one or more public Internet links (b) traffic flowing within a provider network data center (c) traffic flowing between two provider network data centers (d) traffic flowing between the particular service instance and nodes of a different service implemented at the provider network.

4. The system as recited in claim 1, wherein the client request indicates one or more directions of network traffic flow to which the lower resource usage limit is to be applied, including one of:

(a) traffic flowing from the particular service instance to one or more destinations;

(b) traffic flowing to the particular service instance from one or more sources.

5. The system as recited in claim 1, wherein the client request indicates a particular user account of a plurality of user accounts established on behalf of a particular client at the multi-tenant network-accessible service, wherein the lower resource usage limit is to be applied to the particular user account, and wherein a different resource usage limit applies to a different user account of the plurality of user accounts established on behalf of the particular client.

6. A method, comprising:

performing, by a plurality of computing devices;

implementing a programmatic interface enabling a client to request an imposition of a lower resource usage limit than an existing resource usage limit in effect at the time of the request at one or more service instances of a network-accessible service, wherein the lower resource usage limit is to be applied to at least one category of network traffic associated with the service;

receiving a client request, via a particular interface of the one or more programmatic interfaces, indicating a particular lower resource usage limit to be imposed on the at least one category of network traffic at a particular service instance of the service, wherein the particular lower resource usage limit indicated by the client request is lower than a particular existing resource usage limit in effect at the time of the client request that is imposed on the at least one category of network traffic at the particular service instance of the service;

obtaining resource usage metrics corresponding to one or more categories of network traffic at the particular service instance; and

in response to determining that resource usage associated with network traffic at the particular service instance has reached a threshold level determined at least in part from the particular lower resource usage limit, initiating one or more responsive actions.

7. The method as recited in claim 6, wherein the particular lower resource usage limit comprises an indication of one of:

(a) an average traffic transmission rate that is not to be exceeded, (b) a burst traffic transmission rate that is not to be exceeded, (c) an upper limit to a number of bytes of data transferred, or (d) an upper limit on the number of network messages transferred.

8. The method as recited in claim 6, wherein the client request indicates a particular category of network traffic to which the particular lower resource usage limit is to be applied, wherein the particular category is selected from a plurality of categories of network traffic associated with the service including one or more of:

(a) traffic flowing over one or more public Internet links (b) traffic flowing within a provider network data center (c) traffic flowing between two provider network data centers (d) traffic flowing between nodes of the service and nodes of a different service implemented at a provider network.

9. The method as recited in claim 6, wherein the client request indicates one or more directions of network traffic flow to which the lower resource usage limit is to be applied, including one of:

(a) traffic flowing from the particular service instance to one or more destination endpoints;

(b) traffic flowing to the particular service instance from one or more sources.

10. The method as recited in claim 6, wherein the client request indicates a particular user account of a plurality of user accounts established on behalf of a client at the multi-tenant network-accessible service, wherein the lower resource usage limit is to be applied to the particular user account, and wherein a different resource usage limit applies to a different user account of the plurality of user accounts.

11. The method as recited in claim 6, wherein the one or more responsive actions comprise one of:

(a) discarding one or more packets, (b) queuing one or more packets, or (c) increasing, for a particular time period, the resource usage limit to be imposed on network traffic at the particular service instance.

12. The method as recited in claim 6, further comprising performing, by the one or more computing devices:

implementing a different programmatic interface enabling a client to determine a measured resource usage associated with network traffic at the particular service instance; and

in response to a request received via the different programmatic interface, providing an indication of the measured resource usage.

13. The method as recited in claim 6, wherein the client request includes an indication of a time period during which the particular lower resource usage limit is to be imposed.

14. The method as recited in claim 6, wherein the client request includes an indication of one of:

(a) the threshold level, or (b) a particular responsive action of the one or more responsive actions.

15. The method as recited in claim 6, wherein the network-accessible service is implemented using instance hosts of a provider network, further comprising performing, by the one or more computing devices:

receiving, at a particular server of a centralized networking configuration service of the provider network, a plurality of client requests for respective lower resource usage limits at specified service instances; and

transmitting, from the particular server to respective control modules instantiated at respective instance hosts of the specified service instances, indications of the respective lower resource usage limits.

16. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors:

receive, via a programmatic interface, a client request indicating a particular lower resource usage limit to be imposed on at least one category of network traffic at a particular instance of a network-accessible service, wherein the particular lower resource usage limit indicated by the client request is lower than a particular existing resource usage limit in effect at the time of the client request that is imposed on the at least one category of network traffic at the particular instance of the network-accessible service;

obtain resource usage metrics corresponding to one or more categories of network traffic at the particular instance; and

in response to a determination that resource usage associated with network traffic at the particular instance has reached a threshold level, initiate one or more responsive actions.

17. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the instructions when executed on the one or more processors:

receive a different client request indicating a combined resource usage limit to be imposed collectively on network traffic at a first and a second instance of the network-accessible service; and

in response to a determination that a sum of the resource usage associated with network traffic at the first and second instances has reached a threshold level, initiate one or more responsive actions.

18. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the network-accessible service comprises one of:

(a) a virtual computing service, (b) a storage service, or (c) a database service.

19. The non-transitory computer-accessible storage medium as recited in claim 16, wherein instructions when executed on the one or more processors:

receive a different client request indicating a client budget upper bound for networking resources at a different instance of the network-accessible service; and

in response to a determination that client billing costs associated with networking resources at the different instance exceed a threshold, initiate one or more responsive actions.

20. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the particular lower resource usage limit comprises an indication of one of:

(a) an average traffic transmission rate that is not to be exceeded, (b) a burst traffic transmission rate that is not to be exceeded, (c) an upper limit to a number of bytes of data transferred, or (d) an upper limit on the number of network messages transferred.