Traffic surge management for points of presence

• US 9,887,931 B1
• Filed: 03/30/2015
• Issued: 02/06/2018
• Est. Priority Date: 03/30/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Uppal, Hardeep Singh, Acharya, Prashanth, Howard, Craig Wesley
• Primary Examiner(s): Jacobs, Lashonda
• Application Number:
  US14/673,121
• Time in Patent Office: 1,044 Days
• CPC Class Codes: H04L 12/5691 Access to open networks; Ingress point selection, e.g. ISP selection
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0894 Policy-based network configuration management
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1036 Load balancing of requests to servers for services different from user content provisioning, e.g. load balancing across domain name servers
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements

Abstract

A system, method, and computer-readable medium for point of presence (POP) based traffic surge detection and mitigation are provided. The system detects a traffic surge for a target group of resources directed at a source POP based on the target group'"'"'s rank shifts and volume changes among recent time intervals. The system mitigates the detected traffic surge by identifying destination POPs with spare capacity and routing at least a portion of incoming requests for the target group of resources to the destination POPs in accordance with their spare capacities.

Claims

1. A computer-implemented method for mitigating traffic surges in networks, the computer-implemented method comprising:

under control of a computing device configured with specific computer executable instructions,

obtaining a request volume for requests for network resources corresponding to a target group, wherein the request volume is received at a source point of presence (POP) of a plurality of POPs during a period of time, and wherein the target group is subject to a traffic surge in which a number of requests for the network resources during the period of time exceeds a threshold;

determining, based on the obtained request volume, a source spare capacity associated with the source POP for processing requests for network resources corresponding to the target group;

determining that the source spare capacity is not sufficient for processing the request volume for the target group;

identifying one or more destination POPs from the plurality of POPs;

for each of the destination POPs, determining a respective destination spare capacity associated with the respective destination POP for processing requests for network resources corresponding to the target group;

determining a policy for routing requests for network resources corresponding to the target group based, at least in part, on the source spare capacity and destination spare capacities; and

causing routing of requests for network resources corresponding to the target group in accordance with the policy.

2. The computer-implemented method of claim 1, wherein the target group corresponds to at least one of a Web page, Web application, Web site, domain, or sub-domain.

3. The computer-implemented method of claim 1, wherein determining the source spare capacity comprises determining a maximum capacity for processing requests for network resources at the source POP.

4. The computer-implemented method of claim 3, wherein determining the source spare capacity further comprises taking into account a cushion amount below the maximum capacity.

5. The computer-implemented method of claim 1, wherein determining the source spare capacity comprises determining a volume of requests for network resource currently processed at the source POP.

6. The computer-implemented method of claim 1, wherein identifying one or more destination POPs from the plurality of POPs comprises identifying the one or more destination POPs based, at least in part, on a criterion related to the source POP.

7. The computer-implemented method of claim 1 further comprising determining an aggregate capacity by aggregating the source spare capacity and destination spare capacities.

8. The computer-implemented method of claim 7 further comprising determining whether the aggregate capacity is sufficient for processing the request volume for the target group.

9. The computer-implemented method of claim 1, wherein causing routing of the requests for network resources corresponding to the target group comprises causing routing of the requests deterministically or probabilistically in accordance with the policy.

10. A non-transitory computer readable storage medium storing computer executable instructions that when executed by a processor perform operations comprising:

determining a spare computational capacity associated with a source point of presence (POP) of a plurality of POPs for processing requests for network resources receiving during a first period of time, wherein a number of requests for the network resources during the first period of time exceeds a threshold;

determining that the spare computational capacity associated with the source POP is not sufficient for processing a quantity of requests directed at the source POP for network resources corresponding to a target group, wherein the target group corresponds to a target of a traffic surge;

determining a spare computational capacity associated with a first destination POP of the plurality of POPs for processing requests for network resources; and

causing routing of at least a portion of requests for network resources corresponding to the target group to the first destination POP based, at least in part, on the determined spare computational capacity associated with the source POP and the determined spare computational capacity associated with the first destination POP.

11. The non-transitory computer readable storage medium of claim 10, wherein the quantity of requests directed at the source POP is calculated based, at least in part, on the first period of time.

12. The non-transitory computer readable storage medium of claim 10, wherein determining the spare computational capacity associated with the first destination POP comprises determining a quantity of requests for network resources processed by the first destination POP during the first period of time.

13. The non-transitory computer readable storage medium of claim 10, wherein the operations further comprise identifying the first destination POP from the plurality of POPs based on at least one of a proximity, latency, bandwidth, reliability, computational capacity, or performance associated with the first destination POP.

14. The non-transitory computer readable storage medium of claim 13, wherein the operations further comprise identifying a second destination POP from the plurality of POPs.

15. The non-transitory computer readable storage medium of claim 14, wherein the operations further comprise causing routing of at least a second portion of requests for network resources corresponding to the target group to the second destination POP.

16. The non-transitory computer readable storage medium of claim 15, wherein the operations further comprise causing routing of the second portion of requests for network resources corresponding to the target group to the second destination POP after routing of the portion of requests to the first destination POP.

17. A system comprising:

at least one data store that stores computer-executable instructions; and

at least one processor in communication with the data store, the processor configured with the computer-executable instructions such that the computer-executable instructions, when executed, cause the system to at least;

determine a spare capacity associated with a source point of presence (POP) of a plurality of POPs for processing network resource requests based, at least in part, on a first period of time, wherein a number of requests for the network resources during the first period of time exceeds a threshold;

determine that the spare capacity associated with the source POP is not sufficient for processing a quantity of network resource requests corresponding to a target group, wherein the quantity of network resource requests is directed at the source POP and wherein the target group corresponds to a target of a traffic surge;

determine a spare capacity associated with a destination POP of the plurality of POPs for processing network resource requests based, at least in part, on the first period of time; and

cause routing of at least a portion of network resource requests corresponding to the target group based, at least in part, on the determined spare capacity associated with the source POP and the determined spare capacity associated with the destination POP.

18. The system of claim 17, wherein the computer-executable instructions further cause the system to at least determine a second spare capacity associated with the source POP for processing network resource requests based, at least in part, on a second period of time.

19. The system of claim 17, wherein the computer-executable instructions further cause the system to at least determine a second spare capacity associated with the destination POP for processing network resource requests based, at least in part, on a second period of time.

20. The system of claim 19, wherein the computer-executable instructions further cause the system to at least cause routing of at least a second portion of network resource requests corresponding to the target group to the destination POP based, at least in part, on the second spare capacity associated with the destination POP.