Offloading traffic to edge data centers in a content delivery network

• US 9,979,657 B2
• Filed: 06/17/2016
• Issued: 05/22/2018
• Est. Priority Date: 11/01/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Batrouni, Marwan, Zions, Jason Drew, Hornoiu, Octavian
• Primary Examiner(s): MacIlwinen, John
• Assistant Examiner(s): Doan, Tan
• Application Number:
  US15/185,319
• Publication Number:
  US 20160294701A1
• Time in Patent Office: 704 Days
• Field of Search: 709224
• CPC Class Codes: G06Q 20/145 Payments according to the detected use or quantity
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/726 Reserving resources in multiple paths to be used simultaneously by balancing the load H04L47/125
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/566 Grouping or aggregating service requests, e.g. for unified processing

Abstract

Offloading traffic to edge data centers in a content delivery network (CDN). It is determined that traffic at the edge data center should be offloaded to the other edge data centers. A priority level is determined for requesting the offloading of traffic to the other edge data centers. An offload request is sent to each of the other edge data centers, each offload request indicating the determined priority level. One or more replies are received from one or more of the other edge data centers, including one or more replies indicating that resources are available for use by the load balancer agent. The one or more replies are sorted to identify at least one edge data center for offloading traffic, and traffic is offloaded to the at least one identified edge data center.

Claims

1. A computer system configured as a load balancer agent at an edge data center in a content delivery network (CDN), comprising:

one or more processors; and

one or more computer-readable media having stored thereon computer-executable instructions that are executable by the one or more processors to cause the computer system to offload traffic to one or more other edge data centers in the CDN, the computer-executable instructions including instructions that are executable to cause to computer system to perform at least the following;

determine that traffic at the edge data center should be offloaded to the other edge data centers;

determine a priority level for requesting the offloading of traffic to the other edge data centers, the priority level being based on current bandwidth availability of the edge data center;

send an offload request to each of the other edge data centers, each offload request indicating the determined priority level;

receive one or more replies from one or more of the other edge data centers, including one or more replies indicating that resources are available for use by the load balancer agent;

sort the one or more replies to identify at least one edge data center for offloading traffic;

after identifying the at least one edge data center, select one or more specific servers that are included in the at least one identified edge data center, the selected one or more specific servers being servers that the load balancer agent desires be used when any offloaded traffic is processed by the at least one identified edge data center; and

offload traffic to the at least one identified edge data center, including sending a list of the selected one or more specific servers as being desired to be used when any offloaded traffic is processed by the at least one identified edge data center.

2. The computer system as recited in claim 1, wherein the one or more replies indicating that resources are available for use by the load balancer agent comprise one or more replies indicating that resources are reserved for use by the load balancer agent.

3. The computer system as recited in claim 1, wherein the one or more replies indicating that resources are available for use by the load balancer agent comprise one or more replies indicating a list of servers that are available for use.

4. The computer system as recited in claim 1, wherein sorting the one or more replies to identify at least one edge data center for offloading traffic includes sorting the one or more replies according to one or more of:

a distance of the edge data center sending each reply;

a cost for using the edge data center sending each reply;

or

a number of resources available at the edge data center sending each reply.

5. The computer system as recited in claim 4, wherein the cost for using the edge data center sending each reply comprises a financial cost.

6. The computer system as recited in claim 4, wherein sorting the one or more replies comprises computing a weighted average for each reply based on the distance of the edge data center sending the reply, the cost for using the edge data center sending the reply, and the number of resources available at the edge data center sending the reply.

7. The computer system as recited in claim 6, wherein sorting the one or more replies comprises sorting the one or more replies according to the weighted average for each reply.

8. The computer system as recited in claim 1, wherein receiving one or more replies from one or more of the other edge data centers comprises receiving a plurality of replies, each from a different edge data center.

9. The computer system as recited in claim 1, the computer-executable instructions also including instructions that are executable to cause to computer system to inform at least one edge data center that resources can be freed.

20. The computer system of claim 1, wherein execution of the computer-executable instructions further causes the computer system to:

send a list to the at least one identified edge data center, the list indicating the selected one or more specific servers that the load balancer agent indicated as being desirable to be used when any offloaded traffic is processed by the at least one identified edge data center; and

in addition to sending the list, send a resource manifest to the at least one identified edge data center.

21. The computer system of claim 1, wherein sorting the one or more replies to identify the at least one edge data center for offloading the traffic is at least partially performed by:

identifying a traffic pattern type associated with the at least one edge data center; and

sorting the one or more replies based on the identified traffic pattern type of the at least one edge data center.

22. The computer system of claim 1, wherein the servers that the load balancer indicates as being desirable are selected as candidate servers, the candidate servers being selected based on how much server resources are required to be allocated when executing in accordance with a selected property.

10. A method, implemented at a computer system that includes one or more processors and that is configured as a load balancer agent at an edge data center in a content delivery network (CDN), for offloading traffic to one or more other edge data centers in the CDN, the method comprising:

determining that traffic at the edge data center should be offloaded to the other edge data centers;

determining a priority level for requesting the offloading of traffic to the other edge data centers, the priority level being based on current bandwidth availability of the edge data center;

sending an offload request to each of the other edge data centers, each offload request indicating the determined priority level;

receiving one or more replies from one or more of the other edge data centers, including one or more replies indicating that resources are available for use by the load balancer agent;

sorting the one or more replies to identify at least one edge data center for offloading traffic;

after identifying the at least one edge data center, selecting one or more specific servers that are included in the at least one identified edge data center, the selected one or more specific servers being servers that the load balancer agent desires to be used when any offloaded traffic is processed by the at least one identified edge data center; and

offloading traffic to the at least one identified edge data center, including sending a list of the selected one or more specific servers as being desired to be used when any offloaded traffic is processed by the at least one identified edge data center.

11. The method as recited in claim 10, wherein the one or more replies indicating that resources are available for use by the load balancer agent comprise one or more replies indicating that resources are reserved for use by the load balancer agent.

12. The method as recited in claim 10, wherein the one or more replies indicating that resources are available for use by the load balancer agent comprise one or more replies indicating a list of servers that are available for use.

13. The method as recited in claim 10, wherein sorting the one or more replies to identify at least one edge data center for offloading traffic includes sorting the one or more replies according to one or more of:

a distance of the edge data center sending each reply;

a cost for using the edge data center sending each reply;

or

a number of resources available at the edge data center sending each reply.

14. The method as recited in claim 13, wherein sorting the one or more replies comprises computing a weighted average for each reply based on the distance of the edge data center sending the reply, the cost for using the edge data center sending the reply, and the number of resources available at the edge data center sending the reply.

15. The method as recited in claim 14, wherein sorting the one or more replies comprises sorting the one or more replies according to the weighted average for each reply.

16. The method as recited in claim 10, wherein receiving one or more replies from one or more of the other edge data centers comprises receiving a plurality of replies, each from a different edge data center.

17. The method as recited in claim 10, further comprising informing at least one edge data center that resources can be freed.

18. A computer program product comprising one or more hardware storage devices having stored thereon computer-executable instructions that are executable by one or more processors of a computer system configured as a load balancer agent at an edge data center in a content delivery network (CDN) to cause the computer system to offload traffic to one or more other edge data centers in the CDN, the computer-executable instructions including instructions that are executable to cause to computer system to perform at least the following:

determine that traffic at the edge data center should be offloaded to the other edge data centers;

determine a priority level for requesting the offloading of traffic to the other edge data centers, the priority level being based on current bandwidth availability of the edge data center;

send an offload request to each of the other edge data centers, each offload request indicating the determined priority level;

receive one or more replies from one or more of the other edge data centers, including one or more replies indicating that resources are available for use by the load balancer agent;

sort the one or more replies to identify at least one edge data center for offloading traffic;

after identifying the at least one edge data center, select one or more specific servers that are included in the at least one identified edge data center, the selected one or more specific servers being servers that the load balancer agent desires to be used when any offloaded traffic is processed by the at least one identified edge data center; and

offload traffic to the at least one identified edge data center, including sending a list of the selected one or more specific servers as being desired to be used when any offloaded traffic is processed by the at least one identified edge data center.

19. The computer program product as recited in claim 18, wherein sorting the one or more replies to identify at least one edge data center for offloading traffic includes sorting the one or more replies according to one or more of:

a distance of the edge data center sending each reply;

a cost for using the edge data center sending each reply;

or

a number of resources available at the edge data center sending each reply.