APPARATUS AND METHODS FOR CO-LOCATION AND OFFLOADING OF WEB SITE TRAFFIC BASED ON TRAFFIC PATTERN RECOGNITION

• US 20080091826A1
• Filed: 12/07/2007
• Published: 04/17/2008
• Est. Priority Date: 12/10/2002
• Status: Active Grant

• Current Assignee: Daniel Dias, Honghui Xia, Li Zhang, Mark Squillante, Richard King, Shun-Zheng Yu, Zhen Liu
• Original Assignee: Daniel Dias, Honghui Xia, Li Zhang, Mark Squillante, Richard King, Shun-Zheng Yu, Zhen Liu
• Inventors: Dias, Daniel, Yu, Shun-Zheng, Squillante, Mark, Xia, Honghui, Liu, Zhen, Zhang, Li, King, Richard
• Granted Patent: US 8,352,607 B2
• Time in Patent Office: Days
• US Class Current: 709/226
• CPC Class Codes: H04L 41/142 using statistical or mathematical methods
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/122 by diverting traffic away from congested entities
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

Apparatus and methods for identifying traffic patterns to web sites based on templates that characterize the arrival of traffic to the web sites are provided. Based on these templates, determinations are made as to which web sites should be co-located so as to optimize resource allocation. Specifically, web sites whose templates are complimentary, i.e. a first web site having a peak in arrival traffic at time t1 and a second web site that has a trough in arrival traffic at time t1, are designated as being candidates for co-location. In addition, the present invention uses the templates identified for the traffic patterns of web sites to determine thresholds for offloading traffic to other servers. These thresholds include a first threshold at which offloading should be performed, a second threshold that takes into consideration the lead time needed to begin offloading, and a third threshold that takes into consideration a lag time needed to stop all offloading of traffic to the other servers.

Claims

1-37. -37. (canceled)

38. A computer program product in a recordable type medium for allocating resources to a plurality of web sites, wherein the computer program product is executed by a computer, comprising:

first instructions for identifying a traffic pattern for each of the plurality of web sites;

second instructions for identifying at least one of a plurality of templates for each of the plurality of web sites based on the traffic pattern; and

third instructions for allocating resources to at least one of the plurality of web sites based on the at least one of the plurality of templates identified for the at least one of the plurality of web sites.

39. The computer program product of claim 38, wherein the third instructions for allocating resources to the at least one of the plurality of web sites include:

instructions for identifying at least two of the plurality of web sites that are candidates for co-location based on the at least one of the plurality of templates identified for the at least two of the plurality of web sites; and

instructions for allocating resources to the at least two of the plurality of web sites based on identifying the at least two of the plurality of web sites that are candidates for co-location.

40. The computer program product of claim 38, wherein the third instructions for allocating resources to the at least one of the plurality of web sites include:

instructions for calculating, for at least one particular web site in the plurality of web sites, a first threshold based on the at least one of the plurality of templates identified for the at least one particular web site in the plurality of web sites;

instructions for calculating a second threshold based on the first threshold, wherein offloading of traffic is enabled when a traffic intensity for the at least one particular web site in the plurality of web sites meets or exceeds the second threshold; and

instructions for calculating a third threshold based on the first threshold, wherein offloading of traffic is disabled when the traffic intensity of the at least one particular web site in the plurality of web sites meets or falls below the third threshold.

41. The computer program product of claim 39, wherein the third instructions for allocating resources to the at least one of the plurality of web sites includes:

instructions for calculating, for at least one particular web site in the plurality of web sites, a first threshold based on the at least one of the plurality of templates identified for the at least one particular web site in the plurality of web sites;

instructions for calculating a second threshold based on the first threshold, wherein offloading of traffic is enabled when a traffic intensity for the at least one particular web site in the plurality of web sites meets or exceeds the second threshold; and

instructions for calculating a third threshold based on the first threshold, wherein offloading of traffic is disabled when the traffic intensity of the at least one particular web site in the plurality of web sites meets or falls below the third threshold.

42. The computer program product of claim 40, further comprising:

fourth instructions for monitoring the traffic of the at least one particular web site in the plurality of web sites, on a web server to determine if the traffic intensity exceeds the second threshold; and

fifth instructions for offloading at least a portion of the traffic to another web server if the traffic intensity of the at least one particular web site in the plurality of web sites exceeds the second threshold.

43. The computer program product of claim 42, further comprising:

sixth instructions for monitoring the traffic of the at least one particular web site in the plurality of web sites, on the web server to determine if the traffic intensity falls below the third threshold; and

seventh instructions for disabling the offloading of traffic to the another web server if the traffic intensity of the at least one particular web site in the plurality of web sites falls below the third threshold.

44. The computer program product of claim 39, wherein the instructions for identifying at least two of the plurality of web sites that are candidates for co-location based on the at least one of the plurality of templates identified for the at least two of the plurality of web sites include:

instructions for identifying a first web site of the plurality of web sites having peaks in traffic at a first set of time periods; and

instructions for identifying a second web site of the plurality of web sites having peaks in traffic at a second set of time periods different from the first set of time periods.

45. The computer program product of claim 42, wherein the second web site has a trough in traffic at approximately a same time as the first web site has a peak in traffic.

46. The computer program product of claim 39, wherein the instructions for identifying at least two of the plurality of web sites that are candidates for co-location based on the at least one of the plurality of templates identified for the at least two of the plurality of web sites include:

instructions for identifying the at least two of the plurality of web sites such that a capacity for traffic of a web server on which the at least two of the plurality of web sites are located remains constant.

47. The computer program product of claim 39, wherein the instructions for identifying at least two of the plurality of web sites that are candidates for co-location based on the at least one of the plurality of templates identified for the at least two of the plurality of web sites include:

instructions for identifying the at least two of the plurality of web sites such that a total cost of all web servers hosting the plurality of web sites is minimized.

48. The computer program product of claim 39, wherein the instructions for identifying at least two of the plurality of web sites that are candidates for co-location based on the at least one of the plurality of templates identified for the at least two of the plurality of web sites include:

instructions for formulating an integer programming problem having decision variables that are an assignment of the plurality of web sites to a plurality of web servers, a constraint that is a capacity limitation for any server at any time epoch, and an objective function that is an increasing function of minimum distances between server capacity and peak load at different ones of the plurality of web servers.

49. The computer program product of claim 39, wherein the instructions for identifying at least two of the plurality of web sites that are candidates for co-location based on the at least one of the plurality of templates identified for the at least two of the plurality of web sites include:

instructions for formulating an integer programming problem having decision variables that are an assignment of the plurality of web sites to a plurality of web servers, a constraint that is a capacity limitation for any server at any time epoch, and an objective function that is a sum of costs of all web servers to which at least one web site is assigned.