Co-location and offloading of web site traffic based on traffic pattern recognition

• US 8,352,607 B2
• Filed: 12/07/2007
• Issued: 01/08/2013
• Est. Priority Date: 12/10/2002
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dias, Daniel Manuel, King, Richard Pervin, Liu, Zhen, Squillante, Mark Steven, Xia, Honghui, Yu, Shun-Zheng, Zhang, Li
• Primary Examiner(s): Tiv, Backhean
• Assistant Examiner(s): Chou, Alan S
• Application Number:
  US11/952,641
• Publication Number:
  US 20080091826A1
• Time in Patent Office: 1,859 Days
• Field of Search: 709/226
• US Class Current: 709/226
• CPC Class Codes: H04L 41/142 using statistical or mathematical methods
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/122 by diverting traffic away from congested entities
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

Identifying traffic patterns to web sites based on templates that characterize the arrival of traffic to the web sites is provided. Based on these templates, determinations are made as to which web sites should be co-located so as to optimize resource allocation. Web sites whose templates are complimentary, i.e. a first web site having a peak in arrival traffic at time t1 and a second web site that has a trough in arrival traffic at time t1, are designated as being candidates for co-location. In addition, the templates identified for the traffic patterns of web sites are used to determine thresholds for offloading traffic to other servers. These thresholds include a first threshold at which offloading should be performed, a second threshold that takes into consideration the lead time needed to begin offloading, and a third threshold that takes into consideration a lag time needed to stop offloading of traffic.

Claims

1. A computer program product stored in a non-transitory recordable type medium having instructions embodied therein that are executable by a computer for allocating resources to a plurality of web sites, the computer program product, comprising:

instructions for identifying a traffic pattern for each of the plurality of web sites, wherein the traffic pattern is a selected measurement of data selected from a group consisting of load/request patterns, user navigation patterns, and site hypertext structures;

instructions for identifying at least one of a plurality of traffic pattern graphs for each of the plurality of web sites based on the traffic pattern, wherein a traffic pattern graph in the plurality of traffic pattern graphs is a function of time series data values for the selected measurement for the traffic pattern;

instructions for identifying at least two of the plurality of web sites that are candidates for co-location of traffic associated with the at least two of the plurality of web sites on a set of resources based on the at least one of the plurality of traffic pattern graphs identified for the at least two of the plurality of web sites, wherein the instructions for identifying the at least two of the plurality of web sites that are candidates for co-location of traffic include instructions for formulating an integer programming problem having decision variables that are an assignment of the plurality of web sites to a plurality of web servers, a constraint that is a capacity limitation for any server at any time epoch, and an objective function that is a sum of costs of all web servers to which at least one web site is assigned; and

instructions for allocating the set of resources to handle the co-location of the traffic associated with the at least two of the plurality of web sites based on identifying the at least two of the plurality of web sites that are the candidates for the co-location of the traffic associated with the at least two of the plurality of web sites on the set of resources.

2. The computer program product of claim 1, wherein the instructions for allocating the set of resources to the at least two of the plurality of web sites include:

instructions for calculating, for at least one particular web site in the plurality of web sites, a first threshold based on the at least one of the plurality of traffic pattern graphs identified for the at least one particular web site in the plurality of web sites;

instructions for calculating a second threshold by subtracting a lead time of an offload mechanism to the first threshold, wherein offloading of traffic is enabled when a traffic intensity for the at least one particular web site in the plurality of web sites meets or exceeds the second threshold; and

instructions for calculating a third threshold by adding a lag time of the offload mechanism to the first threshold, wherein offloading of traffic is disabled when the traffic intensity of the at least one particular web site in the plurality of web sites meets or falls below the third threshold.

3. The computer program product of claim 2, further comprising:

fourth instructions for monitoring traffic of the at least one particular web site in the plurality of web sites on a web server to determine when the traffic intensity exceeds the second threshold; and

instructions for offloading at least a portion of the traffic on the web server to another web server when the traffic intensity of the at least one particular web site in the plurality of web sites exceeds the second threshold.

4. The computer program product of claim 3, further comprising:

instructions for monitoring the traffic of the at least one particular web site in the plurality of web sites on the web server to determine when the traffic intensity falls below the third threshold; and

instructions for disabling the offloading of the traffic on the web server to the another web server when the traffic intensity of the at least one particular web site in the plurality of web sites falls below the third threshold.

5. The computer program product of claim 1, wherein the instructions for identifying the at least two of the plurality of web sites that are the candidates for the co-location of the traffic associated with the at least two of the plurality of web sites on the set of resources include:

instructions for identifying a first web site of the plurality of web sites having peaks in traffic at a first set of time periods; and

instructions for identifying a second web site of the plurality of web sites having peaks in traffic at a second set of time periods different from the first set of time periods.

6. The computer program product of claim 5, wherein the second web site has a trough in traffic at approximately a same time as the first web site has a peak in traffic.

7. The computer program product of claim 1, wherein the instructions for identifying the at least two of the plurality of web sites that are the candidates for the co-location of the traffic associated with the at least two of the plurality of web sites on the set of resources include:

instructions for identifying the at least two of the plurality of web sites such that a capacity for traffic of a web server on which the at least two of the plurality of web sites are located remains constant.

8. The computer program product of claim 1, wherein the instructions for identifying the at least two of the plurality of web sites that are the candidates for the co-location of the traffic associated with the at least two of the plurality of web sites on the set of resources include:

instructions for identifying the at least two of the plurality of web sites such that a total cost of all web servers hosting the plurality of web sites is minimized.

9. The computer program product of claim 1, wherein the instructions for identifying the at least two of the plurality of web sites that are the candidates for the co-location of the traffic associated with the at least two of the plurality of web sites on the set of resources include:

instructions for formulating an integer programming problem having decision variables that are an assignment of the plurality of web sites to a plurality of web servers, a constraint that is a capacity limitation for any server at any time epoch, and an objective function that is an increasing function of minimum distances between server capacity and peak load at different ones of the plurality of web servers.