On-demand global server load balancing system and method of use
First Claim
Patent Images
1. A method of processing requests in a network, comprising:
- measuring performance of one or more servers located at different sites of the network;
computing a load balancing performance metric for each of the sites or the one or more servers at each of the sites;
providing a bias to the load balancing performance metric; and
routing a request to one of the different sites or one of the one or more servers based on the biased load balancing performance metric to balance a workload among the one or more servers,wherein the bias is a multiplier that accentuates a load issue by proactively taking into consideration overall architecture of the network in order to adjust the workload among the one or more servers prior to any capacity problems;
the load balancing performance metric is a load value; and
the load value is calculated by;
factor=(upperbound−
lowerbound)/critical response time; and
load=round((factor*response time)+lowerbound).
1 Assignment
0 Petitions
Accused Products
Abstract
A method and system for measuring performance and balancing workload of sites and servers is provided. The method comprises measuring performance of one or more servers located at different sites of the network and computing a performance metric for each of the sites or one or more servers at each of the sites. The method further comprises providing a bias to the performance metric and routing a request to one of the different sites or one of the one or more servers based on the biased performance metric.
-
Citations
38 Claims
-
1. A method of processing requests in a network, comprising:
-
measuring performance of one or more servers located at different sites of the network; computing a load balancing performance metric for each of the sites or the one or more servers at each of the sites; providing a bias to the load balancing performance metric; and routing a request to one of the different sites or one of the one or more servers based on the biased load balancing performance metric to balance a workload among the one or more servers, wherein the bias is a multiplier that accentuates a load issue by proactively taking into consideration overall architecture of the network in order to adjust the workload among the one or more servers prior to any capacity problems; the load balancing performance metric is a load value; and the load value is calculated by; factor=(upperbound−
lowerbound)/critical response time; andload=round((factor*response time)+lowerbound). - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 36, 37, 38)
-
-
17. A method of routing requests in a network, comprising:
-
computing a load balancing performance metric for at least one of a site and a server of a plurality of servers; and routing a request to at least the site or the server based on the load balancing performance metric for balancing workload among the plurality of servers, wherein the load balancing performance metric includes a biased response time metric associated with the site or the server of the plurality of servers, wherein the biased response time metric comprises a computed response time changed by a bias factor, and wherein the bias factor is a multiplier that accentuates a load issue by proactively taking into consideration overall architecture of the network in order to adjust the workload among the one or more servers prior to any capacity problems; the load balancing performance metric is a load value; and the load value is calculated by; the bias factor=(upperbound−
lowerbound)/critical response time andload=round((the bias factor*the response time)+lowerbound).
-
-
18. A system implemented on hardware for routing requests in a network, comprising:
-
a computer infrastructure configured to; measure performance of one or more servers at different sites; generate a load balancing performance metric for each of the one or more servers; provide a bias to the load balancing performance metric by altering the load balancing performance metric by a bias factor to generate a biased load balancing performance metric; and route a request to one of the different sites or one of the one or more servers based on the biased load balancing performance metric to balance a workload among the one or more servers, wherein the bias factor is a multiplier that accentuates a load issue by proactively taking into consideration overall architecture of the network in order to adjust the workload among the one or more servers prior to any capacity problems; the load balancing performance metric is a load value; and the load value is calculated by; the bias factor=(upperbound−
lowerbound)/critical response time; andload=round((the bias factor*response time)+lowerbound); and the providing the bias is implemented using at least one processor of the computer infrastructure. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25, 26, 27, 28)
-
-
29. A system for balancing workload, comprising:
-
a computing device comprising a combination of hardware and software configured to; collect performance measurements for different sites in a network; generate at least one biased server load balancing performance metric based on a response time of servers located at the different sites; and route a request to a server at one of the different sites based on the at least one biased server load balancing performance metric, wherein the at least one biased server load balancing performance metric comprises a respective response time of the servers located at the different sites changed by a bias factor, and wherein the bias factor is a multiplier that accentuates a load issue by proactively taking into consideration overall architecture of the network in order to adjust workload among the one or more servers prior to any capacity problems; the load balancing performance metric is a load value; and the load value is calculated by; the bias factor=(upperbound−
lowerbound)/critical response time; andload=round((the bias factor*the response time)+lowerbound).
-
-
30. A method to provide a service for establishing a computing infrastructure, comprising:
-
collecting performance measurements for different sites in a network; generating at least one biased server load balancing performance metric based on the performance measurements of servers located at the different sites; and routing a request to a server at one of the different sites based on the biased server load balancing performance metric, wherein the at least one biased server load balancing performance metric comprises a respective performance measurement of the servers located at the different sites changed by a bias factor, and wherein the bias factor is a multiplier that accentuates a load issue by proactively taking into consideration overall architecture of the network in order to adjust workload among the one or more servers prior to any capacity problems; the load balancing performance metric is a load value; and the load value is calculated by; the bias factor=(upperbound−
lowerbound)/critical response time; andload=round((the bias factor*response time)+lowerbound). - View Dependent Claims (31, 32, 33)
-
-
34. A method of processing queries in a network, comprising the steps of:
-
measuring performance of one or more servers at different locations; routing a request to the one of the one or more servers based on a computed load balancing performance metric including proximity to the requestor and a biased allocation of workload amongst the one or more servers, wherein the biased allocation of workload comprises a computed allocation of workload changed by a bias factor, and wherein the bias is a multiplier that accentuates a load issue by proactively taking into consideration overall architecture of the network in order to adjust the workload among the one or more servers prior to any capacity problems; the load balancing performance metric is a load value; and the load value is calculated by; factor=(upperbound−
lowerbound)/critical response time; andload=round((factor*response time)+lowerbound).
-
-
35. A computer program product comprising a computer usable device having readable program code embodied in the device, the computer program product includes at least one processor to:
-
collect performance measurements for different sites in a network; generate at least one biased server load balancing performance metric based on the performance measurements of servers located at the different sites; and route a request to a server at one of the different sites based on the biased server load balancing performance metric, wherein the at least one biased server load balancing performance metric comprises a respective performance measurement of the servers located at the different sites changed by a bias factor, and wherein the bias factor is a multiplier that accentuates a load issue by proactively taking into consideration overall architecture of the network in order to adjust workload among the one or more servers prior to any capacity problems; the load balancing performance metric is a load value; and the load value is calculated by; the bias factor=(upperbound−
lowerbound)/critical response time; andload=round((the bias factor*response time)+lowerbound).
-
Specification