Load balancing content requests using dynamic document generation cost information

• US 6,839,700 B2
• Filed: 05/23/2001
• Issued: 01/04/2005
• Est. Priority Date: 05/23/2001
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Doyle, Ronald P., Hind, John R.
• Primary Examiner(s): Mizrahi, Diane D.
• Assistant Examiner(s): MOFIZ, APU M
• Application Number:
  US09/864,609
• Publication Number:
  US 20020178259A1
• Time in Patent Office: 1,322 Days
• Field of Search: 707/10, 707/100, 707/102, 707/200, 707/203, 707/2, 370/229, 705/1, 709/105, 709/201, 709/203, 709/224, 709/230, 709/241
• US Class Current: 707/719
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/1031 Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing

Abstract

Methods, systems, computer program products, and methods of doing business by performing load balancing of content requests using information regarding the cost of dynamically creating the requested document content. Cost metrics are gathered by a server which generates requested content, and may reflect processing at one or more other servers. This cost information is provided to a load balancing host. Several alternative approaches for providing the cost metrics may be used, including defining new headers for response messages, specifying cookie values, and so forth. The load balancing host may choose to route a subsequent request for that content to the server which most recently generated the content, or to another available server, depending on the cost of re-generating the content and the current load on those servers.

Claims

1. A method of improving load balancing operations in a computing network using cost metrics, comprising steps of:

obtaining cost metrics representing a cost of generating document content;

receiving a request for particular document content;

determining a particular one of a plurality servers which most recently served the requested document content; and

routing the request to a selected one of the plurality of servers, further comprising the steps of;

determining which other one of the plurality of servers is (1) capable of serving the requested document content and (2) most laghtly loaded;

using the obtained cost metrics to compare a first cost of routing the request to the determined one to a second cost of routine the request to the particular one; and

selecting the determined one if the first cost is less than the second cost and selecting the particular one otherwise.

2. The method according to claim 1, wherein the first cost and the second cost include a current load on the determined one and the particular one, respectively.

3. The method according to claim 1, wherein:

the obtaining step further comprises the step of receiving meta-data which conveys the cost metrics for the document content; and

the using step further comprises the step of using the cost metrics from the received meta-data.

4. The method according to claim 3, wherein the received meta-data comprises one or more cookies.

5. The method according to claim 3, wherein the received meta-data comprises a HyperText Transfer Protocol (“

HITTP”

) response header.

6. The method according to claim 3, wherein the received meta-data comprises a plurality of HyperText Transfer Protocol (“

HTTP”

) response headers, each of the headers conveying an element of the cost metric for a particular document content.

7. The method according to claim 3, wherein the received meta-data comprises syntax in a markup language.

8. The method according to claim 7, wherein the markup language is HTML (“

HyperText Markup Language”

).

9. The method according to claim 8, wherein the syntax comprises a “

META”

tag using an “

HTTP-EQUIV”

attribute syntax.

10. The method according to claim 8, wherein the syntax comprises a “

META”

tag using a “

NAME”

attribute syntax.

11. The method according to claim 8, wherein the syntax comprises a specially denoted comment.

12. The method according to claim 1, wherein the markup language is XML (“

Extensible Markup Language”

).

13. The method according to claim 1, wherein the obtaining step further comprises querying remotely-stored cost metric information.

14. The method according to claim 13, wherein the querying step uses a WebDAV request.

15. The method according to claim 14, wherein a response to the WebDAV request specifies cost metrics for more than one of the plurality of servers.

16. The method according to claim 1, wherein, the second cost includes a current workload on the particular one.

17. A system for improving load balancing operations in a computing network using cost metrics, comprising:

means for obtaining cost metrics representing a cost of generating document content;

means for receiving a request for particular document content;

means for responding to the request using cached content, if available; and

means for routing the request to a selected one of a plurality of server;

when cached content is not available, further comprising;

means for determinig a particular one of the plurality of servers that most recently served the requested document content;

means for determinig which other one of the plurality of servers is (1) capable of serving the requested document content and (2) most lightly loaded;

means for using the obtained cost metrics to compare a first cost of routing the request to the determined one to a second cost of routing the request to the particular one and

means for selecting the determined one if the first cost is less than the second cost and selecting the particular one otherwise.

18. A computer program product for improving load balancing operations in a computing network using cost metrics, the computer program product embodied on one or more computer-readable media and comprising:

computer-readable program code means for obtaining cost metrics representing a cost of generating document content;

computer-readable program code means for receiving a request for particular document content;

computer-readable program code means for responding to the request using cached content, if available; and

computer-readable program code means for routing the request to a selected one of a plurality of servers, when cached content is not available, further comprising;

computer-readable program code means for determining a particular one of the plurality of servers that most recently served the requested document content;

computer-readable program code means for determining which other one of the plurality of servers is (1) capable of serving the requested document content and (2) most lightly loaded;

computer-readable program code means for using the obtained cost metrics to compare a first cost of routing the request to the determined one to a second cost of routing the request to the particular one; and

computer-readable program code means for selecting the determined one if the first cost is less than the second cost and selecting the particular one otherwise.

19. A method of using cost metrics when load balancing incoming content requests in a networking environment, comprising steps of:

gathering cost metric information representing a cost of generating document content; and

creating meta-data to convey the cost metric information to a load balancer;

sending the created meta-data to the load balancer;

receiving the sent cost metric information at the load balancer;

upon receiving a request for the document content at the load balancer, using the received cost metric information to route the request to a server selected from a plurality of servers, further compromising the steps of;

using the received cost metric information to determine a first cost of serving the requested document content from a particular one of the plurality of servers that most recently served the requested document content;

using the received cost metric information to determine a second cost of serving the requested document content from a different one of the plurality of servers, wherein the received cost metric information indicates that the different one of the plurality of servers which is capable of serving the request document content at least cost; and

selecting the particular one if the first cost is less than the second cost and selecting the different one otherwise.

20. The method according to claim 19, wherein the gathered cost metric information comprises at least one of:

(1) processing time at one of the plurality of servers which is an origin server;

(2) network costs from the origin server to one or more ones of the plurality of servers which are backend enterprise servers;

(3) processing time at the backend enterprise servers; and

(4) a cost of delivering the generated document content to a proxy or cache.