Queuing model for a plurality of servers

• US 7,895,231 B2
• Filed: 12/12/2007
• Issued: 02/22/2011
• Est. Priority Date: 02/15/2002
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Patterson, James Edmund
• Primary Examiner(s): ALAM, SHAHID AL
• Application Number:
  US12/000,394
• Publication Number:
  US 20080109452A1
• Time in Patent Office: 1,168 Days
• Field of Search: 707/609, 707/770, 709/203, 709/204, 709/223, 709/246, 717/127, 718/105
• US Class Current: 707/770
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1036 Load balancing of requests to servers for services different from user content provisioning, e.g. load balancing across domain name servers
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

The current invention provides a system and method for queuing and distributing requests to one or more query servers. The system contains a first tier queue associated with a server based mechanism for directing service requests to a second tier queue associated with each of the one or more query servers. The current invention provides a “pull” model for the distribution of an initial service request of a query containing two or more service requests. Subsequent service requests from this query are assigned to a query server without being placed in a first tier queue. These subsequent service requests are placed directly in the queue of the query server that handled the previous service request from the same query.

Claims

1. A two-tier information retrieval system for distributing a first client service request from a client to query servers, the system comprising:

a web server, the web server invoking a gateway upon receiving the first client service request;

a dispatcher in a first tier and in communication with the web server,

a plurality of query servers suitable for fulfilling the first client service request, the plurality of query servers forming a second tier and receiving information from the gateway, the gateway being an interface between the web server and the plurality of query servers;

the gateway determining a presence of a server identification parameter in the first client service request, the server identification parameter identifying a first query server among the plurality of query servers, the first query server having handled a previous service request from the client;

the gateway distributing the first client service request directly to the first query server; and

the dispatcher receiving status information from the plurality of query servers, forwarding a second client service request to an available query server of the plurality of query servers in the absence of the server identification parameter; and

including a queue for the second client service request.

2. The system according to claim 1, further comprising a server manager monitoring and collecting information related to the operation of the plurality of query servers, the server manager communicating the collected information to the dispatcher.

3. The system according to claim 1, wherein the server manager initiates and terminates a configured number of processes on the plurality of query servers.

4. The system according to claim 1, wherein the first client service request and the second client service request are related.

5. The system according to claim 1, wherein the first client service request is for a first page and the second client service request is for a subsequent page.

6. A method of routing a service request to query servers, the method comprising:

receiving the service request at a web server, the web server interfacing the client and the plurality of query servers;

invoking a gateway on the web server upon receiving the service request, the gateway being an interface between the web server and the plurality of query servers;

receiving the service request at the gateway;

receiving a query server identification for an available query server among the plurality of query servers;

forwarding the service request to the available query server identified by the query server identification; and

including a server identification parameter in a reply to the client service request;

determining a presence of the server identification parameter in a second client service request; and

distributing the second service request directly to the available query server identified by the server identification parameter.

7. The method according to claim 6, further comprising the step of:

forwarding identification information related to the service request for directing service requests.

8. The method according to claim 6, further comprising the steps of:

determining an availability of the plurality of query servers for accepting the service request; and

placing the service request in a queue in an absence of the availability.

9. The method according to claim 6, wherein the server identification parameter comprises an IP address of the query server.

10. The method according to claim 7, wherein service request is forwarded based on a member selected from the group consisting of max server session, request limit, minimum idle wait, minimum switch wait and a combination thereof;

wherein the max server session specifies the number of servers upon which each user can be active, the request limit defines the total number of requests that can be waiting for service at any one time, the minimum idle wait specifies the creation of new user sessions, and the minimum switch wait is the time to wait before a user having an assigned max server session is switched to a new query server.

11. The method according to claim 6, further comprising the step of creating a user session defining the relationship between a particular identified user and the available query server.

12. A storage medium readable by a computer encoding a computer program for execution by the computer to carry out a method of routing a service request to query servers, the computer program comprising:

code means for receiving the service request at a web server;

the web server interfacing the client and the plurality of query servers,

code means for invoking a gateway on the web server upon receiving the service request, the gateway being an interface between the web server and the plurality of query servers;

code means for receiving the service request at the gateway;

code means for receiving a query server identification for an available query server among the plurality of query servers;

code means for forwarding the service request to the available query server identified by the query server identification;

code means for including a server identification parameter in a reply to the client service request;

code means for determining a presence of the server identification parameter in a second client service request; and

code means for distributing the second service request directly to the available query server identified by the server identification parameter.

13. The storage medium according to claim 12, further comprising:

code means for forwarding identification information related to the service request for directing service requests.

14. The storage medium according to claim 12, further comprising:

code means for determining an availability of the plurality of query servers for accepting the service request; and

code means for placing the service request in a queue in an absence of the availability.

15. The storage medium according to claim 12, wherein the server identification parameter comprises an IP address of the query server.

16. The storage medium according to claim 12, wherein the service request is forwarded based on a member selected from the group consisting of max server session, request limit, minimum idle wait, minimum switch wait and a combination thereof;

wherein the max server session specifies the number of servers upon which each user can be active, the request limit defines the total number of requests that can be waiting for service at any one time, the minimum idle wait specifies the creation of new user sessions, and the minimum switch wait is the time to wait before a user having an assigned max server session is switched to a new query server.

17. The storage medium according to claim 12, further comprising:

code means for creating a user session defining the relationship between a particular identified user and the available query server.