Queuing model for a plurality of servers

• US 7,333,974 B2
• Filed: 02/14/2003
• Issued: 02/19/2008
• Est. Priority Date: 02/15/2002
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: Cognos Incorporated (International Business Machines Corporation)
• Inventors: Patterson, James Edmund
• Primary Examiner(s): ALAM, SHAHID AL
• Application Number:
  US10/366,475
• Publication Number:
  US 20030182261A1
• Time in Patent Office: 1,831 Days
• Field of Search: 707 1- 10, 707100-1041, 707200-205, 715/705, 717/127, 718/105, 709/203, 709/204, 709/223, 709/246
• US Class Current: 1/1
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1036 Load balancing of requests to servers for services different from user content provisioning, e.g. load balancing across domain name servers
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

The current invention provides a system and method for queuing and distributing requests to one or more query servers. The system contains a first tier queue associated with a server based mechanism for directing service requests to a second tier queue associated with each of the one or more query servers. The current invention provides a “pull” model for the distribution of an initial service request of a query containing two or more service requests. Subsequent service requests from this query are assigned to a query server without being placed in a first tier queue. These subsequent service requests are placed directly in the queue of the query server that handled the previous service request from the same query.

Claims

1. A two tier information retrieval system for distributing one or more service requests to one or more query servers, the service request being from a client, the system comprising:

a web server in the first tier, the web server invoking a gateway upon receiving the service request;

one or more query servers suitable for fulfilling the service request,

the gateway determining a presence of a server identification parameter in the service request, the server identification parameter identifying a query server among the one or more query servers, the query server having handled a previous service request from the client;

the gateway distributing the service request directly to the query server identified by the server identification parameter;

a dispatcher in communication with the web server the dispatcher and the one or more query servers forming a second tier for receiving information related to a second service request without the server identification parameter from the gateway, for receiving status information from the one or more query servers, and for forwarding the second service request to an available query server of the one or more query servers;

the dispatcher including a queue for the second service request; and

a server manager monitoring and collecting information related to the operation of the one or more query servers, the server manager communicating the collected information to the dispatcher.

2. The system according to claim 1, wherein the server manager initiates and terminates a configured number of processes on the one or more query servers.

3. The system according to claim 2, wherein the information received by the dispatcher is the second service request.

4. A two tier information retrieval system for providing a response to a client originating a service request, the system comprising:

a web server in the first tier, the web server invoking a gateway upon receiving the service request;

one or more query servers, the one or more query servers receiving service request from the gateway for fulfilling the service request;

the gateway determining a presence of a server identification parameter, the server identification parameter identifying a query server from the one or more query servers, the query server, having handled a previous service request from the client;

the gateway distributing the service request directly to the query server identified by the server identification parameter; and

a dispatcher in communication with the web server, the dispatcher and the one or more query servers forming a second tier for receiving information related to a second service request without the server identification parameter from the gateway, for receiving status information from the one or more query servers, and for forwarding the second service request to an available query server of the one or more query servers; and

the dispatcher including a queue for the second service request receiving information related to the one or more query servers, the dispatcher communicating with the gateway and directing the gateway for distributing of service requests with no server identification parameter.

5. The system according to claim 4 wherein the information received by the dispatcher is the second service request.

6. The system according to claim 4, wherein the one or more query servers comprise a queue maintaining the service request.

7. The system according to claim 4, further comprising:

a server manager, the server manager collecting information related to the operation of the one or more query servers and providing the information to the dispatcher.

8. The system according to claim 7, wherein the dispatcher comprises a queue for maintaining the service request.