Queuing model for a plurality of servers
3 Assignments
0 Petitions
Accused Products
Abstract
The current invention provides a system and method for queuing and distributing requests to one or more query servers. The system contains a first tier queue associated with a server based mechanism for directing service requests to a second tier queue associated with each of the one or more query servers. The current invention provides a “pull” model for the distribution of an initial service request of a query containing two or more service requests. Subsequent service requests from this query are assigned to a query server without being placed in a first tier queue. These subsequent service requests are placed directly in the queue of the query server that handled the previous service request from the same query.
107 Citations
39 Claims
-
1-22. -22. (canceled)
-
23. A two-tier information retrieval system for distributing a client service request from a client to query servers, the system comprising:
-
a web server, the web server invoking a gateway upon receiving the client service request;
a dispatcher in a first tier and in communication with the web server, a plurality of query servers suitable for fulfilling the client service request, the plurality of query servers forming a second tier and receiving information from the gateway;
the gateway determining a presence of a server identification parameter in the client service request, the server identification parameter identifying a first query server among the plurality of query servers, the first query server having handled a previous service request from the client;
the gateway distributing the service request directly to the first query server; and
the dispatcher receiving status information from the plurality of query servers, forwarding a second service request to an available query server of the plurality of query servers in the absence of the server identification parameter; and
including a queue for the second service request. - View Dependent Claims (24, 25, 26, 27)
-
-
28. A method of routing a service request to query servers, the method comprising the steps of:
-
receiving the service request at a web server;
the web server interfacing the client and the plurality of query servers,invoking a gateway on the web server upon receiving the service request;
receiving the service request at the gateway;
receiving a query server identification for an available query server among the plurality of query servers;
forwarding the service request to the available query server identified by the query server identification; and
including a server identification parameter in a reply to the client service request;
determining a presence of the server identification parameter in a second client service request; and
distributing the second service request directly to the available query server identified by the server identification parameter. - View Dependent Claims (29, 30, 31, 32, 33)
-
-
34. A storage medium readable by a computer encoding a computer program for execution by the computer to carry out a method of routing a service request to query servers, the computer program comprising:
-
code means for receiving the service request at a web server;
the web server interfacing the client and the plurality of query servers,code means for invoking a gateway on the web server upon receiving the service request;
code means for receiving the service request at the gateway;
code means for receiving a query server identification for an available query server among the plurality of query servers;
code means for forwarding the service request to the available query server identified by the query server identification;
code means for including a server identification parameter in a reply to the client service request;
code means for determining a presence of the server identification parameter in a second client service request; and
code means for distributing the second service request directly to the available query server identified by the server identification parameter. - View Dependent Claims (35, 36, 37, 38, 39)
-
Specification