SYSTEMS, METHODS, AND SOFTWARE FOR DISTRIBUTED LOADING OF DATABASES
First Claim
Patent Images
1. An information retrieval system comprising:
- a queue for storing load data requests;
a set of two or more load servers for retrieving data from a queue and indexing documents for retrieval based on the data retrieved from the queue;
first and second load monitors for monitoring operation of the load servers and providing new data on the queue accessible by the set of loaders, with the first load monitor configured to provide information regarding its operations to the second load monitor, and the second load monitor configured to respond to status information indicating failure of the first load monitor to take over monitoring of the load servers and providing new data on the queue.
0 Assignments
0 Petitions
Accused Products
Abstract
The present inventors have devised one or more systems, methods, and software for distributed loading of information retrieval systems. One exemplary system includes two or more (at least two) load monitor servers that not only monitor and ensure completion of load tasks by individual load servers in a set of two or more load servers, but also provide for one load monitor to monitor performance of the another. Moreover, the exemplary system provides a service-level-agreement (SLA) data structure for each load server. The SLA data structure governs what types and priority levels of loading tasks will be performed for predetermined time periods.
40 Citations
22 Claims
-
1. An information retrieval system comprising:
-
a queue for storing load data requests; a set of two or more load servers for retrieving data from a queue and indexing documents for retrieval based on the data retrieved from the queue; first and second load monitors for monitoring operation of the load servers and providing new data on the queue accessible by the set of loaders, with the first load monitor configured to provide information regarding its operations to the second load monitor, and the second load monitor configured to respond to status information indicating failure of the first load monitor to take over monitoring of the load servers and providing new data on the queue. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. An information retrieval system comprising:
-
first and second load monitors for monitoring operation of a plurality of load servers that index documents for addition to a database, wherein the first load monitor is configured to provide status information regarding its operation to the second load monitor, and the second load monitor is configured to respond to status information indicating failure of the first load monitor to take over monitoring of the load servers. - View Dependent Claims (12, 13)
-
-
14. A method comprising:
-
receiving a file containing documents for addition to a database of an online information-retrieval system; notifying two or more load servers in response to receiving the file; indexing the documents in the file using one of the notified load servers; loading the indexed documents onto the database; notifying two or more load monitors that the documents have been loaded on the database; confirming that the documents have been loaded on the database using a first one of the notified load monitors; and confirming proper operation of a first one of the notified load monitors using a second one of the notified load monitors. - View Dependent Claims (15, 16, 17, 18, 19)
-
- 20. A service-related data structure for use in an information retrieval system having a plurality of load servers, the data structure associated with one of the plurality of load servers and including means for indicating a priority level of load requests that the one load server is permitted to process.
Specification