Methods and system for using web browser to search large collections of documents

• US 6,292,802 B1
• Filed: 05/09/2000
• Issued: 09/18/2001
• Est. Priority Date: 12/22/1997
• Status: Expired due to Term

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Company (HP Inc.)
• Inventors: Thelen, Gregory W., Applin, John R., Kessenich, John M.
• Primary Examiner(s): Amsbury, Wayne
• Assistant Examiner(s): PARDO, THUY N
• Application Number:
  US09/567,861
• Time in Patent Office: 497 Days
• Field of Search: 707/3, 707/6, 707/101, 707/102, 707/501, 709/201, 709/105, 370/60
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9532 Query formulation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 16/972 Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

A system for rapidly and easily searching large collections of documents using standard web browser programs as the user interface. The present invention parses a collection of text documents to identify symbols therein and builds a database file which identifies the file and line locations of each symbol identified. The database file is constructed to permit rapid searching for symbols to permit interactive use of the present invention as a search tool. A database client process interacts with the web browser via standard CGI techniques to convert browser commands and queries into appropriate server process requests. A server process receives such requests and manipulates the database files in response to the requests. Query results returned to the client process are then reformatted by the client process to return a document with hypertext links in place of search keys located in the database (e.g., an HTML page). The system of the present invention thereby provides for rapid searching of large collections of text documents which is not coupled to a specific toolset used to create any one of the documents and which uses a simple and well-known user interface, namely: web browsers.

Claims

1. A system for searching for symbols in a text document using a web browser comprising:

a database file identifying locations of said symbols in said text document; and

a database search process, associated with said web browser, for performing queries on said database file on behalf of said web browser, wherein said database search process returns results of said queries to said web browser in a format having hyperlinks corresponding to said symbols in said results of said queries wherein said hyperlinks link to said identifying locations corresponding to said symbols in said text document.

2. The system of claim 1 wherein said database search process includes:

a database client process associated with said web browser; and

a database server process associated with said database client process for processing said queries in said database file,

wherein said database client process is adapted to receive said queries from said web browser and to forward said queries to said database server process for processing, and

wherein said database client process is adapted to receive results of processing said queries and is adapted to return said results to said web browser in a format having hyperlinks corresponding to symbols in said results.

3. The system of claim 2 wherein said database server process is multi-threaded.

4. The system of claim 2 wherein said web browser displays said results and wherein operation of said web browser and or said database client process and of said database server process overlap in time such that display said results generated by said database server process are streamed to said web browser for display.

5. The system of claim 1 further comprising:

a database builder process for constructing said database file.

6. The system of claim 5 wherein said database builder process includes:

a parser for identifying said symbols in said text document.

7. The system of claim 5 wherein said document has a document type associated therewith and wherein said database builder process includes:

a plurality of parsers wherein each of said plurality of parsers is adapted to parse a particular type of document and wherein said builder process selects a particular one of said plurality of parsers adapted to parse documents of said document type.

8. The system of claim 1 wherein said database file includes:

an entry corresponding to each unique one of said symbols wherein each said entry includes;

location information identifying all locations of said unique one of said symbols in said text document.

9. The system of claim 8 wherein said location information includes:

document identification indicia for a document in which the symbol corresponding to said entry is found; and

position identification indicia for a location in said document at which the symbol corresponding to said entry is found in said document.

10. The system of claim 9 wherein said database file further includes:

hash table structures for locating the entry corresponding to said each unique one of said symbols in said database file wherein the hash function of said hash table uses the symbol for computation of a hash value.

11. The system of claim 10 wherein integer values in said hash table are compressed and wherein said position identification indicia are compressed.

12. The system of claim 11 wherein a concatenated sequence of said integer values is further compressed in that integer values in said sequence of integer values following a first of said sequence of integer values are encoded as a relative offset value from the preceding integer value in said sequence of integer values.

13. A method for searching for symbols in a text document using a web browser comprising the steps of:

providing a database file identifying locations of said symbols in said text document;

constructing, within said web browser, a database query to locate said symbols in said text document;

performing said query in said database file on behalf of said web browser; and

receiving, within said web browser, results of said query in a format having hyperlinks corresponding to said symbols in said results of said query wherein said hyperlinks link to said identifying locations corresponding to said symbols in said text document.

14. The method of claim 13

wherein the step of constructing a database query includes the step of transmitting said query to a database client process,

wherein the step of receiving results includes the step of receiving results from said database client process, and

wherein the step of performing said query includes the steps of:

transmitting said query from said database client process to a database server process;

executing said query within said database server process; and

returning results of said query from said database server process to said database client process.

15. The method of claim 14 wherein the step of displaying includes the step of transforming, within said database client process, said results received from said database server process into HTML format.

16. The method of claim 14 wherein the step of performing said query further includes the step of creating an independent thread, within said database server process, for performing the steps of executing said query and returning results of said query to said database client process.

17. A computer readable storage medium tangibly embodying programed instructions implementing a method for searching for symbols in a text document using a web browser, said method comprising the steps of:

providing a database file identifying locations of said symbols in said text document;

constructing, within said web browser, a database query to locate said symbols in said text document;

performing said query in said database file on behalf of said web browser;

receiving, within said web browser, results of said query in a format having hyperlinks corresponding to symbols in said results of said query wherein said hyperlinks link to said identifying locations corresponding to said symbols in said text document; and

displaying said results in said web browser.

18. The storage medium of claim 17

wherein the method step of constructing a database query includes the step of transmitting said query to a database client process,

wherein the method step of receiving results includes the step of receiving results from said database client process, and

wherein the method step of performing said query includes the steps of:

transmitting said query from said database client process to a database server process;

executing said query within said database server process; and

returning results of said query from said database server process to said database client process.

19. The storage medium of claim 18 wherein the method step of displaying includes the step of transforming, within said database client process, said results received from said database server process into HTML format.

20. The storage medium of claim 18 wherein the method step of performing said query further includes the step of creating an independent thread, within said database server process, for performing the steps of executing said query and returning results of said query to said database client process.