Method and apparatus for cascaded indexing and retrieval

• US 6,182,063 B1
• Filed: 03/31/1997
• Issued: 01/30/2001
• Est. Priority Date: 07/07/1995
• Status: Expired due to Term

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Woods, William A.
• Primary Examiner(s): Alam, Hosain T.
• Assistant Examiner(s): Corrielus, Jean M.
• Application Number:
  US08/829,657
• Time in Patent Office: 1,401 Days
• Field of Search: 707/2, 707/3, 707/6
• US Class Current: 707/722
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: Y10S 707/917 Text
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

Systems and methods consistent with the present invention respond to queries of stored information by receiving a query identifying desired information; providing the query as a search request to a search engine; receiving a search result from the search engine, including identifiers for stored documents; and constructing an index from the documents using the identifiers in the search result.

Claims

1. A method for responding to queries of stored information comprising the steps, performed by a processor, of:

receiving a query identifying desired information;

providing the query as a search request to a search engine;

receiving a search result from the search engine, including identifiers for stored documents; and

constructing an index from the documents using the identifiers in the search result.

2. The method of claim 1, wherein the constructing step includes the substeps of:

extracting conceptual information from the documents;

analyzing the extracted conceptual information semantically; and

assembling the index from the extracted conceptual information in a manner that reflects relations based on semantic data in a stored lexicon.

3. The method of claim 1, wherein the constructing step includes the substep of:

accessing the identified documents.

4. An apparatus for responding to queries of stored information, comprising:

first receiving means configured to receive a query identifying desired information;

providing means configured to provide the query as a search request to a search engine;

second receiving means configured to receive a search result from the search engine, including identifiers for stored documents; and

constructing means configured to construct an index from the documents using the identifiers in the search result.

5. The apparatus of claim 4, wherein the constructing means includes:

extracting means configured to extract conceptual information from the documents;

analyzing means configured to analyze the extracted conceptual information semantically; and

assembling means configured to assemble the index from the extracted conceptual information in a manner that reflects relations based on semantic data in a stored lexicon.

6. The apparatus of claim 4, wherein the constructing means includes:

accessing means configured to access the identified documents.

7. A computer program product comprising:

a computer usable medium having computer readable code embodied therein for responding to queries of stored information, the computer usable medium comprising;

a first receiving module configured to receive a query identifying desired information;

a providing module configured to provide the query as a search request to a search engine;

a second receiving module configured to receive a search result from the search engine, including identifiers for stored documents; and

a constructing module configured to construct an index from the documents using the identifiers in the search result.

8. The computer usable medium of claim 7, wherein the constructing module includes:

an extracting module configured to extract conceptual information from the documents;

an analyzing module configured to analyze the extracted conceptual information semantically; and

an assembling module configured to assemble the index from the extracted conceptual information in a manner that reflects relations based on semantic data in a stored lexicon.

9. The computer usable medium of claim 7, wherein the constructing module includes:

an accessing module configured to access the identified documents.

10. A method for responding to queries comprising the steps, performed by a processor, of:

receiving a query identifying desired information;

providing the query as a search request to a search engine;

receiving a search result from the search engine, including identifiers to documents distributed among a plurality of platforms; and

constructing an index from the documents using the identifiers in the search result.

11. An apparatus for responding to queries of stored information, comprising:

first receiving means configured to receive a query identifying desired information;

providing means configured to provide the query as a search request to a search engine;

second receiving means configured to receive a search result from the search engine, including identifiers to documents distributed among a plurality of platforms; and

constructing means configured to construct an index from the documents using the identifiers in the search result.

12. A computer program product comprising:

a computer usable medium having computer readable code embodied therein for responding to queries of stored information, the computer usable medium comprising;

a receiving module configured to receive a query identifying desired information;

a providing module configured to provide the query as a search request to a search engine;

a receiving module configured to receive a search result from the search engine, including identifiers to documents distributed among a plurality of platforms; and

a constructing module configured to construct an index from the documents using the identifiers in the search result.

13. A method for accessing stored information comprising the steps, performed by a processor, of:

receiving a query identifying desired information;

providing the query as a search request to a search engine;

receiving a search result from the search engine, including identifiers for stored documents;

constructing an index from the documents accessed using the search result;

identifying hits representing information in the index corresponding to the query;

determining, for each hit, a measure of a difference between the query and the information from one of a plurality of stored indexes corresponding to the hit; and

combining the hits from the stored indexes in accordance with the corresponding measure.

14. An apparatus for accessing stored information, comprising:

first receiving means configured to a query identifying desired information;

providing means configured to provide the query as a search request to a search engine;

second receiving means configured to receive a search result from the search engine, including identifiers for stored documents;

constructing means configured to construct an index from the documents accessed using the search result;

identifying means configured to identify hits representing information in the index corresponding to the query;

determining means configured to determine, for each hit, a measure of a difference between the query and the information from one of a plurality of stored indexes corresponding to the hit; and

combining means configured to combine the hits from stored the indexes in accordance with the corresponding measure.

15. A computer program product comprising:

a computer usable medium having computer readable code embodied therein for accessing stored information, the computer usable medium comprising;

a receiving module configured to a query identifying desired information;

a providing module configured to provide the query as a search request to a search engine;

a receiving module configured to receive a search result from the search engine, including identifiers for stored documents;

a constructing module configured to construct an index from the documents accessed using the search result;

an identifying module configured to identify hits representing information in the index corresponding to the query;

a determining module configured to determine, for each hit, a measure of a difference between the query and the information from one of a plurality of stored indexes corresponding to the hit; and

a combining module configured to combine the hits from stored the indexes in accordance with the corresponding measure.

16. A method for accessing information comprising the steps, performed by a processor, of:

receiving a query identifying desired information;

providing the query as a search request to a search engine;

receiving a search result from the search engine, including identifiers for stored documents;

constructing an index of conceptual information from the documents using the identifiers in the search result;

identifying conceptual information from the index that corresponds to the query; and

determining a measure of a difference between the query and the identified information.

17. The method of claim 16, wherein the constructing step includes the substep of:

extracting conceptual information from the identified documents; and

assembling the index from the extracted conceptual information, reflecting relations based on semantic data in a stored lexicon.

18. The method of claim 17, wherein the searched documents are linked to other documents in a parent-child relationship, wherein extracting step includes the substep of:

accessing child-documents linked to the identified documents; and

wherein the assembling step includes the substep of;

including in the index conceptual information extracted from the child-documents.

19. The method of claim 16, further comprising step of:

retrieving a portion of one of the documents identified in the index as including conceptual information corresponding to the query.

20. The method of claim 19, wherein the retrieving step further includes the substep of:

receiving a request to retrieve the portion of the document identified in the index as including conceptual information corresponding to the query.

21. The method of claim 20, wherein the receiving step further includes the substep of

presenting an identifier for the portion of the document identified in the index as including conceptual information corresponding to the query.

22. An apparatus for accessing stored information, comprising:

first receiving means configured to receive a query identifying desired information;

providing means configured to provide the query as a search request to a search engine;

second receiving means configured to receive a search result from the search engine, including identifiers for stored documents;

constructing means configured to construct an index of conceptual information from the documents using the identifiers in the search result;

identifying means configured to identify conceptual information from the index that corresponds to the query; and

determining means configured to identify a measure of a difference between the query and the identified information.

23. The apparatus of claim 22, wherein the constructing means includes:

extracting means configured to extract conceptual information from the identified documents; and

assembling means configured to assemble the index from the extracted conceptual information, reflecting relations based on semantic data in a stored lexicon.

24. The apparatus of claim 23, wherein the searched documents are linked to other documents in a parent-child relationship, wherein the extracting means includes:

accessing means configured to access child-documents linked to the identified documents; and

wherein the assembling means includes;

including means configured to include in the index conceptual information extracted from the child-documents.

25. The apparatus of claim 22, further comprising:

retrieving means configured to retrieve a portion of one of the documents identified in the index as including conceptual information corresponding to the query.

26. The apparatus of claim 25, wherein the retrieving means further includes:

receiving means configured to receive a request to retrieve the portion of the document identified in the index as including conceptual information corresponding to the query.

27. The apparatus of claim 26, wherein the receiving means configured to receive a request to retrieve the portion of the document identified in the index as including conceptual information corresponding to the query, includes:

presenting means configured to present an identifier for the portion of the document identified in the index as including conceptual information corresponding to the query.

28. A computer program product comprising:

a computer usable medium having computer readable code embodied therein for accessing stored information, the computer usable medium comprising;

a receiving module configured to receive a query identifying desired information;

a providing module configured to provide the query as a search request to a search engine;

a receiving module configured to receive a search result from the search engine, including identifiers for stored documents;

a constructing module configured to construct an index of conceptual information from the documents using the identifiers in the search result;

an identifying module configured to identify conceptual information from the index that corresponds to the query; and

a determining module configured to identify a measure of a difference between the query and the identified information.

29. The computer usable medium of claim 28, wherein the constructing module includes:

an extracting module configured to extract conceptual information from the identified documents; and

an assembling module configured to assemble the index from the extracted conceptual information, reflecting relations based on semantic data in a stored lexicon.

30. The computer usable medium of claim 29, wherein the searched documents are linked to other documents in a parent-child relationship, wherein the extracting module includes:

an accessing module configured to access child-documents linked to the identified documents; and

wherein the assembling module includes;

an including module configured to include in the index conceptual information extracted from the child-documents.

31. The computer usable medium of claim 28, further comprising:

a retrieving module configured to retrieve a portion of one of the documents identified in the index as including conceptual information corresponding to the query.

32. The computer usable medium of claim 31, where in the retrieving module further includes:

a receiving module configured to receive a request to retrieve the portion of the document identified in the index as including conceptual information corresponding to the query.

33. The computer usable medium of claim 32, wherein the receiving module configured to receive a request to retrieve the portion of the document identified in the index as including conceptual information corresponding to the query, includes:

a presenting module configured to present an identifier for the portion of the document identified in the index as including conceptual information corresponding to the query.

34. A method for responding to queries of stored information comprising the steps, performed by a processor, of:

receiving a query identifying desired information;

providing the query as a search request to a search engine;

receiving a search result from the search engine identifying stored documents;

retrieving the stored documents based on the search result;

constructing an index from the retrieved documents; and

permitting searches of the retrieved documents in accordance with the index.

35. The method of claim 34, wherein the constructing step includes the substeps of:

extracting conceptual information from the documents;

analyzing the extracted conceptual information semantically; and

assembling the index from the extracted conceptual information in a manner that reflects relations based on semantic data in a stored lexicon.

36. The method of claim 34, wherein the step of constructing an index from the retrieved documents, includes

indexing the retrieved documents in accordance with a first search algorithm, and wherein the step of permitting searches of the retrieved documents in accordance with the index, includes

using a second search algorithm that is different from the first search algorithm.

37. The method of claim 34, wherein the step of constructing an index from the retrieved documents, includes

indexing the retrieved documents using an algorithm that includes a factor proportional to the distance between occurrences of terms in each document.

38. The method of claim 34, wherein the step of constructing an index from the retrieved documents, includes

indexing the retrieved documents to support passage retrieval in each retrieved document.

39. A query processing apparatus, comprising:

at least one memory having program instructions to receive a query identifying desired information, provide the query as a search request to a search engine, receive a search result from the search engine identifying stored documents, retrieve the stored documents based on the search result, construct an index from the retrieved documents, and permit searches of the retrieved documents in accordance with the index; and

a processor for executing the instructions.

40. A query processing apparatus according to claim 39, wherein the program instructions to construct an index from the retrieved documents include instructions to extract conceptual information from the documents, analyze the extracted conceptual information semantically, and assemble the index from the extracted conceptual information in a manner that reflects relations based on semantic data in a stored lexicon.

41. A computer readable medium containing instructions for controlling a data processing system to perform a query processing method, the method comprising:

receiving a query identifying desired information;

providing the query as a search request to a search engine;

receiving a search result from the search engine identifying stored documents;

retrieving the stored documents based on the search result;

constructing an index from the retrieved documents; and

permitting searches of the retrieved documents in accordance with the index.

42. The computer readable medium of claim 41, wherein the constructing operation includes:

extracting conceptual information from the documents;

analyzing the extracted conceptual information semantically; and

assembling the index from the extracted conceptual information in a manner that reflects relations based on semantic data in a stored lexicon.