Method and apparatus for distributed indexing and retrieval

• US 6,101,491 A
• Filed: 03/31/1997
• Issued: 08/08/2000
• Est. Priority Date: 07/07/1995
• Status: Expired due to Term

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Woods, William A.
• Primary Examiner(s): AMSBURY, WAYNE P
• Application Number:
  US08/829,655
• Time in Patent Office: 1,226 Days
• Field of Search: 707/6, 707/3, 707/2
• US Class Current: 707/696
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: Y10S 707/917 Text
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

Systems and methods consistent with the present invention access information from databases having stored indexes of completed information corresponding to the databases by receiving a query identifying desired information; examining the concepts of information in the stored indexes to identify as hits the contents of the databases that match the query; determining, for each hit, a measure of a difference between the query and the conceptual information from the indexes; and combining the hits from the indexes in accordance with the determined measures.

Claims

1. A method for accessing information from databases having stored indexes of conceptual information corresponding to the databases comprising the steps, performed by a processor, of:

receiving a query identifying desired information;

distributing the query to the indexes;

examining the concepts of information in the stored indexes to identify as hits the contents of the databases that match the query;

determining, for each hit, a measure of a difference between the query and the conceptual information from the indexes; and

combining the hits from the indexes in accordance with the determined measures.

2. The method of claim 1, wherein the combining step includes the substep of:

ranking the hits in accordance with the measure for each hit, the hits with lower measures indicating a better correspondence between the represented conceptual information and the query than the hits with higher measures.

3. The method of claim 1, wherein the receiving step includes the substep of:

receiving a hit limit indicating a maximum number of hits.

4. The method of claim 3, wherein the combining step includes the substep of:

pruning the hits in accordance with the hit limit.

5. The method of claim 1, wherein the examining step includes the substep of:

accessing in the indexes a stored taxonomy of concepts and relationships between the concepts.

6. The method of claim 5, wherein the accessing step includes the substep of:

identifying concepts from the stored taxonomy that correspond to the query.

7. The method of claim 5, wherein the accessing step includes the substep of:

identifying concepts from the stored taxonomy that correspond to the query based on the relationships among the concepts in the taxonomy.

8. The method of claim 1 wherein the combining steps includes the substep of:

pruning the hits in accordance with a predetermined hit limit.

9. The method of claim 1, further comprising the step of:

returning the conceptual information corresponding to each hit with its difference measure.

10. The method of claim 1, wherein the indexes identify documents in the databases, and wherein the method further comprises the step of:

presenting, for each hit, an identifier specifying a location in a document the the indexes identify as including the conceptual information.

11. The method of claim 10, wherein the presenting step includes the substeps of:

receiving a request including a location-identifier for conceptual information of the stored document; and

retrieving the stored document in accordance with the requested location-identifier.

12. The method of claim 1, further comprising step of:

retrieving from the databases a document identified in the indexes as including conceptual information of at least one hit.

13. The method of claim 1, further comprising step of:

retrieving from the databases a portion of a document identified in the indexes as including conceptual information of at least one hit.

14. The method of claim 1, wherein the receiving step includes the substep of:

receiving a query term and a search parameter setting user preference for text retrieval.

15. The method of claim 14, wherein the determining step includes the substep of:

computing the measure of a difference between the query and the conceptual information from one of the indexes corresponding to each hit in accordance with the search parameter.

16. An apparatus for accessing information from databases having stored indexes of conceptual information corresponding to the databases, comprising:

receiving means configured to receive a query identifying desired information;

distributing means configured to distribute the query to the indexes;

examining means configured to examine the concepts of information in the stored indexes to identify as hits the contents of the databases that match the query;

determining means configured to determine, for each hit, a measure of a difference between the query and the conceptual information from the indexes; and

combining means configured to combine the hits from the indexes in accordance with the determined measures.

17. The apparatus of claim 16, wherein the combining means includes:

ranking means configured to rank the hits in accordance with the measure for each hit, the hits with lower measures indicating a better correspondence between the represented conceptual information and the query than the hits with higher measures.

18. The apparatus of claim 16, wherein the receiving means includes:

hit receiving means configured to receive a hit limit indicating a maximum number of hits.

19. The apparatus of claim 18, wherein the combining means includes:

pruning means configured to prune the hits in accordance with the hit limit.

20. The apparatus of claim 16, wherein the examining means includes:

accessing means configured to access in the indexes a stored taxonomy of concepts and relationships between the concepts.

21. The apparatus of claim 20, wherein the accessing means includes:

identifying means configured to identify concepts from the stored taxonomy that correspond to the query.

22. The apparatus of claim 20, wherein the accessing means includes:

identifying means configured to identify concepts from the stored taxonomy that correspond to the query based on the relationships among the concepts in the taxonomy.

23. The apparatus of claim 16, wherein the combining means includes:

pruning means configured to prune the hits in accordance with a predetermined hit limit.

24. The apparatus of claim 16, further comprising:

returning means configured to return the conceptual information corresponding to each hit with its difference measure.

25. The apparatus of claim 16, wherein the indexes identify documents in the databases, and wherein the apparatus further comprises:

presenting means configured to present, for each hit, an identifier specifying a location in a document that the indexes identify as including the conceptual information.

26. The apparatus of claim 16, further comprising:

retrieving means configured to retrieve from the databases a document identified in the indexes as including conceptual information of at least one hit.

27. The apparatus of claim 16, further comprising:

retrieving means configured to retrieve from the databases a portion of a document identified in the indexes as including conceptual information of at least one hit.

28. The apparatus of claim 16, wherein the presenting means includes:

receiving means configured to receive a request including a location-identifier for conceptual information of the stored document; and

retrieving the stored document in accordance with the requested location-identifier.

29. The apparatus of claim 16, wherein the receiving means includes:

means configured to receive a query term and a search parameter setting user preference for text retrieval.

30. The apparatus of claim 29, wherein the determining means includes:

computing means configured to compute the measure of a difference between the query and the conceptual information from one of the indexes corresponding to each hit in accordance with the search parameter.

31. A computer program product comprising:

a computer usable medium having computer readable code embodied therein for accessing information from databases having stored indexes of conceptual information corresponding to the databases, the computer usable medium comprising;

a receiving module configured to receive a query identifying desired information;

a distribution module configured to distribute the query to the indexes;

an examining module configured to examine the concepts of information in the stored indexes to identify as hits the contents of the databases that match the query;

a determining module configured to determine, for each hit, a measure of a difference between the query and the conceptual information from the indexes; and

a combining module configured to combine the hits from the indexes in accordance with the determined measures.

32. The computer usable medium of claim 31, wherein the combining module includes:

a ranking module configured to rank the hits in accordance with the measure for each hit, the hits with lower measures indicating a better correspondence between the represented conceptual information and the query than the hits with higher measures.

33. The computer usable medium of claim 31, wherein the receiving module includes:

a hit receiving module configured to receive a hit limit indicating a maximum number of hits.

34. The computer usable medium of claim 33, wherein the combining module includes:

a pruning module configured to prune the hits in accordance with the hit limit.

35. The computer usable medium of claim 31, wherein the examining module includes:

an accessing module configured to access in the indexes a stored taxonomy of concepts and relationships between the concepts.

36. The computer usable medium of claim 35, wherein the accessing module includes:

an identifying module configured to identify concepts from the stored taxonomy that correspond to the query.

37. The computer usable medium of claim 35, wherein the accessing module includes:

an identifying module configured to identify concepts from the stored taxonomy that correspond to the query based on the relationships among the concepts in the taxonomy.

38. The computer usable medium of claim 31 wherein the combining module includes:

a pruning module configured to prune the hits in accordance with a predetermined hit limit.

39. The computer usable medium of claim 31, further comprising:

a returning module configured to return the conceptual information corresponding to each hit with its difference measure.

40. The computer usable medium of claim 31, wherein the indexes identify documents in the databases, and wherein the computer usable medium further comprises:

a presenting module configured to present, for each hit, an identifier specifying a location in a document that the indexes identify as including the conceptual information.

41. The computer usable medium of claim 40, wherein the presenting module includes:

a receiving module configured to receive a request including a location-identifier for conceptual information of the stored document; and

a retrieving module the stored document in accordance with the requested location-identifier.

42. The computer usable medium of claim 31, further comprising:

a retrieving module configured to retrieve from the databases a document identified in the indexes as including conceptual information of at least one hit.

43. The computer usable medium of claim 31, further comprising:

a retrieving module configured to retrieve from the databases a portion of a document identified in the indexes as including conceptual information of at least one hit.

44. The computer usable medium of claim 31, wherein the receiving module includes:

a module configured to receive a query term and a search parameter setting user preference for text retrieval.

45. The computer usable medium of claim 44, wherein the determining module includes:

a computing module configured to compute the measure of a difference between the query and the conceptual information from one of the indexes corresponding to each hit in accordance with the search parameter.

46. A method for accessing information from databases having stored indexes of conceptual information corresponding to the databases in a distributed processing system having a plurality of platforms, the method comprising the steps, performed by a processor, of:

receiving a query identifying desired information;

distributing the query to the indexes;

identifying information corresponding to the query from the stored indexes distributed among the plurality of platforms; and

determining a measure of a difference between the query and the identified information.

47. The method of claim 46 further comprising the step of:

combining the identified information from each index in accordance with the corresponding measure.

48. The method of claim 47, wherein the combining step includes the substep of:

ranking the identified information from all of the indexes, with the information having lower measures indicating a better correspondence between that information and the query than the information with higher measures.

49. An apparatus for accessing information from databases having stored indexes of conceptual information corresponding to the databases in a distributed processing system having a plurality of platforms, comprising:

receiving means configured to receive a query identifying desired information;

distributing means configured to distribute the query to the indexes;

identifying means configured to identify information corresponding to the query from the stored indexes distributed among the plurality of platforms; and

determining means configured to determine a measure of a difference between the query and the identified information.

50. The apparatus of claim 49 further comprising:

combining means configured to combine the identified information from each index in accordance with the corresponding measure.

51. The apparatus of claim 50, wherein the combining means includes:

ranking means configured to rank the identified information from all of the indexes, with the information having lower measures indicating a better correspondence between that information and the query than the information with higher measures.

52. A computer program product comprising:

a computer usable medium having computer readable code embodied therein for accessing information from databases having stored indexes of conceptual information corresponding to the databases in a distributed processing system having a plurality of platforms, the computer usable medium comprising;

a receiving module configured to receive a query identifying desired information;

a distributing module configured to distribute the query to the indexes;

an identifying module configured to identify information corresponding to the query from the stored indexes distributed among the plurality of platforms; and

determining means configured to determine a measure of a difference between the query and the identified information.

53. The computer usable medium of claim 52 further comprising:

a combining module configured to combine the identified information from each index in accordance with the corresponding measure.

54. The computer usable medium of claim 53, wherein the combining module includes:

a ranking module configured to rank the identified information from all of the indexes, with the information having lower measures indicating a better

correspondence between that information and the query than the information with higher measures.

55. A method for accessing information from databases having stored indexes of conceptual information corresponding to the databases in a processing system having a plurality of platforms, the method comprising the steps, performed by a processor, of:

receiving a query identifying desired information;

distributing the query to the indexes;

identifying information corresponding to the query from the stored indexes distributed among the plurality of processes; and

determining a measure of a difference between the query and the identified information.

56. The method of claim 55 further comprising the step of:

combining the identified information from each index in accordance with the corresponding measure.

57. The method of claim 56, wherein the combining step includes the substep of:

ranking the identified information from all of the indexes with the information having lower measures indicating a better correspondence between that information and the query than the information with higher measures.

58. An apparatus for accessing information from databases having stored indexes of conceptual information corresponding to the databases in a processing system having a plurality of platforms, comprising:

receiving means configured to receive a query identifying desired information;

distributing means configured to distribute the query to the indexes;

identifying means configured to identify information corresponding to the query from the stored indexes distributed among the plurality of processes; and

determining means configured to determine a measure of a difference between the query and the identified information.

59. The apparatus of claim 58 further comprising:

combining means configured to combine the identified information from each index in accordance with the corresponding measure.

60. The apparatus of claim 59, wherein the combining means includes:

ranking means configured to rank the identified information from all of the indexes with the information having lower measures indicating a better correspondence between that information and the query than the information with higher measures.

61. A computer program product comprising:

a computer usable medium having computer readable code embodied therein for accessing information from databases having stored indexes of conceptual information corresponding to the databases in a processing system having a plurality of platforms, the computer usable medium comprising;

a receiving module configured to receive a query identifying desired information;

a distributing module configured to distribute the query to the indexes;

an identifying module configured to identify information corresponding to the query from the stored indexes distributed among the plurality of processes; and

a determining module configured to determine a measure of a difference between the query and the identified information.

62. The computer usable medium of claim 61 further comprising:

a combining module configured to combine the identified information from each index in accordance with the corresponding measure.

63. The computer usable medium of claim 62, wherein the combining module includes:

a ranking module configured to rank the identified information from all of the indexes with the information having lower measures indicating a better correspondence between that information and the query than the information with higher measures.