SYSTEM AND METHOD FOR MEASURING THE QUALITY OF DOCUMENT SETS

• US 20090006382A1
• Filed: 06/25/2008
• Published: 01/01/2009
• Est. Priority Date: 06/26/2007
• Status: Active Grant

• Current Assignee: Oracle OTC Subsidiary LLC (Oracle Corporation)
• Original Assignee: Endeca Technologies Incorporated (Oracle Corporation)
• Inventors: Tunkelang, Daniel, Zelevinsky, Vladimir, Wang, Joyce Jeanpin
• Granted Patent: US 8,005,643 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/3331 Query processing

Abstract

Systems and methods are described that calculate the interestingness of a set of one or more records in a database, either absolutely (i.e., compared to an overall collection of records) or relative to some other set of records. In one embodiment, the measure is a relative entropy value that has been normalized. Various applications of the measure are described in the context of an information retrieval system. These applications include, for example, guiding query interpretation, guiding view selection and summarization, intelligent ranges, event detection, concept triggers and interpreting user actions, hierarchy discovery, and adaptive data mining.

Claims

1. A method for measuring the distinctiveness of a result generated from a collection of information, wherein the result is comprised of elements associated with the collection of information, the method comprising:

analyzing the result to obtain a statistical distribution of at least one identifying characteristic within the result;

generating a measurement of distinctiveness for the result based on the statistical distribution of the at least one identifying characteristic; and

comparing the measured statistical distribution against a baseline statistical distribution.

2. The method according to claim 1, further comprising an act of determining a baseline statistical distribution for the collection of information for at least one identifying characteristic within the collection of information.

3. The method according to claim 1, further comprising an act of predetermining the baseline statistical distribution.

4. The method according to claim 1, wherein the baseline statistical distribution further comprises a measurement of distinctiveness based on at least one identifying characteristic.

5. The method according to claim 3, wherein the act of predetermining the baseline statistical distribution includes generating at least one random result within the collection of information.

6. The method according to claim 3, further comprising the acts of:

storing the baseline statistical distribution; and

retrieving the baseline statistical distribution for comparison.

7. The method according to claim 1, further comprising an act of dynamically generating the baseline statistical distribution.

8. The method according to claim 7, wherein the act of dynamically generating the baseline statistical distribution includes generating at least one random result within the collection of information.

9. The method according to claim 8, wherein the act of generating the at least one random result is based on at least one of a size of the result set, a concentration of relevance of the result set, and a topicality of the result set.

10. The method according to claim 7, wherein the dynamically generated baseline distribution is adapted from previous execution of the act of analyzing the result to obtain a statistical distribution of at least one identifying characteristic within the result.

11. The method according to claim 1, wherein the collection of information comprises a collection of at least one document, and wherein the at least one document further comprises a unit of storage of digital data.

12. The method according to claim 11, wherein the at least one document further comprises at least one of a data record, within a database, textual information, non-textual information, audio, video, streaming data, a defined entity, a programmatically defined entity, metadata, and information derived from a document.

13. The method according to claim 1, wherein the result is generated from at least one of a query run against the collection of information, navigation within the collection of information, a search performed on the collection of information, a filter against the collection of information, a ranking operation, and a data mining operation performed on the collection of information.

14. The method according to claim 1, further comprising an act of generating a representation of the collection of information, wherein the representation of the collection of information is adapted to statistical manipulation.

15. The method according to claim 14, wherein the representation of the collection of information is used to determined the baseline statistical distribution

16. The method according to claim 1, wherein the baseline distribution is determined by approximating a statistical distribution for at least one identifying characteristic within the collection of information.

17. The method according to claim 1, further comprising an act of generating a representation of the result, wherein the representation of the result is adapted to statistical manipulation.

18. The method according to claim 17, wherein the representation of the result is used to determine the statistical distribution

19. The method according to claim 1, wherein the statistical distribution is determined by approximating a statistical distribution for at least one identifying characteristic within the result.

20. The method according to claim 19, wherein the act of approximating the statistical distribution includes at least one of the acts of permitting modification of the result without recalculating the distribution, examining similar results, and using previous analysis of at least one result to generate the statistical distribution.

21. The method according to claim 1, wherein the act of generating the measurement of distinctiveness further comprises an act of assigning a weight value to at least one member of the collection of information.

22. The method according to claim 1, further comprising an act of incorporating a weight value into the measurement of distinctiveness.

23. The method according to claim 2, further comprising an act of incorporating a weight value into the measurement of distinctiveness.

24. The method according to claim 2, further comprising an act of smoothing the statistical distribution of the at least one identifying characteristic.

25. The method according to claim 1, wherein a measurement of distinctiveness is determined from at least one function of:

relative entropy, Kullback-Leibler divergence, Euclidean distance, Manhattan distance, Hellinger distance, diversity difference, cosine difference, Jaccard distance, Jenson-Shannon divergence, and skew divergence.

26. The method according to claim 1, wherein the act of generating a measurement of distinctiveness further comprising acts of:

determining a similarity measure; and

inverting the sense of the similarity measure.

27. A method, operative in an information retrieval system, for improving a user'"'"'s interaction with data stored and accessible from the system, comprising:

relating a first and second sets of items in the information retrieval system to generate a salience measure; and

using the salience measure to guide a subsequent user interaction with the information retrieval system.

28. The method as described in claim 27, wherein the first and second sets of items share a given characteristic.

29. The method as described in claim 28 wherein the given characteristic is set size.

30. The method as described in claim 28, wherein the given characteristic is concentration of relevance.

31. The method as described in claim 28 wherein the subsequent user interaction with the information retrieval system is one of:

guiding query interpretation, guiding view selection and summarization, intelligent ranges, event detection, concept triggers and interpreting user actions, hierarchy discovery, and adaptive data mining.

32. A computer-readable medium having computer-readable instructions stored thereon that define instructions that, as a result of being executed by a computer, instruct the computer to perform a method measuring the distinctiveness of a result generated from a collection of information, wherein the result is comprised of elements associated with the collection of information, the method comprising the acts of:

analyzing the result to obtain a statistical distribution of at least one identifying characteristic within the result;

generating a measurement of distinctiveness for the result based on the statistical distribution of the at least one identifying characteristic; and

comparing the measured statistical distribution against a baseline statistical distribution.

33. A system for measuring the distinctiveness of a result generated from a collection of information, wherein the result is comprised of elements associated with the collection of information, the system comprising:

an analysis component adapted to obtain a statistical distribution of at least one identifying characteristic;

a measurement component adapted to generate a measurement of distinctiveness for the result based on the statistical distribution of the at least one identifying characteristic; and

a comparison component adapted to compare the measured statistical distribution against a baseline statistical distribution.

34. The system according to claim 33, wherein the measurement component is further adapted to determine a baseline statistical distribution for the collection of information for at least one identifying characteristic within the collection of information.

35. The system according to claim 33, further comprising a storage component adapted to store the baseline statistical distribution.

36. The system according to claim 33, wherein the baseline statistical distribution further comprises a measurement of distinctiveness based on at least one identifying characteristic.

37. The system according to claim 35, further comprising a generation component adapted to generate a random result from the collection of information, and wherein the measurement component is further adapted to generate a baseline measurement from the at least one random result.

38. The system according to claim 33, further comprising an act of dynamically generating the baseline statistical distribution.

39. The system according to claim 33, further comprising an act of generating at least one random result based on the size of the result.

40. The system according to claim 38, further comprising an act of generating the at least one random result based on the result, wherein the act of generating the at least one random result is based on at least one of a size of the result set, a concentration of relevance of the result set, and a topicality of the result set.

41. The system according to claim 38, wherein the dynamically generated baseline distribution is adapted from previous execution of the act of analyzing the result to obtain a statistical distribution of at least one identifying characteristic within the result.

42. The system according to claim 33, wherein the collection of information comprises a collection of at least one document, and wherein the at least one document further comprises a unit of storage of digital data.

43. The system according to claim 33, wherein the result is generated from at least one of a query run against the collection of information, navigation within the collection of information, a search performed on the collection of information, a filter on elements of the collection of information, a ranking of elements of the collection of information, and a data mining operation performed on the collection of information.

44. The system according to claim 33, further comprising an act of generating a representation of the collection of information, wherein the representation of the collection of information is adapted to statistical manipulation.

45. The system according to claim 33, wherein the baseline distribution is determined by approximating a statistical distribution for at least one identifying characteristic with the collection of information.

46. The system according to claim 33, further comprising an act of generating a representation of the result, wherein the representation of the result is adapted to statistical manipulation.

47. The system according to claim 33, wherein the statistical distribution is determined by approximating a statistical distribution for at least one identifying characteristic within the result.

48. The system according to claim 33, wherein the act of generating the measurement of distinctiveness further comprises an act of assigning a weight value to at least one member of the result.

49. The system according to claim 33, further comprising an act of incorporating a weight value associated with at least member of the collection of information into the act of determining the baseline statistical distribution.

50. The system according to claim 33, further comprising an act of incorporating a weight value associated with the at least one identifying characteristic.

51. The system according to claim 35, further comprising an act of incorporating a weight value associated with the at least one identifying characteristic.

52. The system according to claim 35, further comprising an act of smoothing the statistical distribution of the at least one identifying characteristic.

53. The system according to claim 35, wherein a measurement of distinctiveness is determined from at least one function of:

relative entropy, Kullback-Leibler divergence, Euclidean distance, Manhattan distance, Hellinger distance, diversity difference, cosine difference, Jaccard distance, Jenson-Shannon divergence, and skew divergence.

54. The system according to claim 33, wherein the act of generating a measurement of distinctiveness further comprising acts of:

determining a similarity measure; and

inverting the sense of the similarity measure.