DISCRIMINATING SEARCH RESULTS BY PHRASE ANALYSIS

• US 20100223273A1
• Filed: 02/27/2009
• Published: 09/02/2010
• Est. Priority Date: 02/27/2009
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Schneider, James Paul
• Granted Patent: US 8,396,850 B2
• Time in Patent Office: Days
• US Class Current: 707/758
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking

Abstract

A statistical analysis parses documents for phrases in the documents. Each document is analyzed with a phrase analysis engine to determine a key phrase that frequently occur throughout each document. One or more documents are grouped together based a corresponding statistically improbable phrase.

Claims

1. A computer-implemented method comprising:

parsing one or more documents for phrases in the one or more documents;

analyzing each document with a phrase analysis engine to determine a key phrase that frequently occur throughout each document; and

grouping one or more documents together based on a corresponding statistically improbable phrase.

2. The computer-implemented method of claim 1 further comprising:

adding to a group, documents with a similar statistically improbable phrase.

3. The computer-implemented method of claim 2 wherein the documents with the similar statistically improbable phrase are not associated with the key phrase.

4. The computer-implemented method of claim 1 wherein the statistically improbable phrase is determined by:

performing a statistical analysis to determine a frequency of occurrence of a phrase in a document relative to a set of documents; and

associating the phrase with one or more documents that have a lower probability of occurrence of the phrase in the set of documents.

5. The computer-implemented method of claim 1 further comprising:

sorting one or more documents based on one or more statistically improbable phrases.

6. The computer-implemented method of claim 1 further comprising:

adjusting a degree of correlation between documents in a group based on the number of shared key phrases.

7. The computer-implemented method of claim 1 further comprising:

displaying the different groups of the one or more documents in response to a search query phrase.

8. A server comprising:

a processing device;

a memory coupled to the processing device, the memory storing documents; and

a phrase analysis engine coupled to the processor, the phrase analysis engine comprising a parser, an analyzer, and a categorizer,

wherein the parser is configured to parse the documents for phrases,

wherein the analyzer is configured to analyze each document to determine a key phrase that frequently occur throughout each document;

wherein the categorizer is configured to group one or more documents together based a corresponding statistically improbable phrase.

9. The server of claim 8 wherein the phrase analysis engine further comprises a correlater configured to add to a group, documents with a similar statistically improbable phrase.

10. The server of claim 9 wherein the documents with the similar statistically improbable phrase are not associated with the key phrase.

11. The server of claim 8 wherein the statistically improbable phrase is determined by performing a statistical analysis to determine a frequency of occurrence of a phrase in a document relative to a set of documents, and associating the phrase with one or more documents that have a lower probability of occurrence of the phrase in the set of documents.

12. The server of claim 8 wherein the categorizer is farther configured to sort one or more documents based on one or more statistically improbable phrases.

13. The server of claim 8 wherein the categorizer is further configured to adjust a degree of correlation between documents in a group based on the number of shared key phrases.

14. The server of claim 8 wherein the server is coupled to a display, the display configured to display the different groups of the one or more documents in response to a search query phrase.

15. A computer-accessible storage medium including data that, when accessed by a computer system, cause the computer system to perform a method comprising:

parsing one or more documents for phrases in the one or more documents;

analyzing each document with a phrase analysis engine to determine a key phrase that frequently occur throughout each document; and

grouping one or more documents together based on a corresponding statistically improbable phrase.

16. The computer-accessible storage medium of claim 15 wherein the method further comprises:

adding to a group, documents with a similar statistically improbable phrase.

17. The computer-accessible storage medium of claim 16 wherein the documents with the similar statistically improbable phrase are not associated with the key phrase.

18. The computer-accessible storage medium of claim 15 wherein the statistically improbable phrase is determined by:

performing a statistical analysis to determine a frequency of occurrence of a phrase in a document relative to a set of documents; and

associating the phrase with one or more documents that have a lower probability of occurrence of the phrase in the set of documents.

19. The computer-accessible storage medium of claim 15 wherein the method further comprises:

sorting one or more documents based on one or more statistically improbable phrases.

20. The computer-accessible storage medium of claim 15 wherein the method further comprises

adjusting a degree of correlation between documents in a group based on the number of shared key phrases.