Annotation of inverted list text indexes using search queries

• US 20060248037A1
• Filed: 04/29/2005
• Published: 11/02/2006
• Est. Priority Date: 04/29/2005
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Meyer, Joerg, Tomkins, Andrew S., Pieper, Jan H.
• Application Number:
  US11/118,526
• Publication Number:
  US 20060248037A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3331 Query processing

Abstract

A system and method of data mining comprises processing contents of a primary posting index; and producing a posting within a secondary posting index based on the processing of the contents of the primary posting index, wherein the processing of contents of the primary posting index comprises submitting a disjunction of terms or phrases to the primary posting index. The processing of contents of the primary posting index comprises generating a query result by submitting a query to the primary posting index using a query language of the primary posting index. Moreover, the processing of contents of the primary posting index comprises processing the primary posting index in order to generate results, wherein the results comprise a set of candidate entries with additional metadata; and filtering the results in order to produce the posting within the secondary posting index.

Claims

1. A method of data mining, said method comprising:

processing contents of a primary posting index; and

producing a posting within a secondary posting index based on the processing of said contents of said primary posting index.

2. The method of claim 1, wherein the processing of contents of said primary posting index comprises submitting a disjunction of terms or phrases to said primary posting index.

3. The method of claim 1, wherein the processing of contents of said primary posting index comprises generating a query result by submitting a query to said primary posting index using a query language of said primary posting index.

4. The method of claim 1, wherein the processing of contents of said primary posting index comprises:

processing said primary posting index in order to generate results, wherein said results comprise a set of candidate entries with additional metadata; and

filtering said results in order to produce said posting within said secondary posting index.

5. The method of claim 1, wherein the processing of said primary posting index comprises:

receiving, as input, a candidate set of terms and phrases and a supplemental set of terms and phrases;

extracting, from said primary posting index, a set of posting entries comprising;

posting entries corresponding to an occurrence of a term or phrase of said candidate set; and

posting entries corresponding to an occurrence of a term or phrase from said supplemental set, wherein a document including said term or phrase from said supplemental set includes an occurrence of a term or phrase from said candidate set;

generating a posting list in said secondary posting index by processing resulting posting entries generated during said extracting from said primary posting index.

6. The method of claim 1, wherein the processing of said primary posting index comprises:

receiving, as input, a candidate set of terms and phrases and a supplemental set of terms and phrases;

sending a query to said primary posting index;

returning, from said query, result information comprising;

posting entries corresponding to an occurrence of a term or phrase of said candidate set; and

posting entries corresponding to an occurrence of a term or phrase from said supplemental set, wherein a document including said term or phrase from said supplemental set include an occurrence of a term or phrase from said candidate set;

generating a posting list in said secondary posting index by processing resulting posting entries from said primary posting index.

7. The method of claim 1, wherein the processing of said primary posting index accepts all phrases deemed topical by a disambiguating classifier given access to locations of all phrases, on-topic terms, and off-topic terms in said primary posting index.

8. The method of claim 7, wherein a search query to said primary posting index comprises a disjunct of phrases representing a feature set of said classifier, wherein result postings of said search query are filtered by said classifier to determine which of the postings are accepted into said secondary posting index.

9. A program storage device readable by computer, tangibly embodying a program of instructions executable by said computer to perform a method of data mining, said method comprising:

processing contents of a primary posting index; and

producing a posting within a secondary posting index based on the processing of said contents of said primary posting index.

10. The program storage device of claim 9, wherein in said method, the processing of contents of said primary posting index comprises submitting a disjunction of terms or phrases to said primary posting index.

11. The program storage device of claim 9, wherein in said method, the processing of contents of said primary posting index comprises generating a query result by submitting a query to said primary posting index using a query language of said primary posting index.

12. The program storage device of claim 9, wherein in said method, the processing of contents of said primary posting index comprises:

processing said primary posting index in order to generate results, wherein said results comprise a set of candidate entries with additional metadata; and

filtering said results in order to produce said posting within said secondary posting index.

13. The program storage device of claim 9, wherein in said method, the processing of said primary posting index comprises:

receiving, as input, a candidate set of terms and phrases and a supplemental set of terms and phrases;

extracting, from said primary posting index, a set of posting entries comprising;

posting entries corresponding to an occurrence of a term or phrase of said candidate set; and

posting entries corresponding to an occurrence of a term or phrase from said supplemental set, wherein a document including said term or phrase from said supplemental set includes an occurrence of a term or phrase from said candidate set;

generating a posting list in said secondary posting index by processing resulting posting entries generated during said extracting from said primary posting index.

14. The program storage device of claim 9, wherein in said method, the processing of said primary posting index comprises:

receiving, as input, a candidate set of terms and phrases and a supplemental set of terms and phrases;

sending a query to said primary posting index;

returning, from said query, result information comprising;

posting entries corresponding to an occurrence of a term or phrase of said candidate set; and

posting entries corresponding to an occurrence of a term or phrase from said supplemental set, wherein a document including said term or phrase from said supplemental set include an occurrence of a term or phrase from said candidate set;

generating a posting list in said secondary posting index by processing resulting posting entries from said primary posting index.

15. The program storage device of claim 9, wherein in said method, the processing of said primary posting index accepts all phrases deemed topical by a disambiguating classifier given access to locations of all phrases, on-topic terms, and off-topic terms in said primary posting index.

16. The program storage device of claim 15, wherein a search query to said primary posting index comprises a disjunct of phrases representing a feature set of said classifier, wherein result postings of said search query are filtered by said classifier to determine which of the postings are accepted into said secondary posting index.

17. A system of data mining comprising:

a primary posting index; and

a secondary posting index comprising a posting, wherein said posting is generated based on a processing of contents of said primary posting index.

18. The system of claim 17, wherein the processing of contents of said primary posting index comprises a disjunction of terms or phrases submitted to said primary posting index.

19. The system of claim 17, wherein the processing of contents of said primary posting index comprises a query result generated by submitting a query to said primary posting index using a query language of said primary posting index.

20. The system of claim 17, wherein the processing of contents of said primary posting index comprises:

a processor adapted to process said primary posting index in order to generate results, wherein said results comprise a set of candidate entries with additional metadata; and

a filter adapted to filter said results in order to produce said posting within said secondary posting index.

21. The system of claim 17, wherein the processing of said primary posting index comprises:

an input candidate set of terms and phrases and a supplemental set of terms and phrases;

a set of posting entries extracted from said primary posting index comprising;

posting entries corresponding to an occurrence of a term or phrase of said candidate set; and

posting entries corresponding to an occurrence of a term or phrase from said supplemental set, wherein a document including said term or phrase from said supplemental set includes an occurrence of a term or phrase from said candidate set;

a posting list generated in said secondary posting index by processing resulting posting entries generated during said extracting from said primary posting index.

22. The system of claim 17, wherein the processing of said primary posting index comprises:

an input candidate set of terms and phrases and a supplemental set of terms and phrases;

a query sent to said primary posting index;

result information returned from said query comprising;

posting entries corresponding to an occurrence of a term or phrase of said candidate set; and

posting entries corresponding to an occurrence of a term or phrase from said supplemental set, wherein a document including said term or phrase from said supplemental set include an occurrence of a term or phrase from said candidate set;

a posting list generated in said secondary posting index by processing resulting posting entries from said primary posting index.

23. The system of claim 17, wherein the processing of said primary posting index accepts all phrases deemed topical by a disambiguating classifier given access to locations of all phrases, on-topic terms, and off-topic terms in said primary posting index.

24. The system of claim 23, wherein a search query to said primary posting index comprises a disjunct of phrases representing a feature set of said classifier, wherein result postings of said search query are filtered by said classifier to determine which of the postings are accepted into said secondary posting index.