DYNAMIC CREATION OF DOMAIN SPECIFIC CORPORA

• US 20150347467A1
• Filed: 05/27/2014
• Published: 12/03/2015
• Est. Priority Date: 05/27/2014
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Basson, Sara H., Goodwin, Richard T., Katircioglu, Kaan K., Laker, Meir M., Lenchner, Jonathan, Mazzoleni, Pietro, Nayak, Nitinchandra R., Vergo, John G., Zadrozny, Wlodek W., Forcke, Kember A.-R.
• Application Number:
  US14/287,474
• Publication Number:
  US 20150347467A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes

Abstract

A model of a domain is received, wherein the model has a plurality of elements. A corpus of select documents covering the plurality of elements of the model is also received. A plurality of select topics is generated from the corpus of select documents. Topics of an additional document are compared to the plurality of select topics to calculate a distance between the topics of the additional document and the plurality of select topics. Upon the distance meeting a threshold value, a new corpus is generated to include the additional document. The new document is annotated with the plurality of elements of the model.

Claims

1. A computer implemented method for generating a domain-relevant corpus for use in a question answering (QA) application, the method comprising:

receiving a corpus of select documents corresponding to a plurality of elements of a model of a domain;

generating a plurality of select topics based on the corpus of select documents;

comparing topics of an additional document to the plurality of select topics to obtain a distance measure between the topics of the additional document and the plurality of select topics; and

upon the distance measure matching a set of selection criteria, adding the additional document to a new corpus.

2. The method of claim 1, further comprising:

annotating the additional document with the plurality of elements of the model.

3. The method of claim 1, wherein the new corpus further comprises the corpus of select documents.

4. The method of claim 1, further comprising:

updating the plurality of select topics to include the topics of the additional document.

5. The method of claim 1, wherein the received corpus of select documents is generated based on a parameterized search of a set of starting documents.

6. The method of claim 5, further comprising:

assessing a quality measure of each document in the set of starting documents to generate the corpus of select documents.

7. The method of claim 1, further comprising:

searching any one or both of the corpus of select documents and the new corpus using a search phrase, wherein the search phrase is based on any one or more of;

a phrase from a domain-relevant ontology source;

the select topics; and

the topics of the additional document.

8. A computer system for generating a domain-relevant corpus for use in a question answering (QA) application, comprising:

a computer having a processor and a computer-readable storage device;

a program embodied on the storage device for execution by the processor, the program having a plurality of program modules, the program modules including;

a receiving module configured to receive a corpus of select documents corresponding to a plurality of elements of a model of a domain;

a generating module configured to generate a plurality of select topics based on the corpus of select documents;

a comparing module configured to compare topics of an additional document to the plurality of select topics to obtain a distance measure between the topics of the additional document and the plurality of select topics; and

an adding module configured to add the additional document to a new corpus upon the distance measure matching a set of selection criteria.

9. The system of claim 8, further comprising:

an annotating module configured to annotate the additional document with the plurality of elements of the model.

10. The system of claim 8, wherein the new corpus further comprises the corpus of select documents.

11. The system of claim 8, further comprising:

an updating module configured to update the plurality of select topics to include the topics of the additional document.

12. The system of claim 8, wherein the received corpus of select documents is generated based on a parameterized search of a set of starting documents.

13. The system of claim 12, further comprising:

an assessing module configured to assess a quality measure of each document in the set of starting documents to generate the corpus of select documents.

14. A computer program product for generating a domain-relevant corpus for use in a question answering (QA) application, comprising a computer-readable storage medium having program code embodied therewith, the program code executable by a processor of a computer to perform a method comprising:

receiving, by the processor, a corpus of select documents corresponding to a plurality of elements of a model of a domain;

generating, by the processor, a plurality of select topics based on the corpus of select documents;

comparing, by the processor, topics of an additional document to the plurality of select topics to obtain a distance measure between the topics of the additional document and the plurality of select topics; and

upon the distance measure matching a set of selection criteria, adding, by the processor, the additional document to a new corpus.

15. The computer program product of claim 14, wherein the method further comprises:

annotating, by the processor, the additional document with the plurality of elements of the model.

16. The computer program product of claim 14, wherein the new corpus further comprises the corpus of select documents.

17. The computer program product of claim 14, wherein the method further comprises:

updating, by the processor, the plurality of select topics to include the topics of the additional document.

18. The computer program product of claim 14, wherein the received corpus of select documents is generated based on a parameterized search of a set of starting documents.

19. The computer program product of claim 18, further comprising:

assessing a quality measure of each document in the set of starting documents to generate the corpus of select documents.

20. The computer program product of claim 14, wherein the method further comprises:

searching, by the processor, any one or both of the corpus of select documents and the new corpus using a search phrase, wherein the search phrase is based on any one or more of;

a phrase from a domain-relevant ontology source;

the select topics; and

the topics of the additional document.