SYSTEM AND METHOD FOR DOMAIN ADAPTATION IN QUESTION ANSWERING
1 Assignment
0 Petitions
Accused Products
Abstract
The present disclosure relates generally to question answering systems and methods and, particularly, to systems and methods for domain adaptation in question answering.
10 Citations
36 Claims
-
1-18. -18. (canceled)
-
19. A method for providing adaptation to a question answering system, wherein the question answering system has associated therewith a plurality of trace data and a question-answer set, the method comprising the steps of:
-
submitting a set of questions to the question answering system; receiving back from the question answering system a set of answers generated in response to the set of questions; comparing the set of answers received back from the question answering system to answers in the question-answer set; and generating, based on the comparison and the plurality of trace data, an estimate of how much more training data is needed for each of a plurality of question types or answer types; wherein the training data comprises a plurality of training questions along with a corresponding plurality of correct training answers; wherein the trace data is generated during the generation of the set of answers; and wherein the step of generating further comprises the following steps; (a) for each question type, successively sample an increasing number of question-answer pairs from the question-answer set; (b) automatically train the question answering system using the sampled question-answer pairs; (c) automatically compute a functional dependence of the question answering system performance on the remaining questions relative to the size of the sample; and (d) extrapolate from the functional dependence a required number of training question-answer pairs of each question type required. - View Dependent Claims (20, 35)
-
-
21-34. -34. (canceled)
-
36-39. -39. (canceled)
Specification