User collaboration for answer generation in question and answer system
First Claim
1. A method, in a data processing system comprising a processor and a memory configured to implement a question and answer system (QA), for generating answers to an input question, comprising:
- receiving, in the data processing system, the input question;
processing, by the data processing system, the input question to generate at least one query for application to a corpus of information;
applying, by the data processing system, the at least one query to the corpus of information to generate a set of candidate answers to the input question and corresponding selections of evidence portions of the corpus of information providing evidence in support of the at least one candidate answer in the set of candidate answers being a correct answer for the input question;
outputting, via a graphical user interface (GUI), the set of candidate answers in a first GUI sub-section, and the evidence portions in a second GUI sub-section, for evaluation by a user;
receiving, via the graphical user interface, user input modifying at least one of the set of candidate answers or the evidence portions; and
adjusting an operation of the data processing system based on the user input, wherein the user input specifies an action for adding a new candidate answer to the at least one candidate answer, and wherein adjusting the operation of the data processing system based on the user input comprises;
adding the new candidate answer to the at least one candidate answer;
automatically submitting the new candidate answer to the QA system for evaluation in response to the addition of the new candidate answer; and
automatically updating the first GUI sub-section and second GUI sub-section based on results of the evaluation of the new candidate answer by the QA system.
1 Assignment
0 Petitions
Accused Products
Abstract
Mechanisms are provided, in association with a question and answer system, for generating answers to an input question. An input question is received and processed to generate at least one query. The at least one query is applied to the corpus to generate a set of candidate answers and corresponding selections of evidence portions of the corpus of information providing evidence in support of the at least one candidate answer being a correct answer for the input question. A graphical user interface (GUI) is output comprising a first GUI sub-section comprising the set of candidate answers, and a second GUI sub-section comprising the evidence portions of the corpus. User input modifying at least one of set of candidate answers or the evidence portions of the corpus of information is received via the GUI and an operation of the data processing system is adjusted based on the user input.
32 Citations
23 Claims
-
1. A method, in a data processing system comprising a processor and a memory configured to implement a question and answer system (QA), for generating answers to an input question, comprising:
-
receiving, in the data processing system, the input question; processing, by the data processing system, the input question to generate at least one query for application to a corpus of information; applying, by the data processing system, the at least one query to the corpus of information to generate a set of candidate answers to the input question and corresponding selections of evidence portions of the corpus of information providing evidence in support of the at least one candidate answer in the set of candidate answers being a correct answer for the input question; outputting, via a graphical user interface (GUI), the set of candidate answers in a first GUI sub-section, and the evidence portions in a second GUI sub-section, for evaluation by a user; receiving, via the graphical user interface, user input modifying at least one of the set of candidate answers or the evidence portions; and adjusting an operation of the data processing system based on the user input, wherein the user input specifies an action for adding a new candidate answer to the at least one candidate answer, and wherein adjusting the operation of the data processing system based on the user input comprises; adding the new candidate answer to the at least one candidate answer; automatically submitting the new candidate answer to the QA system for evaluation in response to the addition of the new candidate answer; and automatically updating the first GUI sub-section and second GUI sub-section based on results of the evaluation of the new candidate answer by the QA system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A computer program product comprising a non-transitory computer readable medium having a computer readable program stored therein, wherein the computer readable program, when executed on a data processing system implementing a question and answer system (QA), causes the data processing system to:
-
receive an input question; process the input question to generate at least one query for application to a corpus of information; apply the at least one query to the corpus of information to generate a set of candidate answers to the input question and corresponding selections of evidence portions of the corpus of information providing evidence in support of the at least one candidate answer being a correct answer for the input question; output, via a graphical user interface (GUI), the set of candidate answer in a first GUI sub-section, and the evidence portions in a second GUI sub-section, for evaluation by a user; receive, via the graphical user interface, user input modifying at least one of the set of candidate answers or the evidence portions; and adjust an operation of the data processing system based on the user input, wherein the user input specifies an action for adding a new candidate answer to the at least one candidate answer, and wherein adjusting the operation of the data processing system based on the user input comprises; adding the new candidate answer to the at least one candidate answer; automatically submitting the new candidate answer to the QA system for evaluation in response to the addition of the new candidate answer; and automatically updating the first GUI sub-section and second GUI sub-section based on results of the evaluation of the new candidate answer by the QA system. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A data processing system configured to implement a question and answer system (QA), comprising:
-
a processor; and a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to; receive an input question; process the input question to generate at least one query for application to a corpus of information; apply the at least one query to the corpus of information to generate at least one candidate answer to the input question and corresponding selections of portions of the corpus of information providing evidence in support of the at least one candidate answer being a correct answer for the input question; output, via a graphical user interface (GUI), the at least one candidate answer in a first GUI sub-section, and the portions of the corpus of information in a second GUI sub-section, for evaluation by a user; receive, via the graphical user interface, user input modifying at least one of the at least one candidate answer or the portions of the corpus of information; and adjust an operation of the data processing system based on the user input, wherein the user input specifies an action for adding a new candidate answer to the at least one candidate answer, and wherein adjusting the operation of the data processing system based on the user input comprises; adding the new candidate answer to the at least one candidate answer; automatically submitting the new candidate answer to the QA system for evaluation in response to the addition of the new candidate answer; and automatically updating the first GUI sub-section and second GUI sub-section based on results of the evaluation of the new candidate answer by the QA system.
-
Specification