CONTENT REVISION USING QUESTION AND ANSWER GENERATION

• US 20140046947A1
• Filed: 08/09/2012
• Published: 02/13/2014
• Est. Priority Date: 08/09/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Jenkins, Jana H., Zadrozny, Wlodek W., Steinmetz, David C.
• Granted Patent: US 9,965,472 B2
• Time in Patent Office: Days
• US Class Current: 707/740
• CPC Class Codes: G06F 16/38 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/56 Natural language generation

Abstract

A method for question/answer creation for a document is described. The method includes importing a document having a set of questions based on content in the document. The method also includes automatically creating a candidate question from the content in the document. The method also includes automatically generating answers for the set of questions and the candidate question using the content in the document. The method also includes presenting the set of questions, the candidate question, and the answers to a content creator for user verification of accuracy. The method also includes storing a verified set of questions in the document. The verified set of questions includes the candidate question.

Claims

1. A computer program product, comprising:

a computer readable storage medium to store a computer readable program, wherein the computer readable program, when executed by a processor within a computer, causes the computer to perform operations for question/answer creation for a document, the operations comprising;

importing a document having a set of questions based on content in the document;

automatically creating a candidate question from the content in the document;

automatically generating answers for the set of questions and the candidate question using the content in the document;

presenting the set of questions, the candidate question, and the answers to a content creator for user verification of accuracy; and

storing a verified set of questions in the document, wherein the verified set of questions comprises the candidate question.

2. The computer program product of claim 1, wherein automatically creating the candidate question further comprises:

detecting a pattern in the content of the document that is common for other content in a corpus to which the document belongs; and

creating the candidate question based on the pattern.

3. The computer program product of claim 1, wherein importing the document further comprises:

scanning viewable content of the document and metadata in the document to obtain the set of questions; and

categorizing the set of questions based on the content of the document.

4. The computer program product of claim 1, wherein the computer readable program, when executed on the computer, causes the computer to perform additional operations, comprising:

verifying the set of questions, the candidate question, and the answers for accuracy according to the content of the document and applicability to the content of the document; and

revising the candidate question to correctly reflect the content in the document.

5. The computer program product of claim 1, wherein the computer readable program, when executed on the computer, causes the computer to perform additional operations, comprising:

scoring question/answer pairs generated by the system, wherein question/answer pairs that meet a scoring threshold are retained.

6. The computer program product of claim 1, wherein storing the verified set of questions in the document further comprises:

populating the verified set of questions with the candidate question in response to determining that the candidate question is accurate based on the content.

7. The computer program product of claim 1, wherein the computer readable program, when executed on the computer, causes the computer to perform additional operations, comprising:

receiving feedback from a user, wherein the feedback is related to the document;

receiving an input from the content creator to create a new question corresponding to the content in the document and based on the feedback; and

automatically generating answers for the new question using the content in the document.

8. A method for question/answer creation for a document, comprising:

importing a document having a set of questions based on content in the document;

automatically creating a candidate question from the content in the document;

automatically generating answers for the set of questions and the candidate question using the content in the document;

presenting the set of questions, the candidate question, and the answers to a content creator for user verification of accuracy; and

storing a verified set of questions in the document, wherein the verified set of questions comprises at least one verified question from the set of questions and the candidate question.

9. The method of claim 8, wherein automatically creating the candidate question further comprises:

detecting a pattern in the content of the document that is common for other content in a corpus to which the document belongs; and

creating the candidate question based on the pattern.

10. The method of claim 8, wherein importing the document further comprises:

scanning viewable content of the document and metadata in the document to obtain the set of questions; and

categorizing the set of questions based on the content of the document.

11. The method of claim 8, further comprising:

verifying the set of questions, the candidate question, and the answers for accuracy according to the content of the document and applicability to the content of the document; and

revising the candidate question to correctly reflect the content in the document.

12. The method of claim 8, further comprising:

scoring question/answer pairs generated by the system, wherein question/answer pairs that meet a scoring threshold are retained.

13. The method of claim 8, wherein storing the verified set of questions in the document further comprises:

populating the verified set of questions with the candidate question in response to determining that the candidate question is accurate based on the content.

14. The method of claim 8, further comprising:

receiving feedback from a user, wherein the feedback is related to the document;

receiving an input from the content creator to create a new question corresponding to the content in the document and based on the feedback; and

automatically generating answers for the new question using the content in the document.

15. A question/answer creation system, comprising:

a memory device; and

a processor connected to the memory device, wherein the processor is configured to;

import a document having a set of questions based on content in the document;

automatically create a candidate question from the content in the document;

automatically generate answers for the set of questions and the candidate question using the content in the document;

present the set of questions, the candidate question, and the answers to a content creator for user verification of accuracy; and

store a verified set of questions in the document, wherein the verified set of questions comprises at least one verified question from the set of questions and the candidate question.

16. The system of claim 15, wherein automatically creating the candidate question further comprises:

detecting a pattern in the content of the document that is common for other content in a corpus to which the document belongs; and

creating the candidate question based on the pattern.

17. The system of claim 15, wherein importing the document further comprises:

scanning viewable content of the document and metadata in the document to obtain the set of questions; and

categorizing the set of questions based on the content of the document.

18. The system of claim 15, wherein the processor is further configured to:

verify the set of questions, the candidate question, and the answers for accuracy according to the content of the document and applicability to the content of the document; and

.

revise the candidate question to correctly reflect the content in the document.

19. The system of claim 15, wherein storing the verified set of questions in the document further comprises:

populating the verified set of questions with the candidate question in response to determining that the candidate question is accurate based on the content.

20. The system of claim 15, wherein the processor is further configured to:

receive feedback from a user, wherein the feedback is related to the document;

receive an input from the content creator to create a new question corresponding to the content in the document and based on the feedback; and

automatically generate answers for the new question using the content in the document.