Providing answers to questions using multiple models to score candidate answers

• US 9,990,419 B2
• Filed: 11/08/2016
• Issued: 06/05/2018
• Est. Priority Date: 09/28/2010
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Brown, Eric W., Ferrucci, David, Murdock, IV, James W.
• Primary Examiner(s): LE, HUNG D
• Application Number:
  US15/345,879
• Publication Number:
  US 20170053020A1
• Time in Patent Office: 574 Days
• Field of Search: None
• CPC Class Codes: F16H 1/28 with gears having orbital motion
• CPC Class Codes: F16H 2200/0034 the gear ratios comprising two forward speeds
• CPC Class Codes: F16H 2200/0039 the gear ratios comprising three forward speeds
• CPC Class Codes: F16H 2200/2005 with one sets of orbital gears
• CPC Class Codes: F16H 2200/2035 with two engaging means
• CPC Class Codes: F16H 3/006 power being selectively transmitted by either one of the parallel flow paths
• CPC Class Codes: F16H 3/091 including a single countershaft
• CPC Class Codes: F16H 3/54 one of the central gears being internally toothed and the other externally toothed
• CPC Class Codes: F16H 37/02 comprising essentially only toothed or friction gearings
• CPC Class Codes: F16H 37/0813 with only one input shaft differentials for four wheel drive vehicles B60K17/346
• CPC Class Codes: F16H 57/035 Gearboxes for gearing with endless flexible members
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06N 20/00 Machine learning

Abstract

A method, system and computer program product for generating answers to questions. In one embodiment, the method comprises receiving an input query; conducting a search to identify candidate answers to the input query, and producing a plurality of scores for each of the candidate answers. For each of the candidate answers, one, of a plurality of candidate ranking functions, is selected. This selected ranking function is applied to the each of the candidate answers to determine a ranking for the candidate answer based on the scores for that candidate answer. One or more of the candidate answers is selected, based on the rankings for the candidate answers, as one or more answers to the input query. In an embodiment, the ranking function selection is performed using information about the question. In an embodiment, the ranking function selection is performed using information about each answer.

Claims

1. A system for generating answers to questions, comprising:

a computer device comprising;

at least one distinct software module, each distinct software module being embodied on a tangible computer-readable medium;

a memory; and

at least one processor coupled to the memory device and operative for;

receiving an input query;

obtaining, from an unstructured data source, a plurality of candidate answers to the input query;

performing context independent answer processing to produce first scores for each of the candidate answers;

computing specified information about each of the candidate answers during the context independent answer processing;

sending the candidate answers to a model selection module;

using the model selection module to use said specified information computed about the candidate answers during the context independent answer processing, to select one of a plurality of scoring models;

sending each of the candidate answers to the selected one of the scoring models;

using the selected one of the scoring models for weighting the first scores for the candidate answers to determine an answer score for each of the candidate answers; and

generating at least one answer to the input query based on the answer scores.

2. The system according to claim 1, wherein the computed specified information is based on the candidate answers.

3. The system according to claim 1, wherein the computed specified information is a specified characteristic of the candidate answers.

4. The system according to claim 1, wherein the computed specified information is intrinsic to the candidate answers.

5. The system according to claim 1, wherein the computed specified information is a length of the candidate answers.

6. The system according to claim 1, wherein the computed specified information is an identified part of speech.

7. The system according to claim 1, wherein the computing specified information about each of the candidate answers during the context independent processing is performed before sending the candidate answers to the model selection module.

8. A method for generating answers to questions, comprising:

receiving an input query;

obtaining, from an unstructured data source, a plurality of candidate answers to the input query;

performing context independent answer processing to produce a first score for each of the candidate answers;

computing specified information about each of the candidate answers during the context independent answer processing;

sending the candidate answers to a model selection module;

using the model selection module to use the specified information computed about the candidate answers during the context independent answer processing, to select one of a plurality of scoring models;

sending each of the candidate answers to the selected one of the scoring models;

using the selected one of the scoring models for weighting the first scores for the candidate answers to determine an answer score for each of the candidate answers; and

generating at least one answer to the input query based on the answer scores.

9. The method according to claim 8, wherein the computed specified information is based on the candidate answers.

10. The method according to claim 8, wherein the computed specified information is a specified characteristic of the candidate answers.

11. The method according to claim 8, wherein the computed specified information is intrinsic to the candidate answers.

12. The method according to claim 8, wherein the computed specified information is a length of the candidate answers.

13. The method according to claim 8, wherein the computed specified information is an identified part of speech.

14. The method according to claim 8, wherein the computing specified information about each of the candidate answers during the context independent processing is performed before sending the candidate answers to the model selection module.

15. An article of manufacture, comprising:

at least one tangible computer readable device having computer readable program code logic tangibly embodied therein to generate answers to questions, the computer readable program code logic, when executing, performing the following;

receiving an input query;

obtaining, from an unstructured data source, a plurality of candidate answers to the input query;

performing context independent answer processing to produce first scores for each of the candidate answers;

computing specified information about each of the candidate answers during the context independent answer processing;

sending the candidate answers to a model selection module;

using the model selection module to use said specified information computed about the candidate answers during the context independent answer processing, to select one of a plurality of scoring models;

sending each of the candidate answers to the selected one of the scoring models;

using the selected one of the scoring models for weighting the first scores for the candidate answers to determine an answer score for each of the candidate answers; and

generating at least one answer to the input query based on the answer scores.

16. The article of manufacture according to claim 15, wherein the computed specified information is based on the candidate answers.

17. The article of manufacture according to claim 15, wherein the computed specified information is a specified characteristic of the candidate answers.

18. The article of manufacture according to claim 15, wherein the computed specified information is intrinsic to the candidate answers.

19. The article of manufacture according to claim 15, wherein the computed specified information is a length of the candidate answers.

20. The article of manufacture according to claim 15, wherein the computed specified information is an identified part of speech.