Evidence profiling

• US 9,189,541 B2
• Filed: 09/23/2011
• Issued: 11/17/2015
• Est. Priority Date: 09/24/2010
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Brown, Eric W., Chu-Carroll, Jennifer, Fan, James J., Ferrucci, David A., Gondek, David C., Levas, Anthony T., Murdock, James W. IV
• Primary Examiner(s): Huang, Miranda
• Application Number:
  US13/243,891
• Publication Number:
  US 20120131016A1
• Time in Patent Office: 1,516 Days
• Field of Search: 707/722, 707/724, 707/728, 707/732, 707/733, 707/734, 707/748, 707/758, 707/767, 707/771, 707/778, 707/E17.048, 707/999.003
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3328 using graphical result space presentation or visualisation
• CPC Class Codes: G06F 16/338 Presentation of query results
• CPC Class Codes: G06F 16/353 into predefined classes
• CPC Class Codes: G06F 16/358 Browsing; Visualisation therefor

Abstract

Evidence profiling, in one aspect, may receive a candidate answer and supporting pieces of evidence. An evidence profile may be generated, the evidence profile communicating a degree to which the evidence supports the candidate answer as being correct. The evidence profile may provide dimensions of evidence, and each dimension may support or refute the candidate answer as being correct.

Claims

1. A method for evidence profiling, comprising:

receiving a candidate answer and supporting pieces of evidence; and

generating, by a processor, an evidence profile communicating a degree to which the evidence supports the candidate answer as being correct, wherein the evidence profile provides dimensions of evidence and each dimension may support or refute the candidate answer as being correct,

wherein the dimensions of evidence comprise at least taxonomic, geospatial, temporal, source reliability, passage support and popularity dimensions, and the supporting pieces of evidence comprise at least content whose features are grouped into said dimensions of evidence used to generate the evidence profile;

presenting one or more candidate answers with associated confidence levels, the candidate answer being one of said one or more candidate answers, said one or more candidate answers having a corresponding evidence profile,

wherein a user is enabled to navigate to the evidence profile by selecting said one or more candidate answers,

wherein a visualization of the evidence profile presents said selected one or more candidate answers by the dimensions with associated dimension scores, said dimension scores representing degrees to which the supporting pieces of evidence corresponding to the dimensions support said selected one or more candidate answers as being correct, wherein the user is enabled to further navigate to the supporting pieces of evidence used to produce the dimension scores via the visualization.

2. The method of claim 1 further comprising configuring the visualization of the evidence profile such that each dimension of evidence can be selected and a weight associated with each dimension altered.

3. The method of claim 1, further comprising:

configuring a selection of a desired dimension; and

displaying pieces of evidence contributing to a score for the selected dimension.

4. The method of claim 1, wherein the generating an evidence profile includes:

determining dimensions of evidence based on types of algorithms that were used to gather and score each piece of supporting evidence; and

obtaining a score associated with each of the dimensions of the evidence by aggregating the scores for each piece of supporting evidence.

5. The method of claim 3, wherein the dimensions of evidence are aggregated into a hierarchy.

6. The method of claim 5, wherein the dimensions of evidence are aggregated automatically or manually or combinations thereof.

7. The method of claim 2, wherein the visualization includes presenting relative contributions of each of the dimensions of evidence supporting the candidate answer.

8. The method of claim 2, wherein the visualization includes showing comparison of two or more candidate answers, in which the dimensions of evidence supporting said two or more candidate answers are shown.

9. The method of claim 8, wherein only the dimensions of evidence that provide different levels of support for the two or more candidate answers are shown.

10. The method of claim 9, wherein relative differences in contribution of the dimensions of evidence between the two or more candidate answers are shown.