×

Knowledge corroboration

  • US 8,706,653 B2
  • Filed: 12/08/2010
  • Issued: 04/22/2014
  • Est. Priority Date: 12/08/2010
  • Status: Active Grant
First Claim
Patent Images

1. A method of obtaining enhanced answers to a plurality of questions comprising:

  • accessing features comprising any one or more of;

    at least one feature for each of a plurality of judges, and at least one feature for each of the questions;

    accessing at least one answer for each question given by one of the judges and, for a plurality of the questions, more than one answer given by different ones of the judges;

    using a probabilistic learning system to learn an expertise of each judge using the features, the probabilistic learning system using at least a first question for which an answer is known as ground truth and a second question for which a ground truth answer is unknown, true answers to at least some of the questions being unknown to the probabilistic learning system and true expertise of the judges for the questions being unknown to the probabilistic learning system, an enhanced answer to a question being more likely to be accurate than a corresponding answer before application of the probabilistic learning system; and

    using the probabilistic learning system to determine enhanced answers to the questions by aggregating the answers in a manner which takes into account the identified expertise of the judges by weighting answers of the judges based on the identified expertise of the judges.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×