×

Automatic updating of confidence scoring functionality for speech recognition systems with respect to a receiver operating characteristic curve

  • US 9,330,665 B2
  • Filed: 01/07/2011
  • Issued: 05/03/2016
  • Est. Priority Date: 01/07/2011
  • Status: Active Grant
First Claim
Patent Images

1. A method comprising:

  • determining an original receiver operating characteristic (ROC) curve describing performance of a speech recognition system with respect to an original rate of false acceptance (FA) of the speech recognition system versus an original rate of correct acceptance (CA) of the speech recognition system;

    changing an algorithm used by the speech recognition system for sentence confidence scores, wherein changing the algorithm results in a new ROC curve with respect to a new rate of FA of the speech recognition system versus a new rate of CA of the speech recognition system;

    receiving a user specification of relative importance of the new rate of FA versus the new rate of CA; and

    based on the relative importance of the new rate of FA versus the new rate of CA, adjusting a confidence scoring functionality related to recognition reliability for a given input utterance,wherein at or above a given operating point of the speech recognition system, the new ROC curve reflects a double gain constraint relative to the original ROC curve, such that the new rate of FA is equal to or less than the original rate of FA, and the new rate of CA is equal to or greater than the original rate of CA.

View all claims
  • 3 Assignments
Timeline View
Assignment View
    ×
    ×