Natural error handling in speech recognition

• US 7,702,512 B2
• Filed: 06/09/2008
• Issued: 04/20/2010
• Est. Priority Date: 07/31/2002
• Status: Expired due to Term

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Maison, Benoit, Wu, Brian C., Gopinath, Ramesh A.
• Primary Examiner(s): Dorvil; Richemond
• Assistant Examiner(s): He; Jialong
• Application Number:
  US12/135,397
• Publication Number:
  US 20080243507A1
• Time in Patent Office: 680 Days
• Field of Search: 704/270, 704/251, 704/257, 704/235
• US Class Current: 704/270
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/225 Feedback of the input speech

Abstract

A user interface, and associated techniques, that permit a fast and efficient way of correcting speech recognition errors, or of diminishing their impact. The user may correct mistakes in a natural way, essentially by repeating the information that was incorrectly recognized previously. Such a mechanism closely approximates what human-to-human dialogue would be in similar circumstances. Such a system fully takes advantage of all the information provided by the user, and on its own estimates the quality of the recognition in order to determine the correct sequence of words in the fewest number of steps.

Claims

1. An apparatus for handling errors in speech recognition, said apparatus comprising:

an input arrangement which accepts speech input from a user;

said input arrangement comprising a recognizer which recognizes the speech input;

a feedback arrangement which provides feedback of the recognized speech input to the user; and

a correction arrangement which accepts corrective information from the user relating to the occurrence of one or more errors in the recognized speech input,

wherein said correction arrangement is adapted to permit the user to simultaneously signal with only one input the presence of one or more errors and to perform both of;

indicating at least one location of the one or more errors, and providing at least one correction to the one or more errors, without the user separately signaling the presence of one or more errors.

2. The apparatus according to claim 1, wherein said correction arrangement is adapted to permit the use of context-sensitive natural correction commands.

3. The apparatus according to claim 1, wherein said feedback arrangement is adapted to provide a context-sensitive clarification dialog, said clarification dialog comprising explicit or implicit confirmation requests.

4. The apparatus according to claim 3, wherein said explicit confirmation request is a disambiguation question.

5. The apparatus according to claim 1, wherein said correction arrangement is adapted to:

accept from the user a plurality of repetitions of corrective information; and

use at least a portion of the repetitions of corrective information to arrive at a best hypothesis of corrective information.

6. The apparatus according to claim 1, wherein said recognizer is adapted to:

produce a list of hypotheses related to the speech input, each hypothesis comprising a sequence of at least one word; and

score each word, with higher scores being associated with words that have been more likely to have been correctly recognized.

7. The apparatus according to claim 6, further comprising a transforming arrangement which transforms the score of each word to form a new list of hypotheses, whereby the transformed score of represents the estimated probability that the corresponding word is correct.

8. The apparatus according to claim 7, further comprising a comparing arrangement which compares words from the new list of hypotheses with a current best hypothesis and determines a new best hypothesis for each word.

9. The apparatus according to claim 8, wherein said comparing arrangement is adapted to compare like words when possible.

10. The apparatus according to claim 9, wherein said feedback arrangement is further adapted to:

provide additional feedback of recognized speech input subsequent to said step of accepting corrective information and associating at least one confidence score with such speech input;

wherein, in providing additional feedback, said feedback arrangement represents recognized speech input having lower confidence scores in a first manner and represents recognized speech input having higher confidence scores in a second manner, the first manner involving a lower level of representation than the second manner.

11. A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for handling errors in speech recognition, said method comprising the steps of:

accepting speech input from a user and recognizing the speech input;

providing feedback of the recognized speech input to the user; and

accepting corrective information from the user relating to the occurrence of one or more errors in the recognized speech input,

wherein said step of accepting corrective information comprises permitting the user to simultaneously signal with only one input the presence of one or more errors and to perform both of;

indicating at least one location of the one or more errors, and providing at least one correction to the one or more errors, without the user separately signaling the presence of one or more errors.