Error correction for speech recognition systems

• US 20060293889A1
• Filed: 06/27/2005
• Published: 12/28/2006
• Est. Priority Date: 06/27/2005
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Leppanen, Jussi Artturi, Kiss, Imre
• Application Number:
  US11/169,277
• Publication Number:
  US 20060293889A1
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/0631 Creating reference templates; Clustering

Abstract

Words in a sequence of words that is obtained from speech recognition of an input speech sequence are presented to a user, and at least one of the words in the sequence of words is replaced, in case it has been selected by a user for correction. Words with a low recognition confidence value are emphasized; alternative word candidates for the at least one selected word are ordered according to an ordering criterion; after replacing a word, an order of alternative word candidates for neighboring words in the sequence is updated; the replacement word is derived from a spoken representation of the at least one selected word by speech recognition with a limited vocabulary; and the word that replaces the at least one selected word is derived from a spoken and spelled representation of the at least one selected word.

Claims

1. A method for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, said method comprising:

presenting said sequence of words to a user, wherein each word in said sequence of words is associated with a respective recognition confidence value, and wherein at least one word in said sequence of words is automatically emphasized in dependence on its recognition confidence value; and

replacing at least one word in said sequence of words, in case it has been selected by a user for correction.

2. The method according to claim 1, wherein said at least one emphasized word is associated with a lowest recognition confidence value of all words in said sequence of words.

3. The method according to claim 2, wherein said at least one emphasized word is automatically emphasized by automatically positioning a selector on it.

4. The method according to claim 1, wherein said at least one emphasized word is associated with a recognition confidence value that is below a pre-defined threshold.

5. A device for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, said device comprising:

means arranged for presenting said sequence of words to a user, wherein each word in said sequence of words is associated with a respective recognition confidence value, and wherein at least one word in said sequence of words is automatically emphasized in dependence on its recognition confidence value; and

means arranged for replacing at least one word in said sequence of words, in case it has been selected by a user for correction.

6. The device according to claim 5, wherein said device is a portable multimedia device or a part thereof.

7. A software application product, comprising a storage medium having a software application for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence embodied therein, said software application comprising:

program code for presenting said sequence of words to a user, wherein each word in said sequence of words is associated with a respective recognition confidence value, and wherein at least one word in said sequence of words is automatically emphasized in dependence on its recognition confidence value; and

program code for replacing at least one word in said sequence of words, in case it has been selected by a user for correction.

8. A method for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, wherein for each word in said sequence of words, an associated set of alternative word candidates exists, said method comprising:

presenting said sequence of words to a user; and

replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word candidate from its associated set of word candidates, wherein said word candidates in said set of word candidates that is associated with said at least one selected word are ordered according to an ordering criterion related to a likelihood of said word candidates to correctly replace said at least one selected word.

9. The method according to claim 8, wherein said ordering criterion is based on at least one of a language model that contains statistics on the likelihood of a set of words comprising at least one word to occur in a language, and a recognition confidence of said word candidates, wherein said recognition confidence expresses, for each word candidate in a set of word candidates, a respective confidence that said word candidate is a correct speech recognition result.

10. The method according to claim 8, wherein a selecting of said word candidate that replaces said at least one selected word from said set of word candidates comprises stepping through said word candidates on a word-candidate-by-word-candidate basis.

11. The method according to claim 8, wherein said ordering criterion is at least based on a language model that contains statistics on the likelihood of at least two words of a language following each other, said method further comprising:

updating, in case said at least one word has been selected and replaced in said sequence of words by said word candidate, an order of word candidates in at least one set of word candidates associated with a respective word that is, within said sequence of words, adjacent to said at least one selected and replaced word, wherein said updating of said order of said word candidates in said at least one set of word candidates is performed according to said ordering criterion and under consideration of said word candidate by which said at least one selected and replaced word has been replaced.

12. A device for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, wherein for each word in said sequence of words, an associated set of alternative word candidates exists, said device comprising:

means arranged for presenting said sequence of words to a user; and

means arranged for replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word candidate from its associated set of word candidates, wherein said word candidates in said set of word candidates that is associated with said at least one selected word are ordered according to an ordering criterion related to a likelihood of said word candidates to correctly replace said at least one selected word.

13. The device according to claim 12, further comprising:

means arranged for stepping through selection alternatives on a word-candidate-by-word-candidate basis in order to select said word candidate that replaces said at least one selected word from said set of word candidates.

14. The device according to claim 12, further comprising:

means arranged for updating, in case said at least one word has been selected and replaced in said sequence of words by said word candidate, an order of word candidates in at least one set of word candidates associated with a respective word that is, within said sequence of words, adjacent to said at least one selected and replaced word, wherein said ordering criterion is at least based on a language model that contains statistics on a likelihood of at least two words of a language following each other, and wherein said updating of said order of said word candidates in said at least one set of word candidates is performed according to said ordering criterion and under consideration of said word candidate by which said at least one selected and replaced word has been replaced.

15. The device according to claim 12, wherein said device is a portable multimedia device or a part thereof.

16. A software application product, comprising a storage medium having a software application embodied therein for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, wherein for each word in said sequence of words, an associated set of alternative word candidates exists, said software application comprising:

program code for presenting said sequence of words to a user; and

program code for replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word candidate from its associated set of word candidates, wherein said word candidates in said set of word candidates that is associated with said at least one selected word are ordered according to an ordering criterion related to a likelihood of said word candidates to correctly replace said at least one selected word.

17. The software application product according to claim 16, wherein said ordering criterion is at least based on a language model that contains statistics on a likelihood of at least two words of a language following each other, said software application product further comprising:

program code for updating, in case said at least one word has been selected and replaced in said sequence of words by said word candidate, an order of word candidates in at least one set of word candidates associated with a respective word that is, within said sequence of words, adjacent to said at least one selected and replaced word, wherein said updating of said order of said word candidates in said at least one set of word candidates is performed according to said ordering criterion and under consideration of said word candidate by which said at least one selected and replaced word has been replaced.

18. A method for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, wherein for each word in said sequence of words, an associated set of alternative word candidates exists, said method comprising:

presenting said sequence of words to a user; and

replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word that is obtained from speech recognition of an new input speech sequence that only contains a representation of a correct version of said at least one selected word spoken by said user, wherein a recognition vocabulary used in said speech recognition of said new input speech sequence is limited to said set of word candidates associated with said at least one selected word.

19. A device for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, wherein for each word in said sequence of words, an associated set of alternative word candidates exists, said device comprising:

means arranged for presenting said sequence of words to a user; and

means arranged for replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word that is obtained from speech recognition of a new input speech sequence that only contains a representation of a correct version of said at least one selected word spoken by said user, wherein a recognition vocabulary used in said speech recognition of said new input speech sequence is limited to said set of word candidates associated with said at least one selected word.

20. The device according to claim 19, wherein said device is a portable multimedia device or a part thereof.

21. A software application product, comprising a storage medium having a software application embodied therein for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, wherein for each word in said sequence of words, an associated set of alternative word candidates exists, said software application comprising:

program code for presenting said sequence of words to a user; and

program code for replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word that is obtained from speech recognition of a new input speech sequence that only contains a representation of a correct version of said at least one selected word spoken by said user, wherein a recognition vocabulary used in said speech recognition of said new input speech sequence is limited to said set of word candidates associated with said at least one selected word.

22. A method for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, said method comprising:

presenting said sequence of words to a user; and

replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word that is obtained from a new input speech sequence, which only contains a representation of a correct version of said at least one selected word spoken by said user and a representation of said correct version of said at least one selected word spelled by said user.

23. A device for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, said device comprising:

means arranged for presenting said sequence of words to a user; and

means arranged for replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word that is obtained from a new input speech sequence, which only contains a representation of a correct version of said at least one selected word spoken by said user and a representation of said correct version of said at least one selected word spelled by said user.

24. The device according to claim 23, wherein said device is a portable multimedia device or a part thereof.

25. A software application product, comprising a storage medium having a software application embodied therein for correcting words in a sequence of words that is obtained from speech recognition of an input speech sequence, said software application comprising:

program code for presenting said sequence of words to a user; and

program code for replacing at least one word in said sequence of words, in case it has been selected by said user for correction, by a word that is obtained from a new input speech sequence, which only contains a representation of a correct version of said at least one selected word spoken by said user and a representation of said correct version of said at least one selected word spelled by said user.