Automatically improving a voice recognition system
First Claim
1. An automated method of monitoring recognition accuracy in a voice recognition system comprising:
- retrieving voice recognition information produced by a voice recognition system in response to recognizing a user utterance, the voice recognition information comprising a recognized voice command associated with the user utterance and a reference to an audio file that includes the user utterance;
playing the audio file;
determining if the recognized voice command matches the user utterance included in the audio file;
transcribing the user utterance to create a transcribed utterance, if the recognized voice command does not match the user utterance; and
recording the transcribed utterance in association with the recognized voice command to monitor recognition accuracy of the voice recognition system.
4 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for automatically improving a voice recognition system are provided. In one embodiment, the systems and methods retrieve voice recognition information produced by a voice recognition system in response to recognizing a user utterance. The voice recognition information comprises a recognized voice command associated with the user utterance and a reference to an audio file that includes the user utterance. The audio file is played and it is determined if the recognized voice command matches the user utterance included in the audio file. The user utterance is then transcribed to create a transcribed utterance, if the recognized voice command does not match the user utterance. The transcribed utterance is then recorded in association with the recognized voice command to monitor recognition accuracy.
-
Citations
60 Claims
-
1. An automated method of monitoring recognition accuracy in a voice recognition system comprising:
-
retrieving voice recognition information produced by a voice recognition system in response to recognizing a user utterance, the voice recognition information comprising a recognized voice command associated with the user utterance and a reference to an audio file that includes the user utterance;
playing the audio file;
determining if the recognized voice command matches the user utterance included in the audio file;
transcribing the user utterance to create a transcribed utterance, if the recognized voice command does not match the user utterance; and
recording the transcribed utterance in association with the recognized voice command to monitor recognition accuracy of the voice recognition system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system for monitoring recognition accuracy of a voice recognition system having at least one recognition grammar comprising:
-
software for retrieving voice recognition information stored in a call log by a voice recognition system in response to recognizing a user utterance, the voice recognition information comprising a recognized voice command associated with the user utterance and a reference to an audio file that includes the user utterance;
a transcription log produced by the software, the transcription log comprising an entry associated with the user utterance, the entry comprising;
the recognized voice command; and
a transcribed utterance produced from transcribing the user utterance, if the user utterance included in the audio file does not match the recognized voice command associated with it;
wherein the software determines a recognition accuracy for the voice recognition system by analyzing the entry recorded in the transcription log. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30)
-
-
31. A method for automatically improving a voice recognition system comprising:
-
determining voice recognition accuracy by analyzing voice recognition information produced by a voice recognition system in response to receiving a user utterance, the voice recognition system comprising a recognition grammar and a first configuration, the voice recognition information comprising a recognized voice command associated with the user utterance;
detecting a recognition error, if the recognized voice command does not match a transcribed utterance for the user utterance;
determining at least one source of error for the detected recognition error;
hypothesizing at least one solution to eliminate the source of error; and
modifying the first configuration based on the hypothesized solution to implement a second configuration for the voice recognition system with better recognition accuracy. - View Dependent Claims (32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49)
-
-
50. A method of improving recognition accuracy and efficiency in a voice recognition system having a grammar, wherein a received utterance is accepted if the utterance is an acoustic match with at least one term included in the grammar and rejected otherwise, the method comprising:
-
determining if the utterance has been falsely accepted by the voice recognition system; and
removing a term from the grammar, if the utterance is part of the grammar but is falsely accepted as another term included in the grammar due to acoustic similarity. - View Dependent Claims (51, 52, 53, 54, 55, 56, 57, 58, 59)
-
-
60. A method performed on a computer for monitoring recognition accuracy in a voice recognition system comprising:
-
recording a user utterance in an audio file;
storing a voice command which was recognized by the voice recognition system for the user utterance;
presenting the audio file and the voice command to an operator for selection;
playing the user utterance from the audio file for the operator upon selection by the operator;
receiving a transcription of the user utterance; and
associating the transcription with the recognized voice command.
-
Specification