Voice quality control for high quality speech reconstruction

• US 20070129945A1
• Filed: 12/06/2005
• Published: 06/07/2007
• Est. Priority Date: 12/06/2005
• Status: Abandoned Application

• Current Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Ma, Changxue, Cheng, Yan, Ramabadran, Tenkasi, Nowlan, Steven
• Application Number:
  US11/294,959
• Publication Number:
  US 20070129945A1
• Time in Patent Office: Days
• US Class Current: 704/254
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 25/69 for evaluating synthetic or decoded voice signals

Abstract

A method and apparatus are provided for reproducing a speech sequence of a user through a communication device of the user. The method includes the steps of detecting a speech sequence from the user through the communication device, recognizing a phoneme sequence within the detected speech sequence and forming a confidence level of each phoneme within the recognized phoneme sequence. The method further includes the steps of audibly reproducing the recognized phoneme sequence for the user through the communication device and gradually highlighting or degrading a voice quality of at least some phonemes of the recognized phoneme sequence based upon the formed confidence level of the at least some phonemes.

Claims

1. A method of reproducing a speech sequence of a user through a communication device of the user comprising:

detecting a speech sequence from the user through the communication device;

recognizing a phoneme sequence within the detected speech sequence;

forming a confidence level of each phoneme within the recognized phoneme sequence;

audibly reproducing the recognized phoneme sequence for the user through the communication device; and

gradually highlighting or degrading a voice quality of at least some phonemes of the recognized phoneme sequence based upon the formed confidence level of the at least some phonemes.

2. The method of reproducing the speech sequence as in claim 1 further comprising reproducing the recognized phoneme sequence from a voice quality table.

3. The method of reproducing the speech sequence as in claim 1 further comprising generating the formed confidence level of the recognized phoneme from a voice quality table.

4. The method of reproducing the speech sequence as in claim 2 further comprising selecting a plurality of entries from the voice quality table to represent each phoneme of the recognized phoneme sequence.

5. The method of reproducing the speech sequence as in claim 4 wherein the step of gradually highlighting or degrading the voice quality further comprises limiting the selected entries of the voice quality table to the most frequently used entries in direct proportion to the formed confidence level.

6. The method of reproducing the speech sequence as in claim 1 further comprising comparing the formed confidence level of at least some phonemes of the phoneme sequence with a first threshold value and, when the formed confidence level of the at least some phonemes exceed the first threshold, matching the at least some phonemes with phonemes of a model phoneme dictionary and audibly reproducing the respective matched model phonemes in place of the at least some phonemes.

7. The method of reproducing the speech sequence as in claim 2 further comprising comparing the formed confidence level of at least some phonemes of the phoneme sequence with a second threshold value and when the formed confidence level of the at least some phonemes exceed the second threshold expanding a reproduction time of the audibly reproduced at least some phonemes.

8. The method of reproducing the speech sequence as in claim 1 wherein the step of detecting the speech sequence further comprises converting the detected speech sequence into a set of Mel Frequency Cepstral Coefficients(MFCC) vectors, where each phoneme of the recognized phoneme sequence is represented by the set of MFCC vectors.

9. The method of reproducing the speech sequence as in claim 8 further comprising recognizing the speech sequence using a Hidden Markov Model.

10. The method of reproducing the speech sequence as in claim 9 further comprising comparing training a database of the Hidden Markov Model to associate MFCC vectors of the user with phonemes of a model phoneme dictionary.

17. The communication device as in claim 10 wherein the step of detecting the speech sequence further comprises a set of Mel Frequency Cepstral Coefficients (MFCC) vectors into which the detected speech sequence is converted.

18. The communication device as in claim 17 wherein the HMM processor further comprises a Hidden Markov Model.

19. The communication device as in claim 18 further comprising a database of the Hidden Markov Model that is trained to associate MFCC vectors of the user with phonemes of a model phoneme dictionary.

20. The communication device as in claim 18 further comprising a cellular telephone.

11. A communication device that reproducing a speech sequence of a user comprising:

a speech detector that detects a speech sequence from the user;

a Hidden Markov Model (HMM) processor that recognizes a phoneme sequence within the detected speech sequence;

a confidence processor that forms a confidence level of each phoneme within the recognized phoneme sequence;

a reproduction processor that audibly reproduces the recognized phoneme sequence for the user through a speaker of the communication device; and

a phoneme processor that gradually highlights a voice quality of at least some phonemes of the recognized phoneme sequence based upon the formed confidence level of the at least some phonemes.

12. The communication device as in claim 11 further comprising a voice quality table from which the recognized phoneme sequence are reproduced.

13. The communication device as in claim 12 further comprising a plurality of code word entries selected from the voice quality table to represent each phoneme of the recognized phoneme sequence.

14. The communication device as in claim 13 wherein the plurality of code word entries further comprises a plurality of most frequently used entries to which reproduction is limited in direct proportion to the formed confidence level.

15. The communication device as in claim 11 further comprising a first threshold level that is compared with the formed confidence level of at least some phonemes of the phoneme sequence and, when the formed confidence level of the at least some phonemes exceeds the first threshold, the at least some phonemes are matched with phonemes of a model phoneme dictionary and the respective matched model phonemes are reproduced in place of the at least some phonemes.

16. The communication device as in claim 12 further comprising a second threshold level that is comparing with the formed confidence level of at least some phonemes of the phoneme sequence with a second threshold value and when the formed confidence level of the at least some phonemes exceeds the second threshold, a reproduction time of the audibly reproduced at least some phonemes is expanded.