System and method for improving robustness of speech recognition using vocal tract length normalization codebooks

• US 8,600,744 B2
• Filed: 04/13/2012
• Issued: 12/03/2013
• Est. Priority Date: 06/20/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Gilbert, Mazin
• Primary Examiner(s): AZAD, ABUL K
• Application Number:
  US13/446,329
• Publication Number:
  US 20120203547A1
• Time in Patent Office: 599 Days
• Field of Search: 704200-257
• US Class Current: 704/234
• CPC Class Codes: G10L 15/07 to the speaker

Abstract

Disclosed are systems, methods, and computer readable media for performing speech recognition. The method embodiment comprises selecting a codebook from a plurality of codebooks with a minimal acoustic distance to a received speech sample, the plurality of codebooks generated by a process of (a) computing a vocal tract length for a each of a plurality of speakers, (b) for each of the plurality of speakers, clustering speech vectors, and (c) creating a codebook for each speaker, the codebook containing entries for the respective speaker'"'"'s vocal tract length, speech vectors, and an optional vector weight for each speech vector, (2) applying the respective vocal tract length associated with the selected codebook to normalize the received speech sample for use in speech recognition, and (3) recognizing the received speech sample based on the respective vocal tract length associated with the selected codebook.

Claims

1. A method comprising:

estimating, based on a voice sample from a user, a vocal tract length;

generating, via a processor, a codebook comprising the vocal tract length;

receiving an utterance from the user;

adjusting the codebook based on environmental conditions, to yield a modified codebook;

normalizing the utterance using the modified codebook, to yield a normalized utterance; and

recognizing the utterance using the normalized utterance.

2. The method of claim 1, wherein the codebook further comprises a speech vector.

3. The method of claim 2, wherein the speech vector further comprises a weight.

4. The method of claim 1, wherein normalizing the utterance using the codebook comprises modifying the utterance based on a difference in the vocal tract length and a detected vocal tract length of the utterance.

5. The method of claim 1, further comprising modifying the codebook upon receiving additional voice samples.

6. The method of claim 1, wherein recognizing the utterance using the normalized utterance occurs in real time.

7. The method of claim 1, further comprising inserting the codebook into a plurality of codebooks.

8. A system comprising:

a processor; and

a computer-readable storage device having instructions stored which, when executed on the processor, perform operations comprising;

estimating, based on a voice sample from a user, a vocal tract length;

generating a codebook comprising the vocal tract length;

receiving an utterance from the user;

adjusting the codebook based on environmental conditions, to yield a modified codebook;

normalizing the utterance using the modified codebook, to yield a normalized utterance; and

recognizing the utterance using the normalized utterance.

9. The system of claim 8, wherein the codebook further comprises a speech vector.

10. The system of claim 9, wherein the speech vector further comprises a weight.

11. The system of claim 8, wherein normalizing the utterance using the codebook comprises modifying the utterance based on a difference in the vocal tract length and a detected vocal tract length of the utterance.

12. The system of claim 8, the computer-readable storage device having additional instructions stored which result in the operations further comprising modifying the codebook upon receiving additional voice samples.

13. The system of claim 8, wherein recognizing the utterance using the normalized utterance occurs in real time.

14. The system of claim 8, the computer-readable storage device having additional instructions stored which result in the operations further inserting the codebook into a plurality of codebooks.

15. A computer-readable storage device having instructions stored which, when executed on a computing device, cause the computing device to perform operations comprising:

estimating, based on a voice sample from a user, a vocal tract length;

generating a codebook comprising the vocal tract length;

receiving an utterance from the user;

adjusting the codebook based on environmental conditions, to yield a modified codebook;

normalizing the utterance using the modified codebook, to yield a normalized utterance; and

recognizing the utterance using the normalized utterance.

16. The computer-readable storage device of claim 15, wherein the codebook further comprises a speech vector.

17. The computer-readable storage device of claim 16, wherein the speech vector further comprises a weight.

18. The computer-readable storage device of claim 15, wherein normalizing the utterance using the codebook comprises modifying the utterance based on a difference in the vocal tract length and a detected vocal tract length of the utterance.

19. The computer-readable storage device of claim 15, the computer-readable storage device having additional instructions stored which result in the operations further comprising modifying the codebook upon receiving additional voice samples.

20. The computer-readable storage device of claim 15, wherein recognizing the utterance using the normalized utterance occurs in real time.