System and method for Mandarin Chinese speech recognition using an optimized phone set

• US 7,353,173 B2
• Filed: 03/31/2003
• Issued: 04/01/2008
• Est. Priority Date: 07/11/2002
• Status: Expired due to Fees

• Current Assignee: Ironworks Patents LLC, Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Lu, Jingwen, Olorenshaw, Lex, Menendez-Pidal, Xavier, Duan, Lei
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): Siedler, Dorothy S
• Application Number:
  US10/403,642
• Publication Number:
  US 20040010405A1
• Time in Patent Office: 1,828 Days
• Field of Search: 704/251, 704/253, 704/254, 704/256.1, 704/256.2
• US Class Current: 704/254
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 2015/025 Phonemes, fenemes or fenones being the recognition units

Abstract

The present invention comprises a system and method for implementing a Mandarin Chinese speech recognizer with an optimized phone set, and may include a recognizer configured to compare input speech data to phone strings from a vocabulary dictionary that is implemented according to an optimized Mandarin Chinese phone set. The optimized Mandarin Chinese phone set may be implemented with a phonetic technique to separately include consonantal phones and vocalic phones. For reasons of system efficiency, the optimized Mandarin Chinese phone set may preferably be implemented in a compact manner to include only a minimum required number of consonantal phones and vocalic phones to accurately represent Mandarin Chinese speech during the speech recognition procedure.

Claims

1. A system for performing a Mandarin Chinese speech recognition procedure with an electronic device, comprising:

a recognizer configured to compare input speech data to phone strings from a vocabulary dictionary to thereby generate and output one or more recognized words from said vocabulary dictionary, said vocabulary dictionary being implemented according to an optimized phone set, said optimized phone set being implemented with a phonetic technique to separately provide consonantal phones and vocalic phones, one or more of said phone strings including more than two phones from said consonantal phones and said vocalic phones, said optimized phone set being implemented in a compact manner to include only a minimum required number of said consonantal phones and said vocalic phones, said optimized phone set representing sounds of a Mandarin Chinese language without utilizing corresponding tonal information as part of different phones in said optimized phone set, said recognizer thus performing said Mandarin Chinese speech recognition procedure without utilizing any type of tone data to thereby output said one or more recognized words as a final speech recognition result; and

a processor configured to control said recognizer to thereby perform said Mandarin Chinese speech recognition procedure.

2. The system of claim 1 wherein said input speech data includes Mandarin Chinese language data, said optimized phone set being compactly configured to accurately represent said Mandarin Chinese language data.

3. The system of claim 1 wherein said recognizer and said processor are implemented as part of a consumer electronics device.

4. The system of claim 1 wherein said optimized phone set conserves processing resources and memory resources while performing said speech recognition procedure.

5. The system of claim 1 wherein said optimized phone set reduces training requirements for performing a recognizer training procedure to initially implement said recognizer.

6. The system of claim 1 wherein said phone strings each include a different series of phones from said optimized phone set, each of said phone strings corresponding to a different word from said vocabulary dictionary.

7. The system of claim 6 wherein said recognizer compares said input speech data to Hidden Markov Models for said phone strings from said vocabulary dictionary to thereby select said one or more recognized words during said speech recognition procedure.

8. The system of claim 1 wherein said optimized phone set includes phones b, p, d, t, g, k, z, c, zh, ch, j, q, f, s, sh, x, h, m, n, ng, l, r, y, w, a, e, o, i, u, yu, ai, ei, ao, and ou.

9. The system of claim 1 wherein said optimized phone set includes consonantal phones b, p, d, t, g, k, z, c, zh, ch, j, q, f, s, sh, x, h, m, n, ng, l, r, y, and w.

10. The system of claim 1 wherein said optimized phone set includes a closure phone “

cl”

.

11. The system of claim 1 wherein said optimized phone set includes vocalic phones a, e, o, i, u, yu, ai, ei, ao, and ou.

12. The system of claim 1 wherein said optimized phone set represents certain diphthongs by utilizing unified diphthong phones to thereby conserve processing resources and memory resources while providing greater accuracy characteristics for said speech recognition procedure.

13. The system of claim 12 wherein said optimized phone set includes unified diphthong phones ai, ei, ao, and ou.

14. The system of claim 1 wherein said optimized phone set includes a stops category that includes separate phones for b, p, d, t, g, and k.

15. The system of claim 1 wherein said optimized phone set includes a affricates category that includes separate phones for z, c, zh, ch, j, and q.

16. The system of claim 1 wherein said optimized phone set includes a fricatives category that includes separate phones for f, s, sh, x, and h.

17. The system of claim 1 wherein said optimized phone set includes an approximants category that includes separate phones for l, r, y, w, and yu.

18. The system of claim 1 wherein said optimized phone set includes a nasals category that includes separate phones for m, n, and ng.

19. The system of claim 1 wherein said consonantal phones and said vocalic phones from said optimized phone set are combined to represent syllables from a Mandarin Chinese language system.

41. The system of claim 1 wherein said optimized phone set includes only phones b, p, d, t, g, k, z, c, zh, ch, j, q, f, s, sh, x, h, m, n, ng, l, r, y, w, a, e, o, i, u, yu, ai, ei, ao, and ou.

20. A method for performing a Mandarin Chinese speech recognition procedure with an electronic device, comprising the steps of:

configuring a recognizer to compare input speech data to phone strings from a vocabulary dictionary to thereby generate and output one or more recognized words from said vocabulary dictionary, said vocabulary dictionary being implemented according to an optimized phone set, said optimized phone set being implemented with a phonetic technique to separately provide consonantal phones and vocalic phones, one or more of said phone strings including more than two phones from said consonantal phones and said vocalic phones, said optimized phone set being implemented in a compact manner to include only a minimum required number of said consonantal phones and said vocalic phones, said optimized phone set representing sounds of a Mandarin Chinese language without utilizing corresponding tonal information as part of different phones in said optimized phone set, said recognizer thus performing said Mandarin Chinese speech recognition procedure without utilizing any type of tone data to thereby output said one or more recognized words as a final speech recognition result; and

controlling said recognizer with a processor to thereby perform said Mandarin Chinese speech recognition procedure.

21. The method of claim 20 wherein said input speech data includes Mandarin Chinese language data, said optimized phone set being compactly configured to accurately represent said Mandarin Chinese language data.

22. The method of claim 20 wherein said recognizer and said processor are implemented as part of a consumer electronics device.

23. The method of claim 20 wherein said optimized phone set conserves processing resources and memory resources while performing said speech recognition procedure.

24. The method of claim 20 wherein said optimized phone set reduces training requirements for performing a recognizer training procedure to initially implement said recognizer.

25. The method of claim 20 wherein said phone strings each include a different series of phones from said optimized phone set, each of said phone strings corresponding to a different word from said vocabulary dictionary.

26. The method of claim 25 wherein said recognizer compares said input speech data to Hidden Markov Models for said phone strings from said vocabulary dictionary to thereby select said one or more recognized words during said speech recognition procedure.

27. The method of claim 20 wherein said optimized phone set includes phones b, p, d, t, g, k, z, c, zh, ch, j, q, f, s, sh, x, h, m, n, ng, l, r, y, w, a, e, o, i, u, yu, ai, ei, ao, and ou.

28. The method of claim 20 wherein said optimized phone set includes consonantal phones b, p, d, t, g, k, z, c, zh, ch, j, q, f, s, sh, x, h, m, n, ng, l, r, y, and w.

29. The method of claim 20 wherein said optimized phone set includes a closure phone “

cl”

.

30. The method of claim 20 wherein said optimized phone set includes vocalic phones a, e, o, i, u, yu, ai, ei, ao, and ou.

31. The method of claim 20 wherein said optimized phone set represents certain diphthongs by utilizing unified diphthong phones to thereby conserve processing r&

sources and memory resources while providing greater accuracy characteristics for said speech recognition procedure.

32. The method of claim 31 wherein said optimized phone set includes unified diphthong phones ai, ei, ao, and ou.

33. The method of claim 20 wherein said optimized phone set includes a stops category that includes separate phones for b, p, d, t, g, and k.

34. The method of claim 20 wherein said optimized phone set includes a aifricates category that includes separate phones for z, c, zh, ch, j, and q.

35. The method of claim 20 wherein said optimized phone set includes a fricatives category that includes separate phones for f, s, sh, x, and h.

36. The method of claim 20 wherein said optimized phone set includes an approximants category that includes separate phones for l, r, y, w, and yu.

37. The method of claim 20 wherein said optimized phone set includes a nasals category that includes separate phones for m, n, and ng.

38. The method of claim 20 wherein said consonantal phones and said vocalic phones from said optimized phone set are combined to represent syllables from a Mandarin Chinese language system.

39. A computer-readable medium encoded with a computer program for performing a Mandarin Chinese speech recognition procedure, by performing the steps of:

configuring a recognizer to compare input speech data to phone strings from a vocabulary dictionary to thereby generate and output one or more recognized words from said vocabulary dictionary, said vocabulary dictionary being implemented according to an optimized phone set, said optimized phone set being implemented with a phonetic technique to separately provide consonantal phones and vocalic phones, one or more of said phone strings including more than two phones from said consonantal phones and said vocalic phones, said optimized phone set being implemented in a compact manner to include only a minimum required number of said consonantal phones and said vocalic phones, said optimized phone set representing sounds of a Mandarin Chinese language without utilizing corresponding tonal information as part of different phones in said optimized phone set, said recognizer thus performing said Mandarin Chinese speech recognition procedure without utilizing any type of tone data to thereby output said one or more recognized words as a final speech recognition result; and

controlling said recognizer with a processor to thereby perform said Mandarin Chinese speech recognition procedure.

40. A system for performing a Mandarin Chinese speech recognition procedure with an electronic device, comprising:

means for comparing input speech data to phone strings from a vocabulary dictionary to thereby generate and output one or more recognized words from said vocabulary dictionary, said vocabulary dictionary being implemented according to an optimized phone set, said optimized phone set being implemented with a phonetic technique to separately provide consonantal phones and vocalic phones, one or more of said phone strings including more than two phones from said consonantal phones and said vocalic phones, said optimized phone set being implemented in a compact manner to include only a minimum required number of said consonantal phones and said vocalic phones, said optimized phone set representing sounds of a Mandarin Chinese language without utilizing corresponding tonal information as part of different phones in said optimized phone set, said means for comparing thus performing said Mandarin Chinese speech recognition procedure without utilizing any type of tone data to thereby output said one or more recognized words as a final speech recognition result; and

means for controlling said means for comparing to thereby perform said Mandarin Chinese speech recognition procedure.