Multi-space distribution for pattern recognition based on mixed continuous and discrete observations

• US 20080120108A1
• Filed: 11/16/2006
• Published: 05/22/2008
• Est. Priority Date: 11/16/2006
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Soong, Frank Kao-Ping, Qian, Yao
• Application Number:
  US11/600,381
• Publication Number:
  US 20080120108A1
• Time in Patent Office: Days
• US Class Current: 704/254
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06V 30/287 of Kanji, Hiragana or Katakana characters

Abstract

Performing speech recognition on a tonal language is done using a plurality of tonal models. Each tonal model has a multi-space distribution and corresponds to a known syllable in a language. A first data stream indicative of an observation of an utterance is received. The observation has both a discrete and a continuous tonal feature. A second data stream indicative of spectral features of a syllable of an utterance is also received. The first data stream is compared against at least one of the plurality of tonal models and the second data stream is compared against a spectral model.

Claims

1. A method of performing speech recognition on a tonal language, comprising:

obtaining a datastore on a tangible medium including a plurality of tonal models each having a multi-space distribution, wherein each tonal model corresponds to a known syllable in a language;

receiving a first data stream indicative of an observation of an utterance having a discrete tonal feature and a continuous tonal feature and a second data stream indicative of spectral features of a syllable of the utterance; and

outputting a recognition result by;

comparing the first data stream against at least one of the plurality of tonal models; and

comparing a portion of the second data stream against a spectral model.

2. The method of claim 1, wherein the step of obtaining one of the plurality of tonal models comprises:

receiving one or more data streams each indicative of an observation of an utterance of a known syllable; and

creating a probability distribution function describing a fundamental frequency of a tonal feature of the one or more data streams.

3. The method of claim 2, wherein the known syllable has an unvoiced phoneme.

4. The method of claim 2, wherein the step of creating a probability distribution function includes mixing more than one Gaussian distribution.

5. The method of claim 1, wherein creating the plurality of tonal models comprises:

partitioning each known syllable into one or more phonemes; and

creating a tonal model for each of the one or more phonemes.

6. The method of claim 5, wherein the step of creating a tonal model for each of the one or more phonemes comprises:

partitioning each phoneme into more than one state; and

creating a tonal model for each of the more than one states.

7. The method of claim 6, wherein comparing a portion of the first data stream against at least one of the plurality of tonal models and comparing a portion of the second data stream with spectral models are tied together.

8. A method of generating a tonal model for modeling tonal features of an utterance, comprising:

creating a plurality of tonal models each having a multi-space distribution, wherein each tonal model corresponds to a known syllable in a language, the plurality of tonal models being configured such that they can be compared against tonal features in an utterance to be recognized.

9. The method of claim 8, wherein the step of creating a tonal model for each syllable comprises:

partitioning each syllable into one or more phonemes; and

creating a tonal model for each of the one or more phonemes.

10. The method of claim 9, wherein the step of creating a tonal model for each of the one or more phonemes comprises:

partitioning each phoneme into more than one state; and

creating a tonal model for each of the more than one states.

11. The method of claim 8 wherein the step of creating a tonal model comprises:

creating a zero dimensional sub-space indicative of the probability of an unvoiced component; and

creating a one dimensional sub-space indicative of the probability of a voiced component.

12. The method of claim 11, wherein the step of creating the one dimensional sub-space comprises:

providing a signal indicative of a probability distribution function indicative of a tone for a particular syllable.

13. The method of claim 12, wherein the probability distribution function is based upon the analysis of a training data corpus of utterances of the particular syllable provided by a plurality of individuals.

14. The method of claim 13, wherein each of the plurality of individuals are from the same gender.

15. The method of claim 12, wherein the probability distribution function is based upon the analysis of a training data corpus of utterances of the particular syllable provided by a single individual.

16. A system for recognizing an observed pattern having both a continuous and discrete component, comprising:

a database including a plurality of models each having a multi-space distribution, wherein each model corresponds to a known pattern that can be recognized;

an interface configured to receive a signal indicative of an observed pattern; and

an analyzer configured to compare the signal against one or more of the plurality of models.

17. The system of claim 16, wherein the observed pattern includes one or more handwritten characters.

18. The system of claim 16, wherein the observed pattern is an utterance of speech.

19. The system of claim 18, wherein the interface is configured to receive a signal indicative of a tonal feature of the utterance.

20. The system of claim 19, wherein the tonal model includes a first subspace and a second subspace wherein at least one of the first and second subspaces is a one-dimensional subspace.