Method, Apparatus and Computer Program Product for Providing a Language Based Interactive Multimedia System

• US 20080126093A1
• Filed: 11/28/2006
• Published: 05/29/2008
• Est. Priority Date: 11/28/2006
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Sivadas, Sunil
• Application Number:
  US11/563,829
• Publication Number:
  US 20080126093A1
• Time in Patent Office: Days
• US Class Current: 704/254
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/187 Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams

Abstract

An apparatus for providing a language based interactive multimedia system includes a selection element, a comparison element and a processing element. The selection element may be configured to select a phoneme graph based on a type of speech processing associated with an input sequence of phonemes. The comparison element may be configured to compare the input sequence of phonemes to the selected phoneme graph. The processing element may be in communication with the comparison element and configured to process the input sequence of phonemes based on the comparison.

Claims

1. A method comprising:

selecting a phoneme graph based on a type of speech processing associated with an input sequence of phonemes;

comparing the input sequence of phonemes to the selected phoneme graph; and

processing the input sequence of phonemes based on the comparison.

2. A method according to claim 1, wherein selecting the phoneme graph comprises selecting one of a first phoneme graph corresponding to the input sequence of phonemes being received from an automatic speech recognition element or a second phoneme graph corresponding to the input sequence of phonemes being received from a text-to-speech element.

3. A method according to claim 2, wherein selecting the phoneme graph further comprises selecting the second phoneme graph including metadata related to prosody information, duration, and speaker characteristics.

4. A method according to claim 3, further comprising determining a language associated with the input sequence of phonemes.

5. A method according to claim 4, wherein selecting the phoneme graph further comprises selecting a phoneme graph corresponding to the determined language.

6. A method according to claim 1, wherein selecting the phoneme graph further comprises selecting a single phoneme graph that corresponds to a plurality of languages.

7. A method according to claim 1, wherein processing the input sequence of phonemes comprises modifying the input sequence of phonemes based on the selected phoneme graph to improve a quality measure of the modified input sequence of phonemes.

8. A method according to claim 7, wherein processing the input sequence of phonemes further comprises modifying the input sequence of phonemes based on the selected phoneme graph to increase a probability measure of the modified input sequence of phonemes.

9. A method according to claim 7, wherein processing the input sequence of phonemes further comprises modifying the input sequence of phonemes based on the selected phoneme graph to decrease a distortion measure of the modified input sequence of phonemes.

10. A computer program product comprising at least one computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

a first executable portion for selecting a phoneme graph based on a type of speech processing associated with an input sequence of phonemes;

a second executable portion for comparing the input sequence of phonemes to the selected phoneme graph; and

a third executable portion for processing the input sequence of phonemes based on the comparison.

11. A computer program product according to claim 10, wherein the first executable portion includes instructions for selecting one of a first phoneme graph corresponding to the input sequence of phonemes being received from an automatic speech recognition element or a second phoneme graph corresponding to the input sequence of phonemes being received from a text-to-speech element.

12. A computer program product according to claim 11, wherein the first executable portion includes instructions for selecting the second phoneme graph including metadata related to prosody information, duration, and speaker characteristics.

13. A computer program product according to claim 12, further comprising a fourth executable portion for determining a language associated with the input sequence of phonemes.

14. A computer program product according to claim 13, wherein the first executable portion includes instructions for selecting a phoneme graph corresponding to the determined language.

15. A computer program product according to claim 10, wherein the first executable portion includes instructions for selecting a single phoneme graph that corresponds to a plurality of languages.

16. A computer program product according to claim 10, wherein the third executable portion includes instructions for modifying the input sequence of phonemes based on the selected phoneme graph to improve a quality measure of the modified input sequence of phonemes.

17. A computer program product according to claim 16, wherein the third executable portion includes instructions for modifying the input sequence of phonemes based on the selected phoneme graph to increase a probability measure of the modified input sequence of phonemes.

18. A computer program product according to claim 16, wherein the third executable portion includes instructions for modifying the input sequence of phonemes based on the selected phoneme graph to decrease a distortion measure of the modified input sequence of phonemes.

19. An apparatus comprising:

a selection element configured to select a phoneme graph based on a type of speech processing associated with an input sequence of phonemes;

a comparison element configured to compare the input sequence of phonemes to the selected phoneme graph; and

a processing element in communication with the comparison element and configured to process the input sequence of phonemes based on the comparison.

20. An apparatus according to claim 19, wherein the selection element is further configured to select one of a first phoneme graph corresponding to the input sequence of phonemes being received from an automatic speech recognition element or a second phoneme graph corresponding to the input sequence of phonemes being received from a text-to-speech element.

21. An apparatus according to claim 20, wherein the selection element is further configured to select the second phoneme graph including metadata related to prosody information, duration, and speaker characteristics.

22. An apparatus according to claim 21, further comprising a language identification element for determining a language associated with the input sequence of phonemes.

23. An apparatus according to claim 22, wherein the selection element is further configured to select a phoneme graph corresponding to the determined language.

24. An apparatus according to claim 19, wherein the selection element is further configured to select a single phoneme graph that corresponds to a plurality of languages.

25. An apparatus according to claim 19, wherein the processing element is further configured to modify the input sequence of phonemes based on the selected phoneme graph to improve a quality measure of the modified input sequence of phonemes.

26. An apparatus according to claim 25, wherein the processing element is further configured to modify the input sequence of phonemes based on the selected phoneme graph to increase a probability measure of the modified input sequence of phonemes.

27. An apparatus according to claim 25, wherein the processing element is further configured to modify the input sequence of phonemes based on the selected phoneme graph to decrease a distortion measure of the modified input sequence of phonemes.

28. An apparatus according to claim 19, wherein the apparatus is embodied as a mobile terminal.

29. An apparatus comprising:

means for selecting a phoneme graph based on a type of speech processing associated with an input sequence of phonemes;

means for comparing the input sequence of phonemes to the selected phoneme graph; and

means for processing the input sequence of phonemes based on the comparison.

30. An apparatus according to claim 29, wherein the means for selecting the phoneme graph further comprises means for selecting one of a first phoneme graph corresponding to the input sequence of phonemes being received from an automatic speech recognition element or a second phoneme graph corresponding to the input sequence of phonemes being received from a text-to-speech element.