Phonetic speech-to-text-to-speech system and method

• US 20070088547A1
• Filed: 10/16/2006
• Published: 04/19/2007
• Est. Priority Date: 10/11/2002
• Status: Abandoned Application

• Current Assignee: Twisted Sun Innovations Incorporated
• Original Assignee: Twisted Sun Innovations Incorporated
• Inventors: Freedman, Gordon
• Application Number:
  US11/580,884
• Publication Number:
  US 20070088547A1
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 19/0018 Speech coding using phonetic or linguistical decoding of the source; Reconstruction using text-to-speech synthesis
• CPC Class Codes: G10L 2015/025 Phonemes, fenemes or fenones being the recognition units

Abstract

A speech-to-text-to-speech for use with on-line and real time transmission of speech with a small bandwidth from a source to a destination. A speech is received and broken down to speechlets, which are encoded into series of symbols compatible with communication systems and other than a known symbolic representation of the speech in a known language for being transmitted through communication networks. When received, the series of symbols is decoded to restore the speechlets and for reconstituting a speech according to the speechlets prior to being communicated to a listening party.

Claims

1. A speech-to-text-to-speech system comprising:

a first input port for receiving a speech;

a first processor in communication with the first input port, the first processor for associating speechlets within the received speech and for encoding the speechlets into series of symbols compatible with communication systems, the series of symbols other than a known symbolic representation of the speech in a known language;

a first output port in connection with the first processor, the first output port for transmitting the series of symbols;

a second input port for receiving the series of symbols;

a second processor in communication with the second input port, the second processor for decoding the series of symbols to restore the speechlets and for reconstituting speech according to the speechlets; and

,

a second output port for providing a signal indicative of the reconstituted speech,

wherein the reconstituted speech is similar to the received speech.

2. A speech to text to speech system according to claim 1, comprising:

a transducer for communicating the reconstituted speech to a listening party.

3. A speech-to-text-to-speech system according to claim 2, comprising:

a first memory for storing a speechlet database therein, the speechlet database including at least one of all phonemes or samples relating to at least one language.

4. A speech-to-text-to-speech system according to claim 3, wherein:

the speechlet database includes variants associated with at least one phoneme of the language, the variants being at least indicative of at least one of a regional dialect and an emotion.

5. A speech-to-text-to-speech system according to claim 2, wherein:

the speechlet database includes pseudo-phonemes of at least one language.

6. A speech-to-text-to-speech system according to claim 5, wherein:

the pseudo-phonemes are derived to at least one of increase conversion speed into symbols, reduce processor power, facilitate dialects, and capture language nuances due to the speakers sex.

7. A speech-to-text-to-speech system according to claim 3, wherein:

the samples are derived by at least samples of speech by at least one known individual.

8. A speech-to-text-to-speech system according to claim 7, wherein:

the samples are cross-referenced to phonemes by at least one of teaching the first processor and stored rules, the symbols transmitted being those associated with the cross-referenced phonemes and not the samples.

9. A speech-to-text-to-speech system according to claim 3, further comprising:

a second memory for storing at least a look-up table therein, the look-up table including symbols representative of the speechlets for encoding the speechlets into series of symbols compatible with communication systems and other than a known symbolic representation of the speech in a known language.

10. A speech-to-text-to-speech system according to claim 2, wherein:

the second processor comprises a voice generator for generating a signal, the signal, when provided to a speaker for resulting in the reconstituted speech.

11. A speech-to-text-to-speech system according to claim 3, wherein:

the speechlet database includes variants of at least one phoneme, each variant being associated with a different individual and allowing identification of the individual during the encoding of speechlets.

12. A speech-to-text-to-speech system according to claim 11, wherein:

the identification of the individual is transmitted along with the symbols and modifies the reconstituted speech generated by the second processor.

13. A speech-to-text-to-speech system according to claim 11, wherein:

the identification of the individual is transmitted along with the symbols and at least one of determines and grants access to a third memory, the third memory for storing voice profiles of speakers for personalizing the reconstituted speech when generated.

14. A speech-to-text-to-speech system according to claim 2, wherein:

the first processor additionally comprises a sound analyzer for identifying at least one of a pitch, a speed and a tone with which a speechlet is spoken and for associating intonation values indicative of the at least one of pitch, speed and tone relative to the speech.

15. A speech-to-text-to-speech system according to claim 14, wherein:

the intonation values are also transmitted.

16. A speech-to-text-to-speech system according to claim 15, wherein:

the intonation values are employed by the second processor in reconstituting the speech.

17. A speech-to-text-to-speech system according to claim 14, wherein:

the intonation values are employed by the second processor in establishing which one of a plurality of stored speechlet databases to employ in reconstituting the speech.

18. A speech-to-text-to-speech system according to claim 2, wherein:

the first output port and the second input port are network connections for coupling with a wide area network.

19. A speech-to-text-to-speech system according to claim 18, wherein:

the second output port comprises a speaker.

20. A method of transmitting a speech on-line comprising the steps of:

providing speech;

identifying speechlets within the received speech;

encoding the speechlets into series of symbols compatible with a communication system, the series of symbols other than a known symbolic representation of the speech in a known language;

transmitting the series of symbols via a communication medium;

receiving the series of symbols;

decoding the series of symbols to provide a signal representative of the speech and including data reflective of the speechlets reconstituted to form reconstituted speech similar to the received speech.

21. A method according to claim 20, further comprising the steps of:

reconstituting a speech according to the signal; and

,

communicating the reconstituted speech to a listening party.

22. The method according to claim 21, wherein:

the step of providing a speech comprises the step of speaking into a microphone.

23. The method according to claim 21, wherein:

the step of communicating the reconstituted speech to a listening party comprises the step of providing the reconstituted speech to at least a speaker.

24. The method according to claim 21, wherein:

the step of encoding the speechlets into series of symbols comprises the steps of;

identifying a language of the speech;

selecting from a phonetic database a look-up table from a plurality of different look-up tables and associated with the identified language;

providing with a symbolic representation of the identified speechlets in accordance with the selected look-up table.

25. The method according to claim 20, wherein:

identifying the language of the speech is by at least one of spoken word, a user interaction with the system other than speech, and a sound analyzer.

26. A method according to claim 25, wherein:

the sound analyzer is for identifying at least one of a pitch, a speed and a tone with which at least a predetermined speechlet is spoken and for associating at least one of the language spoken and intonation values with the analysed at least a predetermined speechlet, the intonation values indicative of the at least one of pitch, speed and tone relative to the speech.

27. The method according to claim 24, wherein:

the step of decoding the series of symbols to restore the speechlets comprises the steps of;

identifying the language of the provided speech;

selecting from a phonetic database a look-up table from a plurality of different look-up tables and associated with the identified language;

providing with a phonetic representation of the series of symbols in accordance with the selected look-up table.

28. A method according to claim 27, wherein:

the provided phonetic representations are modified according to a least an intonation value, the at least an intonation value indicative of at least one of pitch, speed and tone of the speech as determined when encoding the speechlets and transmitted in association with the series of symbols.

29. The method according to claim 21, wherein:

the step of transmitting the series of symbols comprises the step of attaching the selected look-up table to the series of symbols.

30. The method according to claim 29, wherein:

the step of decoding the speechlets into series of symbols comprises the step of using the look-up table attached to the transmitted series of symbols.

31. The method according to claim 21, wherein:

the step of identifying speechlets within the received speech comprises the steps of;

characterizing at least one voice related parameter; and

,

encoding a value indicative of the at least a voice related parameter in association with one or more speechlets.

32. The method according to claim 21, wherein:

the step of communicating the reconstituted speech to a listening party comprises the steps of;

identifying a speaker;

retrieving from a memory a voice profile of the speaker previously stored therein; and

,

reconstituting the speech using the retrieved voice profile.

33. The method according to claim 21, wherein:

the communication medium includes the Internet.

34. A speech-to-text-to-speech system comprising:

means for providing speech;

means for identifying speechlets within the received speech;

means for encoding the speechlets into series of symbols compatible with a communication system, the series of symbols other than a known symbolic representation of the speech in a known language;

means for transmitting the series of symbols via a communication medium;

means for receiving the series of symbols;

means for decoding the series of symbols to provide a signal representative of the speech and including data reflective of the speechlets reconstituted to form reconstituted speech similar to the received speech.