Voice and text communication system, method and apparatus

• US 9,940,923 B2
• Filed: 12/28/2015
• Issued: 04/10/2018
• Est. Priority Date: 07/31/2006
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Molloy, Stephen, El-Maleh, Khaled Helmi
• Primary Examiner(s): Serrou, Abdelali
• Application Number:
  US14/981,298
• Publication Number:
  US 20160111082A1
• Time in Patent Office: 834 Days
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/027 Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 21/0208 Noise filtering

Abstract

The disclosure relates to systems, methods and apparatus to convert speech to text and vice versa. One apparatus comprises a vocoder, a speech to text conversion engine, a text to speech conversion engine, and a user interface. The vocoder is operable to convert speech signals into packets and convert packets into speech signals. The speech to text conversion engine is operable to convert speech to text. The text to speech conversion engine is operable to convert text to speech. The user interface is operable to receive a user selection of a mode from among a plurality of modes, wherein a first mode enables the speech to text conversion engine, a second mode enables the text to speech conversion engine, and a third mode enables the speech to text conversion engine and the text to speech conversion engine.

Claims

1. An apparatus for wireless communications, said apparatus comprising:

a module configured to, when a mobile communications device has been set to a first mode in which said mobile communications device accepts text input instead of speech input, receive text that has been entered by a user of said mobile communications device and to convert the received text to a synthesized speech signal during a call in which a second communications device is configured to receive speech packets, wherein said mobile communications device is settable to a second mode in which said mobile communications device accepts speech input instead of text input;

a vocoder configured to encode the synthesized speech signal to produce a plurality of corresponding speech packets; and

a transceiver configured to transmit the plurality of corresponding speech packets over a wireless communications link to said second communications device,

wherein said module includes a voice synthesizer configured to store characteristics of a voice of the user and to use said stored characteristics to produce the synthesized speech signal,

wherein said apparatus is configured to transmit, via said transceiver, an audio notification informing said second communications device that speech from said mobile communications device following said audio notification will be converted from text, and

wherein said apparatus is configured to transmit said audio notification prior to transmitting said plurality of corresponding speech packets.

2. The apparatus according to claim 1, wherein said module includes a text-to-speech conversion engine configured to convert said received text to a speech signal, and

wherein said voice synthesizer is arranged to produce the synthesized speech signal from said speech signal.

3. The apparatus according to claim 1, wherein the mobile communications device includes said apparatus.

4. The apparatus according to claim 3, wherein said stored characteristics include pitch.

5. The apparatus according to claim 3, wherein said apparatus is configured to receive said text via at least one among a keypad and a display.

6. The apparatus according to claim 1, wherein said audio notification is recorded prior to said receiving said entered text.

7. The apparatus according to claim 1, wherein said apparatus comprises a memory configured to store said audio notification, and

wherein said audio notification is stored within said memory prior to said receiving said entered text.

8. The apparatus according to claim 1, wherein said audio notification is already recorded within the apparatus when said text is received.

9. The apparatus according to claim 3, wherein said apparatus includes a microphone, and

wherein, in a said second mode, said apparatus is configured to receive a speech signal from a microphone, and to produce encoded speech packets based on said received speech signal, and

wherein, in said first mode, said apparatus is configured to convert said received text to said synthesized speech signal, and to encode said synthesized speech signal to produce said plurality of corresponding speech packets, without performing echo cancellation on said synthesized speech signal.

10. The apparatus according to claim 3, wherein said apparatus includes a microphone, and

wherein, in said second mode, said apparatus is configured to receive a speech signal from a microphone, and to produce encoded speech packets based on said received speech signal, and

wherein, in said first mode, said apparatus is configured to convert said received text to said synthesized speech signal, and to encode said synthesized speech signal to produce said plurality of corresponding speech packets, without performing noise suppression on said synthesized speech signal.

11. The apparatus according to claim 1, wherein said apparatus is arranged to receive said text via said transceiver.

12. The apparatus according to claim 11, wherein said apparatus is configured to receive said text in the form of text packets.

13. The apparatus according to claim 11, wherein said apparatus is configured to receive voice packets that have said characteristics of the voice of the user and to store said characteristics.

14. The apparatus according to claim 13, wherein said apparatus is configured to store said characteristics prior to receiving said text packets.

15. The apparatus according to claim 13, wherein said stored characteristics include spectral parameters and pitch information of the user.

16. A method for wireless communications, said method comprising:

receiving text that has been entered by a user of a mobile communications device wherein said text is received when said mobile communications device has been set to a first mode in which said mobile communications device accepts text input instead of speech input, wherein said text is received during a call in which a second communications device is configured to receive speech packets, and wherein said mobile communications device is settable to a second mode in which said mobile communications device accepts speech input instead of text input;

converting the received text to a synthesized speech signal;

encoding the synthesized speech signal to produce a plurality of corresponding speech packets;

transmitting the plurality of corresponding speech packets over a wireless communications link to said second communications device; and

transmitting an audio notification informing said second communications device that speech from said mobile communications device following said audio notification will be converted from text, wherein said audio notification is transmitted prior to transmitting said plurality of corresponding speech packets, and wherein said converting the received text to the synthesized speech signal includes using stored characteristics of the user'"'"'s voice to produce the synthesized speech signal.

17. The method according to claim 16, wherein said method includes, in said second mode, receiving a speech signal from a microphone, and producing encoded speech packets based on said received speech signal, and

wherein said method includes, in said first mode, converting said received text to said synthesized speech signal, and encoding said synthesized speech signal to produce said plurality of corresponding speech packets, without performing echo cancellation on said synthesized speech signal.

18. The method according to claim 16, wherein said method includes, in said second mode, receiving a speech signal from a microphone, and producing encoded speech packets based on said received speech signal, and

wherein said method includes, in said first mode, converting said received text to said synthesized speech signal, and encoding said synthesized speech signal to produce said plurality of corresponding speech packets, without performing noise suppression on said synthesized speech signal.

19. The method according to claim 16, wherein said transmitting comprises transmitting the plurality of corresponding speech packets over the wireless communications link via a transceiver, and

wherein said method comprises receiving said text via the transceiver.

20. A non-transitory computer-readable medium comprising instructions which when executed by a processor cause the processor to:

receive text that has been entered by a user of a mobile communications device, wherein said text is received when said mobile communications device has been set to a first mode in which said mobile communications device accepts text input instead of speech input, wherein said text is received during a call in which a second communications device is configured to receive speech packets, and wherein said mobile communications device is settable to a second mode in which said mobile communications device accepts speech input instead of text input;

convert the received text to a synthesized speech signal;

encode the synthesized speech signal to produce a plurality of corresponding speech packets;

transmit the plurality of corresponding speech packets over a wireless communications link to said second communications device; and

transmit an audio notification informing said second communications device that speech from said mobile communications device following said audio notification will be converted from text, wherein said audio notification is transmitted prior to transmitting said plurality of corresponding speech packets, and wherein said converting the received text to the synthesized speech signal includes using stored characteristics of the user'"'"'s voice to produce the synthesized speech signal.

21. The medium according to claim 20, wherein said medium includes instructions which when executed by the processor cause the processor to, in said second mode, receive a speech signal from a microphone, and produce encoded speech packets based on said received speech signal, and

wherein said medium includes instructions which when executed by the processor cause the processor to, in said first mode, convert said received text to said synthesized speech signal, and encode said synthesized speech signal to produce said plurality of corresponding speech packets, without performing echo cancellation on said synthesized speech signal.

22. The medium according to claim 20, wherein said medium includes instructions which when executed by the processor cause the processor to, in said second mode, receive a speech signal from a microphone, and produce encoded speech packets based on said received speech signal, and

wherein said medium includes instructions which when executed by the processor cause the processor to, in said first mode, convert said received text to said synthesized speech signal, and encode said synthesized speech signal to produce said plurality of corresponding speech packets, without performing noise suppression on said synthesized speech signal.

23. The medium according to claim 20, wherein said transmitting comprises transmitting the plurality of corresponding speech packets over the wireless communications link via a transceiver, and

wherein said medium includes instructions which when executed by the processor cause the processor to receive said text via the transceiver.