Synthesized speech intelligibility enhancement through environment awareness

• US 20030061049A1
• Filed: 08/29/2002
• Published: 03/27/2003
• Est. Priority Date: 08/30/2001
• Status: Abandoned Application

• Current Assignee: CSR Technology Incorporated (Qualcomm, Inc.)
• Original Assignee: Clarity LLC
• Inventors: Erten, Gamze
• Application Number:
  US10/231,759
• Publication Number:
  US 20030061049A1
• Time in Patent Office: Days
• US Class Current: 704/260
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 2021/03646 Stress or Lombard effect

Abstract

Synthesized speech is enhanced by listening to the acoustic background into which the synthesized speech is delivered and adjusting parameters of the synthesized speech accordingly. In one embodiment, text is synthesized into speech based on at least one noise parameter determined from the environment into which the synthesized speech is delivered. In another embodiment, parameters for a filter modifying the synthesized signal are determined based environmental noise.

Claims

1. A method for synthesizing speech in an environment, the method comprising:

receiving text to be converted into an audible speech signal;

sensing the audio content of the environment;

determining at least one noise parameter based on the sensed audio content; and

converting the text into a speech signal based on the at least one noise parameter.

2. A method for synthesizing speech as in claim 1 wherein converting the received text is based on a command to change volume of converted text in the speech signal.

3. A method for synthesizing speech as in claim 1 wherein converting the received text is based on a command to change pitch of converted text in the speech signal.

4. A method for synthesizing speech as in claim 1 wherein converting the received text is based on a command to change rate of speech of converted text in the speech signal.

5. A method for synthesizing speech as in claim 1 wherein converting the received text is based on a command to change pause duration of converted text in the speech signal.

6. A method for synthesizing speech as in claim 1 wherein converting the text comprises writing a command into the text prior to conversion, the command based on the at least one noise parameter.

7. A method for synthesizing speech as in claim 1 further comprising:

determining spectral characteristics of a filter based on the determined at least one noise parameter; and

processing the speech signal with the filter.

8. A method for synthesizing speech as in claim 1 further comprising:

detecting the presence of speech in the sensed audio content; and

determining at least one noise parameter only when the presence of speech is not detected.

9. A method for synthesizing speech as in claim 1 further comprising:

detecting the presence of speech in the sensed audio content;

extracting at least one command from the detected speech; and

modifying the conversion of text into speech based on the at least one extracted command.

10. A method for synthesizing speech as in claim 1 further comprising determining between one of at least two phonetic translation dictionaries used for converting the modified text into a speech signal based on the at least one determined noise parameter.

11. A method for synthesizing speech as in claim 1 wherein the at least one noise parameter comprises a noise level.

12. A method for synthesizing speech as in claim 1 wherein the at least one noise parameter comprises a noise spectrum.

13. A method for synthesizing speech as in claim 1 wherein the at least one noise parameter comprises an indication of noise periodicity.

14. An automotive sound system comprising:

at least one sound generator operative to play sound into a body compartment;

a memory operative to hold at least one text file;

a speech synthesizer in communication with the memory and each speaker, the speech synthesizer converting text from each text file into a speech signal and providing the speech signal to each sound generator;

at least one acoustic transducer for sensing sound in the body compartment; and

control logic in communication with each acoustic transducer and the memory, the control logic determining at least one noise parameter from sound sensed in the body compartment and generating at least one command based on the determined at least one noise parameter, each command modifying the conversion of text into speech by the speech synthesizer.

15. An automotive sound system as in claim 14 wherein the generated command changes an amplitude of the speech signal.

16. An automotive sound system as in claim 14 wherein the generated command changes pitch of the speech signal.

17. An automotive sound system as in claim 14 wherein the generated command changes speech rate of the speech signal.

18. An automotive sound system as in claim 14 wherein the generated command changes pause duration of the speech signal.

19. An automotive sound system as in claim 14 wherein the generated command is inserted into the memory.

20. An automotive sound system as in claim 14 wherein the control logic determines at least one noise parameter only when the presence of speech is not detected from sound sensed in the body compartment.

21. An automotive sound system as in claim 14 further comprising a programmable filter filtering the sound signal before the sound signal is played into the body compartment, wherein the control logic programs the filter based on the determined at least one noise parameter

22. An automotive sound system as in claim 14 further comprising:

a server serving text files;

a wireless transmitter in communication with the server; and

a wireless receiver in communication with the memory, the wireless receiver receiving text files transmitted from the server and placing the received text files into the memory.

23. A method for synthesizing speech to be acoustically delivered into an environment, the comprising:

analyzing the acoustic noise in the environment;

generating parameters for a filter to improve intelligibility of synthesized speech based on the environmental noise;

converting a text stream into a speech signal; and

passing the speech signal through the filter.