Speech communications system for a vehicle and method of operating a speech communications system for a vehicle

• US 20080071547A1
• Filed: 09/15/2006
• Published: 03/20/2008
• Est. Priority Date: 09/15/2006
• Status: Active Grant

• Current Assignee: Volkswagen Of America (Volkswagen AG)
• Original Assignee: Volkswagen Of America (Volkswagen AG)
• Inventors: Prieto, Ramon, Mishra, Rohit
• Granted Patent: US 8,214,219 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: G10L 15/19 Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: H04R 3/02 for preventing acoustic reaction , i.e. acoustic oscillatory feedback specially adapted for hearing aids H04R25/453

Abstract

A speech communications system for a vehicle includes a microphone system provided in the vehicle interior in order to detect audio information. An interaction manager provides grammar information to a speech recognizer. The speech recognizer provides speech recognition results to the interaction manager. An acoustic echo canceller eliminates portions of the audio information detected by the microphone system. A sound localizer determines a sound source location in the vehicle interior. A method of operating a speech communications system in a vehicle is also provided. An interruptible text-to-speech operation provides a speech output to a user. Voice information is requested from the user for a maximum number of times if insufficient voice information or no voice information is provided in response to the speech output provided by the interruptible text-to-speech operation. The dialog context of an unfinished speech interaction is saved.

Claims

1. In combination with a vehicle having a vehicle interior, a speech communications system comprising:

a microphone system provided in the vehicle interior, said microphone system being configured to detect audio information;

a speech recognizer operatively connected to said microphone system;

an interaction manager operatively connected to said speech recognizer, said interaction manager providing grammar information to said speech recognizer, said speech recognizer being configured to provide speech recognition results to said interaction manager;

an acoustic echo canceller operatively connected to said speech recognizer, said acoustic echo canceller being configured to at least partially eliminate portions of the audio information detected by said microphone system; and

a sound localizer operatively connected to said microphone system and to said interaction manager, said sound localizer being configured to determine a sound source location in the vehicle interior.

2. The speech communications system according to claim 1, wherein said interaction manager selectively enables and disables a user-controllable function in dependence on the sound source location.

3. The speech communications system according to claim 1, wherein:

said microphone system includes a first microphone array and a second microphone array;

said first microphone array and said second microphone array are spaced from one another by a given spacing distance;

said sound localizer determines a first sound source angle as a function of audio information provided by said first microphone array and said sound localizer determines a second sound source angle as a function of audio information provided by said second microphone array; and

said sound localizer determines a sound source location in dependence on the first sound source angle and the second sound source angle.

4. The speech communications system according to claim 1, including:

a seat sensor connected to said sound localizer, said seat sensor providing seat occupancy information to said sound localizer;

said microphone system including a first microphone array and a second microphone array;

said first microphone array and said second microphone array being spaced from one another by a given spacing distance;

said sound localizer determining a first sound source angle as a function of audio information provided by said first microphone array and said sound localizer determining a second sound source angle as a function of audio information provided by said second microphone array; and

said sound localizer determining a sound source location in dependence on the first sound source angle, the second sound source angle and the seat occupancy information.

5. The speech communications system according to claim 1, including:

a text-to-speech unit operatively connected to said interaction manager, said interaction manager being configured to prompt said text-to-speech unit to provide a speech output; and

said acoustic echo canceller being configured to at least partially eliminate the speech output provided by said text-to-speech unit from the audio information detected by said microphone system.

6. The speech communications system according to claim 1, including:

a text-to-speech unit operatively connected to said interaction manager; and

said interaction manager being configured to selectively prompt said text-to-speech unit to provide a speech output and to interrupt a speech output.

7. The speech communications system according to claim 1, including:

a vehicle stereo system operatively connected to said interaction manager, said interaction manager being configured to control a volume setting for said vehicle stereo system; and

said acoustic echo canceller being configured to at least partially eliminate sound produced by said vehicle stereo system from the audio information detected by said microphone system.

8. The speech communications system according to claim 1, wherein:

the vehicle has a ventilation fan operatively connected to said interaction manager; and

said interaction manager controls a fan speed setting for said ventilation fan.

9. The speech communications system according to claim 1, wherein:

said speech recognizer is configured to recognize a spoken keyword; and

said interaction manager is configured to retrieve a stored dialog context and to start a speech interaction triggered by the spoken keyword.

10. A method of operating a speech communications system in a vehicle, the method which comprises:

detecting audio information with a microphone system provided in a vehicle interior;

running an interruptible text-to-speech operation based on a dialog context in order to provide a speech output;

running a speech recognition operation for providing a speech recognition result;

requesting voice information for a maximum number of times if insufficient voice information or no voice information is provided in response to the speech output provided by the interruptible text-to-speech operation; and

saving a dialog context of an unfinished speech interaction.

11. The method according to claim 10, which comprises:

recognizing a keyword with the speech recognition operation; and

retrieving the dialog context which has been saved for the unfinished speech interaction.

12. The method according to claim 10, which comprises at least partially eliminating the speech output provided by the text-to-speech operation from the audio information detected with the microphone system by performing an echo cancellation operation.

13. The method according to claim 10, which comprises at least partially eliminating sound generated by a vehicle stereo system from the audio information detected with the microphone system by performing an echo cancellation operation.

14. The method according to claim 10, which comprises controlling a fan speed of a ventilation fan in order to improve the speech recognition result provided by the speech recognition operation.

15. The method according to claim 10, which comprises controlling a volume setting of a vehicle stereo system in order to improve the speech recognition result provided by the speech recognition operation.

16. The method according to claim 10, which comprises:

determining a first sound source angle as a function of audio information provided by a first microphone array of the microphone system;

determining a second sound source angle as a function of audio information provided by a second microphone array of the microphone system; and

determining a sound source location based on the first sound source angle and the second sound source angle.

17. The method according to claim 16, which comprises:

detecting a seat occupancy by using a seat sensor; and

determining a sound source location in dependence on the first sound source angle, the second sound source angle, and seat occupancy information.

18. The method according to claim 10, which comprises:

determining a sound source location in the vehicle interior; and

selectively enabling and disabling a user-controllable function in dependence on the sound source location.