SPEECH DIALOG CONTROL BASED ON SIGNAL PRE-PROCESSING

• US 20080147397A1
• Filed: 12/06/2007
• Published: 06/19/2008
• Est. Priority Date: 12/14/2006
• Status: Active Grant

• Current Assignee: Cerence Inc., Cerence Operating Company (Cerence Inc.)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Schmidt, Gerhard Uwe, Low, Andreas, Konig, Lars
• Granted Patent: US 8,306,815 B2
• Time in Patent Office: Days
• US Class Current: 704/246
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 21/02 Speech enhancement, e.g. noise reduction or echo cancellation reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08

Abstract

A speech dialog system interfaces a user to a computer. The system includes a signal pre-processor that processes a speech input to generate an enhanced signal and an analysis signal. A speech recognition unit may generate a recognition result based on the enhanced signal. A control unit may manage an output unit or an external device based on the information within the analysis signal.

Claims

1. A speech dialog system, comprising:

a signal pre-processor unit configured to process a speech input signal and generate an enhanced speech signal and an analysis signal, where the analysis signal comprises information related to one or more non-semantic characteristics of the speech input signal;

a speech recognition unit configured to receive the enhanced speech signal and generate a recognition result based on the enhanced speech signal; and

a control unit configured to receive the analysis signal and control an output unit or an external device based at least in part on the information of the analysis signal.

2. The speech dialog system of claim 1, where the information related to one or more non-semantic characteristics of the speech input signal comprises information related to one or more of:

a noise component of the speech input signal;

an echo component of the speech input signal;

a location of a source of the speech input signal;

a volume level of the speech input signal;

a pitch of the speech input signal;

or

a stationarity of the speech input signal.

3. The speech dialog system of claim 1, where the speech input signal comprises a representation of one or more words spoken by a user;

and

where the information of the analysis signal is unrelated to a meaning or identity of the one or more words spoken by the user.

4. The speech dialog system of claim 1, where the signal pre-processor unit is configured to determine a noise component of the speech input signal;

and

where the analysis signal comprises information related to the noise component of the speech input signal.

5. The speech dialog system of claim 4, where the control unit is configured to increase a volume of the output unit when the noise component of the speech input signal is above a predetermined threshold.

6. The speech dialog system of claim 4, where the control unit is configured to generate an output message to instruct a user to neutralize a noise source when the noise component of the speech input signal is above a predetermined threshold.

7. The speech dialog system of claim 1, where the signal pre-processor unit is configured to determine an echo component of the speech input signal;

and

where the analysis signal comprises information related to the echo component of the speech input signal.

8. The speech dialog system of claim 1, where the signal pre-processor unit is configured to determine a location of a source of the speech input signal;

and

where the analysis signal comprises information related to the location of the source of the speech input signal.

9. The speech dialog system of claim 8, where the control unit is configured to customize content for the output unit or control an external device based on the location of the source of the speech input signal.

10. The speech dialog system of claim 1, where the signal pre-processor unit is configured to determine a volume level of the speech input signal;

and

where the analysis signal comprises information related to the volume level of the speech input signal.

11. The speech dialog system of claim 1, where the signal pre-processor unit is configured to determine a pitch of the speech input signal;

and

where the analysis signal comprises information related to the pitch of the speech input signal.

12. The speech dialog system of claim 11, where the control unit is configured to analyze the information related to the pitch of the speech input signal to determine an age or gender of a user that provided the speech input signal;

and

where the control unit is configured to customize content for the output unit or control an external device based on the age or gender of the user.

13. The speech dialog system of claim 1, where the signal pre-processor unit is configured to determine a stationarity of the speech input signal;

and

where the analysis signal comprises information related to the stationarity of the speech input signal.

14. The speech dialog system of claim 1, where the control unit is configured to use the information of the analysis signal to control the signal pre-processor unit.

15. The speech dialog system of claim 1, where the signal pre-processor unit comprises a noise reduction filter or an echo compensation filter;

and

where the control unit is configured to adjust one or more parameters of the noise reduction filter or the echo compensation filter based on the information of the analysis signal.

16. The speech dialog system of claim 1, where the control unit is configured to use the information of the analysis signal to control the speech recognition unit.

17. The speech dialog system of claim 1, where the speech recognition unit comprises a plurality of available code books for speech recognition;

and

where the control unit is configured to select one of the plurality of code books to be used by the speech recognition unit based on the information of the analysis signal.

18. The speech dialog system of claim 1, further comprising:

one or more microphones configured to detect the speech input signal, where the one or more microphones comprise one or more directional microphones; and

where the signal pre-processor unit comprises a beamformer configured to determine a location of a source of the speech input signal.

19. The speech dialog system of claim 1, where the analysis signal comprises a real number between approximately zero and approximately one representing a probability measure for one of the one or more non-semantic characteristics of the speech input signal.

20. A speech dialog system, comprising:

a signal pre-processor unit configured to process a speech input signal and generate an enhanced speech signal and an analysis signal, where the analysis signal comprises information related to one or more non-semantic characteristics of the speech input signal;

a speech recognition unit configured to receive the enhanced speech signal and generate a recognition result based on the enhanced speech signal; and

a control unit configured to receive the analysis signal and control the signal pre-processor unit or the speech recognition unit based at least in part on the information of the analysis signal.

21. The speech dialog system of claim 20, where the signal pre-processor unit comprises a noise reduction filter or an echo compensation filter;

and

where the control unit is configured to adjust one or more parameters of the noise reduction filter or the echo compensation filter based on the information of the analysis signal.

22. The speech dialog system of claim 20, where the speech recognition unit comprises a plurality of available code books for speech recognition;

and

where the control unit is configured to select one of the plurality of code books to be used by the speech recognition unit based on the information of the analysis signal.

23. A method, comprising the steps of:

processing a speech input signal to generate an enhanced speech signal;

analyzing the speech input signal or the enhanced speech signal to generate an analysis signal that comprises information related to one or more non-semantic characteristics of the speech input signal;

generating a recognition result based on the enhanced speech signal; and

controlling an output unit or an external device based at least in part on the information of the analysis signal.

24. A method, comprising the steps of:

processing a speech input signal to generate an enhanced speech signal;

analyzing the speech input signal or the enhanced speech signal to generate an analysis signal that comprises information related to one or more non-semantic characteristics of the speech input signal;

generating a recognition result based on the enhanced speech signal; and

adjusting one or more parameters used to process the speech input signal or one or more parameters used to generate the recognition result based at least in part on the information of the analysis signal.

25. A computer readable medium comprising computer executable instructions adapted to perform:

processing a speech input signal to generate an enhanced speech signal;

analyzing the speech input signal or the enhanced speech signal to generate an analysis signal that comprises information related to one or more non-semantic characteristics of the speech input signal;

generating a recognition result based on the enhanced speech signal; and

controlling an output unit or an external device based at least in part on the information of the analysis signal.