Hands-free telephony and in-vehicle communication

• US 8,369,901 B2
• Filed: 08/07/2009
• Issued: 02/05/2013
• Est. Priority Date: 08/07/2008
• Status: Active Grant

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Haulick, Tim, Iser, Bernd, Schmidt, Gerhard, Wolf, Arthur
• Primary Examiner(s): Alam, Fayyaz
• Application Number:
  US12/537,662
• Publication Number:
  US 20100035663A1
• Time in Patent Office: 1,278 Days
• Field of Search: 4555691-570, 37942001-42004
• US Class Current: 455/569.1
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: H04M 1/6083 by interfacing with the vehicle audio system
• CPC Class Codes: H04M 9/00 Arrangements for interconnection not involving centralised switching

Abstract

The present invention relates to a signal processing system, comprising a number of microphones and loudspeakers, a hands-free set configured to receive a telephone signal from a remote party and to transmit a microphone signal supplied by at least one of the microphones to the remote party; an in-vehicle communication system configured to receive a microphone signal supplied by at least one of the microphones; receive the telephone signal; amplify the microphone signal to obtain at least one first output signal; output the at least one first output signal and/or a second output signal corresponding to the telephone signal to at least one of the loudspeakers; and wherein the signal processing systems is configured to detect speech activity in the telephone signal and to control the in-vehicle communication system to reduce amplification of the microphone signal by a damping factor, if it is detected that speech activity is present in the telephone signal.

Claims

1. A signal processing system, comprising

a plurality of microphones and loudspeakers;

a hands-free set configured to receive a telephone signal from a remote party and to transmit a microphone signal supplied by at least one of the microphones to the remote party;

an in-vehicle communication system configured to;

receive the microphone signal supplied by at least one of the microphones;

receive the telephone signal;

amplify the microphone signal to obtain at least one first output signal;

output the at least one first output signal and/or a second output signal corresponding to the telephone signal to at least one of the loudspeakers;

wherein the signal processing system is configured to detect speech activity in the telephone signal and to control the in-vehicle communication system to reduce amplification of the microphone signal, if it is detected that speech activity is present in the telephone signal, wherein the hands-free set comprises an adaptive echo compensation filtering system and is configured to adapt the filter coefficients of the echo compensation filtering system only when the at least one first output signal output by the in-vehicle communication system is reduced to a predetermined level and wherein the in-vehicle communication system is configured to receive multiple microphone signals in multiple channels and to amplify the multiple microphone signals to obtain multiple first output signals and further comprising;

a power estimating module configured to estimate the short-time power density of the multiple first output signals and to supply the maximum of the short-time power densities of the multiple first output signals to the hands-free set; and

wherein

the hands-free set is configured to determine whether the at least one first output signal output by the in-vehicle communication system is reduced to the predetermined level based on the maximum of the short-time power densities of the multiple first output signals.

2. A signal processing system, comprising

a plurality of microphones and loudspeakers;

a hands-free set configured to receive a telephone signal from a remote party and to transmit a microphone signal supplied by at least one of the microphones to the remote party;

an in-vehicle communication system configured to;

receive the microphone signal supplied by at least one of the microphones;

receive the telephone signal;

amplify the microphone signal to obtain at least one first output signal;

output the at least one first output signal and/or a second output signal corresponding to the telephone signal to at least one of the loudspeakers;

wherein the signal processing system is configured to detect speech activity in the telephone signal and to control the in-vehicle communication system to reduce amplification of the microphone signal, if it is detected that speech activity is present in the telephone signal

wherein

the hands-free set comprises;

a first equalization filter module configured to equalize microphone signals obtained by at least one of the number of microphones and input in the hands-free set and to adapt the filter coefficients of the first equalization filter module in the sub-band or Fourier domain; and

the in-vehicle communication system comprises a second equalization filtering module configured to equalize microphone signals input in the in-vehicle communication system and to adapt the filter coefficients of the second equalization filtering module in the time domain based on the adapted filter coefficients of the first equalization filtering module.

4. The signal processing system according to claim 2, wherein

the hands-free set is configured to detect speech activity in the telephone signal and to supply a damping factor for reducing the amplification to the in-vehicle communication system, if it is detected that speech activity is present in the telephone signal.

3. A signal processing system, comprising

a plurality of microphones and loudspeakers;

a hands-free set configured to receive a telephone signal from a remote party and to transmit a microphone signal supplied by at least one of the microphones to the remote party;

an in-vehicle communication system configured to;

receive the microphone signal supplied by at least one of the microphones;

receive the telephone signal;

amplify the microphone signal to obtain at least one first output signal;

output the at least one first output signal and/or a second output signal corresponding to the telephone signal to at least one of the loudspeakers;

wherein the signal processing system is configured to detect speech activity in the telephone signal and to control the in-vehicle communication system to reduce amplification of the microphone signal, if it is detected that speech activity is present in the telephone signal

wherein

the in-vehicle communication system is configured to process the microphone signal in the time domain; and

the hands-free set further comprises an analysis filter bank to obtain microphone sub-band signals or a Fourier transform module to obtain Fourier transformed microphone signals; and

wherein the in-vehicle communication system is configured to detect speech activity in microphone signals obtained by at least one of the number of microphones and input in the in-vehicle communication system by processing the microphone signals in the time domain; and

supply a signal to the hands-free set operating in the sub-band or Fourier domain that indicates speech activity or no speech activity.

5. A method for speech communication using a hands-free set and an in-vehicle communication system wherein both are installed in a passenger compartment, the method comprising:

receiving a telephone signal from a remote party by the hands-free set;

determining whether or not speech is present in the received telephone signal,

detecting an utterance of a passenger in the passenger compartment by at least one of a set of microphones installed in the passenger compartment to obtain a microphone signal;

processing the microphone signal by the in-vehicle communication system to obtain at least one first processed signal;

processing the telephone signal by the in-vehicle communication system or the hand-free set to obtain a second processed signal; and

outputting the at least one first and/or second processed signal to at least one loudspeaker installed in the passenger compartment;

wherein the processing of the microphone signal by the in-vehicle communication system comprises amplifying the microphone signal by a first gain factor when it is determined that no speech is present in the telephone signal and by a second gain factor smaller than the first gain factor when it is determined that speech is present in the telephone signal

wherein filter coefficients are only adapted when the at least one first processed signal is damped to a predetermined level with respect of the first gain factor.

6. The method according to claim 5, wherein the hands-free set and/or the in-vehicle communication system determines whether or not speech is present in the telephone signal and provides a damping factor and wherein the second gain factor is obtained on the basis of the first gain factor and the damping factor.

7. The method according to claim 5, wherein

the hands-free set comprises a first equalization filtering module configured to equalize microphone signals obtained by at least two of the set of microphones and input in the hands-free set;

the in-vehicle communication system comprises a second equalization filtering module configured to equalize microphone signals input in the in-vehicle communication system;

the method comprising the steps of;

adapting filter coefficients of the first equalization filtering module in the sub-band or Fourier domain; and

adapting the filter coefficients of the second equalization filtering module in the time domain based on the adapted filter coefficients of the first equalization filtering module.

8. The method according to claims 5, further comprising:

detecting speech activity in microphone signals obtained by at least one of the set of microphones and input in the in-vehicle communication system by processing the microphone signals in the time domain by the in-vehicle communication system; and

supplying a signal by the in-vehicle communication system to the hands-free set operating in the sub-band or Fourier domain that indicates speech activity or no speech activity present in the microphone signal in response to the step of speech detection.

9. The method according to claim 5, wherein the second gain factor is obtained based on the first gain factor and a damping factor and wherein the damping factor g_tel(n) is determined by

10. A computer program product comprising a non-transitory computer readable medium having computer-executable instructions for speech communication using a hands-free set and an in-vehicle communication system wherein both are installed in a passenger compartment, the computer-executable instructions comprising:

computer code for receiving a telephone signal from a remote party by the hands-free set;

computer code for determining whether or not speech is present in the received telephone signal;

computer code for detecting an utterance of a passenger in the passenger compartment by at least one of a set of microphones installed in the passenger compartment to obtain a microphone signal;

computer code for processing the microphone signal by the in-vehicle communication system to obtain at least one first processed signal;

computer code for processing the telephone signal by the in-vehicle communication system or the hand-free set to obtain a second processed signal; and

computer code for outputting the at least one first and/or second processed signal to at least one loudspeaker installed in the passenger compartment;

wherein the computer code for processing of the microphone signal by the in-vehicle communication system includes computer code for amplifying the microphone signal by a first gain factor when it is determined that no speech is present in the telephone signal and by a second gain factor smaller than the first gain factor when it is determined that speech is present in the telephone signal;

computer code for inputting the microphone signal in the hands-free set wherein the hands-free set includes an adaptive echo compensation filtering module;

computer code for echo compensating the microphone signal input in the hands-free set by the adaptive echo compensation filtering module; and

computer code for transmitting the echo compensated microphone signal to the remote party;

wherein filter coefficients are only adapted when the at least one first processed signal is damped to a predetermined level with respect of the first gain factor.

11. A computer program product comprising a non-transitory computer readable medium having computer-executable instructions for speech communication using a hands-free set and an in-vehicle communication system wherein both are installed in a passenger compartment, the computer-executable instructions comprising:

computer code for receiving a telephone signal from a remote party by the hands-free set;

computer code for determining whether or not speech is present in the received telephone signal;

computer code for detecting an utterance of a passenger in the passenger compartment by at least one of a set of microphones installed in the passenger compartment to obtain a microphone signal;

computer code for processing the microphone signal by the in-vehicle communication system to obtain at least one first processed signal;

computer code for processing the telephone signal by the in-vehicle communication system or the hand-free set to obtain a second processed signal; and

computer code for outputting the at least one first and/or second processed signal to at least one loudspeaker installed in the passenger compartment;

wherein the computer code for processing of the microphone signal by the in-vehicle communication system includes computer code for amplifying the microphone signal by a first gain factor when it is determined that no speech is present in the telephone signal and by a second gain factor smaller than the first gain factor when it is determined that speech is present in the telephone signal;

computer code for detecting speech activity in microphone signals obtained by at least one of the set of microphones and input in the in-vehicle communication system by processing the microphone signals in the time domain by the in-vehicle communication system; and

computer code for supplying a signal by the in-vehicle communication system to the hands-free set operating in the sub-band or Fourier domain that indicates speech activity or no speech activity present in the microphone signal in response to the step of speech detection.

12. A computer program product comprising a non-transitory computer readable medium having computer-executable instructions for speech communication using a hands-free set and an in-vehicle communication system wherein both are installed in a passenger compartment, the computer-executable instructions comprising:

computer code for receiving a telephone signal from a remote party by the hands-free set;

computer code for determining whether or not speech is present in the received telephone signal;

computer code for detecting an utterance of a passenger in the passenger compartment by at least one of a set of microphones installed in the passenger compartment to obtain a microphone signal;

computer code for processing the microphone signal by the in-vehicle communication system to obtain at least one first processed signal;

computer code for processing the telephone signal by the in-vehicle communication system or the hand-free set to obtain a second processed signal; and

computer code for outputting the at least one first and/or second processed signal to at least one loudspeaker installed in the passenger compartment;

wherein the computer code for processing of the microphone signal by the in-vehicle communication system includes computer code for amplifying the microphone signal by a first gain factor when it is determined that no speech is present in the telephone signal and by a second gain factor smaller than the first gain factor when it is determined that speech is present in the telephone signal;

wherein the second gain factor is obtained based on the first gain factor and a damping factor and wherein the damping factor g_tel(n) is determined by