AUDIO SIGNAL PROCESSING WITH ACOUSTIC ECHO CANCELLATION

• US 20200136675A1
• Filed: 10/24/2019
• Published: 04/30/2020
• Est. Priority Date: 10/30/2018
• Status: Active Grant

• Current Assignee: Harman Becker Automotive Systems GmbH (Samsung Electronics Co. Ltd.)
• Original Assignee: Harman Becker Automotive Systems GmbH (Samsung Electronics Co. Ltd.)
• Inventors: Christoph, Markus
• Granted Patent: US 10,979,100 B2
• Time in Patent Office: Days
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: H04B 3/23 using a replica of transmitted signal in the time domain, e.g. echo cancellers
• CPC Class Codes: H04M 19/08 with current supply sources at the substations generating ringing current H04M19/04
• CPC Class Codes: H04R 2227/009 Signal processing in [PA] systems to enhance the speech intelligibility
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 2420/03 Application of parametric coding in stereophonic audio systems
• CPC Class Codes: H04S 3/02 of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other

Abstract

Multi-channel audio signal processing includes receiving a left stereo audio signal from a first channel and a right stereo audio signal from a second channel; up-mixing the left and the right stereo audio signals to generate an up-mixed audio signal for a third channel; de-correlating the up-mixed audio signal from the left and the right stereo audio signals to generate a de-correlated up-mixed audio signal; providing the left and right stereo signals and the de-correlated up-mixed audio signal to first, second, and third loudspeakers respectively to generate first, second, and third sound signals, respectively; picking up the first, second and third sound signals with a microphone to generate a microphone output signal; and adaptively filtering the microphone output signal with an acoustic echo canceller based on the left, the right, and the de-correlated up-mixed audio signal to generate an echo compensated microphone signal.

Claims

1. A method for multi-channel audio signal processing, comprising:

receiving a left stereo audio signal from a first channel, and receiving a right stereo audio signal from a second channel;

up-mixing the left stereo audio signal and the right stereo audio signal to generate an up-mixed audio signal for a third channel;

de-correlating the up-mixed audio signal from the left stereo audio signal and the right stereo audio signal to generate a de-correlated up-mixed audio signal;

providing the left stereo audio signal to a first loudspeaker to generate a first sound signal, providing the right stereo audio signal to a second loudspeaker to generate a second sound signal, and providing the de-correlated up-mixed audio signal to a third loudspeaker to generate a third sound signal;

picking up the first, second and third sound signals with a microphone to generate a microphone output signal; and

adaptively filtering the microphone output signal with an acoustic echo canceller based on the left stereo audio signal, the right stereo audio signal and the de-correlated up-mixed audio signal to generate an echo compensated microphone signal.

2. The method of claim 1, wherein de-correlating of the up-mixed audio signal includes generating the de-correlated up-mixed audio signal by applying a time-varying all-pass filtering to the up-mixed audio signal, the time-varying all-pass filtering being based on at least one time-varying parameter.

3. The method of claim 2, wherein the at least one time-varying parameter is predetermined or controllable.

4. The method of claim 1, wherein de-correlating of the up-mixed audio signal includes transforming the up-mixed audio signal from a time domain to a frequency domain to generate a multiplicity of sub-band signals, multiplying each of the sub-band signals with a corresponding controlled modulation signal to generate modulated sub-band signals, and transforming the modulated sub-band signals from the frequency domain into the time domain to provide the de-correlated up-mixed audio signal.

5. The method of claim 1, further comprising:

determining correlations between the up-mixed audio signal and either of the left stereo audio signal and the right stereo audio signal; and

controlling de-correlation based on the determined correlations between the up-mixed audio signal and either of the first and second audio input signals.

6. The method of claim 5, wherein correlation is determined by calculating a short time correlation value or a short time coherence value of the up-mixed audio signal.

7. The method of claim 1, further comprising controlling the de-correlating based upon an adaptation state of the adaptive filtering in the acoustic echo canceller.

8. The method of claim 7, wherein the adaptation state of the acoustic echo canceller is determined on the basis of an echo compensation signal generated by the acoustic echo canceller.

9. The method of claim 7, wherein the adaptation state of the acoustic echo canceller is determined on the basis of the filter coefficients of the acoustic echo canceller.

10. The method of claim 1, further comprising delaying of the left stereo audio signal and the right stereo audio signal by a delay time or phase value that is equal to a delay time or phase value introduced into the up-mixed signal by at least one of de-correlating and up-mixing.

11. The method of claim 1, further comprising beamforming based on the up-mixed audio signal, the left stereo audio signal and the right stereo audio signal before providing the left stereo audio signal to the first loudspeaker, to provide beamformed audio signals to the first loudspeaker, second loudspeaker and the third loudspeaker.

12. The method of claim 1, further comprising:

detecting the first sound signal, the second sound signal and the third sound signal with at least one additional microphone to generate at least one additional microphone output signal; and

adaptively filtering the at least one additional microphone output signal with the acoustic echo canceller based on the left stereo audio signal, the right stereo audio signal and the de-correlated up-mixed audio signal to generate at least one additional echo compensated microphone signal.

13. The method of claim 1, further comprising:

up-mixing the left stereo audio signal and the right stereo audio signal to generate at least one additional up-mixed audio signal;

de-correlating the at least one additional up-mixed audio signal from the left stereo audio signal, the right stereo audio signal and remaining up-mixed audio signals to generate at least one de-correlated up-mixed audio signal; and

providing the at least one de-correlated up-mixed audio signal to at least one additional loudspeaker to generate at least one additional sound signal.

14. A system for multi-channel audio processing, comprising:

an up-mixer configured to up-mix a the left stereo audio signal from a first channel and a right stereo audio signal from second channel to generate an up-mixed audio signal for a third channel;

a de-correlator configured to de-correlate the up-mixed audio signal from the left stereo audio signal and the right stereo audio signal to generate a de-correlated up-mixed audio signal; and

an adaptive acoustic echo canceller configured to echo compensate a microphone output signal based on the left stereo audio signal, the right stereo audio signal and the de-correlated up-mixed audio signal.

15. The system of claim 14, wherein the de-correlator is further configured to generate the de-correlated up-mixed audio signal by applying a time-varying all-pass filtering to the up-mixed audio signal, the time-varying all-pass filtering being based on at least one time-varying parameter.

16. The system of claim 15, wherein the at least one time-varying parameter is predetermined or controllable.

17. The system of claim 14, wherein the de-correlator is further configured to:

transform the up-mixed audio signal from a time domain to a frequency domain to generate a multiplicity of sub-band signals;

multiply each of the sub-band signals with a corresponding controlled modulation signal to generate modulated sub-band signals; and

transform the modulated sub-band signals from the frequency domain into the time domain to provide the de-correlated up-mixed audio signal.

18. The system of claim 14, wherein the controller is further configured to:

determine correlations between the up-mixed audio signal and either of the left stereo audio signal and the right stereo audio signal; and

control de-correlation based on the determined correlation between the up-mixed audio signal and either of the first and second audio input signals.

19. The system of claim 18, wherein the controller is further configured to determine correlation by calculating a short time correlation value or a short time coherence value of the up-mixed audio signal.

20. A computer-readable medium comprising instructions which, when executed by a computer, cause the computer to:

receive a left stereo audio signal from a first channel, and receive a right stereo audio signal from a second channel;

up-mix the left stereo audio signal and the right stereo audio signal to generate an up-mixed audio signal for a third channel;

de-correlate the up-mixed audio signal from the left stereo audio signal and the right stereo audio signal to generate a de-correlated up-mixed audio signal;

provide the left stereo audio signal to a first loudspeaker to generate a first sound signal, provide the right stereo audio signal to a second loudspeaker to generate a second sound signal, and provide the de-correlated up-mixed audio signal to a third loudspeaker to generate a third sound signal;

pick up the first, second and third sound signals with a microphone to generate a microphone output signal; and

adaptively filter the microphone output signal with an acoustic echo canceller based on the left stereo audio signal, the right stereo audio signal and the de-correlated up-mixed audio signal to generate an echo compensated microphone signal.