Echo control through hidden audio signals

• US 9,552,827 B2
• Filed: 06/27/2013
• Issued: 01/24/2017
• Est. Priority Date: 06/28/2012
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Johnston, Craig, Shi, Dong, Sun, Xuejing, Dickins, Glenn N.
• Primary Examiner(s): NGUYEN, QUYNH H
• Application Number:
  US14/409,948
• Publication Number:
  US 20150371654A1
• Time in Patent Office: 1,307 Days
• Field of Search: 381/66
• US Class Current: 1/1
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain
• CPC Class Codes: H04M 9/082 using echo cancellers echo cancellers per se H04B3/23

Abstract

A method (800) for determining an estimate (215, 261) of an echo path property of an electronic device (200, 250, 300, 600). The electronic device is configured to render a total audio signal using a loudspeaker (102), and the electronic device is configured to record an echo of the rendered audio signal using a microphone (103), thereby yielding a recorded audio signal (112). The method comprises inserting (801), in an inaudible manner, an auxiliary audio signal (212) into the total audio signal to be rendered; wherein the auxiliary audio signal (212) comprises a tonal audio signal at a first frequency; isolating (803) the echo of the auxiliary audio signal (212) from the recorded audio signal (112); and determining (804) the estimate (215, 261) of the echo path property based on the inserted auxiliary audio signal (212) and based on the isolated echo of the auxiliary audio signal (212).

Claims

1. A method for determining an estimate of an echo path property of an echo path of an electronic device configured to render a total audio signal using a loudspeaker, thereby yielding a rendered audio signal, and configured to record an echo of the rendered audio signal using a microphone, thereby yielding a recorded audio signal;

the electronic device comprising an acoustic echo cancellation unit;

the method comprising;

inserting, in an inaudible manner, an auxiliary audio signal into the total audio signal to be rendered by the loudspeaker;

wherein the auxiliary audio signal comprises a tonal audio signal at a first frequency;

isolating the echo of the auxiliary audio signal from the recorded audio signal;

determining the estimate of the echo path property based on the inserted auxiliary audio signal and based on the isolated echo of the auxiliary audio signal, the estimate of the echo path property being suitable for detecting a discontinuity occurring on the echo path;

using the estimate of the echo path property to determine at least one of

an estimate of a rate of occurrence of discontinuities occurring on the echo path, and

an estimate of the extent of discontinuities occurring on the echo path; and

bypassing the acoustic echo cancellation unit if the estimate of the rate of occurrence of discontinuities exceeds a pre-determined rate threshold or if the estimate of the extent of discontinuities exceeds a pre-determined discontinuity threshold.

2. The method of claim 1, wherein

the first frequency lies outside of a frequency range audible by a human being, e.g. wherein the first frequency is at 17 kHz or higher;

or

a signal level of the tonal audio signal lies below a threshold of hearing of a human being at the first frequency.

3. The method of claim 1, wherein

the rendered audio signal comprises the auxiliary audio signal and a reference audio signal;

and

the auxiliary audio signal comprises a signal component with an energy below a masking threshold of the reference audio signal.

4. The method of claim 3, further comprising

removing the echo of the auxiliary audio signal from the recorded audio signal, thereby yielding a net audio signal;

and

performing at least one of acoustic echo cancellation or acoustic echo suppression based on the net audio signal and based on the reference audio signal.

5. The method of claim 3, wherein

the method further comprises determining an amount of noise comprised within the reference audio signal at a particular time instant;

and

a signal level of the auxiliary audio signal at the particular time instant depends on the amount of noise comprised within the reference audio signal at the particular time instant.

6. The method of claim 1, wherein isolating the echo of the auxiliary audio signal comprises filtering the recorded audio signal using a filter with a pass band at the first frequency.

7. The method of claim 1, wherein

the estimate of the echo path property comprises an estimate of an echo path delay;

the tonal audio signal at the first frequency has a pre-determined pulse length; and

determining the estimate of the echo path delay comprises determining a time offset between the tonal audio signal and an echo of the tonal audio signal comprised within the isolated echo of the auxiliary audio signal.

8. The method of claim 7, wherein

the pre-determined pulse length is shorter than an expected echo path delay;

the tonal audio signal is amplitude modulated across a temporal length of the tonal audio signal;

the tonal audio signal has an amplitude peak at a temporal center of the temporal length of the tonal audio signal;

or

the amplitude modulation corresponds to a sinusoidal half wave across the temporal length of the tonal audio signal.

9. The method of claim 7, further comprising

delaying a reference audio signal comprised within the total audio signal which is to be rendered, based on the determined estimate of the echo path delay, thereby yielding a delayed reference audio signal;

and

performing acoustic echo cancellation of an audio signal derived from the recorded audio signal, based on the delayed reference audio signal.

10. The method of claim 1, wherein

determining the estimate of the echo path property comprises determining a frequency offset between an echo of the tonal audio signal comprised within the isolated echo of the auxiliary audio signal and the first frequency.

11. The method of claim 10, wherein the discontinuity occurring on the echo path is due to any one or more of:

a drop or a repeat of a frame of the total audio signal caused by the electronic device when rendering the total audio signal;

a drop or a repeat of a frame of the total audio signal caused by the electronic device when recording the echo of the rendered audio signal;

a glitch of a sample of the total audio signal caused by the electronic device when rendering the total audio signal;

a glitch of a sample of the total audio signal caused by the electronic device when recording the echo of the rendered audio signal;

a mismatch between a sampling rate of the total audio signal which is to be rendered and a sampling rate of the recorded audio signal; and

a motion of the electronic device impacting the echo path.

12. The method of claim 10, wherein the frequency offset is determined using a phase-locked loop, referred to as PLL, unit configured to lock to the first frequency.

13. The method of claim 10, wherein

bypassing the acoustic echo cancellation unit if the estimate of the extent of discontinuities exceeds a pre-determined discontinuity threshold comprises bypassing the acoustic echo cancellation unit if the determined frequency offset exceeds a pre-determined frequency offset threshold.

14. The method of claim 1, wherein

the tonal audio signal has at least one of a bandwidth corresponding to less than 5% of the first frequency

or a Gaussian spectral envelope across its bandwidth.

15. The method of claim 1, wherein the auxiliary audio signal comprises a plurality of tonal signals at a plurality of different frequencies.

16. The method of claim 1, wherein the electronic device further comprises an acoustic echo suppression unit and the method further comprises choosing, when bypassing the acoustic echo cancellation unit, to move from echo cancellation in the acoustic echo cancellation unit to echo suppression in the acoustic echo suppression unit.

19. A non-transitory storage medium comprising a software program adapted for execution on a processor and for performing the method steps of claim 1 when carried out on a computing device.

17. A processing unit configured to determine an estimate of an echo path property of an echo path of an electronic device, the electronic device comprising an acoustic echo cancellation unit;

wherein the electronic device is configured to render a total audio signal using a loudspeaker, thereby yielding a rendered audio signal, and wherein the electronic device is configured to record an echo of the rendered audio signal using a microphone, thereby yielding a recorded audio signal;

wherein the processing unit is configured to

insert, in an inaudible manner, an auxiliary audio signal into the total audio signal to be rendered by the loudspeaker;

wherein the auxiliary audio signal comprises a tonal audio signal at a first frequency;

isolate the echo of the auxiliary audio signal from the recorded audio signal; and

determine the estimate of the echo path property based on the inserted auxiliary audio signal and based on the isolated echo of the auxiliary audio signal, the estimate of the echo path property being suitable for detecting a discontinuity occurring on the echo path;

use the estimate of the echo path property to determine at least one of

an estimate of a rate of occurrence of discontinuities occurring on the echo path, and

an estimate of the extent of discontinuities occurring on the echo path; and

bypass the acoustic echo cancellation unit if the estimate of the rate of occurrence of discontinuities exceeds a pre-determined rate threshold or if the estimate of the extent of discontinuities exceeds a pre-determined discontinuity threshold.

18. The processing unit of claim 17, wherein the electronic device further comprises an acoustic echo suppression unit and the method further comprises choosing, when bypassing the acoustic echo cancellation unit, to move from echo cancellation in the acoustic echo cancellation unit to echo suppression in the acoustic echo suppression unit.