Reference microphone for non-linear and time variant echo cancellation

• US 9,712,915 B2
• Filed: 11/18/2015
• Issued: 07/18/2017
• Est. Priority Date: 11/25/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Knowles Electronics Llc (Knowles Corporation)
• Inventors: Nandy, Dibyendu
• Primary Examiner(s): Lee, Ping
• Application Number:
  US14/944,474
• Publication Number:
  US 20160150337A1
• Time in Patent Office: 608 Days
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04M 9/082 using echo cancellers echo cancellers per se H04B3/23
• CPC Class Codes: H04R 2410/05 Noise reduction with a separate noise microphone
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 3/02 for preventing acoustic reaction , i.e. acoustic oscillatory feedback specially adapted for hearing aids H04R25/453

Abstract

A far end signal from a far end user and broadcasting the far end signal at a loudspeaker is received. A signal for use in an echo transfer function is determined, and the signal selected from between: the far end signal or an echo reference signal received from a near field microphone disposed in close proximity to the speaker. The near field microphone sensing the far end signal that is broadcast from the speaker while sensing the near-end speech and ambient noise at insignificant energy levels compared to the speaker signal. An echo transfer function is determined based at least in part upon the selected signal, and the echo transfer function represents characteristics of an acoustic path between the loudspeaker and a far field microphone that is disposed at a greater distance from the speaker than the near field microphone. An estimated echo is determined based at least in part upon the echo transfer function. The estimated echo is subtracted from a signal received from the far field microphone, the subtracting effective to cancel an echo present in the signal received from the far end microphone.

Claims

1. A method, comprising:

receiving a far end signal from a far end user and broadcasting the far end signal at a loudspeaker;

determining a signal for use in estimating an echo transfer function, the signal selected from between;

the far end signal and an echo reference signal received from a near field microphone disposed in close proximity to the speaker, the determining the signal based at least in part on a comparison between the far end signal and the echo reference signal, the near field microphone sensing the far end signal that is broadcast from the speaker;

determining an echo transfer function based at least in part upon the selected signal, the echo transfer function representing characteristics of an acoustic path between the loudspeaker and a far field microphone that is disposed at a greater distance from the speaker than the near field microphone;

determining an estimated echo based at least in part upon the echo transfer function;

subtracting the estimated echo from a signal received from the far field microphone, the subtracting effective to cancel an echo present in the signal received from the far end microphone.

2. The method of claim 1, wherein the near field microphone is a differential microphone.

3. The method of claim 2, wherein a differential pressure level due to a speaker output of the far end signal does not overload the differential microphone despite the differential microphone being proximate to the speaker.

4. The method of claim 3, wherein a signal picked up at the differential microphone is the speaker output including speaker non-linearity effects and has insignificant energy due to a near-end speech signal and ambient noise, and wherein the echo transfer function estimation process is a linear process.

5. The method of claim 2, wherein a differential pressure level due to a near-end speech signal and ambient noise is insignificant at the differential microphone due to distances of a source of the near-end speech signal and a source of the ambient noise from the differential microphone.

6. The method of claim 5, wherein a signal picked up at the differential microphone is a speaker output signal including speaker non-linearity effects and has insignificant energy due to a near-end speech signal and ambient noise, and wherein the echo transfer function is linear.

7. The method of claim 6, whereby the echo transfer estimate from the linear echo transfer function estimation is used to estimate a non-linear echo path and subtract the non-linear echo path from the signal received from the far-field microphone.

8. The method of claim 1, wherein the far end signal is amplified by a power amplifier.

9. The method of claim 1, wherein the speaker and near field microphone are disposed so as to be approximately within 5 mm of each other.

10. The method of claim 1, wherein the near field microphone, the far field microphone, and the speaker are disposed in a single platform.

11. The method of claim 10, wherein the single platform is in a cellular phone, laptop, tablet, home automation device, or other near-end speech communication device or device capable of audio playback and responsive to speech input.

12. The method of claim 1, wherein the near field microphone and the speaker are disposed in a single first platform and the far-field microphone is disposed in another a second platform within the same acoustic environment.

13. An apparatus, comprising,

a near field microphone for receiving sound from a speaker and producing an echo reference signal;

a far field microphone that receives sound from the speaker;

wherein the near field microphone and speaker are in close proximity;

an echo reference control module configured to adaptively and determine an echo estimation signal, the echo estimation signal being selected from between;

an echo reference signal received from the near field microphone and a far end signal from a far end user, the determination of the echo estimation signal based at least in part on a comparison between the echo reference signal and the far end signal;

an adaptation module that is configured to determine an echo transfer function based at least in part upon the selected echo estimation signal, and the adaptation module being further configured to determine an estimated echo based at least in part upon the echo transfer function;

a summer that subtracts the estimated echo from a signal produced by the far field microphone to produce an echo canceled signal.

14. The apparatus of claim 13, wherein the near field microphone is a differential microphone.

15. The apparatus of claim 14, wherein a differential pressure level due to a speaker output of the far end signal does not overload the differential microphone despite the differential microphone being proximate to the speaker.

16. The apparatus of claim 15, wherein a signal picked up the differential microphone is the speaker output including speaker non-linearity effects and has insignificant energy due to a near-end speech signal and ambient noise, and wherein the echo transfer function estimation process is a linear process.

17. The apparatus of claim 14, wherein a differential pressure level due to a near-end speech signal and ambient noise is insignificant at the differential microphone due to distances of a source of the near-end speech signal and a source of the ambient noise from the differential microphone.

18. The apparatus of claim 17, wherein a signal picked up at the differential microphone is a speaker output signal including speaker non-linearity effects and has insignificant energy due to a near-end speech signal and ambient noise, and wherein the echo transfer function is linear.

19. The apparatus of claim 18, whereby the echo transfer estimate from the linear echo transfer function estimation is used to estimate a non-linear echo path and subtract the non-linear echo path from the signal received from the far-field microphone.

20. The apparatus of claim 13, wherein the far end signal is amplified by a power amplifier.

21. The apparatus of claim 13, wherein the speaker and the near field microphone are disposed so as to be approximately within 5 mm of each other.

22. The apparatus of claim 13, wherein the near field microphone, the far field microphone, and the speaker are disposed in a single platform.

23. The apparatus of claim 22, wherein the single platform is in a cellular phone, laptop, tablet, home automation device, or other near-end speech communication device or device capable of audio playback and responsive to speech input.

24. The apparatus of claim 13, wherein the near field microphone and the speaker are disposed in a first platform and the far-field microphone is disposed in a second platform within the same acoustic environment.