Method and device for in ear canal echo suppression

• US 8,526,645 B2
• Filed: 07/09/2008
• Issued: 09/03/2013
• Est. Priority Date: 05/04/2007
• Status: Active Grant

• Current Assignee: Staton Techiya, LLC
• Original Assignee: Personics Holdings, Inc.
• Inventors: Boillot, Marc, Usher, John, Goldstein, Steven, McIntosh, Jason
• Primary Examiner(s): Lao, Lun-See
• Application Number:
  US12/170,171
• Publication Number:
  US 20090034765A1
• Time in Patent Office: 1,882 Days
• Field of Search: 381/74, 381/57, 381 941- 945, 381/107, 381/309, 381/315, 381/59, 381/71.1, 381/380, 381/56, 381/71.11, 381/71.12, 379/207.02, 37940601-40616, 704/260
• US Class Current: 381/309
• CPC Class Codes: H04R 1/1016 Earpieces of the intra-aural type
• CPC Class Codes: H04R 25/02 adapted to be supported entirely by ear
• CPC Class Codes: H04R 25/453 electronically
• CPC Class Codes: H04R 3/002 Damping circuit arrangements for transducers, e.g. motional feedback circuits

Abstract

An earpiece (100) and acoustic management module (300) for in-ear canal echo suppression control suitable is provided. The earpiece can include an Ambient Sound Microphone (111) to capture ambient sound, an Ear Canal Receiver (125) to deliver audio content to an ear canal, an Ear Canal Microphone (123) configured to capture internal sound, and a processor (121) to generate a voice activity level (622) and suppress an echo of spoken voice in the electronic internal signal, and mix an electronic ambient signal with an electronic internal signal in a ratio dependent on the voice activity level and a background noise level to produce a mixed signal (323) that is delivered to the ear canal (131).

Claims

1. A method for in-ear canal echo suppression control suitable for use in an earpiece, the method comprising the steps of:

capturing an ambient acoustic signal from at least one Ambient Sound Microphone (ASM) to produce an electronic ambient signal;

capturing in an ear canal an internal sound from at least one Ear Canal Microphone (ECM) to produce an electronic internal signal, the electronic internal signal including an echo of a spoken voice generated by a wearer of the earpiece;

measuring a background noise signal from the electronic ambient signal and the electronic internal signal;

suppressing the echo in the electronic internal signal to produce a modified electronic internal signal containing primarily the spoken voice;

generating a voice activity level for the spoken voice based on characteristics of the modified electronic internal signal and a level of the background noise signal; and

mixing and adjusting the electronic ambient signal with the electronic internal signal in a ratio dependent on at least one of the voice activity level or the background noise signal to produce a mixed signal that is delivered to the ear canal by way of an Ear Canal Receiver (ECR).

2. The method of claim 1, comprising

increasing an internal gain of the electronic internal signal as background noise levels increase, while

decreasing an external gain of the electronic ambient signal as the background noise levels increase, or

decreasing the internal gain of the electronic internal signal as the background noise levels decrease, while

increasing the external gain of the electronic ambient signal as the background noise levels decrease.

3. The method of claim 1, where the step of mixing includes filtering the electronic ambient signal and the electronic internal signal based on a characteristic of the background noise signal,

where the characteristic is the level of the background noise signal, a spectral profile, or an envelope fluctuation.

4. The method of claim 3, further comprising

adapting a first set of filter coefficients of a Least Mean Squares (LMS) filter to model an ear canal microphone transfer function (ECTF).

5. The method of claim 4, further comprising

monitoring the voice activity level of the modified electronic internal signal;

and

freezing an adaptation of the first set of filter coefficients for the modified electronic internal signal if the voice activity level is above a predetermined threshold.

6. The method of claim 5, further comprising transmitting the modified electronic internal signal to a voice communication device.

7. The method of claim 5, further comprising looping back the modified electronic internal signal to the ear canal.

8. The method of claim 4, wherein the voice activity level is determined by an energy level characteristic and a frequency response characteristic.

9. The method of claim 4, further comprising

adapting a second set of filter coefficients for a replica of the LMS filter, and

substituting the second set of filter coefficients for the first set of filter coefficients when the voice activity level is below a predetermined threshold.

10. The method of claim 1, comprising

at low background noise levels and low voice activity levels, amplifying the electronic ambient signal relative to the electronic internal signal in producing the mixed signal,

at medium background noise levels and medium voice activity levels, attenuating low frequencies in the electronic ambient signal and attenuating high frequencies in the electronic internal signal, and

at high background noise levels and high voice activity levels, amplifying the electronic internal signal relative to the electronic ambient signal in producing the mixed signal.

11. A method for in-ear canal echo suppression control suitable for use in an earpiece, the method comprising the steps of:

capturing an ambient sound from at least one Ambient Sound Microphone (ASM) to produce an electronic ambient signal;

delivering audio content to an ear canal by way of an Ear Canal Receiver (ECR) to produce an acoustic audio content;

capturing in the ear canal by way of an Ear Canal Microphone (ECM) the acoustic audio content to produce an electronic internal signal, the electronic internal signal including an echo of a spoken voice generated by a wearer of the earpiece;

suppressing the echo of the spoken voice in the electronic internal signal to produce a modified electronic internal signal;

generating a voice activity level of the spoken voice based on the modified electronic internal signal and the electronic ambient signal; and

controlling a mixing and an adjusting of the electronic ambient signal and the electronic internal signal based on the voice activity level.

12. The method of claim 11, further comprising

measuring a background noise signal from the electronic ambient signal and the electronic internal signal;

and

mixing the electronic ambient signal with the electronic internal signal in a ratio dependent on the background noise signal to produce a mixed signal that is delivered to the ear canal by way of the ECR.

13. The method of claim 12, further comprising

accounting for an acoustic attenuation level of the earpiece;

accounting for an audio content level reproduced by the ECR that delivers the audio content to the earpiece; and

adjusting the mixing based on the audio content level, a level of the background noise signal, and the acoustic attenuation level of the earpiece.

14. The method of claim 12, further comprising filtering the electronic ambient signal and the electronic internal signal based on a characteristic of the background noise signal,

where the characteristic is a level of the background noise signal, a spectral profile, or an envelope fluctuation.

15. The method of claim 11, further comprising

adapting a first set of filter coefficients of a Least Mean Squares (LMS) filter to model an ear canal microphone transfer function (ECTF);

freezing an adaptation of the first set of filter coefficients for the modified electronic internal signal if the voice activity level is above a first predetermined threshold, while

adapting a second set of filter coefficients for a replica of the LMS filter; and

substituting the second set of filter coefficients for the first set of filter coefficients when the voice activity level is below a second predetermined threshold and unfreezing the adaptation of the first set of filter coefficients.

16. The method of claim 11, wherein the mixing is performed by

applying a first gain (G1) to the electronic ambient signal, and

applying a second gain (G2) to the electronic internal signal, where the first gain and the second gain are a function of a background noise level (BNL) and the voice activity level (VAL), according to the relation:

G1=f(BNL)+f(VAL)and G2=f(BNL)+f(VAL).

17. The method of claim 11, comprising controlling at least one voice operation of the earpiece based on the voice activity level.

18. The method of claim 11, comprising

transmitting the modified electronic internal signal to another voice communication device;

and

looping back the modified electronic internal signal to the ear canal.

19. An earpiece to provide in-ear canal echo suppression, comprising:

an Ambient Sound Microphone (ASM) configured to capture ambient sound and produce an electronic ambient signal;

an Ear Canal Receiver (ECR) configured to deliver audio content to an ear canal;

an Ear Canal Microphone (ECM) configured to capture internal sound in the ear canal and produce an electronic internal signal, the electronic internal signal including an echo of a spoken voice generated by a wearer of the earpiece; and

a processor operatively coupled to the ASM, the ECM and the ECR where the processor is configured to;

measure a background noise signal from the electronic ambient signal and the electronic internal signal;

suppress the echo of the spoken voice in the electronic internal signal to produce a modified electronic internal signal containing primarily the spoken voice;

generate a voice activity level for the spoken voice based on characteristics of the modified electronic internal signal and a level of the background noise signal; and

mix and adjust the electronic ambient signal with the electronic internal signal in a ratio dependent on at least one of the voice activity level or the background noise signal to produce a mixed signal that is delivered to the ear canal by way of the ECR.

20. The earpiece of claim 19, further comprising a Least Mean Squares (LMS) echo suppressor to model an ear canal microphone transfer function (ECTF) between the ASM and the ECM.

21. The earpiece of claim 19, further comprising

a transceiver operatively coupled to the processor to transmit the mixed signal to a further communication device.

22. The earpiece of claim 21, where the processor plays the mixed signal back to the ECR for loopback listening.

23. The earpiece of claim 20, comprising a voice activity detector operatively coupled to the echo suppressor to

adapt a first set of filter coefficients of the echo suppressor to model an ear canal microphone transfer function (ECTF);

freeze an adaptation of the first set of filter coefficients for the modified electronic internal signal if the voice activity level is above a first predetermined threshold, while

adapting a second set of filter coefficients for the echo suppressor; and

substitute the second set of filter coefficients for the first set of filter coefficients when the voice activity level is below a second predetermined threshold and unfreezing the adaptation of the first set of filter coefficients.

24. The earpiece of claim 19, wherein the audio content is at least one among a phone call, a voice message, a music signal, and the spoken voice.