Processing audio signals

• US 8,824,693 B2
• Filed: 11/30/2011
• Issued: 09/02/2014
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Skype S.Ã R.L. (Microsoft Corporation)
• Inventors: hgren, Per
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): FAHNERT, FRIEDRICH
• Application Number:
  US13/307,994
• Publication Number:
  US 20130083934A1
• Time in Patent Office: 1,007 Days
• Field of Search: 381 56- 58, 381/71.1, 381/71.11, 381/71.12, 381/92, 381/94.1, 381 95- 96, 381/122, 381/66, 381/80, 381/107, 704/205, 704/224, 704/226, 704/233, 37940601-40616
• US Class Current: 381/58
• CPC Class Codes: G10K 11/34 using electrical steering of transducer arrays, e.g. beam steering constructional aspects B06B1/0607, B06B1/085
• CPC Class Codes: H04M 9/082 using echo cancellers echo cancellers per se H04B3/23
• CPC Class Codes: H04R 2430/23 Direction finding using a sum-delay beam-former
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 2499/15 Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 3/02 for preventing acoustic reaction , i.e. acoustic oscillatory feedback specially adapted for hearing aids H04R25/453

Abstract

Method, device and computer program product for processing audio signals at the device, the device comprising an audio output for outputting audio signals. Audio signals are received at a plurality of microphones of the device. A characteristic of at least one of the audio signals received by the plurality of microphones is measured. A beamformer applies beamformer coefficients to the received audio signals, thereby generating a beamformer output. An echo canceller is applied to the beamformer output, thereby suppressing, from the beamformer output, an echo resulting from audio signals output from the audio output, wherein an operating parameter of the echo canceller is controlled based on the measured characteristic of the at least one of the audio signals received by the plurality of microphones.

Claims

1. A method of processing audio signals at a device, the device comprising an audio output for outputting audio signals, the method comprising:

receiving audio signals at a plurality of microphones of the device;

measuring a characteristic of at least one of the audio signals received by the plurality of microphones;

a beamforrner applying beamformer coefficients to the received audio signals, thereby generating a beamforrner output; and

applying an echo canceller to the beamforrner output, thereby suppressing, from the beamformer output, an echo resulting from audio signals output from the audio output,

wherein an operating parameter of the echo canceller is controlled based on the measured characteristic of the at least one of the audio signals received by the plurality of microphones,

wherein the power of said at least one of the audio signals received by the plurality of microphones is used to determine an upper bound on the power of the strongest of the received audio signals based on the distance between the plurality of microphones of the device.

2. The method of claim 1 wherein said at least one of the audio signals received by the plurality of microphones comprises the strongest of the received audio signals.

3. The method of claim 2 further comprising determining which of the received audio signals is the strongest of the received audio signals.

4. The method of claim 1 wherein said at least one of the audio signals received by the plurality of microphones is selected from those ones of the received audio signals which have a power which is not more than a predetermined amount less than the power of the strongest of the received audio signals.

5. The method of claim 4 wherein the predetermined amount is variable, and the method comprises receiving a variation of the predetermined amount.

6. The method of claim 1 wherein said measuring a characteristic of at least one of the audio signals comprises measuring an echo path gain from the at least one of the audio signals received by the plurality of microphones.

7. The method of claim 6 further comprising using said measured echo path gain to determine an estimate of the echo power in the beamformer output, wherein said operating parameter is controlled based on the estimate of the echo power in the beamformer output.

8. The method of claim 7 further comprising determining a frequency dependent beamformer gain that is applied by the beamformer to the audio signals that are received by the plurality of microphones from a principal direction of the beamformer, wherein said beamformer gain is used in said determination of the estimate of the echo power in the beamformer output.

9. The method of claim 7 wherein said determined estimate of the echo power represents an upper bound of the echo power in the beamformer output.

10. The method of claim 1 wherein said operating parameter comprises a level of echo suppression which is applied by the echo canceller to the beamformer output.

11. The method of claim 1 further comprising adapting said beamformer coefficients of the beamformer based on an analysis of the received audio signals.

12. The method of claim 11 wherein said beamformer coefficients are adapted so as to minimise the power in the beamformer output within beamforming constraints of the beamformer.

13. The method of claim 12 wherein said beamforming constraints of the beamformer comprise a constraint that an audio signal received at the plurality of microphones in a principal direction of the beamformer is not distorted by the application of the beamformer coefficients.

14. The method of claim 1 wherein the beamformer coefficients describe either a linear function or a non-linear function of the received audio signals.

15. A device for processing audio signals, the device comprising:

an audio output for outputting audio signals;

a plurality of microphones for receiving audio signals;

a beamformer configured to apply beamformer coefficients to the received audio signals, to thereby generate a beamformer output;

an echo canceller configured to be applied to the beamformer output, to thereby suppress, from the beamformer output, an echo resulting from audio signals output from the audio output; and

a measuring component for measuring a characteristic of at least one of the audio signals received by the plurality of microphones, and for controlling an operating parameter of the echo canceller based on the measured characteristic of the at least one of the audio signals received by the plurality of microphones,

wherein the power of said at least one of the audio signals received by the plurality of microphones is used to determine an upper bound on the power of the strongest of the received audio signals based on the distance between the plurality of microphones.

16. The device of claim 15 wherein said echo canceller is arranged to apply echo suppression to the beamformer output.

17. The device of claim 16 wherein said echo canceller is further arranged to apply echo subtraction to each of the audio signals received by the plurality of microphones prior to application of the beamformer coefficients to the received audio signals by the beamformer.

18. The device of claim 15 wherein the beamformer is a Minimum Variance Distortionless Response beamformer.

19. A computer program product for processing audio signals at a device, the device comprising a plurality of microphones for receiving audio signals and audio output for outputting audio signals, the computer program product being embodied on a computer-readable device and configured so as when executed on a processor of the device to perform operations comprising:

measuring a characteristic of at least one of the audio signals received by the plurality of microphones;

using a beamformer to apply beamformer coefficients to the received audio signals, thereby generating a beamformer output; and

applying an echo canceller to the beamformer output, thereby suppressing, from the beamformer output, an echo resulting from audio signals output from the audio output,

wherein an operating parameter of the echo canceller is controlled based on the measured characteristic of the at least one of the audio signals received by the plurality of microphones,

wherein the power of said at least one of the audio signals received by the plurality of microphones is used to determine an upper bound on the power of the strongest of the received audio signals based on the distance between the plurality of microphones of the device.

20. A device configured to process audio signals, the device comprising:

an audio output block configured to output audio signals;

a plurality of microphones configured to receive audio signals;

a beamformer configured to apply beamformer coefficients to the received audio signals, to thereby generate a beamformer output;

an echo cancelling block configured to be applied to the beamformer output, to thereby suppress, from the beamformer output, an echo resulting from audio signals output from the audio output block; and

a processing block configured to measure a characteristic of at least one of the audio signals received by the plurality of microphones, and for controlling an operating parameter of the echo cancelling block based on the measured characteristic of the at least one of the audio signals received by the plurality of microphones,

wherein the power of said at least one of the audio signals received by the plurality of microphones is used to determine an upper bound on the power of the strongest of the received audio signals based on the distance between the plurality of microphones.

21. A method of processing audio signals at a device, the device comprising an audio output for outputting audio signals, the method comprising:

receiving audio signals at a plurality of microphones of the device;

measuring a characteristic of at least one of the audio signals received by the plurality of microphones by measuring an echo path gain from the at least one of the audio signals received by the plurality of microphones;

a beamforrner applying beamformer coefficients to the received audio signals, thereby generating a beamforrner output; and

applying an echo canceller to the beamforrner output, thereby suppressing, from the beamformer output, an echo resulting from audio signals output from the audio output,

wherein an operating parameter of the echo canceller is controlled based on the measured characteristic of the at least one of the audio signals received by the plurality of microphones, and using said measured echo path gain to determine an estimate of the echo power in the beamformer output, wherein said operating parameter is controlled based on the estimate of the echo power in the beamformer output.

22. The method of claim 21 further comprising determining a frequency dependent beamformer gain that is applied by the beamformer to the audio signals that are received by the plurality of microphones from a principal direction of the beamformer, wherein said beamformer gain is used in said determination of the estimate of the echo power in the beamformer output.

23. The method of claim 22 wherein said determined estimate of the echo power represents an upper bound of the echo power in the beamformer output.

24. A method of processing audio signals at a device, the device comprising an audio output for outputting audio signals, the method comprising:

receiving audio signals at a plurality of microphones of the device;

measuring a characteristic of at least one of the audio signals received by the plurality of microphones;

a beamforrner applying beamformer coefficients to the received audio signals, thereby generating a beamforrner output, said beamformer coefficients being adapted based on an analysis of the received audio signals and being adapted so as to minimise the power in the beamformer output within beamforming constraints of the beamformer; and

applying an echo canceller to the beamforrner output, thereby suppressing, from the beamformer output, an echo resulting from audio signals output from the audio output,

wherein an operating parameter of the echo canceller is controlled based on the measured characteristic of the at least one of the audio signals received by the plurality of microphones.

25. The method of claim 24 wherein said beamforming constraints of the beamformer comprise a constraint that an audio signal received at the plurality of microphones in a principal direction of the beamformer is not distorted by the application of the beamformer coefficients.