Beamforming Pre-Processing for Speaker Localization

• US 20100014690A1
• Filed: 07/16/2009
• Published: 01/21/2010
• Est. Priority Date: 07/16/2008
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Buck, Markus, Wolff, Tobias, Schmidt, Gerhard
• Granted Patent: US 8,660,274 B2
• Time in Patent Office: Days
• US Class Current: 381/92
• CPC Class Codes: H04R 2430/20 Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic H04R2203/12 takes precedence
• CPC Class Codes: H04R 2430/23 Direction finding using a sum-delay beam-former
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

Embodiments of the present invention relate to methods, systems, and computer program products for signal processing. A first plurality of microphone signals is obtained by a first microphone array. A second plurality of microphone signals is obtained by a second microphone array different from the first microphone array. The first plurality of microphone signals is beamformed by a first beamformer comprising beamforming weights to obtain a first beamformed signal. The second plurality of microphone signals is beamformed by a second beamformer comprising the same beamforming weights as the first beamformer to obtain a second beamformed signal. The beamforming weights are adjusted such that the power density of echo components and/or noise components present in the first and second plurality of microphone signals is substantially reduced.

Claims

1. A method for signal processing in a signal processing system comprising the steps of:

obtaining a first plurality of microphone signals by a first microphone array;

obtaining a second plurality of microphone signals by a second microphone array different from the first microphone array;

beamforming the first plurality of microphone signals by a first beamformer comprising beamforming weights to obtain a first beamformed signal;

beamforming the second plurality of microphone signals by a second beamformer comprising the same beamforming weights as the first beamformer to obtain a second beamformed signal; and

adjusting the beamforming weights such that the power density of echo components and/or noise components present in the first and second plurality of microphone signals is substantially reduced.

2. The method according to claim 1, wherein the beamforming weights are adjusted such that the power density of the sum of the first and the second beamformed signals is substantially reduced.

3. The method according to claim 1, wherein the beamforming weights are adjusted such that the sum of the power density of the first beamformed signal and the power density of the second beamformed signal is substantially reduced.

4. The method according to claim 1, wherein the beamforming weights are adjusted by a non-linear least mean square algorithm observing the condition that the L2 norm of the vector of the beamforming weights is greater than zero.

5. The method according to claim 1, wherein the beamforming weights are adjusted by a non linear least mean square algorithm observing the condition that the power transfer function of the first and the second beamformers for a predetermined frequency range and a predetermined range of spatial angles does not fall below a predetermined limit.

6. The method according to claim 1, wherein the first and the second microphone arrays are sub-arrays of a third microphone array and the first and second plurality of microphone signals are selected from a third plurality of microphone signals obtained by the third microphone array and wherein,

in particular, the first plurality of microphone signals comprises at least one microphone signal of the second plurality of microphone signals.

7. A method according to claim 1 further comprising:

determining the speaker'"'"'s direction towards and/or distance from the first and/or second microphone arrays on the basis of the first and/or second beamformed signals.

8. Signal processing means, comprising:

a first microphone array configured to obtain a first plurality of microphone signals;

a second microphone array different from the first microphone array and configured to obtain a second plurality of microphone signals;

a first beamformer comprising beamforming weights and configured to beamform the first plurality of microphone signals to obtain a first beamformed signal;

a second beamformer comprising the same beamforming weights as the first beamformer and configured to beamform the second plurality of microphone signals to obtain a second beamformed signal; and

a control means configured to adjust the beamforming weights such that the power density of echo components and/or noise components present in the first and/or second plurality of microphone signals is minimized.

9. The signal processing means according to claim 8, wherein the control means is configured to adjust the beamforming weights by minimizing the power density of the sum of the first and the second beamformed signals or by minimizing the sum of the power density of the first beamformed signal and the power density of the second beamformed signals.

10. The signal processing means according to claim 8, wherein the first and second beamformers are chosen from the group consisting of an adaptive filter-and-sum beamformer, a linearly constrained minimum variance beamformer,

in particular, a minimum variance distortionless response beamformer, and a differential beamformer.

11. A communication system adapted for the localization of a speaker, the communication system comprising:

a first microphone array configured to obtain a first plurality of microphone signals;

a second microphone array different from the first microphone array and configured to obtain a second plurality of microphone signals;

a first beamformer comprising beamforming weights and configured to beamform the first plurality of microphone signals to obtain a first beamformed signal;

a second beamformer comprising the same beamforming weights as the first beamformer and configured to beamform the second plurality of microphone signals to obtain a second beamformed signal;

a control means configured to adjust the beamforming weights such that the power density of echo components and/or noise components present in the first and/or second plurality of microphone signals is minimized; and

a processing means configured to determine the speaker'"'"'s direction towards and/or distance from the first and/or second microphone arrays on the basis of the first and/or second beamformed signals.

12. A communication system according to claim 11 wherein the communication system is a hands-free communication device.