Forming beams with nulls directed at noise sources

• US 7,991,167 B2
• Filed: 04/13/2006
• Issued: 08/02/2011
• Est. Priority Date: 04/29/2005
• Status: Active Grant

• Current Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Original Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Inventors: Oxford, William V.
• Primary Examiner(s): Chin; Vivian
• Assistant Examiner(s): Kim; Paul
• Application Number:
  US11/404,107
• Publication Number:
  US 20060262943A1
• Time in Patent Office: 1,937 Days
• Field of Search: 381/92, 381/94.1, 381/94.3, 381/122, 367/118, 367/124, 367/127, 367/129
• US Class Current: 381/92
• CPC Class Codes: H04R 2225/41 Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
• CPC Class Codes: H04R 2430/23 Direction finding using a sum-delay beam-former
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

A communication system (e.g., a speakerphone) includes an array of microphones, a speaker, memory and a processor. The processor may perform a virtual broadside scan on the microphone array and analyze the resulting amplitude envelope to identify acoustic source angles. Each of the source angles may be further investigated with a directed beam (e.g., a hybrid superdirective/delay-and-sum beam) to obtain a corresponding beam signal. Each source may be classified as either intelligence or noise based on an analysis of the corresponding beam signal. The processor may design a virtual beam pointed at an intelligence source and having nulls directed at one or more of the noise sources. Thus, the virtual beam may be highly sensitive to the intelligence source and insensitive to the noise sources.

Claims

1. A method comprising:

(a) identifying angles of acoustic sources from peaks in an amplitude envelope, wherein the amplitude envelope corresponds to an output of a virtual broadside scan on blocks of input signal samples, one block from each microphone in an array of microphones, wherein the microphones of the array are arranged on a circle, wherein the virtual broadside scan comprises scanning a virtual broadside array through a set of angles spanning the circle in order to generate said output, wherein the virtual broadside array operates on the blocks of input signal samples;

(b) for each of the source angles, operating on the input signal blocks with a directed beam pointed in the direction of the source angle to obtain a corresponding beam signal;

(c) classifying each source as speech or noise based on analysis of spectral characteristics of the corresponding beam signal, wherein said classifying results in one or more of the sources being classified as speech and one or more of the sources being classified as noise;

(d) generating parameters for a virtual beam, pointed at a first of the speech sources, and having one or more nulls pointed at least at a subset of the one or more noise sources;

(e) operating on the input signal blocks with the virtual beam to obtain an output signal;

(f) transmitting the output signal to one or more remote devices.

2. The method of claim 1, wherein (a) through (f) are performed by one or more processors in a speakerphone.

3. The method of claim 1 further comprising:

selecting said subset of the one or more noise sources by identifying a number of the one or more noise sources whose corresponding beam signals have the highest energies.

4. The method of claim 1 further comprising:

performing the virtual broadside scan on the blocks of input signal samples to generate the amplitude envelope.

5. The method of claim 4 further comprising:

repeating said performing and said actions (a) through (f) on different sets of input signal sample blocks from the array of microphones.

6. The method of claim 1, wherein the microphones of said array are arranged in a horizontal plane.

7. The method of claim 1, wherein the microphones of said array are omni-directional microphones.

8. The method of claim 1, wherein said identifying angles of acoustic sources from peaks in an amplitude envelope comprises:

estimating an angular position of a first peak in the amplitude envelope;

constructing a shifted and scaled version of a virtual broadside response pattern using the angular position and an amplitude of the first peak;

subtracting the shifted and scaled version from the amplitude envelope to obtain an update to the amplitude envelope.

9. The method of claim 8 further comprising repeating said estimating, said constructing, and said subtracting on the updated amplitude envelope in order to identify a second peak.

15. The memory medium of claim 1, wherein said identifying angles of acoustic sources from peaks in an amplitude envelope comprises:

estimating an angular position of a first peak in the amplitude envelope;

constructing a shifted and scaled version of a virtual broadside response pattern using the angular position and an amplitude of the first peak;

subtracting the shifted and scaled version from the amplitude envelope to obtain an update to the amplitude envelope.

16. The memory medium of claim 15 wherein the program instructions are executable to further implement:

repeating said estimating, said constructing and said subtracting on the updated amplitude envelope.

10. A computer readable memory medium configured to store program instructions, wherein the program instructions are executable to implement:

(a) identifying angles of acoustic sources from peaks in an amplitude envelope, wherein the amplitude envelope corresponds to an output of a virtual broadside scan on blocks of input signal samples, one block from each microphone in an array of microphones, wherein the microphones of the array are arranged on a circle, wherein the virtual broadside scan comprises scanning a virtual broadside array through a set of angles spanning the circle in order to generate said output, wherein the virtual broadside array operates on the blocks of input signal samples;

(b) for each of the source angles, operating on the input signal blocks with a directed beam pointed in the direction of the source angle to obtain a corresponding beam signal;

(c) classifying each source as speech or noise based on analysis of spectral characteristics of the corresponding beam signal, wherein said classifying results in one or more of the sources being classified as speech and one or more of the sources being classified as noise;

(d) generating parameters for one or more virtual beams so that each of the one or more virtual beams is pointed at a corresponding one of the speech sources and has one or more nulls pointed at least at a subset of the one or more noise sources;

(e) operating on the input signal blocks with the one or more virtual beams to obtain corresponding output signals;

(f) generating a resultant signal from the one or more output signals.

11. The memory medium of claim 10, wherein the program instructions are executable to further implement:

transmitting the resultant signal to one or more remote devices.

12. The memory medium of claim 10 wherein the program instructions are executable to further implement:

performing the virtual broadside scan on the blocks of input signal samples to generate the amplitude envelope.

13. The memory medium of claim 11 wherein the program instructions are executable to further implement:

repeating said performing and operations (a) through (f) on different sets of input signal sample blocks from the array of microphones.

14. The memory medium of claim 10 further comprising:

selecting said subset of the one or more noise sources by identifying a number of the one or more noise sources whose corresponding beam signals have the highest energies.

17. A system comprising:

memory configured to store program instructions;

a processor configured to read and execute the program instructions from the memory, wherein the program instructions are executable by the processor to implement;

(a) identifying angles of acoustic sources from peaks in an amplitude envelope, wherein the amplitude envelope corresponds to an output of a virtual broadside scan on blocks of input signal samples, one block from each microphone in an array of microphones, wherein the microphones of the array are arranged on a circle, wherein the virtual broadside scan comprises scanning a virtual broadside array through a set of angles spanning the circle in order to generate said output, wherein the virtual broadside array operates on the blocks of input signal samples;

(b) for each of the source angles, operating on the input signal blocks with a directed beam pointed in the direction of the source angle to obtain a corresponding beam signal;

(c) classifying each source as speech or noise based on analysis of spectral characteristics of the corresponding beam signal, wherein said classifying results in one or more of the sources being classified as speech and one or more of the sources being classified as noise;

(d) generating parameters for a virtual beam, pointed at a first of the speech sources, and having one or more nulls pointed at least at a subset of the one or more noise sources;

(e) operating on the input signal blocks with the virtual beam to obtain an output signal;

(f) transmitting the output signal to one or more remote devices.

18. The system of claim 17 further comprising said array of microphones.