Beam rejection in multi-beam microphone systems

• US 9,689,960 B1
• Filed: 04/04/2013
• Issued: 06/27/2017
• Est. Priority Date: 04/04/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Barton, William Folwell, Hild, II, Kenneth Edgar, Gopalan, Ramya, Chhetri, Amit Singh, Velusamy, Kavitha
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): Hamid, Ammar
• Application Number:
  US13/857,040
• Time in Patent Office: 1,545 Days
• Field of Search: 381 66, 381 61, 381 92
• CPC Class Codes: G01S 3/805 using adjustment of real or effective orientation of directivity characteristics of a transducer or transducer system to give a desired condition of signal derived from that transducer or transducer system, e.g. to give a maximum or minimum signal
• CPC Class Codes: G01S 3/8083 determining direction of source
• CPC Class Codes: G01S 3/86 with means for eliminating undesired waves, e.g. disturbing noises
• CPC Class Codes: G01S 5/22 Position of source determined by co-ordinating a plurality of position lines defined by path-difference measurements G01S5/28 takes precedence
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 2201/401 2D or 3D arrays of transducers
• CPC Class Codes: H04R 2201/403 Linear arrays of transducers
• CPC Class Codes: H04R 2430/20 Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic H04R2203/12 takes precedence
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 25/407 Circuits for combining signals of a plurality of transducers
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

The systems, devices, and processes described herein may identify a beam of a voice-controlled device that is directed toward a reflective surface, such as a wall. The beams may be created by a beamformer. An acoustic echo canceller (AEC) may create filter coefficients for a reference sound. The filter coefficients may be analyzed to identify beams that include multiple peaks. The multiple peaks may indicate presence of one or more reflective surfaces. Using the amplitude and the time delay between the peaks, the device may determine that it is close to a reflective surface in a direction of the beam.

Claims

1. A computing device comprising:

memory;

one or more processors;

an audio player module stored in the memory and executable by the one or more processors to cause a speaker to generate a reference sound based on a reference signal;

a plurality of microphones that receive the reference sound and generate a plurality of audio signals;

a beamforming module stored in the memory and executable by the one or more processors to receive the audio signals and to generate a plurality of beamformed signals;

an acoustic echo cancellation module stored in the memory and executable by the one or more processors to use the reference signal to perform echo cancellation on each beamformed signal of the plurality of beamformed signals, wherein the acoustic echo cancellation module outputs filter coefficients for each beamformed signal; and

a beam rejection module stored in the memory and executable by the one or more processors to;

determine, using the filter coefficients, that a first beamformed signal of the plurality of beamformed signals comprises a reflection of the reference sound, wherein the reflection is associated with a first time delay;

determine that the computing device is proximate to a reflective surface in a direction of the first beamformed signal when the first time delay is less than or equal to a threshold; and

exclude from further processing, at least temporarily, a beamformed signal having a direction that is at least substantially the same as the direction of the first beamformed signal.

2. The computing device as recited in claim 1, wherein the threshold corresponds to a predetermined acceptable distance of the computing device to the reflective surface.

3. The computing device as recited in claim 1, wherein the plurality of microphones comprise a circular microphone array and wherein the beamforming module comprises a fixed beamformer.

4. A computer-implemented method comprising:

under control of one or more processors of a computing device,

generating, by a speaker, audio using an audio signal;

receiving, from a microphone array, a plurality of received audio signals generated by the microphone array from the audio;

creating a first beamformed signal using at least one of (i) the plurality of received audio signals or (ii) a plurality of processed signals derived from the plurality of received audio signals;

generating a plurality of filter coefficients by performing acoustic echo cancellation (AEC) on at least one of (i) the first beamformed signal, (ii) a first received audio signal of the plurality of received audio signals, or (iii) a processed signal derived from at least one of the plurality of received audio signals;

determining, based at least in part on the plurality of filter coefficients, at least one of an amplitude or a time delay corresponding to a reflection of the audio;

determining that the computing device is proximate to a reflective surface in a direction of the first beamformed signal using at least one of the amplitude or the time delay; and

excluding from further processing, at least temporarily, a beamformed signal having a direction that is at least substantially the same as the direction of the first beamformed signal.

5. The computer-implemented method as recited in claim 4, wherein creating the first beamformed signal comprises using a fixed beamformer.

6. The computer-implemented method as recited in claim 4, wherein the audio signal comprises music.

7. The computer-implemented method as recited in claim 4, wherein determining, based at least in part on the filter coefficients, at least one of an amplitude or a time delay corresponding to the reflection of the audio comprises:

analyzing the filter coefficients to determine a first peak corresponding to a direct path of the audio and a second peak corresponding to a reflection of the audio.

8. The computer-implemented method as recited in claim 4, further comprising performing preprocessing on the plurality of received audio signals, wherein the preprocessing occurs prior to creating the first beamformed signal and prior to generating the plurality of filter coefficients.

9. The computer-implemented method as recited in claim 4, wherein the first beamformed signals is created prior to generating the plurality of filter coefficients, and wherein generating the plurality of filter coefficients comprises using the first beamformed signal.

10. The computer-implemented method as recited in claim 4, wherein the plurality of filter coefficients is generated prior to creating the first beamformed signal and wherein generating the plurality of filter coefficients comprises using the received audio signals.

11. The computer-implemented method as recited in claim 4, wherein the creating the first beamformed signal includes a front-end process occurring prior to generating the plurality of filter coefficients and a back-end process occurring after generating the plurality of filter coefficients.

12. The computer-implemented method as recited in claim 4, further comprising determining that the amplitude is greater than a threshold amplitude.

13. The computer-implemented method as recited in claim 12, further comprising determining that the time delay is greater than a threshold time delay, and wherein the threshold time delay corresponds to a predetermined acceptable distance of the computing device to the reflective surface.

14. One or more non-transitory computer-readable media storing compute-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

causing a speaker to generate audio from an audio signal;

receiving, from a microphone array, a plurality of received audio signals;

creating a plurality of filter coefficients by acoustic echo cancellation (AEC) of the received audio signals;

creating a first beamformed signal using the plurality of received audio signals;

associating the plurality of filter coefficients with the first beamformed signal;

analyzing the filter coefficients to identify a time delay corresponding to a reflection of the audio;

determining that the time delay is less than or equal to a threshold; and

excluding from further processing, at least temporarily, a beamformed signal having a direction that is at least substantially the same as the first beamformed signal.

15. The one or more non-transitory computer-readable media as recited in claim 14, wherein the first beamformed signal is created prior to performing the AEC.

16. The one or more non-transitory computer-readable media as recited in claim 14, wherein the threshold corresponds to a predetermined acceptable distance of a computing device to a reflective surface that causes the reflection.

17. The one or more non-transitory computer-readable media as recited in claim 14, wherein the audio signal is a portion of a longer audio clip.

18. The one or more non-transitory computer-readable media as recited in claim 14, wherein the analyzing the filter coefficients comprises determining that the reflection of the audio includes an amplitude greater than or equal to a threshold amplitude or includes a difference in amplitude that is less than or equal to a threshold difference.

19. The one or more non-transitory computer-readable media as recited in claim 14, wherein creating a first beamformed signal comprises using a fixed beamformer.