SYSTEMS, METHODS, AND APPARATUS FOR SPATIALLY DIRECTIVE FILTERING

• US 20130272539A1
• Filed: 03/15/2013
• Published: 10/17/2013
• Est. Priority Date: 04/13/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Kim, Lae-Hoon, Visser, Erik
• Granted Patent: US 9,291,697 B2
• Time in Patent Office: Days
• US Class Current: 381/92
• CPC Class Codes: G01B 21/00 Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
• CPC Class Codes: G01S 15/86 Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
• CPC Class Codes: G01S 15/876 Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector G01S15/872 takes precedence
• CPC Class Codes: G01S 3/80 using ultrasonic, sonic or infrasonic waves
• CPC Class Codes: G01S 3/8006 Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals
• CPC Class Codes: G01S 3/8083 determining direction of source
• CPC Class Codes: G01S 5/18 using ultrasonic, sonic, or infrasonic waves
• CPC Class Codes: G01S 5/186 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G06F 1/1633 Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/40 Visual indication of stereophonic sound image

Abstract

Systems, methods, and apparatus are described for applying, based on angles of arrival of source components relative to the axes of different microphone pairs, a spatially directive filter to a multichannel audio signal to produce an output signal.

Claims

1. A method of processing a multichannel audio signal that includes a first source component and a second source component, said method comprising:

calculating a first angle of arrival, relative to an axis of a first pair of microphones, for the first source component and a first angle of arrival, relative to the axis of the first pair of microphones, for the second source component;

calculating a second angle of arrival, relative to an axis of a second pair of microphones, for the first source component and a second angle of arrival, relative to the axis of the second pair of microphones, for the second source component;

based on said first angles of arrival and said second angles of arrival, applying a spatially directive filter to the multichannel audio signal to produce an output signal.

2. The method according to claim 1, wherein said calculated first angle of arrival for the first source component is different than said calculated second angle of arrival for the first source component.

3. The method according to claim 1, wherein said axis of the first pair of microphones is neither parallel to nor coincident with said axis of the second pair of microphones.

4. The method according to claim 1, wherein said calculating the first angles of arrival is based on information from a first pair of channels of the multichannel audio signal and said calculating the second angles of arrival is based on information from a second pair of channels of the multichannel audio signal, and

wherein each channel of said first pair of channels is based on a signal produced by a corresponding microphone of the first pair of microphones and each channel of said second pair of channels is based on a signal produced by a corresponding microphone of the second pair of microphones.

5. The method according to claim 1, wherein a direction of arrival of at least one source component among the first and second source components is outside a plane defined by the axis of the first pair of microphones and the axis of the second pair of microphones.

6. The method according to claim 1, wherein one microphone of said first pair of microphones is also included in said second pair of microphones.

7. The method according to claim 1, wherein, for each channel of the multichannel audio signal, a proportion of energy of the first source component, relative to energy of the second source component, is greater in the output signal than in said channel of the multichannel audio signal.

8. The method according to claim 1, wherein said applying the spatially directive filter includes selecting the spatially directive filter, based on said calculated first angles of arrival and said calculated second angles of arrival, from among a plurality of spatially directive filters.

9. The method according to claim 1, wherein said applying the spatially directive filter includes calculating a plurality of filter coefficients of the spatially directive filter, based on said calculated first angles of arrival and said calculated second angles of arrival.

10. The method according to claim 9, wherein said calculating the plurality of filter coefficients of the spatially directive filter comprises:

calculating a plurality of steering vectors; and

inverting a matrix that is based on the plurality of steering vectors,

wherein said plurality of filter coefficients of the spatially directive filter is based on the inverted matrix, and

wherein said plurality of steering vectors includes;

a first steering vector that is based on said calculated first angle of arrival for the first source component,

a second steering vector that is based on said calculated first angle of arrival for the second source component,

a third steering vector that is based on said calculated second angle of arrival for the first source component, and

a fourth steering vector that is based on said calculated second angle of arrival for the second source component.

11. The method according to claim 10, wherein said first steering vector indicates a propagation delay of the first source component at the first pair of microphones, said second steering vector indicates a propagation delay of the second source component at the first pair of microphones, said third steering vector indicates a propagation delay of the first source component at the second pair of microphones, and said fourth steering vector indicates a propagation delay of the second source component at the second pair of microphones.

12. The method according to claim 10, wherein said method comprises calculating an array steering matrix such that (A) a first column of the array steering matrix includes the first steering vector and the second steering vector and (B) a second column of the array steering matrix includes the third steering vector and the fourth steering vector, and

wherein said matrix that is based on the plurality of steering vectors is based on the array steering matrix.

13. The method according to claim 12, wherein a first row of the array steering matrix corresponds to one microphone of the first pair of microphones, a second row of the array steering matrix corresponds to the other microphone of the first pair of microphones, and a third row of the array steering matrix corresponds to one microphone of the second pair of microphones.

14. The method according to claim 12, wherein each element of a diagonal of said matrix that is based on said array steering matrix includes a regularization value.

15. The method according to claim 12, wherein said spatially directive filter comprises a plurality of frequency-domain filters, and

wherein each of the plurality of frequency-domain filters is based on a corresponding array steering matrix, and

wherein said applying the spatially directive filter to the multichannel audio signal comprises applying each of at least some of the plurality of frequency-domain filters to a corresponding frequency component of the multichannel audio signal, and

wherein said calculating the plurality of filter coefficients of the spatially directive filter comprises determining, for each of at least some of the plurality of frequency-domain filters, whether a matrix that is based on the corresponding array steering matrix is ill-conditioned.

16. The method according to claim 1, wherein said spatially directive filter comprises a plurality of frequency-domain filters, and

wherein said applying the spatially directive filter to the multichannel audio signal comprises, for each of at least some of the plurality of frequency-domain filters, applying the frequency-domain filter to a corresponding frequency component of the multichannel audio signal.

52. A non-transitory computer-readable data storage medium having tangible features that cause a machine reading the features to perform a method according to claim 1.

17. A method of processing a multichannel signal, said method comprising:

calculating a plurality of steering vectors;

inverting a matrix that is based on the plurality of steering vectors; and

applying a spatially directive filter that is based on the inverted matrix to the multichannel signal,

wherein said multichannel signal includes a first pair of channels and a second pair of channels, wherein each channel of the first pair of channels is based on a signal produced by a corresponding microphone of a first pair of microphones, and wherein each channel of the second pair of channels is based on a signal produced by a corresponding microphone of a second pair of microphones, and

wherein said plurality of steering vectors includes;

a first steering vector that is based on a first designated angle of arrival relative to an axis of the first pair of microphones,

a second steering vector that is based on a second designated angle of arrival relative to the axis of the first pair of microphones,

a third steering vector that is based on a third designated angle of arrival relative to the axis of the second pair of microphones, and

a fourth steering vector that is based on a fourth designated angle of arrival relative to the axis of the second pair of microphones.

18. An apparatus for processing a multichannel audio signal that includes a first source component and a second source component, said apparatus comprising:

means for calculating a first angle of arrival, relative to an axis of a first pair of microphones, for the first source component and a first angle of arrival, relative to the axis of the first pair of microphones, for the second source component;

means for calculating a second angle of arrival, relative to an axis of a second pair of microphones, for the first source component and a second angle of arrival, relative to the axis of the second pair of microphones, for the second source component;

means for applying, based on said first angles of arrival and said second angles of arrival, a spatially directive filter to the multichannel audio signal to produce an output signal.

19. The apparatus according to claim 18, wherein said calculated first angle of arrival for the first source component is different than said calculated second angle of arrival for the first source component.

20. The apparatus according to claim 18, wherein said axis of the first pair of microphones is neither parallel to nor coincident with said axis of the second pair of microphones.

21. The apparatus according to claim 18, wherein said means for calculating the first angles of arrival is configured to calculate the first angles of arrival based on information from a first pair of channels of the multichannel audio signal, and

wherein said means for calculating the second angles of arrival is configured to calculate the second angles of arrival based on information from a second pair of channels of the multichannel audio signal, and

wherein each channel of said first pair of channels is based on a signal produced by a corresponding microphone of the first pair of microphones and each channel of said second pair of channels is based on a signal produced by a corresponding microphone of the second pair of microphones.

22. The apparatus according to claim 18, wherein a direction of arrival of at least one source component among the first and second source components is outside a plane defined by the axis of the first pair of microphones and the axis of the second pair of microphones.

23. The apparatus according to claim 18, wherein one microphone of said first pair of microphones is also included in said second pair of microphones.

24. The apparatus according to claim 18, wherein, for each channel of the multichannel audio signal, a proportion of energy of the first source component, relative to energy of the second source component, is greater in the output signal than in said channel of the multichannel audio signal.

25. The apparatus according to claim 18, wherein said means for applying the spatially directive filter includes means for selecting the spatially directive filter, based on said calculated first angles of arrival and said calculated second angles of arrival, from among a plurality of spatially directive filters.

26. The apparatus according to claim 18, wherein said means for applying the spatially directive filter includes means for calculating a plurality of filter coefficients of the spatially directive filter, based on said calculated first angles of arrival and said calculated second angles of arrival.

27. The apparatus according to claim 26, wherein said means for calculating the plurality of filter coefficients of the spatially directive filter comprises:

means for calculating a plurality of steering vectors; and

means for inverting a matrix that is based on the plurality of steering vectors,

wherein said plurality of filter coefficients of the spatially directive filter is based on the inverted matrix, and

wherein said plurality of steering vectors includes;

a first steering vector that is based on said calculated first angle of arrival for the first source component,

a second steering vector that is based on said calculated first angle of arrival for the second source component,

a third steering vector that is based on said calculated second angle of arrival for the first source component, and

a fourth steering vector that is based on said calculated second angle of arrival for the second source component.

28. The apparatus according to claim 27, wherein said first steering vector indicates a propagation delay of the first source component at the first pair of microphones, said second steering vector indicates a propagation delay of the second source component at the first pair of microphones, said third steering vector indicates a propagation delay of the first source component at the second pair of microphones, and said fourth steering vector indicates a propagation delay of the second source component at the second pair of microphones.

29. The apparatus according to claim 27, wherein said apparatus comprises means for calculating an array steering matrix such that (A) a first column of the array steering matrix includes the first steering vector and the second steering vector and (B) a second column of the array steering matrix includes the third steering vector and the fourth steering vector, and

wherein said matrix that is based on the plurality of steering vectors is based on the array steering matrix.

30. The apparatus according to claim 29, wherein a first row of the array steering matrix corresponds to one microphone of the first pair of microphones, a second row of the array steering matrix corresponds to the other microphone of the first pair of microphones, and a third row of the array steering matrix corresponds to one microphone of the second pair of microphones.

31. The apparatus according to claim 29, wherein each element of a diagonal of said matrix that is based on said array steering matrix includes a regularization value.

32. The apparatus according to claim 29, wherein said spatially directive filter comprises a plurality of frequency-domain filters, and

wherein each of the plurality of frequency-domain filters is based on a corresponding array steering matrix, and

wherein said means for applying the spatially directive filter to the multichannel audio signal comprises means for applying each of at least some of the plurality of frequency-domain filters to a corresponding frequency component of the multichannel audio signal, and

wherein said means for calculating the plurality of filter coefficients of the spatially directive filter comprises means for determining, for each of at least some of the plurality of frequency-domain filters, whether a matrix that is based on the corresponding array steering matrix is ill-conditioned.

33. The apparatus according to claim 18, wherein said spatially directive filter comprises a plurality of frequency-domain filters, and

wherein said means for applying the spatially directive filter to the multichannel audio signal comprises means for applying, for each of at least some of the plurality of frequency-domain filters, the frequency-domain filter to a corresponding frequency component of the multichannel audio signal.

34. An apparatus for processing a multichannel signal, said apparatus comprising:

means for calculating a plurality of steering vectors;

means for inverting a matrix that is based on the plurality of steering vectors; and

means for applying a spatially directive filter that is based on the inverted matrix to the multichannel signal,

wherein said multichannel signal includes a first pair of channels and a second pair of channels, wherein each channel of the first pair of channels is based on a signal produced by a corresponding microphone of a first pair of microphones, and wherein each channel of the second pair of channels is based on a signal produced by a corresponding microphone of a second pair of microphones, and

wherein said plurality of steering vectors includes;

a first steering vector that is based on a first designated angle of arrival relative to an axis of the first pair of microphones,

a second steering vector that is based on a second designated angle of arrival relative to the axis of the first pair of microphones,

a third steering vector that is based on a third designated angle of arrival relative to the axis of the second pair of microphones, and

a fourth steering vector that is based on a fourth designated angle of arrival relative to the axis of the second pair of microphones.

35. An apparatus for processing a multichannel audio signal that includes a first source component and a second source component, said apparatus comprising:

a calculator configured to calculate;

a first angle of arrival, relative to an axis of a first pair of microphones, for the first source component;

a first angle of arrival, relative to the axis of the first pair of microphones, for the second source component;

a second angle of arrival, relative to an axis of a second pair of microphones, for the first source component; and

a second angle of arrival, relative to the axis of the second pair of microphones, for the second source component, and

a discriminator configured to apply, based on said first angles of arrival and said second angles of arrival, a spatially directive filter to the multichannel audio signal to produce an output signal.

36. The apparatus according to claim 35, wherein said calculated first angle of arrival for the first source component is different than said calculated second angle of arrival for the first source component.

37. The apparatus according to claim 35, wherein said axis of the first pair of microphones is neither parallel to nor coincident with said axis of the second pair of microphones.

38. The apparatus according to claim 35, wherein said calculator is configured to calculate the first angles of arrival based on information from a first pair of channels of the multichannel audio signal and to calculate the second angles of arrival based on information from a second pair of channels of the multichannel audio signal, and

wherein each channel of said first pair of channels is based on a signal produced by a corresponding microphone of the first pair of microphones and each channel of said second pair of channels is based on a signal produced by a corresponding microphone of the second pair of microphones.

39. The apparatus according to claim 35, wherein a direction of arrival of at least one source component among the first and second source components is outside a plane defined by the axis of the first pair of microphones and the axis of the second pair of microphones.

40. The apparatus according to claim 35, wherein one microphone of said first pair of microphones is also included in said second pair of microphones.

41. The apparatus according to claim 35, wherein, for each channel of the multichannel audio signal, a proportion of energy of the first source component, relative to energy of the second source component, is greater in the output signal than in said channel of the multichannel audio signal.

42. The apparatus according to claim 35, wherein said discriminator includes a selector configured to select the spatially directive filter, based on said calculated first angles of arrival and said calculated second angles of arrival, from among a plurality of spatially directive filters.

43. The apparatus according to claim 35, wherein said discriminator includes a second calculator configured to calculate a plurality of filter coefficients of the spatially directive filter, based on said calculated first angles of arrival and said calculated second angles of arrival.

44. The apparatus according to claim 43, wherein said second calculator is configured to calculate a plurality of steering vectors and to invert a matrix that is based on the plurality of steering vectors,

wherein said plurality of filter coefficients of the spatially directive filter is based on the inverted matrix, and

wherein said plurality of steering vectors includes:

a first steering vector that is based on said calculated first angle of arrival for the first source component,

a second steering vector that is based on said calculated first angle of arrival for the second source component,

a third steering vector that is based on said calculated second angle of arrival for the first source component, and

a fourth steering vector that is based on said calculated second angle of arrival for the second source component.

45. The apparatus according to claim 44, wherein said first steering vector indicates a propagation delay of the first source component at the first pair of microphones, said second steering vector indicates a propagation delay of the second source component at the first pair of microphones, said third steering vector indicates a propagation delay of the first source component at the second pair of microphones, and said fourth steering vector indicates a propagation delay of the second source component at the second pair of microphones.

46. The apparatus according to claim 44, wherein said apparatus comprises a matrix calculator configured to calculate an array steering matrix such that (A) a first column of the array steering matrix includes the first steering vector and the second steering vector and (B) a second column of the array steering matrix includes the third steering vector and the fourth steering vector, and

wherein said matrix that is based on the plurality of steering vectors is based on the array steering matrix.

47. The apparatus according to claim 46, wherein a first row of the array steering matrix corresponds to one microphone of the first pair of microphones, a second row of the array steering matrix corresponds to the other microphone of the first pair of microphones, and a third row of the array steering matrix corresponds to one microphone of the second pair of microphones.

48. The apparatus according to claim 46, wherein each element of a diagonal of said matrix that is based on said array steering matrix includes a regularization value.

49. The apparatus according to claim 46, wherein said spatially directive filter comprises a plurality of frequency-domain filters, and

wherein each of the plurality of frequency-domain filters is based on a corresponding array steering matrix, and

wherein said discriminator is configured to apply each of at least some of the plurality of frequency-domain filters to a corresponding frequency component of the multichannel audio signal, and

wherein said second calculator is configured to determine, for each of at least some of the plurality of frequency-domain filters, whether a matrix that is based on the corresponding array steering matrix is ill-conditioned.

50. The apparatus according to claim 35, wherein said spatially directive filter comprises a plurality of frequency-domain filters, and

wherein said discriminator is configured to apply, for each of at least some of the plurality of frequency-domain filters, the frequency-domain filter to a corresponding frequency component of the multichannel audio signal.

51. An apparatus for processing a multichannel signal, said apparatus comprising:

a calculator configured to calculate a plurality of steering vectors and to invert a matrix that is based on the plurality of steering vectors; and

a spatially directive filter that is based on the inverted matrix and is arranged to filter the multichannel signal to produce an output signal,

wherein said multichannel signal includes a first pair of channels and a second pair of channels, wherein each channel of the first pair of channels is based on a signal produced by a corresponding microphone of a first pair of microphones, and wherein each channel of the second pair of channels is based on a signal produced by a corresponding microphone of a second pair of microphones, and

wherein said plurality of steering vectors includes;

a first steering vector that is based on a first designated angle of arrival relative to an axis of the first pair of microphones,

a second steering vector that is based on a second designated angle of arrival relative to the axis of the first pair of microphones,

a third steering vector that is based on a third designated angle of arrival relative to the axis of the second pair of microphones, and

a fourth steering vector that is based on a fourth designated angle of arrival relative to the axis of the second pair of microphones.