Systems, methods, and apparatus for enhanced acoustic imaging

• US 8,965,546 B2
• Filed: 07/25/2011
• Issued: 02/24/2015
• Est. Priority Date: 07/26/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Visser, Erik, Xiang, Pei
• Primary Examiner(s): Saunders, Jr., Joseph
• Application Number:
  US13/190,464
• Publication Number:
  US 20120020480A1
• Time in Patent Office: 1,310 Days
• Field of Search: 700/94
• US Class Current: 700/94
• CPC Class Codes: H04R 2201/405 Non-uniform arrays of transducers or a plurality of uniform arrays with different transducer spacing
• CPC Class Codes: H04R 2430/20 Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic H04R2203/12 takes precedence
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

Methods, systems, and apparatus for using a psychoacoustic-bass-enhanced signal to drive an array of loudspeakers are disclosed.

Claims

1. A method of audio signal processing, said method comprising:

spatially processing a first audio signal to generate a first plurality M of imaging signals;

for each of the first plurality M of imaging signals, applying a corresponding one of a first plurality M of driving signals to a corresponding one of a first plurality M of loudspeakers of a first array, wherein the driving signal is based on the imaging signal;

harmonically extending a second audio signal that includes energy in a first frequency range to produce an extended signal that includes harmonics, in a second frequency range that is higher than the first frequency range, of said energy of the second audio signal in the first frequency range;

spatially processing an enhanced signal that is based on the extended signal to generate a second plurality N of imaging signals; and

for each of the second plurality N of imaging signals, applying a corresponding one of a second plurality N of driving signals to a corresponding one of a second plurality N of loudspeakers of the first array, wherein the driving signal is based on the imaging signal, and wherein a distance between adjacent ones of the first plurality M of loudspeakers is less than a distance between adjacent ones of the second plurality N of loudspeakers.

2. A method of audio signal processing according to claim 1, wherein the first plurality M of driving signals includes the second plurality N of driving signals.

3. A method of audio signal processing according to claim 1, wherein both of the first audio signal and the second audio signal are based on a common audio signal.

4. A method of audio signal processing according to claim 1, wherein said applying the second plurality N of driving signals to the second plurality N of loudspeakers comprises creating a beam of acoustic energy that is more concentrated along a first direction than along a second direction that is different than the first direction, and

wherein said method comprises, during said applying the second plurality N of driving signals to the second plurality N of loudspeakers, driving the second plurality N of loudspeakers to create a beam of acoustic noise energy that is more concentrated along the second direction than along the first direction,

wherein the first and second directions are relative to the second plurality N of loudspeakers.

5. A method of audio signal processing according to claim 1, wherein said applying the second plurality N of driving signals to the second plurality N of loudspeakers comprises creating a first beam of acoustic energy that is more concentrated along a first direction than along a second direction that is different than the first direction, and

wherein said method comprises, during said applying the second plurality N of driving signals to the second plurality N of loudspeakers, applying a third plurality N of driving signals to the second plurality N of loudspeakers to create a second beam of acoustic energy that is more concentrated along the second direction than along the first direction,

wherein the first and second directions are relative to the second plurality N of loudspeakers, and

wherein each of the third plurality N of driving signals is based on an additional audio signal that is different than the second audio signal.

6. A method of audio signal processing according to claim 5, wherein the second audio signal and the additional audio signal are different channels of a stereophonic audio signal.

7. A method of audio signal processing according to claim 1, wherein said method comprises determining that an orientation of a head of a user at a first time is within a first range, and

wherein said applying the first plurality M of driving signals to the first plurality M of loudspeakers and said applying the second plurality N of driving signals to the second plurality N of loudspeakers are based on said determining at the first time, and wherein said method comprises:

determining that an orientation of the head of the user at a second time subsequent to the first time is within a second range that is different than the first range;

in response to said determining at the second time, applying the first plurality M of driving signals to a first plurality M of loudspeakers of a second array and applying the second plurality N of driving signals to a second plurality N of loudspeakers of the second array,

wherein at least one of the first plurality M of loudspeakers of the second array is not among the first plurality M of loudspeakers of the first array, and

wherein at least one of the second plurality N of loudspeakers of the second array is not among the second plurality N of loudspeakers of the first array.

8. A method of audio signal processing according to claim 7, wherein the first plurality M of loudspeakers of the first array are arranged along a first axis, and

wherein the first plurality M of loudspeakers of the second array are arranged along a second axis, and

wherein an angle between the first and second axes is at least sixty degrees and not more than one hundred twenty degrees.

9. A method of audio signal processing according to claim 1, wherein said method comprises applying a spatial shaping function to the first plurality M of imaging signals, and

wherein said spatial shaping function maps a position of each among at least a subset of the first plurality M of loudspeakers within the first array to a corresponding gain factor, and

wherein said applying the spatial shaping function comprises varying an amplitude of each among the subset of the first plurality M of imaging signals according to the corresponding gain factor.

10. A method of audio signal processing according to claim 1, wherein a ratio of energy in the first frequency range to energy in the second frequency range is at least six decibels lower for each of the second plurality N of driving signals than for the extended signal.

11. A method of audio signal processing according to claim 1, wherein the second audio signal includes energy in a first high-frequency range that is higher than the second frequency range and energy in a second high-frequency range that is higher than the first high-frequency range, and

wherein a ratio of energy in the first high-frequency range to energy in the second high-frequency range is at least six decibels higher for each of the second plurality N of driving signals than for the extended signal.

12. A method of audio signal processing according to claim 1, wherein said method comprises harmonically extending a third audio signal that includes energy in the second frequency range to produce a second extended signal that includes harmonics, in a third frequency range that is higher than the second frequency range, of said energy of the third audio signal in the second frequency range, and

wherein the first audio signal is based on the second extended signal.

13. A method of audio signal processing according to claim 12, wherein a ratio of energy in the first frequency range to energy in the second frequency range is at least six decibels lower for each of the second plurality N of driving signals than for the extended signal, and

wherein a ratio of energy in the second frequency range to energy in the third frequency range is at least six decibels lower for each of the first plurality M of driving signals than for the second extended signal.

14. A method of audio signal processing according to claim 13, wherein a ratio of energy in the first frequency range to energy in the third frequency range is at least six decibels lower for each of the first plurality M of driving signals than for the second extended signal.

15. A method of audio signal processing according to claim 12, wherein the second audio signal includes energy in a first high-frequency range that is higher than the third frequency range and energy in a second high-frequency range that is higher than the first high-frequency range, and

wherein a ratio of energy in the first high-frequency range to energy in the second high-frequency range is at least six decibels higher for each of the second plurality N of driving signals than for the extended signal, and

wherein the third audio signal includes energy in the second high-frequency range and energy in a third high-frequency range that is higher than the second high-frequency range, and

wherein a ratio of energy in the second high-frequency range to energy in the third high-frequency range is at least six decibels higher for each of the first plurality M of driving signals than for the second extended signal.

16. A method of audio signal processing according to claim 12, wherein both of the second audio signal and the third audio signal are based on a common audio signal.

17. An apparatus for audio signal processing, said apparatus comprising:

means for spatially processing a first audio signal to generate a first plurality M of imaging signals;

means for applying, for each of the first plurality M of imaging signals, a corresponding one of a first plurality M of driving signals to a corresponding one of a first plurality M of loudspeakers of a first array, wherein the driving signal is based on the imaging signal;

means for harmonically extending a second audio signal that includes energy in a first frequency range to produce an extended signal that includes harmonics, in a second frequency range that is higher than the first frequency range, of said energy of the second audio signal in the first frequency range;

means for spatially processing an enhanced signal that is based on the extended signal to generate a second plurality N of imaging signals; and

means for applying, for each of the second plurality N of imaging signals, a corresponding one of a second plurality N of driving signals to a corresponding one of a second plurality N of loudspeakers of the first array, wherein the driving signal is based on the imaging signal, and wherein a distance between adjacent ones of the first plurality M of loudspeakers is less than a distance between adjacent ones of the second plurality N of loudspeakers.

18. An apparatus for audio signal processing according to claim 17, wherein the first plurality M of driving signals includes the second plurality N of driving signals.

19. An apparatus for audio signal processing according to claim 17, wherein both of the first audio signal and the second audio signal are based on a common audio signal.

20. An apparatus for audio signal processing according to claim 17, wherein said means for applying the second plurality N of driving signals to the second plurality N of loudspeakers is configured to create a beam of acoustic energy that is more concentrated along a first direction than along a second direction that is different than the first direction, and

wherein said apparatus comprises means for driving the second plurality N of loudspeakers, during said applying the second plurality N of driving signals to the second plurality N of loudspeakers, to create a beam of acoustic noise energy that is more concentrated along the second direction than along the first direction, wherein the first and second directions are relative to the second plurality N of loudspeakers.

21. An apparatus for audio signal processing according to claim 17, wherein said means for applying the second plurality N of driving signals to the second plurality N of loudspeakers is configured to create a first beam of acoustic energy that is more concentrated along a first direction than along a second direction that is different than the first direction, and

wherein said apparatus comprises means for applying a third plurality N of driving signals to the second plurality N of loudspeakers, during said applying the second plurality N of driving signals to the second plurality N of loudspeakers, to create a second beam of acoustic energy that is more concentrated along the second direction than along the first direction,

wherein the first and second directions are relative to the second plurality N of loudspeakers, and

wherein each of the third plurality N of driving signals is based on an additional audio signal that is different than the second audio signal.

22. An apparatus for audio signal processing according to claim 21, wherein the second audio signal and the additional audio signal are different channels of a stereophonic audio signal.

23. An apparatus for audio signal processing according to claim 17, wherein said apparatus comprises means for determining that an orientation of a head of a user at a first time is within a first range, and

wherein said means for determining at the first time is arranged to enable said means for applying the first plurality M of driving signals to the first plurality M of loudspeakers and said means for applying the second plurality N of driving signals to the second plurality N of loudspeakers, and

wherein said apparatus comprises:

means for determining that an orientation of the head of the user at a second time subsequent to the first time is within a second range that is different than the first range;

means for applying the first plurality M of driving signals to a first plurality M of loudspeakers of a second array; and

means for applying the second plurality N of driving signals to a second plurality N of loudspeakers of the second array,

wherein said means for determining at the second time is arranged to enable said means for applying the first plurality M of driving signals to the first plurality M of loudspeakers of the second array and said means for applying the second plurality N of driving signals to the second plurality N of loudspeakers of the second array,

wherein at least one of the first plurality M of loudspeakers of the second array is not among the first plurality M of loudspeakers of the first array, and

wherein at least one of the second plurality N of loudspeakers of the second array is not among the second plurality N of loudspeakers of the first array.

24. An apparatus for audio signal processing according to claim 23, wherein the first plurality M of loudspeakers of the first array are arranged along a first axis, and

wherein the first plurality M of loudspeakers of the second array are arranged along a second axis, and

wherein an angle between the first and second axes is at least sixty degrees and not more than one hundred twenty degrees.

25. An apparatus for audio signal processing according to claim 17, wherein said apparatus comprises means for applying a spatial shaping function to the first plurality M of imaging signals, and

wherein said spatial shaping function maps a position of each among at least a subset of the first plurality M of loudspeakers within the first array to a corresponding gain factor, and

wherein said means for applying the spatial shaping function comprises means for varying an amplitude of each among the subset of the first plurality M of imaging signals according to the corresponding gain factor.

26. An apparatus for audio signal processing according to claim 17, wherein a ratio of energy in the first frequency range to energy in the second frequency range is at least six decibels lower for each of the second plurality N of driving signals than for the extended signal.

27. An apparatus for audio signal processing according to claim 17, wherein the second audio signal includes energy in a first high-frequency range that is higher than the second frequency range and energy in a second high-frequency range that is higher than the first high-frequency range, and

wherein a ratio of energy in the first high-frequency range to energy in the second high-frequency range is at least six decibels higher for each of the second plurality N of driving signals than for the extended signal.

28. An apparatus for audio signal processing according to claim 17, wherein said apparatus comprises means for harmonically extending a third audio signal that includes energy in the second frequency range to produce a second extended signal that includes harmonics, in a third frequency range that is higher than the second frequency range, of said energy of the third audio signal in the second frequency range, and

wherein the first audio signal is based on the second extended signal.

29. An apparatus for audio signal processing according to claim 28, wherein a ratio of energy in the first frequency range to energy in the second frequency range is at least six decibels lower for each of the second plurality N of driving signals than for the extended signal, and

wherein a ratio of energy in the second frequency range to energy in the third frequency range is at least six decibels lower for each of the first plurality M of driving signals than for the second extended signal.

30. An apparatus for audio signal processing according to claim 29, wherein a ratio of energy in the first frequency range to energy in the third frequency range is at least six decibels lower for each of the first plurality M of driving signals than for the second extended signal.

31. An apparatus for audio signal processing according to claim 28, wherein the second audio signal includes energy in a first high-frequency range that is higher than the third frequency range and energy in a second high-frequency range that is higher than the first high-frequency range, and

wherein a ratio of energy in the first high-frequency range to energy in the second high-frequency range is at least six decibels higher for each of the second plurality N of driving signals than for the extended signal, and

wherein the third audio signal includes energy in the second high-frequency range and energy in a third high-frequency range that is higher than the second high-frequency range, and

wherein a ratio of energy in the second high-frequency range to energy in the third high-frequency range is at least six decibels higher for each of the first plurality M of driving signals than for the second extended signal.

32. An apparatus for audio signal processing according to claim 28, wherein both of the second audio signal and the third audio signal are based on a common audio signal.

33. An apparatus for audio signal processing, said apparatus comprising:

a first spatial processing module configured to spatially process a first audio signal to generate a first plurality M of imaging signals;

an audio output stage configured to apply, for each of the first plurality M of imaging signals, a corresponding one of a first plurality M of driving signals to a corresponding one of a first plurality M of loudspeakers of a first array, wherein the driving signal is based on the imaging signal;

a harmonic extension module configured to harmonically extend a second audio signal that includes energy in a first frequency range to produce an extended signal that includes harmonics, in a second frequency range that is higher than the first frequency range, of said energy of the second audio signal in the first frequency range; and

a second spatial processing module configured to spatially process an enhanced signal that is based on the extended signal to generate a second plurality N of imaging signals, wherein said audio output stage is configured to apply, for each of the second plurality N of imaging signals, a corresponding one of a second plurality N of driving signals to a corresponding one of a second plurality N of loudspeakers of the first array, wherein the driving signal is based on the imaging signal, and wherein a distance between adjacent ones of the first plurality M of loudspeakers is less than a distance between adjacent ones of the second plurality N of loudspeakers.

34. An apparatus for audio signal processing according to claim 33, wherein the first plurality M of driving signals includes the second plurality N of driving signals.

35. An apparatus for audio signal processing according to claim 33, wherein both of the first audio signal and the second audio signal are based on a common audio signal.

36. An apparatus for audio signal processing according to claim 33, wherein said audio output stage is configured to apply the second plurality N of driving signals to the second plurality N of loudspeakers to create a beam of acoustic energy that is more concentrated along a first direction than along a second direction that is different than the first direction, and

wherein said audio output stage is configured to drive the second plurality N of loudspeakers, during said applying the second plurality N of driving signals to the second plurality N of loudspeakers, to create a beam of acoustic noise energy that is more concentrated along the second direction than along the first direction,

wherein the first and second directions are relative to the second plurality N of loudspeakers.

37. An apparatus for audio signal processing according to claim 33, wherein said audio output stage is configured to apply the second plurality N of driving signals to the second plurality N of loudspeakers to create a first beam of acoustic energy that is more concentrated along a first direction than along a second direction that is different than the first direction, and

wherein said audio output stage is configured to apply a third plurality N of driving signals to the second plurality N of loudspeakers, during said applying the second plurality N of driving signals to the second plurality N of loudspeakers, to create a second beam of acoustic energy that is more concentrated along the second direction than along the first direction, wherein the first and second directions are relative to the second plurality N of loudspeakers, and

wherein each of the third plurality N of driving signals is based on an additional audio signal that is different than the second audio signal.

38. An apparatus for audio signal processing according to claim 37, wherein the second audio signal and the additional audio signal are different channels of a stereophonic audio signal.

39. An apparatus for audio signal processing according to claim 33, wherein said apparatus comprises a tracking module configured to determine that an orientation of a head of a user at a first time is within a first range, and

wherein said tracking module is arranged to control said audio output stage to apply the first plurality M of driving signals to the first plurality M of loudspeakers and to apply the second plurality N of driving signals to the second plurality N of loudspeakers, in response to said determining at the first time, and

wherein said tracking module is configured to determine that an orientation of the head of the user at a second time subsequent to the first time is within a second range that is different than the first range, and

wherein said tracking module is arranged to control said audio output stage to apply the first plurality M of driving signals to a first plurality M of loudspeakers of a second array and to apply the second plurality N of driving signals to a second plurality N of loudspeakers of the second array, in response to said determining at the second time, and

wherein at least one of the first plurality M of loudspeakers of the second array is not among the first plurality M of loudspeakers of the first array, and

wherein at least one of the second plurality N of loudspeakers of the second array is not among the second plurality N of loudspeakers of the first array.

40. An apparatus for audio signal processing according to claim 39, wherein the first plurality M of loudspeakers of the first array are arranged along a first axis, and

wherein the first plurality M of loudspeakers of the second array are arranged along a second axis, and

wherein an angle between the first and second axes is at least sixty degrees and not more than one hundred twenty degrees.

41. An apparatus for audio signal processing according to claim 33, wherein said apparatus comprises a spatial shaper configured to apply a spatial shaping function to the first plurality M of imaging signals, and

wherein said spatial shaping function maps a position of each among at least a subset of the first plurality M of loudspeakers within the first array to a corresponding gain factor, and

wherein said spatial shaper is configured to vary an amplitude of each among the subset of the first plurality M of imaging signals according to the corresponding gain factor.

42. An apparatus for audio signal processing according to claim 33, wherein a ratio of energy in the first frequency range to energy in the second frequency range is at least six decibels lower for each of the second plurality N of driving signals than for the extended signal.

43. An apparatus for audio signal processing according to claim 33, wherein the second audio signal includes energy in a first high-frequency range that is higher than the second frequency range and energy in a second high-frequency range that is higher than the first high-frequency range, and

wherein a ratio of energy in the first high-frequency range to energy in the second high-frequency range is at least six decibels higher for each of the second plurality N of driving signals than for the extended signal.

44. An apparatus for audio signal processing according to claim 33, wherein said apparatus comprises a second harmonic extension module configured to harmonically extend a third audio signal that includes energy in the second frequency range to produce a second extended signal that includes harmonics, in a third frequency range that is higher than the second frequency range, of said energy of the third audio signal in the second frequency range, and

wherein the first audio signal is based on the second extended signal.

45. An apparatus for audio signal processing according to claim 44, wherein a ratio of energy in the first frequency range to energy in the second frequency range is at least six decibels lower for each of the second plurality N of driving signals than for the extended signal, and

wherein a ratio of energy in the second frequency range to energy in the third frequency range is at least six decibels lower for each of the first plurality M of driving signals than for the second extended signal.

46. An apparatus for audio signal processing according to claim 45, wherein a ratio of energy in the first frequency range to energy in the third frequency range is at least six decibels lower for each of the first plurality M of driving signals than for the second extended signal.

47. An apparatus for audio signal processing according to claim 44, wherein the second audio signal includes energy in a first high-frequency range that is higher than the third frequency range and energy in a second high-frequency range that is higher than the first high-frequency range, and

wherein a ratio of energy in the first high-frequency range to energy in the second high-frequency range is at least six decibels higher for each of the second plurality N of driving signals than for the extended signal, and

wherein the third audio signal includes energy in the second high-frequency range and energy in a third high-frequency range that is higher than the second high-frequency range, and

wherein a ratio of energy in the second high-frequency range to energy in the third high-frequency range is at least six decibels higher for each of the first plurality M of driving signals than for the second extended signal.

48. An apparatus for audio signal processing according to claim 44, wherein both of the second audio signal and the third audio signal are based on a common audio signal.

49. A non-transitory computer-readable storage medium having tangible features that when read by a machine cause the machine to:

spatially process a first audio signal to generate a first plurality M of imaging signals;

apply, for each of the first plurality M of imaging signals, a corresponding one of a first plurality M of driving signals to a corresponding one of a first plurality M of loudspeakers of a first array, wherein the driving signal is based on the imaging signal;

harmonically extend a second audio signal that includes energy in a first frequency range to produce an extended signal that includes harmonics, in a second frequency range that is higher than the first frequency range, of said energy of the second audio signal in the first frequency range;

spatially process an enhanced signal that is based on the extended signal to generate a second plurality N of imaging signals; and

apply, for each of the second plurality N of imaging signals, a corresponding one of a second plurality N of driving signals to a corresponding one of a second plurality N of loudspeakers of the first array, wherein the driving signal is based on the imaging signal, and wherein a distance between adjacent ones of the first plurality M of loudspeakers is less than a distance between adjacent ones of the second plurality N of loudspeakers.