Systems, methods, apparatus, and computer-readable media for orientation-sensitive recording control

• US 9,031,256 B2
• Filed: 10/24/2011
• Issued: 05/12/2015
• Est. Priority Date: 10/25/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Visser, Erik, Liu, Ian Ernan, Ramakrishnan, Dinesh, Kim, Lae-Hoon, Xiang, Pei
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): SUTHERS, DOUGLAS JOHN
• Application Number:
  US13/280,211
• Publication Number:
  US 20120128175A1
• Time in Patent Office: 1,296 Days
• Field of Search: 381/92, 381/306, 381/333, 381/122, 381/310, 381/17, 381/18
• US Class Current: 381/92
• CPC Class Codes: H04R 2201/401 2D or 3D arrays of transducers
• CPC Class Codes: H04R 2201/403 Linear arrays of transducers
• CPC Class Codes: H04R 2201/405 Non-uniform arrays of transducers or a plurality of uniform arrays with different transducer spacing
• CPC Class Codes: H04R 2430/21 Direction finding using differential microphone array [DMA]
• CPC Class Codes: H04R 2430/23 Direction finding using a sum-delay beam-former
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 2400/15 Aspects of sound capture and related signal processing for recording or reproduction
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

A method of orientation-sensitive recording control includes indicating, within a portable device and at a first time, that the portable device has a first orientation relative to a gravitational axis and, based on the indication, selecting a first pair among at least three microphone channels of the portable device. This method also includes indicating, within the portable device and at a second time that is different than the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation and, based on the indication, selecting a second pair among the at least three microphone channels that is different than the first pair. In this method, each the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.

Claims

1. A method of orientation-sensitive recording control, said method comprising:

within a portable device, and at a first time, indicating that the portable device has a first orientation relative to a gravitational axis;

based on said indication that the portable device has the first orientation, selecting a first pair among at least three microphone channels of the portable device;

within the portable device, and at a second time that is subsequent to the first time, indicating that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation;

based on said indication that the portable device has the second orientation, selecting a second pair among the at least three microphone channels that is different than the first pair;

within the portable device, and at a third time subsequent to the first time, indicating that the portable device has a third orientation relative to a second axis that is orthogonal to the gravitational axis;

based on said indication that the portable device has the third orientation, selecting a first one of a plurality of spatially selective filtering operations; and

performing the selected spatially selective filtering operation on the second pair of microphone channels,

wherein each of the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.

2. The method according to claim 1, wherein the first pair of microphone channels includes a first microphone channel, and wherein the second pair of microphone channels includes the first microphone channel.

3. The method according to claim 1, wherein said indicating that the portable device has the second orientation includes detecting a rotation of the portable device about a line that is orthogonal to the gravitational axis.

4. The method according to claim 1, wherein said indicating that the portable device has the second orientation includes detecting a rotation of the portable device by at least forty-five degrees about a line that is orthogonal to the gravitational axis.

5. The method according to claim 1, wherein said method includes, during a time interval that includes the first and second times, recording a video sequence of images that are based on a signal produced by an imaging sensor of the portable device.

6. The method according to claim 1, wherein said selecting the first one of the plurality of spatially selective filtering operations is based on a specified direction in a plane that is orthogonal to the gravitational axis.

7. The method according to claim 1, wherein said indicating that the portable device has the third orientation is performed in response to an indication that a user of the device has selected a direction for recording.

8. The method according to claim 1, wherein said method comprises:

at a fourth time subsequent to the third time, indicating that the portable device has a fourth orientation relative to the second axis; and

based on said indication that the portable device has the fourth orientation, selecting a second one of the plurality of spatially selective filtering operations; and

performing the selected second spatially selective filtering operation on the second pair of microphone channels.

9. The method according to claim 8, wherein said indicating that the portable device has the fourth orientation includes detecting a rotation of the portable device about the gravitational axis.

10. The method according to claim 8, wherein said selecting a second one of the plurality of spatially selective filtering operations is based on a relation between the third and fourth orientations.

11. The method according to claim 10, wherein said relation is an angle in a plane orthogonal to the gravitational axis.

12. The method according to claim 8, wherein said performing the selected spatially selective filtering operation comprises applying a beam pattern having a first direction relative to the portable device to the second pair of microphone channels, and

wherein said performing the selected second spatially selective filtering operation comprises applying a beam pattern having a second direction relative to the portable device to the second pair of microphone channels,

wherein the second direction is at least thirty degrees different from the first direction.

13. A method of orientation-sensitive recording control, said method comprising:

within a portable device, and at a first time, indicating that the portable device has a first orientation relative to a gravitational axis;

based on said indication that the portable device has the first orientation, selecting a first pair among at least three microphone channels of the portable device;

within the portable device, and at a second time that is subsequent to the first time, indicating that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation;

based on said indication that the portable device has the second orientation, selecting a second pair among the at least three microphone channels that is different than the first pair;

within the portable device, and at a third time subsequent to the second time, indicating that the portable device has a third orientation relative to a second axis that is orthogonal to the gravitational axis; and

based on said indication that the portable device has the third orientation, selecting a third pair among the at least three microphone channels of the portable device that is different than the first pair and the second pair,

wherein each of the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.

14. An apparatus for orientation-sensitive recording control, said apparatus comprising:

means for indicating, at a first time, that a portable device has a first orientation relative to a gravitational axis;

means for selecting a first pair among at least three microphone channels of the portable device, based on said indication that the portable device has the first orientation;

means for indicating, at a second time that is different than the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation;

means for selecting a second pair among the at least three microphone channels that is different than the first pair, based on said indication that the portable device has the second orientation;

means for indicating, at a third time subsequent to the first time, that the portable device has a third orientation relative to a second axis that is orthogonal to the gravitational axis;

means for selecting a first one of a plurality of spatially selective filters, based on said indication that the portable device has the third orientation; and

means for applying the selected spatially selective filter to the second pair of microphone channels,

wherein each of the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.

15. The apparatus according to claim 14, wherein the first pair of microphone channels includes a first microphone channel, and wherein the second pair of microphone channels includes the first microphone channel.

16. The apparatus according to claim 14, wherein said means for indicating that the portable device has a second orientation is configured to indicate that the portable device has the second orientation by detecting a rotation of the portable device about a line that is orthogonal to the gravitational axis.

17. The apparatus according to claim 14, wherein said means for indicating that the portable device has a second orientation is configured to indicate that the portable device has the second orientation by detecting a rotation of the portable device by at least forty-five degrees about a line that is orthogonal to the gravitational axis.

18. The apparatus according to claim 14, wherein said apparatus includes means for recording, during a time interval that includes the first and second times, a video sequence of images that are based on a signal produced by an imaging sensor of the portable device.

19. The apparatus according to claim 14, wherein said means for selecting a first one of a plurality of spatially selective filters is configured to select the first one of the plurality of spatially selective filters based on a specified direction in a plane that is orthogonal to the gravitational axis.

20. The apparatus according to claim 14, wherein said means for selecting a first one of a plurality of spatially selective filters is configured to store a reference orientation in response to an indication that a user of the device has selected a direction for recording, and

wherein said reference orientation is based on said indication that the portable device has a third orientation.

21. The apparatus according to claim 14, wherein said apparatus includes:

means for indicating, at a fourth time subsequent to the third time, that the portable device has a fourth orientation relative to the second axis;

means for selecting a second one of the plurality of spatially selective filters, based on said indication that the portable device has the fourth orientation; and

means for applying the selected second spatially selective filter to the second pair of microphone channels.

22. The apparatus according to claim 21, wherein said means for indicating that the portable device has the fourth orientation is configured to indicate that the portable device has the fourth orientation by detecting a rotation of the portable device about the gravitational axis.

23. The apparatus according to claim 21, wherein said means for selecting a second one of the plurality of spatially selective filters is configured to select the second one of the plurality of spatially selective filters based on a relation between the third and fourth orientations.

24. The apparatus according to claim 23, wherein said relation is an angle in a plane orthogonal to the gravitational axis.

25. The apparatus according to claim 21, wherein a beam pattern of the selected spatially selective filter has a first direction relative to the portable device, and

wherein a beam pattern of the selected second spatially selective filter has a second direction relative to the portable device,

wherein the second direction is at least thirty degrees different from the first direction.

26. An apparatus for orientation-sensitive recording control, said apparatus comprising:

means for indicating, at a first time, that a portable device has a first orientation relative to a gravitational axis;

means for selecting a first pair among at least three microphone channels of the portable device, based on said indication that the portable device has the first orientation;

means for indicating, at a second time that is different than the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation;

means for selecting a second pair among the at least three microphone channels that is different than the first pair, based on said indication that the portable device has the second orientation;

means for indicating, at a third time subsequent to the second time, that the portable device has a third orientation relative to a second axis that is orthogonal to the gravitational axis; and

means for selecting a third pair among the at least three microphone channels of the portable device that is different than the first pair and the second pair, based on said indication that the portable device has the third orientation

wherein each of the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.

27. An apparatus for orientation-sensitive recording control, said apparatus comprising:

an orientation sensor configured to indicate, at a first time, that a portable device has a first orientation relative to a gravitational axis; and

a microphone channel selector configured to select a first pair among at least three microphone channels of the portable device, based on said indication that the portable device has the first orientation,

wherein each of the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device, and

wherein said orientation sensor is configured to indicate, at a second time that is different than the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation,

wherein said microphone channel selector is configured to select a second pair among the at least three microphone channels that is different than the first pair, based on said indication that the portable device has the second orientation,

wherein said orientation sensor is configured to indicate, at a third time subsequent to the first time, that the portable device has a third orientation relative to a second axis that is orthogonal to the gravitational axis, and

wherein said apparatus includes a spatial processing module configured (A) to select a first one of a plurality of spatially selective filters based on said indication that the portable device has the third orientation, and (B) to apply the selected spatially selective filter to the second pair of microphone channels.

28. The apparatus according to claim 27, wherein the first pair of microphone channels includes a first microphone channel, and wherein the second pair of microphone channels includes the first microphone channel.

29. The apparatus according to claim 27, wherein said orientation sensor is configured to indicate that the portable device has the second orientation by detecting a rotation of the portable device about a line that is orthogonal to the gravitational axis.

30. The apparatus according to claim 27, wherein said orientation sensor is configured to indicate that the portable device has the second orientation by detecting a rotation of the portable device by at least forty-five degrees about a line that is orthogonal to the gravitational axis.

31. The apparatus according to claim 27, wherein said apparatus includes a video recording module configured to record, during a time interval that includes the first and second times, a video sequence of images that are based on a signal produced by an imaging sensor of the portable device.

32. The apparatus according to claim 27, wherein said spatial processing module is configured to select the first one of the plurality of spatially selective filters based on a specified direction in a plane that is orthogonal to the gravitational axis.

33. The apparatus according to claim 27, wherein said spatial processing module is configured to store a reference orientation in response to an indication that a user of the device has selected a direction for recording, and

wherein said reference orientation is based on said indication that the portable device has a third orientation.

34. The apparatus according to claim 27, wherein said orientation sensor is configured to indicate, at a fourth time subsequent to the third time, that the portable device has a fourth orientation relative to the second axis, and

wherein said spatial processing module is configured (A) to select a second one of the plurality of spatially selective filters, based on said indication that the portable device has the fourth orientation, and (B) to apply the selected second spatially selective filter to the second pair of microphone channels.

35. The apparatus according to claim 34, wherein said orientation sensor is configured to indicate that the portable device has the fourth orientation by detecting a rotation of the portable device about the gravitational axis.

36. The apparatus according to claim 34, wherein said spatial processing module is configured to select the second one of the plurality of spatially selective filters based on a relation between the third and fourth orientations.

37. The apparatus according to claim 36, wherein said relation is an angle in a plane orthogonal to the gravitational axis.

38. The apparatus according to claim 34, wherein a beam pattern of the selected spatially selective filter has a first direction relative to the portable device, and

wherein a beam pattern of the selected second spatially selective filter has a second direction relative to the portable device,

wherein the second direction is at least thirty degrees different from the first direction.

39. An apparatus for orientation-sensitive recording control, said apparatus comprising:

an orientation sensor configured to indicate, at a first time, that a portable device has a first orientation relative to a gravitational axis; and

a microphone channel selector configured to select a first pair among at least three microphone channels of the portable device, based on said indication that the portable device has the first orientation,

wherein each of the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device, and

wherein said orientation sensor is configured to indicate, at a second time that is different than the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation,

wherein said microphone channel selector is configured to select a second pair among the at least three microphone channels that is different than the first pair, based on said indication that the portable device has the second orientation,

wherein said orientation sensor is configured to indicate, at a third time subsequent to the second time, that the portable device has a third orientation relative to a second axis that is orthogonal to the gravitational axis, and

said spatial processing module is configured to select a third pair among the at least three microphone channels of the portable device that is different than the first pair and the second pair, based on said indication that the portable device has the third orientation.

40. A non-transitory machine-readable storage medium comprising tangible features that when read by a machine cause the machine to:

indicate, at a first time, that a portable device has a first orientation relative to a gravitational axis;

select a first pair among at least three microphone channels of the portable device, based on said indication that the portable device has the first orientation;

indicate, at a second time that is subsequent to the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation;

select a second pair among the at least three microphone channels that is different than the first pair, based on said indication that the portable device has the second orientation,

indicate, at a third time subsequent to the first time, that the portable device has a third orientation relative to a second axis that is orthogonal to the gravitational axis;

select a first one of a plurality of spatially selective filters, based on said indication that the portable device has the third orientation; and

apply the selected spatially selective filter to the second pair of microphone channels,

wherein each of the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.

41. A non-transitory machine-readable storage medium comprising tangible features that when read by a machine cause the machine to:

indicate, at a first time, that a portable device has a first orientation relative to a gravitational axis;

select a first pair among at least three microphone channels of the portable device, based on said indication that the portable device has the first orientation;

indicate, at a second time that is different than the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation;

select a second pair among the at least three microphone channels that is different than the first pair, based on said indication that the portable device has the second orientation;

indicate, at a third time subsequent to the second time, that the portable device has a third orientation relative to a second axis that is orthogonal to the gravitational axis; and

select a third pair among the at least three microphone channels of the portable device that is different than the first pair and the second pair, based on said indication that the portable device has the third orientation

wherein each of the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.