Orientation-based audio

• US 10,284,951 B2
• Filed: 10/06/2014
• Issued: 05/07/2019
• Est. Priority Date: 11/22/2011
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Johnson, Martin E., Goel, Ruchi, Hadley, Darby E., Raff, John
• Primary Examiner(s): Nguyen, Duc
• Assistant Examiner(s): Blair, Kile O
• Application Number:
  US14/507,582
• Publication Number:
  US 20150023533A1
• Time in Patent Office: 1,674 Days
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 1/00 Two-channel systems H04S5/00, H04S7/00 take precedence

Abstract

A method and apparatus for outputting audio based on an orientation of an electronic device, or video shown by the electronic device. The audio may be mapped to a set of speakers using either or both of the device and video orientation to determine which speakers receive certain audio channels.

Claims

1. A method for outputting audio from a plurality of speakers associated with an electronic device, comprising:

determining whether a device orientation of the electronic device is locked;

in response to determining that the device orientation is not locked, selecting a first set of speakers generally on a left side of a video displayed by the electronic device and a second set of speakers generally on a right side of the video displayed by the electronic device based on the device orientation;

in response to determining that the device orientation is locked, selecting a third set of speakers generally on a left side of the video displayed by the electronic device and a fourth set of speakers generally on a right side of the video displayed by the electronic device based on an orientation of the video displayed by the electronic device;

routing left channel audio to the first set of speakers or the third set of speakers for output therefrom;

routing right channel audio to the second set of speakers or the fourth set of speakers for output therefrom;

determining whether a speaker is near a center axis of the electronic device; and

in response to determining there is no speaker near the center axis of the electronic device, suppressing center channel audio.

2. The method of claim 1, further comprising the operations of:

using the determined device orientation in addition to the orientation of the video to determine the first set of speakers and second set of speakers.

3. The method of claim 1, further comprising the operations of:

determining the device orientation; and

determining the orientation of the video.

4. The method of claim 3, wherein determining the device orientation is in response to determining that the device orientation is not locked.

5. The method of claim 1, further comprising:

mixing a left front audio channel and a left rear audio channel to form the left channel audio; and

mixing a right front audio channel and a right rear audio channel to form the right channel audio.

6. The method of claim 1, further comprising:

in the event the speaker is near the center axis of the electronic device, designating the speaker as a center speaker; and

further in the event the speaker is near the center axis of the electronic device, routing the center channel audio to the center speaker.

7. The method of claim 6, further comprising the operation of, in the event there is no speaker near the center axis of the electronic device, routing the center channel audio to the first and second sets of speakers or the third and fourth sets of speakers.

8. The method of claim 1, further comprising:

determining a first number of speakers in the first set of speakers is not equal to a second number of speakers in the second set of speakers; and

applying a gain to one of the left channel audio or the right channel audio in response to determining the first number of speakers is not equal to the second number of speakers, wherein the gain is determined by a ratio of the first number of speakers to the second number of speakers.

9. The method of claim 1, further comprising:

determining whether the first set of speakers is closer to a user than the second set of speakers; and

modifying, in response to the first set of speakers being closer to the user, a volume of one of the left channel audio or the right channel audio.

10. An apparatus for outputting audio, comprising:

a processor;

an audio processing router operably connected to the processor;

a plurality of speakers operably connected to the audio processing router;

a video output operably connected to the processor, the video output operative to display video; and

an orientation sensor operably connected to the audio processing router and operative to output an apparatus orientation of the apparatus;

wherein the audio processing router is operative to

determine whether the apparatus orientation is locked;

select, in response to determining that the apparatus orientation is not locked, a first set of speakers generally on a left side of the video and a second set of speakers generally on a right side of the video based on the apparatus orientation;

select, in response to determining that the apparatus orientation is locked, a third set of speakers generally on a left side of the video and a fourth set of speakers generally on a right side of the video based on an orientation of the video;

route a first audio channel to the first set of speakers or the third set of speakers for output;

route a second audio channel to the second set of speakers or the fourth set of speakers for output;

determine whether a speaker is near a center axis of the apparatus; and

in response to determining there is no speaker near the center axis of the apparatus, suppressing center channel audio.

11. The apparatus of claim 10, wherein the audio processing router is operative to create a first audio map, based on at least one of the apparatus orientation and the orientation of the video, to map the first audio channel to the first set of speakers or the third set of speakers and the second audio channel to the second set of speakers or the fourth set of speakers.

12. The apparatus of claim 10, wherein the audio processing router is software executed by the processor.

13. The apparatus of claim 10, wherein the audio processing router is further operative to mix together the first audio channel and the second audio channel, thereby creating a mixed audio channel for output by the first set of speakers.

14. The apparatus of claim 13, wherein the audio processing router is further operative to apply a gain to the mixed audio channel, and wherein the gain is dependent upon the apparatus orientation.

15. The apparatus of claim 13, wherein the audio processing router is further operative to apply a gain to the mixed audio channel, and wherein the gain is dependent upon a distance of the first set of speakers from a listener.

16. The apparatus of claim 15, further comprising:

a presence detector operatively connected to the audio processing router and providing a presence output;

wherein the audio processing router further employs the presence output to determine the gain.

17. A method for outputting audio from an electronic device, comprising:

generating an initial audio map, based on a first orientation of the electronic device relative to a center axis, wherein the initial audio map routes a center audio channel to a speaker near the center axis, and wherein the speaker is one of a plurality of speakers of the electronic device;

determining that the electronic device is being re-oriented from the first orientation to a second orientation; and

generating a new audio map, based on the second orientation of the electronic device, wherein the new audio map omits the center audio channel in response to none of the plurality of speakers being near the center axis.