System and method for dynamic control of audio playback based on the position of a listener

• US 8,401,210 B2
• Filed: 12/05/2006
• Issued: 03/19/2013
• Est. Priority Date: 12/05/2006
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Freeman, Daniel B.
• Primary Examiner(s): Paul, Disler
• Application Number:
  US11/635,452
• Publication Number:
  US 20080130923A1
• Time in Patent Office: 2,296 Days
• Field of Search: 381/306, 381/303, 381 77- 78, 381/80, 348143-160, 348/14.03, 715/700, 715/716
• US Class Current: 381/303
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

An optimal listening position for the multi-channel audio sound system is determined. A listening area and other audio playback controls may also be defined or modified by a listener. During subsequent audio playback, an imager captures images of at least a portion of the listener. When the listener has moved to a position that is different from a previous position, one or more audio parameters are adjusted for at least one channel in the multi-channel audio system in order to reposition the initial or previous optimal listening position to the current position of the listener. When the listener moves outside the listening area, an out of bounds response is initiated to disable or control the audio playback until the listener moves to a position within the listening area.

Claims

1. A computer system with a multichannel audio system that dynamically adjusts audio playback based on a changeable position of a listener, the system comprising:

an input device operable to receive initial set up data from the listener that comprises a definition of a listening area within a room,

an imaging module operable to capture images of at least a portion of the listener as the listener moves about the room;

a processing module, coupled to the imaging module and the input device, operable to;

determine automatically an original optimal listening position based on the definition of the listening area;

receive the images and determine whether the listener has a position different from a previous position the original optimal listening position; and

generate an adjustment signal when the position of the listener is different from the previous position original optimal listening position; and

an audio processing module, coupled to the processing module, operable to receive the adjustment signal and responsively adjust one or more audio parameters for one or more channels and produce an audio signal for each channel in the multichannel audio system such that the original optimal listening position is repositioned to the position of the listener.

2. The computer system of claim 1, further comprising a plurality of speakers, wherein each speaker is coupled to the audio processing module and operable to receive a respective audio signal.

3. The computer system of claim 1, further comprising an audio input device coupled to the audio processing module and operable to input a plurality of audio signals into the audio processing module.

4. The computer system of claim 1, wherein the imaging module comprises a camera coupled to the processing module.

5. The computer system of claim 2, further comprising a display coupled to the processing module.

6. The computer system of claim 5, wherein the input device receives the initial set up data via manipulation of a graphical representation of the room and the plurality of speakers presented on the display.

7. The computer system of claim 1, wherein the initial set up data further comprises a definition of an out of bounds response.

8. The computer system of claim 7, wherein the out of bounds response comprises at least one of:

disabling the multi-channel audio system;

disabling the computer system; and

reducing a master volume level to a low level.

9. The computer system of claim 1, wherein:

the processing module is further operable to determine whether the listener is within the listening area; and

the processing module is further operable to trigger an out of bounds response if the listener is not within the listening area.

10. The computer system of claim 1, wherein the processing module is further operable to:

receive the images and determine whether the listener has a position different from a previous position; and

generate an adjustment signal when the position of the listener is different from the previous position.

11. A computer system with a multi-channel audio system that dynamically adjusts audio playback based on a changeable position of a listener, the system comprising:

an input device operable to receive initial set up data that comprises dimensions of a listening area;

an imager operable to capture images of at least a portion of the listener;

an image processor operable to receive the images and determine a current position of the listener in the listening area;

a controller, coupled to the input device and the image processor, operable to;

determine automatically an original optimal listening position based on the dimensions of the listening area; and

generate an adjustment signal when the current position of the listener is different from a previous position of the listener; and

an audio processor, coupled to the controller, operable to;

receive the adjustment signal from the controller; and

in response to the adjustment signal, access the original optimal listening position stored in the memory; and

in response to the adjustment signal, adjust one or more audio parameters for one or more channels and produce an audio signal for each channel in the multi-channel audio system such that the original optimal listening position is repositioned to the current position of the listener.

12. The computer system of claim 11, further comprising a plurality of speakers, wherein each speaker is coupled to the audio processor and operable to receive a respective audio signal.

13. The computer system of claim 11, further comprising an audio input device, coupled to the audio processor, operable to input a plurality of audio signals into the audio processor.

14. The computer system of claim 11, wherein the imager comprises a camera coupled to the image processor.

15. The computer system of claim 11, further comprising a display coupled to the controller.

16. The computer system of claim 11, wherein the image processor, the audio processor, and the controller comprise a single processor.

17. The computer system of claim 11, wherein the image processor, the audio processor, and the controller comprise two or more processors.

18. The computer system of claim 11, wherein the input device comprises a switch that the listener can activate to enable or disable the dynamic audio playback.

19. The computer system of claim 11, wherein the input device is further operable to receive initial set up data from the listener that comprises a definition of a listening area and an out of bounds response, wherein the definition of the listening area is stored in the memory.

20. The computer system of claim 19, wherein the controller is further operable to:

access the definition of the listening area stored in the memory;

determine whether the current position of the listener is within the listening area; and

trigger the out of bounds response if the listener is not within the listening area.

21. The computer system of claim 19, wherein the out of bounds response comprises at least one of:

disabling the multi-channel audio system;

disabling the computer system; and

reducing a master volume level to a low level.

22. A method for dynamic control of audio playback in a computer system having a multichannel audio system based on a changeable position of a listener, the method comprising:

the listener performing an initial set up with an input device, wherein the initial set up comprises;

displaying, on a display coupled to the computer system, a graphical representation of a room, and

providing, by manipulation of the graphical representation of the room, a definition of a listening area;

the computer system determining automatically an original optimal listening position based on the definition of the listening area;

the computer system capturing images of at least a portion of the listener with an imager;

the computer system determining whether the listener has moved to a new position different from a previous position at the original optimal listening position using the captured images; and

when the listener has moved to the new position different from the previous position, the computer system adjusting one or more audio parameters for one or more channels in the multi-channel audio system to reposition the original optimal listening position to the new position of the listener.

23. The method of claim 22, wherein the listener performing the initial set up occurs prior to the computer system capturing images.

24. The method of claim 22, wherein the listener performing the initial set up comprises:

setting one or more playback controls that limit an adjustment for at least one audio parameter.

25. The method of claim 22, further comprising:

the computer system determining whether dynamic control of audio playback is enabled.

26. The method of claim 22, further comprising:

the computer system determining whether the listener has moved out of the listening area; and

initiating an out of bounds response when the listener has moved out of the listening area.

27. The method of claim 26, further comprising:

the computer system determining whether the listener has moved to a third position within the listening area subsequent to the computer system determining that the listener has moved out of the listening area.

28. The method of claim 26, wherein the out of bounds response comprises at least one of:

disabling the multi-channel audio system;

disabling the computer system; and

reducing a master volume level to a low level.