3D AUDIO DELIVERY ACCOMPANYING 3D DISPLAY SUPPORTED BY VIEWER/LISTENER POSITION AND ORIENTATION TRACKING

• US 20110157327A1
• Filed: 12/30/2010
• Published: 06/30/2011
• Est. Priority Date: 12/31/2009
• Status: Abandoned Application

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Seshadri, Nambirajan, Bennett, James D., Karaoguz, Jeyhan
• Application Number:
  US12/982,377
• Publication Number:
  US 20110157327A1
• Time in Patent Office: Days
• US Class Current: 348/51
• CPC Class Codes: G02B 6/00 Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
• CPC Class Codes: G03B 35/24 using apertured or refractive resolving means on screens or between screen and eye
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2300/023 Display panel composed of stacked panels
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 13/00 Stereoscopic video systems; Multi-view video systems; Details thereof
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/312 the parallax barriers being placed behind the display panel, e.g. between backlight and spatial light modulator [SLM]
• CPC Class Codes: H04N 13/315 the parallax barriers being time-variant
• CPC Class Codes: H04N 13/332 : Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/351 : for displaying simultaneously
• CPC Class Codes: H04N 13/359 : Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 : Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/366 : using viewer tracking
• CPC Class Codes: H04N 13/383 : for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/398 : Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/403 : the images being monoscopic
• CPC Class Codes: H04N 2013/405 : the images being stereoscopic or three dimensional
• CPC Class Codes: H04N 21/235 : Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 : additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/435 : Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04S 7/303 : Tracking of listener position or orientation

Abstract

Techniques are described herein for supporting 3D audio delivery accompanying 3D display supported by viewer/listener position and orientation tracking. For example, audio content is configured to have a spatial orientation that accords with an orientation of a viewer. A spatial orientation of audio content is a configuration of the audio content in which characteristics of respective portions of the audio content, which correspond to respective speakers, indicate an orientation of ears of a viewer/listener with respect to sound source(s) that correspond to (e.g., are depicted in) a three-dimensional view. Such a characteristic may include an amplitude of sound that corresponds to a sound source and/or a delay associated with the sound that corresponds to the sound source.

Claims

1. A method supporting a viewer of a three-dimensional visual presentation within a premises, the viewer having a first orientation within the premises, the method comprising:

identifying at least one positional characteristic relating to the first orientation of the viewer within the premises;

delivering a video output, tailored based at least in part on the at least one positional characteristic, for the three-dimensional visual presentation to the viewer in the first orientation; and

delivering an audio output, tailored based at least in part on the at least one positional characteristic, to audibly supplement the video output for the viewer in the first orientation.

2. The method of claim 1, wherein the at least one positional characteristic comprising a relative location of the viewer.

3. The method of claim 1, wherein the at least one positional characteristic comprising an orientation of a head of the viewer.

4. The method of claim 1, further comprising tailoring the audio output based at least in part on the at least one positional characteristic.

5. The method of claim 4, wherein the tailoring of the audio output comprising selecting the audio output from a plurality of audio outputs.

6. The method of claim 4, wherein the tailoring of the audio output comprising generating the audio output.

7. The method of claim 1, wherein the audio output is tailored by changing at least an output amplitude.

8. The method of claim 1, wherein the audio output is tailored by adding a delay.

9. Media circuitry supporting a viewer of a three-dimensional visual presentation within a premises, the viewer having a first orientation within the premises, the media circuitry comprising:

first circuitry that identifies at least one positional characteristic relating to the first orientation of the viewer within the premises;

second circuitry that delivers a video output for the three-dimensional visual presentation to the viewer in the first orientation; and

third circuitry that delivers an audio output that is tailored based at least in part on the at least one positional characteristic, the audio output supplementing the video output for the viewer in the first orientation.

10. The media circuitry of claim 9, wherein the at least one positional characteristic comprising a relative location of the viewer.

11. The media circuitry of claim 9, wherein the at least one positional characteristic comprising an orientation of a head of the viewer.

12. The media circuitry of claim 9, further comprising fourth circuitry that performs the tailoring of the audio output.

13. The media circuitry of claim 12, wherein the fourth circuitry performs the tailoring by selecting the audio output from a plurality of audio outputs.

14. The media circuitry of claim 12, wherein the fourth circuitry performs the tailoring by changing at least an output amplitude.

15. The media circuitry of claim 12, wherein the fourth circuitry performs the tailoring by adding a delay.

16. The media circuitry of claim 12, wherein the fourth circuitry performs the tailoring based at least in part on image data captured within the premises.

17. The media circuitry of claim 12, wherein the fourth circuitry performs the tailoring based at least in part on captured audio data captured within the premises.

18. The media circuitry of claim 12, further comprising fifth circuitry that is carried by the viewer, the fifth circuitry assisting the first circuitry in the identification of the at least one positional characteristic.

19. A method relating to delivery of an audio experience for ears of a listener via a plurality of speakers, the audio experience to be established based on audio output that is based on audio content, the audio content having a spatial orientation, the listener being at a first location, the ears of the listener being in either a first orientation or a second orientation with respect to the plurality of speakers, the method comprising:

detecting the ears of the listener being in the first orientation with respect to the plurality of speakers;

delivering first audio output to attempt to establish, with the spatial orientation of the audio content, the audio experience for the ears of the listener in the first orientation;

detecting the ears of the listener being in the second orientation with respect to the plurality of speakers; and

delivering second audio output to attempt to establish, with the spatial orientation of the audio content, the audio experience for the ears of the listener in the second orientation.

20. The method of claim 19, further comprising:

detecting a move by the listener to a second location; and

delivering third audio output to establish, with the spatial orientation of the audio content, the audio experience for the ears of the listener at the second location.

21. The method of claim 19, further comprising:

delivering a three-dimensional visual presentation that is tailored based on the listener being at the first location.