Adaptable media stream servicing two and three dimensional content

• US 9,013,546 B2
• Filed: 12/30/2010
• Issued: 04/21/2015
• Est. Priority Date: 12/31/2009
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Karaoguz, Jeyhan, Bennett, James D., Seshadri, Nambirajan
• Primary Examiner(s): Kim, Hee-Yong
• Application Number:
  US12/982,212
• Publication Number:
  US 20110164111A1
• Time in Patent Office: 1,573 Days
• Field of Search: 348/43
• US Class Current: 348/43
• CPC Class Codes: G02B 6/00 Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
• CPC Class Codes: G03B 35/24 using apertured or refractive resolving means on screens or between screen and eye
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2300/023 Display panel composed of stacked panels
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 13/00 Stereoscopic video systems; Multi-view video systems; Details thereof
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/312 the parallax barriers being placed behind the display panel, e.g. between backlight and spatial light modulator [SLM]
• CPC Class Codes: H04N 13/315 the parallax barriers being time-variant
• CPC Class Codes: H04N 13/332 : Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/351 : for displaying simultaneously
• CPC Class Codes: H04N 13/359 : Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 : Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/366 : using viewer tracking
• CPC Class Codes: H04N 13/383 : for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/398 : Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/403 : the images being monoscopic
• CPC Class Codes: H04N 2013/405 : the images being stereoscopic or three dimensional
• CPC Class Codes: H04N 21/235 : Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 : additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/435 : Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04S 7/303 : Tracking of listener position or orientation

Abstract

Media sources that deliver at least portions of media content to viewer systems are described. The media content represents a plurality of camera perspectives of a single media product. A first request and a second request are both received. The first request is from a first viewer system and the second request is from a second viewer system. The first request is responded to by delivering a primary media stream to the first viewer system. The primary media stream contains a representation of at least a first of the plurality of camera perspectives. The second request is responded to by delivering both the primary media stream and a secondary media stream to the second viewer system. The secondary media stream contains a representation of at least a second of the plurality of camera perspectives. The second viewer system combines the primary and secondary media streams to display a three-dimensional view.

Claims

1. A method used by a media source to deliver at least portions of media content to a first viewer system and a second viewer system, the media content being three-dimensional content representing a first visual perspective, a second visual perspective, a third visual perspective and a fourth visual perspective, the method comprising:

receiving a first request from the first viewer system for a primary media stream;

constructing the primary media stream from a first portion of the media content, the first portion containing representations of at least one but not all of the first visual perspective, the second visual perspective, the third visual perspective and the fourth visual perspective;

delivering the primary media stream to the first viewer system;

receiving a second request from the second viewer system for a second media stream, the second request being received after having delivered a first portion of the primary media stream to the first viewer system;

constructing a secondary media stream from a second portion of the media content, the second portion containing representations of at least one but not all of the first visual perspective, the second visual perspective, the third visual perspective and the fourth visual perspective, the second portion containing a representation of at least one visual perspective not included in the first portion of the media content;

constructing a tertiary media stream based on the first part of the primary media stream; and

delivering the tertiary media stream to the second viewer system; and

delivering both the primary media stream and the secondary media stream to the second viewer system to enable the primary and secondary media streams to be combined to generate a stereoscopic three-dimensional view for display by a display screen of the second viewer system.

2. The method of claim 1, wherein the primary media stream supports a two-dimensional presentation, and both the primary media stream and the secondary media stream together support a three-dimensional presentation.

3. The method of claim 1, wherein the primary media stream represents at least two of the first visual perspective, the second visual perspective, the third visual perspective and the fourth visual perspective.

4. The method of claim 1, wherein the portion of the primary media stream subsequent to the first portion of the primary media stream is multi-cast to both the first viewer system and the second viewer system.

5. The method of claim 4, further comprising removing at least one of the first viewer system and the second viewer system from the multi-cast.

6. The method of claim 5, wherein said removing is based on a difference between a first communication characteristic associated with the first viewer system and a second communication characteristic associated with the second viewer system.

7. The method of claim 1, wherein said constructing comprises:

constructing a tertiary media stream that includes the first portion of the primary media stream and a corresponding portion of the media content requested for the secondary media stream;

wherein said delivering the tertiary media stream comprises;

delivering the tertiary media stream to the second viewer system to enable a first portion of a stereoscopic three-dimensional view to be displayed by a display screen of the second viewer system; and

wherein said delivering both the primary media stream and the secondary media stream comprises;

delivering the secondary media stream and a portion of the primary media stream subsequent to the first portion of the primary media stream to the second viewer system to enable the primary and secondary media streams to be combined to generate a second portion of the stereoscopic three-dimensional view for display by the display screen of the second viewer system.

8. A media source that delivers at least portions of media content to a first viewer system and a second viewer system, the media content representing a plurality of camera perspectives of a single media product, the media source comprising:

a communication interface through which a first request and a second request are both received, the first request being from the first viewer system and the second request being from the second viewer system; and

a processor that responds to the first request from the first viewer system by delivering a primary media stream via the communication interface to the first viewer system, the primary media stream containing a representation of at least a first of the plurality of camera perspectives, a first portion of the primary media stream already delivered to the first viewer system when the second request is received;

the processor responds to the second request from the second viewer system by delivering at least a portion of both the primary media stream and a secondary media stream to the second viewer system via the communication interface, and delivering a tertiary media stream to the second viewer system based on the first part of the primary media stream, the secondary media stream containing a representation of at least a second of the plurality of camera perspectives, the representation of the second of the plurality of camera perspectives not being included in the primary media stream, to enable the primary, the secondary, and the tertiary media streams to be combined to generate a stereoscopic three-dimensional view for display by a display screen of the second viewer system.

9. The media source of claim 8, wherein the primary media stream supports a two-dimensional presentation, and the tertiary media stream supports a three-dimensional presentation.

10. The media source of claim 8, wherein the primary media stream represents at least two of the plurality of camera perspectives.

11. The media source of claim 8, wherein at least the portion of the primary media stream subsequent to the first portion is multi-cast to both the first viewer system and the second viewer system.

12. The media source of claim 8, wherein the secondary media stream is not delivered to the first viewer system.

13. The media source of claim 11, wherein the processor removes at least one of the first viewer system and the second viewer system from the multi-cast.

14. The media source of claim 8, wherein the remaining portion of the primary media stream is multi-cast to both the first viewer system and the second viewer system if both a first communication characteristic of the first viewer system and a second communication characteristic of the second viewer system are relatively similar.

15. The media source of claim 8, wherein the processor responds to the second request from the second viewer system by delivering a portion of the primary media stream subsequent to the first portion, the secondary media stream, and the tertiary media stream to the second viewer system via the communication interface to enable the primary, the secondary, and the tertiary media streams to generate a stereoscopic three-dimensional view for display by the display screen of the second viewer system.

16. A media source that delivers at least portions of media content to a first viewer system and a second viewer system, the media content representing a plurality of camera perspectives of a single media product, the media source comprising:

a communication interface through which a first request and a second request are both received, the first request being from the first viewer system and the second request being from the second viewer system; and

a processor that responds to the first request from the first viewer system by delivering a primary media stream via the communication interface to the first viewer system, the primary media stream containing a representation of at least a first of the plurality of camera perspectives;

the processor responds to the second request from the second viewer system by delivering both the primary media stream and a secondary media stream to the second viewer system via the communication interface, the secondary media stream containing a representation of at least a second of the plurality of camera perspectives, the representation of the second of the plurality of camera perspectives not being included in the primary media stream, to enable the primary and secondary media streams to be combined to generate a stereoscopic three-dimensional view for display by a display screen of the second viewer system, at least a portion of the primary media stream being multi-cast to both the first viewer system and the second viewer system, wherein the processor removes at least one of the first viewer system and the second viewer system from the multi-cast based on a difference between a first communication characteristic associated with the first viewer system and a second communication characteristic associated with the second viewer system.

17. Viewer system circuitry that receives at least a portion of media content from a media source, the media source simultaneously servicing multiple viewers at differing premises, the media content representing a plurality of camera perspectives of a single media product, the viewer system circuitry supporting display of the at least the portion of the media content via a screen assembly, the viewer system circuitry comprising:

communication interface circuitry operable to communicatively couple with the media source;

display interface circuitry operable to communicatively couple with the screen assembly; and

processing circuitry that delivers to the media source a first request for the at least the portion of the media content received, the delivery being via the communication interface circuitry;

the processing circuitry receives, from the media source in response to the first request and via the communication interface circuitry, primary media content, secondary media content, and tertiary media content, the primary media content containing a representation of at least a first of the plurality of camera perspectives, the secondary media content containing a representation of at least a second of the plurality of camera perspectives, the representation of the second of the plurality of camera perspectives not being included in the primary media content, and the tertiary media content being a beginning portion of the single media product not represented in the primary media content and not represented in the secondary media content; and

the processing circuitry establishes a communication flow toward the screen assembly via the display interface circuitry, the communication flow representing at least both of the first of the plurality of camera perspectives and the second of the plurality of camera perspectives to enable at least the first and second of the plurality of camera perspectives to be displayed in a stereoscopic three-dimensional view.

18. The viewer system circuitry of claim 17, wherein the primary media content is provided by the media source in a multi-cast format.

19. The viewer system circuitry of claim 17, wherein at least a portion of the secondary media content is provided by the media source in a uni-cast format.

20. The viewer system circuitry of claim 17, wherein the processing circuitry directs storage of at least a representation of the primary media content and the secondary media content.

21. The viewer system circuitry of claim 17, wherein the primary media content is provided by the media source with destination addressing that changes over time.