FRAME FORMATTING SUPPORTING MIXED TWO AND THREE DIMENSIONAL VIDEO DATA COMMUNICATION

• US 20110169919A1
• Filed: 12/30/2010
• Published: 07/14/2011
• Est. Priority Date: 12/31/2009
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Seshadri, Nambirajan, Bennett, James D., Karaoguz, Jeyhan
• Granted Patent: US 9,247,286 B2
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/312 the parallax barriers being placed behind the display panel, e.g. between backlight and spatial light modulator [SLM]
• CPC Class Codes: H04N 13/351 for displaying simultaneously
• CPC Class Codes: H04N 13/359 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/403 the images being monoscopic
• CPC Class Codes: H04N 2013/405 the images being stereoscopic or three dimensional
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video

Abstract

Systems and methods are provided that relate to frame formatting supporting mixed two and three dimensional video data communication. For example, frames in frame sequence(s) may be formatted to indicate that a first screen configuration is to be used for displaying first video content, that a second screen configuration is to be used for displaying second video content, and so on. The screen configurations may be different or the same. In another example, the frames in the frame sequence(s) may be formatted to indicate that the first video content is to be displayed at a first region of a screen, that the second video content is to be displayed at a second region of the screen, and so on. The regions of the screen may partially overlap, fully overlap, not overlap, be configured such that one or more regions are within one or more other regions, etc.

Claims

1. A method supporting formatting of first video data and second video data for delivery in a series of frames via a communication pathway toward a screen, the screen being capable of simultaneously supporting both a first screen configuration and a second screen configuration, the first video data being associated with the first screen configuration, the second video data being associated with the second screen configuration, the second screen configuration being a three-dimensional screen configuration, the method comprising:

placing in a first region field a first entry that at least assists in identifying a first display region associated with the first video data;

placing in a second region field a second entry that at least assists in identifying a second display region associated with the second video data;

placing in a first configuration field a third entry that at least assists in identifying the first screen configuration to be used with the first video data; and

placing in a second configuration field a fourth entry that at least assists in identifying the second screen configuration to be used with the second video data, the second video data being at least a part of three-dimensional video data, and the second screen configuration being different from the first screen configuration.

2. The method of claim 1, further comprising:

placing segments of the second video data into a correspond plurality of payload fields.

3. The method of claim 2, further comprising:

placing at least a plurality of the first, second, third and fourth entries into at least one frame of the series of frames.

4. The method of claim 1, wherein the first video data being two-dimensional video data.

5. The method of claim 1, wherein the first video data being at least a part of other three-dimensional video data.

6. The method of claim 1, further comprising:

placing in a first payload field a portion of the first video data;

placing in a second payload field a portion of the second video data; and

constructing a frame of the series of frames which contains at least the first payload field content and the second payload field content.

7. A method supporting formatting of first video data and second video data for delivery in a series of frames via a communication pathway, the first video data and the second video data to share an overlapping region on a single screen, the method comprising:

placing in at least a first field a first parameter identifying a first display region associated with the first video data;

placing in at least a second field a second parameter identifying a second display region associated with the second video data, the second display region and the first display region overlapping at least in part;

placing in a first payload field a portion of the first video data; and

placing in a second payload field a portion of the second video data.

8. The method of claim 7, further comprising:

providing a frame identifier.

9. The method of claim 8, further comprising:

repeating the placements in the first payload field and in the second payload field; and

assembling the series of frames.

10. The method of claim 7, wherein the first video data corresponding to first video capture at a first perspective, the second video data corresponding to second video capture at a second perspective, and together the first video data and the second video data being intended for a three-dimensional visual presentation in the overlapping region.

11. The method of claim 10, wherein the first display region and the second display region fully overlap.

12. A communication interface supporting delivery of a sequence of frames that define a simultaneous visual presentation on a screen of a first type and a second type of video content, the first type of the video content corresponding to first video data requiring a first screen configuration in a first region of the screen, the second type of the video content corresponding to second video data requiring a second screen configuration in a second region of the screen, the communication interface comprising:

processing circuitry;

input circuitry that delivers input to the processing circuitry, the input being at least related to the first video data and the second video data, the first video data requiring the first screen configuration which is different from the second screen configuration required by the second video data, and the second screen configuration being a first three-dimensional configuration;

transmitter circuitry coupled to the processing circuitry to receive at least portions of data corresponding to that within fields of each frame of the sequence of frames; and

the transmitter circuitry managing transmission of the data received.

13. The communication interface of claim 12, wherein the input that is at least related to the first type and the second type of the video content comprising the sequence of frames.

14. The communication interface of claim 12, wherein the processing circuitry produces the sequence of frames from the input.

15. The communication interface of claim 12, wherein the first screen configuration is a second three-dimensional configuration.

16. The communication interface of claim 12, wherein the first screen configuration is a two-dimensional configuration.

17. The communication interface of claim 12, wherein at least a first frame of the sequence of frames containing at least a portion of the first video data and at least a portion of the second video data.

18. A method used with a communication link having a constraint, the method comprising:

receiving first video data to be used at least in part in a visual presentation on a single screen;

receiving second video data to be used at least in part in the visual presentation on the single screen, the second video data being different from the first video data, and at least one of the first video data or the second video data representing at least two perspective views of three dimensional content;

generating first output data based at least in part on the first video data, the first output data having a different resource requirement than that of the first video data; and

delivering, using a framing structure and via the communication link, the first output data and second output data, the second output data being based at least in part on the second video data, and such delivering being performed to support the visual presentation, and the visual presentation being a simultaneous presentation on the single screen of visual portions relating to the first video data and the second video data.

19. The method of claim 18, wherein the visual portions being both a first visual portion corresponding to a first region of the single screen and a second visual portion corresponding to a second region of the screen, the second region being different from the first region.

20. The method of claim 18, wherein the second video data being two-dimensional video data.

21. The method of claim 18, wherein the framing structure is an adapted framing structure that supports the delivering within the constraint of the communication link.

22. The method of claim 18, wherein the framing structure is selected from a plurality of available framing structure variations, the framing structure being selected to supports the delivering within the constraint of the communication link.