Frame formatting supporting mixed two and three dimensional video data communication

• US 9,247,286 B2
• Filed: 12/30/2010
• Issued: 01/26/2016
• Est. Priority Date: 12/31/2009
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Karaoguz, Jeyhan, Bennett, James D., Seshadri, Nambirajan
• Primary Examiner(s): Hossain, Farzana
• Assistant Examiner(s): KWAN, MATTHEW K
• Application Number:
  US12/982,289
• Publication Number:
  US 20110169919A1
• Time in Patent Office: 1,853 Days
• Field of Search: 348 42- 60
• US Class Current: 1/1
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/312 the parallax barriers being placed behind the display panel, e.g. between backlight and spatial light modulator [SLM]
• CPC Class Codes: H04N 13/351 for displaying simultaneously
• CPC Class Codes: H04N 13/359 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/403 the images being monoscopic
• CPC Class Codes: H04N 2013/405 the images being stereoscopic or three dimensional
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video

Abstract

Systems and methods are provided that relate to frame formatting supporting mixed two and three dimensional video data communication. For example, frames in frame sequence(s) may be formatted to indicate that a first screen configuration is to be used for displaying first video content, that a second screen configuration is to be used for displaying second video content, and so on. The screen configurations may be different or the same. In another example, the frames in the frame sequence(s) may be formatted to indicate that the first video content is to be displayed at a first region of a screen, that the second video content is to be displayed at a second region of the screen, and so on. The regions of the screen may partially overlap, fully overlap, not overlap, be configured such that one or more regions are within one or more other regions, etc.

Claims

1. A method supporting formatting of first video data and second video data for delivery in a series of frames via a communication pathway toward a screen, the method comprising:

placing in a first region field a first entry that at least assists in identifying a first display region associated with the first video data;

placing in a second region field a second entry that at least assists in identifying a second display region associated with the second video data;

placing in a first configuration field a third entry that at least assists in identifying a first screen configuration to be used with the first video data;

placing in a second configuration field a fourth entry that at least assists in identifying a second screen configuration to be used with the second video data, the second video data being at least a part of three-dimensional video data, the second screen configuration being a three-dimensional screen configuration and is different from the first screen configuration, and the first screen configuration and the second screen configuration being simultaneously supported on the screen;

placing in a first payload field a portion of the first video data;

placing in a second payload field a portion of the second video data;

constructing a frame of the series of frames which contains at least the first payload field content and the second payload field content; and

reformatting one or more of the first video data or the second video data by at least one of

removing one or more of multiple data portions that correspond to an area of overlap,

reducing resolution of the first video data or the second video data, or

reducing a number of perspectives that are represented by the first video data or the second video data.

2. The method of claim 1, further comprising:

placing segments of the second video data into a corresponding plurality of payload fields.

3. The method of claim 2, further comprising:

placing at least a plurality of the first, second, third and fourth entries into at least one frame of the series of frames.

4. The method of claim 1, wherein the first video data is two-dimensional video data.

5. The method of claim 1, wherein the first video data is at least a part of other three-dimensional video data.

6. The method of claim 1, wherein the reformatting of one or more of the first video data or the second video data is based on configuration information regarding one or more limitations of a display associated with the screen, including information relating to a bandwidth or a number of perspectives that is to be used to represent the first video data or the second video data.

7. The method of claim 1, wherein the reformatting of one or more of the first video data or the second video data is based on information provided by a user.

8. A system supporting formatting of first video data and second video data for delivery in a series of frames via a communication pathway toward a screen, the system comprising:

a communication interface that supports delivery of the series of frames; and

processing circuitry coupled to the communication interface, the processing circuitry configured to

place in a first region field a first entry that at least assists in identifying a first display region associated with the first video data,

place in a second region field a second entry that at least assists in identifying a second display region associated with the second video data,

place in a first configuration field a third entry that at least assists in identifying a first screen configuration to be used with the first video data,

place in a second configuration field a fourth entry that at least assists in identifying a second screen configuration to be used with the second video data, the second video data being at least a part of three-dimensional video data, the second screen configuration being three-dimensional screen configuration and is different from the first screen configuration, and the first screen configuration and the second screen configuration being simultaneously supported on the screen,

place in a first payload field a portion of the first video data,

place in a second payload field a portion of the second video data,

construct a frame of the series of frames which contains at least the first payload field content and the second payload field content, and

reformat one or more of the first video data or the second video data by at least one of

removing one or more of multiple data portions that correspond to an area of overlap,

reducing resolution of the first video data or the second video data, or

reducing a number of perspectives that are represented by the first video data or the second video data.

9. The system of claim 8, wherein the processing circuitry is further configured to place segments of the second video data into a corresponding plurality of payload fields.

10. The system of claim 9, wherein the processing circuitry is further configured to place at least a plurality of the first, second, third, and fourth entries into at least one frame of the series of frames.

11. The system of claim 8, wherein the first video data is two-dimensional video data.

12. The system of claim 8, wherein the first video data is at least a part of other three-dimensional video data.

13. The system of claim 8, wherein the reformatting of one or more of the first video data or the second video data is based on configuration information regarding one or more limitations of a display associated with the screen, including information relating to a bandwidth or a number of perspectives that is to be used to represent the first video data or the second video data.

14. The system of claim 8, wherein the reformatting of one or more of the first video data or the second video data is based on information provided by a user.

15. A method supporting formatting of first video data and second video data for delivery in a series of frames via a communication pathway toward a screen, the method comprising:

placing in a first region field a first entry that at least assists in identifying a first display region associated with the first video data;

placing in a second region field a second entry that at least assists in identifying a second display region associated with the second video data;

placing in a first configuration field a third entry that at least assists in identifying a first screen configuration to be used with the first video data;

placing in a second configuration field a fourth entry that at least assists in identifying a second screen configuration to be used with the second video data, the second video data being at least a part of three-dimensional video data, the second screen configuration being a three-dimensional screen configuration and is different from the first screen configuration, and the first screen configuration and the second screen configuration being simultaneously supported on the screen;

placing in a first payload field a portion of the first video data;

placing in a second payload field a portion of the second video data;

constructing a frame of the series of frames which contains at least multiple instances of the first, second, third, and fourth entries; and

reformatting one or more of the first video data or the second video data by at least one of

removing one or more of multiple data portions that correspond to an area of overlap,

reducing resolution of the first video data or the second video data, or

reducing a number of perspectives that are represented by the first video data or the second video data.

16. The method of claim 15, further comprising:

placing at least the first payload field content and the second payload field content in the frame.

17. The method of claim 15, further comprising:

placing segments of the second video data into a corresponding plurality of payload fields.

18. The method of claim 15, wherein the first video data is two-dimensional video data.

19. The method of claim 15, wherein the first video data is at least a part of other three-dimensional video data.

20. The method of claim 15, wherein the reformatting of one or more of the first video data or the second video data is based on configuration information regarding one or more limitations of a display associated with the screen or information provided by a user, including information relating to a bandwidth or a number of perspectives that is to be used to represent the first video data or the second video data.