Stereoplexing for film and video applications

• US 8,487,982 B2
• Filed: 06/07/2007
• Issued: 07/16/2013
• Est. Priority Date: 06/07/2007
• Status: Expired due to Fees

• Current Assignee: RealD Incorporated
• Original Assignee: RealD Incorporated
• Inventors: Lipton, Lenny, Akka, Robert, Cowan, Matt, Greer, Josh
• Primary Examiner(s): Dastouri, Mehrdad
• Assistant Examiner(s): HALLENBECK-HUBER, JEREMIAH CHARLES
• Application Number:
  US11/811,234
• Publication Number:
  US 20080303896A1
• Time in Patent Office: 2,231 Days
• Field of Search: 348/43, 348/47, 348/49
• US Class Current: 348/43
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597

Abstract

A method for multiplexing a stream of stereoscopic image source data into a series of left images and a series of right images combinable to form a series of stereoscopic images, both the stereoscopic image source data and series of left images and series of right images conceptually defined to be within frames. The method includes compressing stereoscopic image source data at varying levels across the frame, thereby forming left images and right images, and providing a series of single frames divided into portions, each single frame containing one right image in a first portion and one left image in a second portion. Alternately, single frames may contain two right images in a first two portions of each single frame and two left images in a second two portions of each single frame, wherein each set of right and left images may be processed differently. Multiplexing processes such as staggering, alternating, filtering, variable scaling, and sharpening from original, uncompressed right and left images may be employed.

Claims

1. A method for multiplexing stereoscopic image source data, the method comprising:

receiving the stereoscopic image source data comprising a left image and a right image;

forming a multiplexed image frame configured to have a precursor format, wherein the multiplexed image frame defines a first image aspect ratio;

providing the multiplexed image frame;

wherein the precursor format of the multiplexed image frame comprises the right image in a first portion of the multiplexed image frame and the left image in a second portion of the multiplexed image frame; and

wherein one of the right image or the left image is divided into a plurality of blocks, the plurality of blocks being re-arranged from a first block arrangement to a second block arrangement different from the first block arrangement, and the other one of the right image or left image is downscaled to a downscaled right image or left image having a second image aspect ratio that is substantially the same as the first image aspect ratio.

2. The method of claim 1, further comprising compressing the left image or the right image.

3. The method of claim 1, wherein the left image is associated with the right image.

4. The method of claim 1, wherein the left image is based on an unprocessed left image and the right image is based on an unprocessed right image, and the method further comprises:

removing every alternate pixel from every row in the unprocessed right image to form the right image and every alternate pixel from every row in the unprocessed left image to form the left image.

5. The method of claim 1, wherein the multiplexed image frame is divided by a vertically oriented border, with the right image on a first side of the multiplexed image frame and the left image on a second side of the multiplexed image frame.

6. The method of claim 1, wherein the left image is based on an unprocessed left image and the right image is based on an unprocessed right image, and the method further comprises:

mapping pixel information from the unprocessed left image to the left image based on information from a plurality of pixels from the unprocessed left image and mapping pixel information from the unprocessed right image to the right image based on information from a plurality of pixels from the unprocessed right image.

7. The method of claim 1, further comprising applying a process to the left image and the right image, the process selected from at least one from a group comprising:

variably applied bicubic scaling;

variable sharpening;

non-variably applied bicubic scaling; and

non-variable sharpening.

8. The method of claim 4, wherein removal of alternate pixels in each row comprises removing a first set of pixels from a first row and a different set of pixels from each row adjacent to the first row.

9. The method of claim 8, wherein removal substantially forms a “

checkerboard”

type pattern of pixels being removed from the unprocessed right image and the unprocessed left image.

10. The method of claim 1, wherein the left image is based on an unprocessed left image and the right image is based on an unprocessed right image, and the method further comprises:

mapping pixel information from the unprocessed left image to the left image by combining more pixels from predetermined areas of the unprocessed left image than other areas of the unprocessed left image, and mapping pixel information from the unprocessed right image to the right image by combining more pixels from predetermined areas of the unprocessed right image than other areas of the unprocessed right image.

11. The method of claim 1, wherein the left image is based on an unprocessed left image comprising alternating rows and remaining rows of pixels and the right image is based on an unprocessed right image comprising alternating and remaining rows of pixels, and the method further comprises:

mapping pixel information from the unprocessed left image to the left image by combining pixels from alternating rows of the unprocessed left image and selecting pixels from remaining rows of the unprocessed left image, and mapping pixel information from the unprocessed right image to the right image by combining pixels from alternating rows of the unprocessed right image and selecting pixels from remaining rows of the unprocessed right image.

12. The method of claim 1, wherein the left image is based on an unprocessed left image comprising alternating rows and remaining rows of pixels and the right image is based on an unprocessed right image comprising alternating and remaining rows of pixels, and the method further comprises:

mapping pixel information from the unprocessed left image to the left image by combining at least two pixels from first positions in alternating rows of the unprocessed left image and combining at least two pixels from second positions in remaining rows of the unprocessed left image, and mapping pixel information from the unprocessed right image to the right image by combining at least two pixels from first positions in alternating rows of the unprocessed right image and combining at least two pixels from second positions in remaining rows of the unprocessed right image.

13. The method of claim 2, wherein the compressing comprises compressing stereoscopic image source data at varying levels across the multiplexed image frame.

14. The method of claim 1, wherein the other one of the right image or the left image is divided into a plurality of blocks and the plurality of blocks are re-arranged from the first block arrangement to the second block arrangement.

15. The method of claim 2, wherein the compressing comprises applying bicubic scaling to the stereoscopic image source data.

16. The method of claim 15, wherein the bicubic scaling is 70%.

17. The method of claim 1, wherein each of the plurality of blocks comprises 8 pixels by 8 pixels.

18. A method for multiplexing a stream of stereoscopic image source data into a series of left images and a series of right images combinable to form a series of stereoscopic images, both the stereoscopic image source data and series of left images and series of right images conceptually defined to be within frames, the method comprising:

receiving stereoscopic image source data comprising left images and right images; and

providing a series of single frames divided into portions, each single frame define a first image aspect ratio and containing one right image in a first portion and one left image in a second portion;

wherein the providing comprises, in at least one single frame, dividing one of the respective right image or the respective left image into a plurality of blocks and re-arranging the plurality of blocks from a first block arrangement to a second block arrangement different from the first block arrangement; and

wherein the other one of the respective right image or the respective left image is downscaled to a second image aspect ratio that is substantially the same as the first image aspect.

19. The method of claim 18, wherein the portions are included within each single frame, and wherein each left image is included in substantially one half of each single frame and each right image is included in substantially another half of each single frame.

20. A method for multiplexing stereoscopic image source data, the method comprising:

receiving the stereoscopic image source data comprising a left image and a right image;

forming a multiplexed image frame configured to have a precursor format, wherein the multiplexed image frame comprises a horizontal pixel count and a vertical pixel count that define a first aspect ratio;

providing the multiplexed image frame;

wherein the precursor format of the multiplexed image frame comprises the right image in a first portion of the multiplexed image frame and the left image in a second portion of the multiplexed image frame; and

wherein one of the right image or the left image is divided into a plurality of blocks, the plurality of blocks being re-arranged from a first block arrangement to a second block arrangement different from the first block arrangement, wherein the re-arrangement includes rotation of the blocks, and the other one of the right image or left image comprises a horizontal pixel count and a vertical pixel count that define a second aspect ratio, the first and second aspect ratios being substantially the same.