Stereoplexing for film and video applications

• US 20140022342A1
• Filed: 07/15/2013
• Published: 01/23/2014
• Est. Priority Date: 06/07/2007
• Status: Active Grant

• Current Assignee: RealD Incorporated
• Original Assignee: RealD Incorporated
• Inventors: Lipton, Lenny, Akka, Robert
• Granted Patent: US 9,030,531 B2
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597

Abstract

A method for multiplexing a stream of stereoscopic image source data into a series of left images and a series of right images combinable to form a series of stereoscopic images, both the stereoscopic image source data and series of left images and series of right images conceptually defined to be within frames. The method includes compressing stereoscopic image source data at varying levels across the frame, thereby forming left images and right images, and providing a series of single frames divided into portions, each single frame containing one right image in a first portion and one left image in a second portion. Alternately, single frames may contain two right images in a first two portions of each single frame and two left images in a second two portions of each single frame, wherein each set of right and left images may be processed differently. Multiplexing processes such as staggering, alternating, filtering, variable scaling, and sharpening from original, uncompressed right and left images may be employed.

Claims

1. A method for demultiplexing a multiplexed image frame configured to have a precursor format, wherein the multiplexed image frame comprises a horizontal pixel count and a vertical pixel count that define a first aspect ratio, wherein the precursor format of the multiplexed image frame comprises a right image in a first portion of the multiplexed image frame and a left image in a second portion of the multiplexed image frame, wherein one of the right image or the left image is divided into a plurality of blocks, the plurality of blocks being re-arranged from a first block arrangement to a second block arrangement different from the first block arrangement, and the other one of the right image or the left image comprises a horizontal pixel count and a vertical pixel count that define a second aspect ratio, wherein the first and second aspect ratios are substantially the same, the method comprising:

receiving the multiplexed image frame;

generating a first demultiplexed image for the one of the right image or the left image in the multiplexed image frame, wherein the generating comprises reverse re-arranging the plurality of blocks in the one of the right image or the left image in the multiplexed image frame from the second block arrangement to the first block arrangement different from the second block arrangement and combining the plurality of blocks of the first clock arrangement; and

generating a second demultiplexed image for the other one of the right image or the left image in the multiplexed image frame.

2. The method of claim 1, wherein the left image or the right image is compressed, said compressing comprises less compression at a center of the left image or the right image, and the method further comprises less uncompressing at the center of the compressed left image.

3. The method of claim 1, wherein the left image is associated with the right image.

4. The method of claim 1, wherein the portions are included within each multiplexed image frame, and wherein each left image is included in substantially one half of each multiplexed image frame and each right image is included in substantially another half of each multiplexed image frame.

5. The method of claim 1, wherein the multiplexed image frame is divided by a vertically oriented border, with the right image on a first side of the multiplexed image frame and the left image on a second side of the multiplexed image frame.

6. The method of claim 1, wherein the left image is based on an unprocessed left image and the right image is based on an unprocessed right image, and the method further comprises:

adding a pixel to every alternate pixel position for every row in the right image to form the unprocessed right image and adding a pixel to every alternate pixel position for every row in the left image to form the unprocessed left image.

7. The method of claim 1, wherein the left image is based on an unprocessed left image and the right image is based on an unprocessed right image, and the method further comprises:

reverse mapping pixel information from the left image to the unprocessed left image based on information from at least one pixel from the left image and reverse mapping pixel information from the right image to the unprocessed right image based on information from at least one pixel from the right image.

8. The method of claim 1, further comprising applying a process to the left image and the right image, the process selected from at least one from a group comprising:

reverse variably applied bicubic scaling;

reverse variable sharpening;

reverse non-variably applied bicubic scaling; and

reverse non-variable sharpening.

9. The method of claim 6, wherein the adding a pixel to every alternate pixel position in each row comprises adding a first set of pixels to a first row and a different set of pixels to each row adjacent to the first row.

10. The method of claim 9, wherein the adding substantially forms a “

checkerboard”

type pattern of pixels being added to the right image and the left image.

11. The method of claim 1, wherein the left image is based on an unprocessed left image and the right image is based on an unprocessed right image, and the method further comprises:

reverse mapping pixel information from the left image to the unprocessed left image by providing more pixels to predetermined areas of the left image than other areas of the left image, and reverse mapping pixel information from the right image to the unprocessed right image by providing more pixels to predetermined areas of the right image than other areas of the right image.

12. The method of claim 1, wherein the left image is based on an unprocessed left image comprising alternating rows and remaining rows of pixels and the right image is based on an unprocessed right image comprising alternating and remaining rows of pixels, and the method further comprises:

reverse mapping pixel information from the left image to the unprocessed left image by reverse combining pixels to alternating rows of the left image and adding pixels to remaining rows of the left image, and reverse mapping pixel information from the right image to the unprocessed right image by reverse combining pixels to alternating rows of the right image and adding pixels to remaining rows of the right image.

13. The method of claim 1, wherein the left image is based on an unprocessed left image comprising alternating rows and remaining rows of pixels and the right image is based on an unprocessed right image comprising alternating and remaining rows of pixels, and the method further comprises:

reverse mapping pixel information from the left image to the unprocessed left image by reverse combining a pixel in alternating rows of the left image to form at least two pixels at first positions of alternating rows of the unprocessed left image and reverse combining a pixel in remaining rows of the left image to form at least two pixels at second positions of remaining rows of the unprocessed left image, and reverse mapping pixel information from the right image to the unprocessed right image by reverse combining a pixel in alternating rows of the right image to form at least two pixels at first positions of alternating rows of the unprocessed right image and reverse combining a pixel in remaining rows of the right image to form at least two pixels at second positions of remaining rows of the unprocessed right image.

14. The method of claim 1, wherein

the other one of the right image or the left image is divided into a plurality of blocks and the plurality of blocks are re-arranged from a third block arrangement to a fourth block arrangement different from the third block arrangement, and the generating the second demultiplexed image for the other one of the right image or the left image in the multiplexed image frame comprises reverse re-arranging the plurality of blocks in the other one of the right image or the left image in the multiplexed image frame from the fourth block arrangement to the third block arrangement different from the fourth block arrangement and combining the plurality of blocks of the third block arrangement.

15. A method for demultiplexing a series of multiplexed single frames divided into portions, each multiplexed single frame comprising a horizontal pixel count and a vertical pixel count that define a first aspect ratio and comprising one right image in a first portion and one left image in a second portion, wherein in at least one multiplexed single frame one of the right image or the left image is divided into a plurality of blocks, the plurality of blocks being re-arranged from a first block arrangement to a second block arrangement different from the first block arrangement, and the other one of the right image or the left image comprises a horizontal pixel count and a vertical pixel count that define a second aspect ratio, wherein the first and second aspect ratio are substantially the same, the method comprising:

receiving the series of multiplexed single frames;

generating a first demultiplexed image for the one of the right image or the left image in each multiplexed single frame of the series of multiplexed single frames, wherein the generating comprises reverse re-arranging the plurality of blocks in the one of the right image or the left image in each multiplexed single frame of the series of multiplexed single frames from the second block arrangement to the first block arrangement different from the second block arrangement and combining the plurality of blocks of the first block arrangement; and

generating a second multiplexed image for the other one of the right image or the left image in each multiplexed single frame of the series of multiplexed single frames.

16. The method of claim 15, wherein the left image in the single frame is associated the right image in the single frame.

17. The method of claim 15, wherein the left image or the right image is compressed, said compressing comprises less compression at a center of the left image or the right image, and the method further comprises less uncompressing at the center of the compressed left image or right image.

18. The method of claim 15, wherein the multiplexed single frame is divided by a vertically oriented border, with the right image on a first side of the multiplexed single frame and the left image on a second side of the multiplexed single frame.

19. The method of claim 15, wherein each left image is based on an unprocessed left image and each right image is based on an unprocessed right image, and each right image is created from an associated unprocessed right image using a process different from processing used to create each other right image, and each left image is created from an associated unprocessed left image using a process different from processing used to create each other left image.

20. The method of claim 15, wherein each left image is based on an unprocessed left image and each right image is based on an unprocessed right image, and the method further comprises:

adding a pixel to every alternate pixel for every row in one right image to form one unprocessed right image and adding a pixel to every alternate pixel for every row in one left image to form one unprocessed left image.

21. The method of claim 15, wherein each left image is based on an unprocessed left image and each right image is based on an unprocessed right image, and the method further comprises:

reverse mapping pixel information from one left image to one unprocessed left image based on information from at least one pixel from the left image and reverse mapping pixel information from the right image to the unprocessed right image based on information from at least one pixel from the right image.

22. The method of claim 15, further comprising applying a process to one left image and one right image, the process selected from at least one from a group comprising:

reverse variably applied bicubic scaling;

reverse variable sharpening;

reverse non-variably applied bicubic scaling; and

reverse non-variable sharpening.

23. The method of claim 20, wherein adding a pixel to every alternate pixel position in each row comprises adding a first set of pixels to a first row and a different set of pixels to each row adjacent to the first row.

24. The method of claim 23, wherein the adding substantially forms a “

checkerboard”

type pattern of pixels being added to one right image and one left image.

25. The method of claim 15, wherein each left image is based on an unprocessed left image and each right image is based on an unprocessed right image, and the method further comprises:

reverse mapping pixel information from one left image to one unprocessed left image by providing more pixels from predetermined areas of one left image than other areas of one left image, and reverse mapping pixel information from one right image to one unprocessed right image by providing more pixels from predetermined areas of one right image than other areas of one right image.

26. The method of claim 15, wherein each left image is based on an unprocessed left image comprising alternating rows and remaining rows of pixels and each right image is based on an unprocessed right image comprising alternating and remaining rows of pixels, and the method further comprises:

reverse mapping pixel information from the left image to the unprocessed left image by reverse combining pixels to alternating rows of the left image and adding pixels to remaining rows of the left image, and reverse mapping pixel information from the unprocessed right image to the unprocessed right image by reverse combining pixels to alternating rows of the right image and adding pixels to remaining rows of the right image.

27. The method of claim 15, wherein each left image is based on an unprocessed left image comprising alternating rows and remaining rows of pixels and each right image is based on an unprocessed right image comprising alternating and remaining rows of pixels, and the method further comprises:

reverse mapping pixel information from the left image to the unprocessed left image by reverse combining a pixel in alternating rows of the left image to form at least two pixels at first positions of alternating rows of the unprocessed left image and reverse combining a pixel in remaining rows of the left image to form at least two pixels at second positions of remaining rows of the unprocessed left image, and reverse mapping pixel information from the right image to the unprocessed right image by reverse combining a pixel in alternating rows of the right image to form at least two pixels at first positions of alternating rows of the unprocessed right image and reverse combining a pixel in remaining rows of the right image to form at least two pixels at second positions of remaining rows of the unprocessed right image.

28. The method of claim 15, wherein the other one of the right image or the left image is divided into a plurality of blocks and the plurality of blocks are re-arranged from a third block arrangement to a fourth block arrangement different from the third block arrangement, and the generating the second demultiplexed image for the other one of the right image or the left image in each multiplexed single frame of the series of multiplexed single frames comprises reverse re-arranging the plurality of blocks in the other one of the right image or the left image in each multiplexed single frame of the series of multiplexed single frames from the fourth block arrangement to the third block arrangement different from the fourth block arrangement and combining the plurality of blocks of the third block arrangement.

29. A system configured to provide a stereoscopic image pair based on a multiplexed image frame configured to have a precursor format, wherein the multiplexed image frame comprises a horizontal pixel count and a vertical pixel count that define a first aspect ratio, wherein the precursor format of the multiplexed image frame comprises a right image in a first portion of the multiplexed image frame and a left image in a second portion of the multiplexed image frame, wherein one of the right image or the left image is divided into a plurality of blocks, the plurality of blocks being re-arranged from a first block arrangement to a second block arrangement different from the first block arrangement, and the other one of the right image or the left image comprises a horizontal pixel count and a vertical pixel count that define a second aspect ratio, wherein the first and second aspect ratios are substantially the same, the system comprising:

an interface configured to receive the multiplexed image frame; and

a demultiplexer configured to;

generate a first demultiplexed image for the one of the right image or the left image in the multiplexed image frame, wherein the generating comprises reverse re-arranging the plurality of blocks in the one of the right image or the left image in the multiplexed image frame from the second block arrangement to the first block arrangement different from the second block arrangement and combining the plurality of blocks of the first block arrangement; and

generate a second demultiplexed image for the other one of the right image or the left image in the multiplexed image frame.