Apparatus for processing a stereoscopic image stream

• US 8,384,766 B2
• Filed: 01/22/2010
• Issued: 02/26/2013
• Est. Priority Date: 04/09/2002
• Status: Active Grant

• Current Assignee: 3DN, LLC
• Original Assignee: SENSIO Technologies, Inc.
• Inventors: Routhier, Nicholas, Malouin, Daniel, Routhier, Pierre-Hugues, Fortin, Etienne
• Primary Examiner(s): Rao, Andy
• Application Number:
  US12/691,786
• Publication Number:
  US 20100171814A1
• Time in Patent Office: 1,131 Days
• Field of Search: 37524001-24029
• US Class Current: 348/43
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/144 for flicker reduction
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/339 using spatial multiplexing H04N13/337 takes precedence
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2013/0096 Synchronisation or controlling aspects
• CPC Class Codes: H04N 2213/002 Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices
• CPC Class Codes: H04N 2213/007 Aspects relating to detection of stereoscopic image format, e.g. for adaptation to the display format

Abstract

A system is provided for processing a compressed image stream of a stereoscopic image stream, the compressed image stream having a plurality of frames in a first format, each frame consisting of a merged image comprising pixels sampled from a left image and pixels sampled from a right image. A receiver receives the compressed image stream and a decompressing module in communication with the receiver decompresses the compressed image stream. The left and right images of the decompressed image stream are stored in a frame buffer. A serializing unit reads pixels of the frames stored in the frame buffer and outputs a pixel stream comprising pixels of a left frame and pixels of a right frame. A stereoscopic image processor receives the pixel stream, buffers the pixels, performs interpolation in order to reconstruct pixels of the left and right images and outputs a reconstructed left pixel stream and a reconstructed right pixel stream, the reconstructed streams having a format different from the first format. A display signal generator receives the stereoscopic pixel stream to provide an output display signal.

Claims

1. A system for processing a compressed image stream of a stereoscopic image stream, said compressed image stream having a plurality of frames in a first format, each frame consisting of a merged image formed by juxtaposing a sampled image frame of a left image and a sampled image frame of a right image, each sampled image frame having half a number of original pixels forming a staggered quincunx pattern in which original pixels surround missing pixels, said system comprising:

a receiver for receiving said compressed image stream;

a decompressing module in communication with said receiver for decompressing said compressed image stream;

a frame buffer connected to said decompressing module for receiving and storing frames of said merged image of said decompressed image stream;

a serializing unit for reading pixels of said frames stored in said frame buffer and outputting a pixel stream comprising pixels of a left frame and pixels of a right frame;

a stereoscopic image processor configured to receive said pixel stream, to buffer said pixels, to perform interpolation in order to reconstruct missing pixels of each of said left and right images using only original pixels of the respective one of said left and right images and to output a reconstructed left pixel stream and a reconstructed right pixel stream, wherein said interpolating comprises, for each missing pixel;

calculating an edge-dependent weighting factor using values of said original pixels including values of original pixels other than those immediately surrounding said missing pixel; and

calculating an interpolated value for said missing pixel using original pixels and said weighting factor;

a display signal generator receiving said stereoscopic pixel stream to provide an output display signal.

2. A system as claimed in claim 1, wherein said stereoscopic image processor comprises:

an interpolation module for forming a reconstructed left frame and a reconstructed right frame from said pixel stream;

an output module for outputting said reconstructed stereoscopic image stream in a format different from said first format, said output module comprising;

a display mode controller for selecting one of a plurality of stereoscopic display modes and outputting said reconstructed frames in said selected mode.

3. A system as claimed in claim 2, wherein said output module further comprises:

a display rate controller for controlling a display rate of said frames.

4. A system as claimed in claim 1, wherein said compressed image stream is stored as a DVD and further comprising a DVD reader providing said compressed image stream to said receiver.

5. A system as claimed in claim 1, wherein said receiver, said decompressing module, said frame buffer and said serializing unit are integrated into a single chip receiving said compressed image stream and outputting said pixel stream.

6. A system as claimed in claim 2, said plurality of stereoscopic display modes comprises at least two of a page flipping, line interleaved, a column interleaved, an anaglyphic, a dual stream display and a monoscopic display mode.

7. A system as claimed in claim 1, further comprising a synchronization module for synchronizing shutter eyeglasses.

8. A system as claimed in claim 3, wherein said display rate controller comprises a temporal interpolator and wherein said controlling said display rate of said frames comprises time interpolation of said frames.

9. A system as claimed in claim 1, wherein said serializing unit and said display signal generator are driven by a common pixel clock.

10. A system as claimed in claim 9, wherein said stereoscopic image processor uses said common pixel clock and outputs said stereoscopic pixel stream with a 5-line delay.

11. A system as claimed in claim 9, wherein said stereoscopic image processor uses said common pixel clock and outputs said stereoscopic pixel stream with one image frame delay.

12. A method for processing a stereoscopic image stream, the stereoscopic image stream including a plurality of frames, each frame formed by juxtaposing a sampled image frame of a left image and a sampled image frame of a right image, each sampled image frame having half a number of original pixels forming a staggered quincunx pattern in which original pixels surround missing pixels, said method comprising:

for each frame of the stereoscopic image stream, reconstructing stereoscopic left and right image frames from the sampled image frames juxtaposed in the respective frame of the stereoscopic image stream, by interpolating missing pixel values for each of said stereoscopic left and right image frames using only the original pixels of the respective sampled image frame, wherein said interpolating includes, for each missing pixel;

calculating an edge-dependent weighting factor using the original pixel values including values of original pixels other than those immediately surrounding said missing pixel; and

calculating an interpolated value for said missing pixel using original pixels and said weighting factor;

outputting a reconstructed stereoscopic pixel stream for use in generating a display signal.

13. A method as claimed in claim 12, wherein calculating an interpolated value for said missing pixel includes taking the arithmetic mean of two pixel values.