Process and system for encoding and playback of stereoscopic video sequences

• US 8,804,842 B2
• Filed: 03/17/2009
• Issued: 08/12/2014
• Est. Priority Date: 04/09/2002
• Status: Active Grant

• Current Assignee: 3DN, LLC
• Original Assignee: SENSIO Technologies, Inc.
• Inventors: Routhier, Nicholas, Thibeault, Claude, Belzile, Jean, Malouin, Daniel, Carpentier, Pierre-Paul, Dallaire, Martin
• Primary Examiner(s): PHILIPPE, GIMS S
• Application Number:
  US12/406,078
• Publication Number:
  US 20090219382A1
• Time in Patent Office: 1,974 Days
• Field of Search: 375/240.25, 348/43, 348/56, 348/51, 382/107, 382/284, 382/285
• US Class Current: 375/240.25
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/144 for flicker reduction
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/339 using spatial multiplexing H04N13/337 takes precedence
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2013/0096 Synchronisation or controlling aspects
• CPC Class Codes: H04N 2213/002 Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices
• CPC Class Codes: H04N 2213/007 Aspects relating to detection of stereoscopic image format, e.g. for adaptation to the display format

Abstract

A method for decoding a compressed image stream, the image stream having a plurality of frames, each frame consisting of a merged image including pixels from a left image and pixels from a right image. The method involves the steps of receiving each merged image; changing a clock domain from the original input signal to an internal domain; for each merged image, placing at least two adjacent pixels into an input buffer and interpolating an intermediate pixel, for forming a reconstructed left frame and a reconstructed right frame according to provenance of the adjacent pixels; and reconstructing a stereoscopic image stream from the left and right image frames. The invention also teaches a system for decoding a compressed image stream.

Claims

1. A system for processing a stereoscopic image stream having a merged frame format, comprising:

a spatial interpolation module configured to spatially interpolate each merged frame of said stereoscopic image stream into reconstructed frame data;

a buffer configured to store said reconstructed frame data;

a memory controller configured to read out said reconstructed frame data from said buffer;

a temporal interpolation module configured to generate an output stream of frames using temporal interpolation of said reconstructed frame data, wherein said temporal interpolation is in accordance with a selected one of a plurality of stereoscopic 3D display modes; and

an output configured to output said output stream of frames.

2. The system according to claim 1, wherein said system further includes an anti-flicker filter downstream of said temporal interpolation module.

3. The system according to claim 1, wherein said system further includes a synchronisation module for synchronising shutter eyeglasses with said output.

4. The system according to claim 1, wherein said plurality of stereoscopic 3D display modes comprise at least two modes selected from the group consisting of:

page flipping, row interleaved, column interleaved, simultaneous dual presentation, and anaglyphic.

5. A system for decoding stereoscopic video, said stereoscopic video formed by topologically decimating a first image sequence and a second image sequences, each having a first display rate, to form adjacent portions of a third image sequence having a second display rate less than twice said first display rate, and encoding said third image sequence for transport through a data transport medium, said system comprising:

a processor configured to;

decode said third image sequence from the encoded third image sequence received from said data transport medium;

topologically interpolate each of said adjacent portions of said third image sequence to form a first rebuilt image sequence and a second rebuilt image sequence respectively;

for each of said first rebuilt image sequence and said second rebuilt image sequence, apply temporal interpolation to at least two successive images in said sequence to form at least one additional image;

for each of said first rebuilt image sequence and said second rebuilt image sequence, modify said sequence by inserting said at least one additional image into said sequence to increase the display rate of said sequence; and

in a page flipping mode, an output image sequence comprised of successively alternating images from each of said first rebuilt image and second rebuilt image sequence of increased display rate.

6. The system of claim 5, wherein the second display rate is not equal to the first display rate.

7. The system of claim 6, wherein the second display rate is greater than the first display rate.

8. The system of claim 5, wherein the display rate of the output image sequence is one of a group consisting of 60 fps, 72 fps, 96 fps and 120 fps.

9. The system of claim 5, wherein the increased display rate of each of said first rebuilt image sequence and said second rebuilt image sequence is at least 36 fps.

10. The system of claim 5, wherein said first frame display rate is 24 fps.