3D video processing

• US 9,270,969 B2
• Filed: 03/05/2013
• Issued: 02/23/2016
• Est. Priority Date: 03/04/2009
• Status: Active Grant

• Current Assignee: Advanced Micro Devices, Inc., ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Original Assignee: Advanced Micro Devices, Inc., ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Inventors: Hong, Sunkwang, Hulyalkar, Samir N.
• Primary Examiner(s): Chang, Jungwon
• Application Number:
  US13/785,274
• Publication Number:
  US 20130182069A1
• Time in Patent Office: 1,085 Days
• Field of Search: 348/44, 348/97, 348/51, 348/42, 382/154, 382/275
• US Class Current: 1/1
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: H04N 13/00 Stereoscopic video systems; Multi-view video systems; Details thereof
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/144 for flicker reduction
• CPC Class Codes: H04N 2013/0074 Stereoscopic image analysis
• CPC Class Codes: H04N 2013/0085 Motion estimation from stereoscopic image signals
• CPC Class Codes: H04N 2213/002 Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices

Abstract

A method, an apparatus, and a non-transitory computer readable medium for performing 2D to 3D conversion are presented. A 2D input source is extracted into left and right 3D images. Motion vectors are calculated for the left and right 3D images. Frame rate conversion is performed on the left 3D image and the right 3D image, using the respective calculated motion vectors, to produce motion compensated left and right 3D images. The left and right 3D images and the motion compensated left and right 3D images are reordered for display.

Claims

1. A method for performing 2D image to 3D image conversion, comprising:

extracting a 2D image input data source into a left 3D image and right 3D image;

calculating a motion vector for each of the left 3D image and right 3D image;

performing frame rate conversion on the left 3D image and the right 3D image, using the respective calculated motion vectors, to produce motion compensated left and right 3D images; and

reordering the left and right 3D images and the motion compensated left and right 3D images for display by a display device.

2. A non-transitory computer-readable storage medium storing a set of instructions for execution by a general purpose computer to perform 2D image to 3D image conversion, the set of instructions comprising:

an extracting code segment for extracting a 2D image input data source into a left 3D image and right 3D image;

a calculating code segment for calculating a motion vector for each of the left 3D image and right 3D image;

a frame rate conversion code segment for performing frame rate conversion on the left 3D image and the right 3D image, using the respective calculated motion vectors, to produce motion compensated left and right 3D images; and

a reordering code segment for reordering the left and right 3D images and the motion compensated left and right 3D images for display by a display device.

3. The non-transitory computer-readable storage medium according to claim 2, wherein the instructions are hardware description language (HDL) instructions used for the manufacture of a device.

4. An apparatus configured to perform 2D image to 3D image conversion, comprising:

a 2D to 3D image extracting device, configured to extract a 2D image input data source into a left 3D image and right 3D image;

a motion vector calculating device, configured to calculate a motion vector for each of the left 3D image and right 3D image;

a frame rate conversion device, configured to produce motion compensated left and right 3D images based on the input left and right 3D images and the calculated motion vectors; and

an image reordering device, configured to reorder the left and right 3D input images and the motion compensated left and right 3D images for display by a display device.

5. A non-transitory computer-readable storage medium storing a set of instructions for execution by one or more processors to facilitate manufacture of an apparatus configured to perform 2D image to 3D image conversion, the apparatus comprising:

a 2D to 3D image extracting device, configured to extract a 2D image input data source into a left 3D image and right 3D image;

a motion vector calculating device, configured to calculate a motion vector for each of the left 3D image and right 3D image;

a frame rate conversion device, configured to produce motion compensated left and right 3D images based on the input left and right 3D images and the calculated motion vectors; and

an image reordering device, configured to reorder the left and right 3D input images and the motion compensated left and right 3D images for display by a display device.

6. A method for performing 2D image to 3D image conversion, comprising:

calculating a motion vector for a 2D image input data source;

performing frame rate conversion on the 2D image input data source, to produce a motion compensated 2D image based upon the calculated motion vector;

extracting the 2D image input source and the motion compensated 2D image into left and right 3D images and left and right motion compensated 3D images; and

reordering the left and right 3D images and the motion compensated left and right 3D images for display by a display device.

7. A non-transitory computer-readable storage medium storing a set of instructions for execution by a general purpose computer to perform 2D image to 3D image conversion, the set of instructions comprising:

a calculating code segment for calculating a motion vector for a 2D image input data source;

a frame rate conversion code segment for performing frame rate conversion on the 2D image input data source, to produce a motion compensated 2D image based upon the calculated motion vector;

an extracting code segment for extracting the 2D image input data source and the motion compensated 2D image into left and right 3D images and left and right motion compensated 3D images; and

a reordering code segment for reordering the left and right 3D images and the motion compensated left and right 3D images for display by a display device.

8. The non-transitory computer-readable storage medium according to claim 7, wherein the instructions are hardware description language (HDL) instructions used for the manufacture of a device.

9. An apparatus configured to perform 2D image to 3D image conversion, comprising:

a motion vector calculating device, configured to calculate a motion vector for a 2D image input data source;

a frame rate conversion device, configured to produce a motion compensated 2D image based on the input 2D image and the calculated motion vector;

a 2D image to 3D image extracting device, configured to extract the 2D image input data source and the motion compensated 2D image into left and right 3D images and left and right motion compensated 3D images; and

an image reordering device, configured to reorder the left and right 3D images and the motion compensated left and right 3D images for display by a display device.