Method and apparatus for monoscopic to stereoscopic image conversion

• US 6,215,516 B1
• Filed: 12/17/1999
• Issued: 04/10/2001
• Est. Priority Date: 07/07/1997
• Status: Expired due to Fees

• Current Assignee: Reveo, Inc.
• Original Assignee: Reveo, Inc.
• Inventors: Ma, Kelvin, Swift, David
• Primary Examiner(s): Le, Vu
• Application Number:
  US09/466,045
• Time in Patent Office: 480 Days
• Field of Search: 348/42-44, 348/96-97, 348/51, 348/571, 348/578, 348/580, 382/154, 345/328, 345/419, 345/326
• US Class Current: 348/43
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0092 Image segmentation from stereoscopic image signals

Abstract

A method and apparatus for converting a monoscopic image with one perspective to a stereoscopic image with two perspectives is provided. A foreground object is identified and outlined. The depth of the object is endowed with depth information. The second perspective is generated by image warping. Alternate embodiments comprising additional features, such as removing redundant frames, which reduce the necessary computation are also provided.

Claims

1. An apparatus for converting a sequence of frames of monoscopic images with at least one foreground object with a depth and at least one background object to a sequence of stereoscopic images, comprising:

a foreground object identifier;

a first foreground object outliner;

a foreground object depth setter;

a second foreground object outliner;

a background object line clipper;

a foreground object point shifter; and

wherein the identifier, the first outliner, the depth setter, the second outliner, and the point shifter are coupled in series.

2. The apparatus of claim 1 wherein said sequence of successive frames is derived from motion picture film.

3. The apparatus of claim 1 wherein said sequence of successive frames is derived from video med.

4. The apparatus of claim 1 wherein said sequence of successive frames contains redundant frames a result of conversion from motion picture film.

5. The apparatus of claim 4 further comprising a redundant frame remover coupled in series before said foreground object identifier.

6. The apparatus of claim 1 wherein said apparatus operates only on selected frames of said monoscopic images, thereby reducing the number of frame that must be converted to stereoscopic images, thereby reducing computation time while providing a sequence of images which appear to be stereoscopic.

7. The apparatus of claim 6 wherein said selected frames are separated by a set interval of time.

8. The apparatus of claim 7 wherein said set interval is about 300 milliseconds.

9. The apparatus of claim 1 wherein said foreground object point shifter shifts points based on said depth of said at least one foreground object and a selected perspective calculation curve.

10. The apparatus of claim 9 wherein said selected perspective calculation curve is an actual perspective calculation curve.

11. The apparatus of claim 9 wherein an operator is prevented from setting said depth of said at least one foreground object significantly beyond a neutral plane.

12. The apparatus of claim 9 wherein said selected perspective calculation curve is a modified perspective calculation curve.

13. The apparatus of claim 12 wherein said modified perspective calculation curve is a saturating perspective calculation curve.

14. The apparatus of claim 1 wherein said depth in said setting step may be varied in response to instructions from an operator.

15. The apparatus of claim 14 wherein said sequence of stereoscopic images is displayed in near real-time.