Image segmentation by means of temporal parallax difference induction

• US 7,340,094 B2
• Filed: 12/18/2006
• Issued: 03/04/2008
• Est. Priority Date: 07/06/2001
• Status: Expired due to Term

• Current Assignee: Vision III Imaging, Inc.
• Original Assignee: Vision III Imaging, Inc.
• Inventors: Martin, Michael B., Mayhew, Christopher A.
• Primary Examiner(s): Sherali; Ishrat
• Application Number:
  US11/640,293
• Publication Number:
  US 20070098258A1
• Time in Patent Office: 442 Days
• Field of Search: 382/173, 382/103, 382/106, 382/107, 382/154, 382/162, 348/446, 348/50, 348586-587, 348/42, 348/208.1, 348/135, 348/139, 345/419, 345/600, 396/324, 396/429, 356/608, 359/470, 359/477
• US Class Current: 382/173
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06T 7/579 from motion
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/275 Generation of keying signals

Abstract

An image compositing and compression method based on the creation and processing of parallax differences in motion photography. A parallax scanning MOE lens creates discrete parallax differences in the objects in the recorded scene that are perceived by the viewer as enhanced texture and depth when displayed. Using parallax differences in a captured scene, a computer can detect objects for the purpose of creating image compositing mattes. This method allows matte passes to be filmed on location at the time of principal photography, thereby saving costly additional blue/green stage production shoot days associated with traveling matte techniques. In addition, because the mattes are based on parallax scan differences in the recorded scene and not on a uniform color and luminance process, certain conflicting scene subject colors will not have to be avoided. Also, because the matte scenes are recorded on location, the lighting in each of the various elements matches in the final composited image.

Claims

1. A method of generating, from a succession of images, a succession of mattes which correspond to scene object layers, respectively, comprising the steps of:

generating a flow map, for one or more of the succession of images, that specifies how pixels move between adjacent images in the succession of images;

separating groups of pixels, for the one or more succession of images, into distinct regions by combining pixels with similar flow values; and

generating a matte for the distinct regions of the one or more of the succession of images to provide the succession of mattes.

2. The method of claim 1, further comprising selecting and removing selected mattes from the succession of mattes.

3. The method of claim 2, further comprising using a computer or control device to automatically select the mattes.

4. The method of claim 2 further comprising manually selecting the mattes.

5. The method of claim 1, further comprising performing region edge processing on at least one matte of the succession of mattes.

6. The method of claim 1, further comprising:

generating color layers for the one or more of the succession of images by multiplying one or more of the succession of mattes by corresponding original image information.

7. The method of claim 6, further comprising:

inserting additional image layers into the color layers generated for the one or more of the succession of images.

8. The method of claim 6, further comprising:

ordering the color layers.

9. The method of claim 6, further comprising:

generating a composite image by adding together at least two of the color layers corresponding to the one or more of the succession of images.

10. The method of claim 9, further comprising:

generating a final composite image by adjusting the composite image for brightness or contrast.