Registration of separations

• US 9,773,314 B2
• Filed: 08/10/2015
• Issued: 09/26/2017
• Est. Priority Date: 01/04/2002
• Status: Expired due to Term

• Current Assignee: Oath Inc. (Verizon Communications Inc.), Warner Bros Entertainment Incorporated (Warner Bros. Discovery, Inc.)
• Original Assignee: Oath Inc. (Verizon Communications Inc.), Warner Bros Entertainment Incorporated (Warner Bros. Discovery, Inc.)
• Inventors: Perlmutter, Keren O., Perlmutter, Sharon M., Wang, Eric, Klamer, Paul R., Cookson, Christopher J., Gasparri, Massimiliano
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US14/822,442
• Publication Number:
  US 20150348268A1
• Time in Patent Office: 778 Days
• Field of Search: 382277, 382282, 382284, 382294, 358538, 358450, 358453
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20064 Wavelet transform [DWT]
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 3/403 Edge-driven scaling; Edge-based scaling
• CPC Class Codes: G06T 3/4084 in the transform domain, e.g. fast Fourier transform [FFT] domain scaling
• CPC Class Codes: G06T 5/10 using non-spatial domain filtering
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06T 7/38 Registration of image sequences
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: H04N 1/58 Edge or detail enhancement; Noise or error suppression, e.g. colour misregistration correction H04N1/62 takes precedence
• CPC Class Codes: H04N 23/15 Image signal generation with circuitry for avoiding or correcting image misregistration
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 9/11 Scanning of colour motion picture films, e.g. for telecine

Abstract

Separations or images relating to film or other fields may be registered using a variety of features, such as, for example: (1) correcting one or more film distortions; (2) automatically determining a transformation to reduce a film distortion; (3) applying multiple criteria of merit to a set of features to determine a set of features to use in determining a transformation; (4) determining transformations for areas in an image or a separation in a radial order; (5) comparing areas in images or separations by weighting feature pixels differently than non-feature pixels; (6) determining distortion values for transformations by applying a partial distortion measure and/or using a spiral search configuration; (7) determining transformations by using different sets of features to determine corresponding transformation parameters in an iterative manner; and (8) applying a feathering technique to neighboring areas within an image or separation.

Claims

1. A method of processing images of film stock, the method comprising:

accessing a first image of film stock bearing a first photograph;

accessing a second image of film stock bearing a second photograph that is different than the first photograph;

identifying a particular set of one or more features in (i) a first portion of the first image, and (ii) a second portion of the second image;

transforming at least a portion of the second image to generate a transformed version of the second image, wherein the particular set of one or more features are located in a third portion of the transformed version of the second image;

aligning the transformed version of the second image and the first image;

combining the first image and the transformed version of the second image into a composite image; and

storing the composite image and one or more other images on a non-transitory machine-readable medium as a set of images, the set of images representing frames of a motion picture.

2. The method of claim 1, wherein (I) differences in (i) at least one of size and position of the first portion of the first image with respect to the first image, and (ii) at least one of size and position of the second portion of the second image with respect to the second image, are greater, respectively, than (II) differences in (i) at least one of size and position of the first portion of the first image with respect to the first image, and (ii) at least one of size and position of the third portion of the transformed version of the second image with respect to the transformed version of the second image.

3. The method of claim 1, wherein:

accessing the first image of film stock bearing the first photograph, comprises accessing the first image of film stock bearing a first spectral component photograph of a scene; and

accessing the second image of film stock bearing the second photograph, comprises accessing the second image of film stock bearing a second spectral component photograph of the scene that is different than the first spectral component photograph of the scene.

4. The method of claim 3, wherein the first and second images are component images of at least the scene captured by a same device.

5. The method of claim 1, wherein aligning the transformed version of the second image and the first image comprises automatically determining an alignment vector for at least the portion of the transformed version of the second image.

6. The method of claim 1, wherein identifying the particular set of one or more features comprises identifying a particular set of one or more edges, pixel intensities, or contours that occur in the first and second images.

7. The method of claim 1, further comprising:

before transforming at least the portion of the second image, designating the first image as a reference image; and

wherein transforming at least the portion of the second image to generate the transformed version of the second image, comprises transforming, based on the reference image, at least the portion of the second image to generate the transformed version of the second image.

8. An apparatus for processing images of film stock, the apparatus comprising at least one processor programmed to perform operations comprising:

accessing a first image of film stock bearing a first photograph;

accessing a second image of film stock bearing a second photograph that is different than the first photograph;

identifying a particular set of one or more features in (i) a first portion of the first image, and (ii) a second portion of the second image;

transforming at least a portion of the second image to generate a transformed version of the second image, wherein the particular set of one or more features are located in a third portion of the transformed version of the second image;

aligning the transformed version of the second image and the first image;

combining the first image and the transformed version of the second image into a composite image; and

storing the composite image and one or more other images on a non-transitory machine-readable medium as a set of images, the set of images representing frames of a motion picture.

9. The apparatus of claim 8, wherein (I) differences in (i) at least one of size and position of the first portion of the first image with respect to the first image, and (ii) at least one of size and position of the second portion of the second image with respect to the second image, are greater, respectively, than (II) differences in (i) at least one of size and position of the first portion of the first image with respect to the first image, and (ii) at least one of size and position of the third portion of the transformed version of the second image with respect to the transformed version of the second image.

10. The apparatus of claim 8, wherein:

accessing the first image of film stock bearing the first photograph, comprises accessing the first image of film stock bearing a first spectral component photograph of a scene; and

accessing the second image of film stock bearing the second photograph, comprises accessing the second image of film stock bearing a second spectral component photograph of the scene that is different than the first spectral component photograph of the scene.

11. The apparatus of claim 10, wherein the first and second images are component images of at least the scene captured by a same device.

12. The apparatus of claim 8, wherein aligning the transformed version of the second image and the first image comprises automatically determining an alignment vector for at least the portion of the transformed version of the second image.

13. The apparatus of claim 8, wherein identifying the particular set of one or more features comprises identifying a particular set of one or more edges, pixel intensities, or contours that occur in the first and second images.

14. The apparatus of claim 8, wherein the operations further comprise:

before transforming at least the portion of the second image, designating the first image as a reference image; and

wherein transforming at least the portion of the second image to generate the transformed version of the second image, comprises transforming, based on the reference image, at least the portion of the second image to generate the transformed version of the second image.

15. A non-transitory computer-readable medium storing instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

accessing a first image of film stock bearing a first photograph;

accessing a second image of film stock bearing a second photograph that is different than the first photograph;

identifying a particular set of one or more features in (i) a first portion of the first image, and (ii) a second portion of the second image;

transforming at least a portion of the second image to generate a transformed version of the second image, wherein the particular set of one or more features are located in a third portion of the transformed version of the second image;

aligning the transformed version of the second image and the first image;

combining the first image and the transformed version of the second image into a composite image; and

storing the composite image and one or more other images on a non-transitory machine-readable medium as a set of images, the set of images representing frames of a motion picture.

16. The non-transitory computer-readable medium of claim 15, wherein (I) differences in (i) at least one of size and position of the first portion of the first image with respect to the first image, and (ii) at least one of size and position of the second portion of the second image with respect to the second image, are greater, respectively, than (II) differences in (i) at least one of size and position of the first portion of the first image with respect to the first image, and (ii) at least one of size and position of the third portion of the transformed version of the second image with respect to the transformed version of the second image.

17. The non-transitory computer-readable medium of claim 15, wherein aligning the transformed version of the second image and the first image comprises automatically determining an alignment vector for at least the portion of the transformed version of the second image.

18. The non-transitory computer-readable medium of claim 15, wherein identifying the particular set of one or more features comprises identifying a particular set of one or more edges, pixel intensities, or contours that occur in the first and second images.

19. A method of processing images of film stock, the method comprising:

accessing one or more component images that are based on digitized film separations, wherein each of the one or more component images includes a set of gray-level pixels;

selecting an image from the one or more component images;

determining an alignment vector for at least a part of the selected component image; and

applying the alignment vector to the part of the selected component image to correct one or more film distortions.

20. The method of claim 19 wherein determining an alignment vector for at least a part of the selected component image comprises;

determining a first set of features associated with a part of a reference image and determining a second set of features associated with a part of the selected component image; and

comparing the first set of features and the second set of features.