IMAGE DEFORMATION APPARATUS AND METHOD OF CONTROLLING OPERATION OF SAME

• US 20150125078A1
• Filed: 01/12/2015
• Published: 05/07/2015
• Est. Priority Date: 07/13/2012
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: KITAGAWA, Junya
• Granted Patent: US 9,177,369 B2
• Time in Patent Office: Days
• US Class Current: 382/173
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20132 Image cropping
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 3/14 Transformations for image registration, e.g. adjusting or mapping for alignment of images
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/11 Region-based segmentation

Abstract

A target image is deformed in such a manner that a subject in a reference image and a subject in the target image will coincide. A reference image and a target image are each divided into regions that conform to amounts of optical distortion. A region which is in the target image and which is common to the reference image and to the target image is subdivided into regions S35 to S37, S38 to S40, S42 to S44 in each of which amounts of optical distortion of both the reference image and target image are obtained. By using the amounts of optical distortion of the reference image and amounts of optical distortion of the target image 11 obtained from the subdivided regions S35 to S37, S38 to S40, S42 to S44, the target image is deformed in such a manner that a subject in the common region will coincide with the reference image.

Claims

1. An image deformation apparatus comprising:

an image input device for inputting multiple frames of an image obtained by imaging the same subject multiple times;

a reference image decision device for deciding a reference image from among the multiple frames of the image that have been input from said image input device;

a target image decision device for deciding a target image from among the multiple frames of the image other than the reference image that have been input from said image input device;

a region dividing device for dividing the reference image decided by said reference image decision device and the target image decided by said target image decision device into regions that conform to amounts of optical distortion;

a region subdividing device for subdividing a common region, which is in the target image and is a region common to the reference image and to the target image, into regions in each of which both amount of optical distortion of the reference image and amount of optical distortion of the target image can be partitioned, in accordance with the amounts of optical distortion in respective ones of the regions of the reference image and regions of the target image divided by said region dividing device; and

a deformation device for deforming the target image using the amounts of optical distortion of the reference image and amounts of optical distortion of the target image obtained from the regions subdivided by said region subdividing device, and making a subject in the common region coincide with the reference image.

2. The apparatus according to claim 1, further comprising a correction device for performing an optical-distortion correction in a case where the optical axis of an imaging optical system utilized in capturing the reference image and the target image is offset from centers of the reference image and target image, the optical-distortion correction being performed centered on offset position of the optical axis;

wherein said region dividing device divides the reference image and the target image, the amounts of optical distortion of which have been corrected by the correction device, into regions in accordance with the corrected amounts of optical distortion.

3. The apparatus according to claim 1, further comprising an aligning device for aligning the reference image and the target image based upon a motion vector of the target image with respect to the reference image;

wherein if the reference image and target image have been aligned by said aligning device, said region dividing device divides, with regard to non-coincident portions of the images, the reference image and the target image into regions in accordance with the corrected amounts of optical distortion.

4. The apparatus according to claim 1, further comprising:

an aligning device for aligning the reference image and the target image based upon a motion vector of the target image with respect to the reference image; and

a determination device for determining that the reference image or the target image contains a moving body if degree of non-coincidence is equal to or greater than a predetermined value.

5. The apparatus according to claim 1, wherein said region dividing device divides the reference image and the target image into rectangular regions or concentric circular regions that conform to amounts of optical distortion.

6. The apparatus according to claim 1, further comprising a compositing device for combining the reference image and the target image that have been deformed by said deformation device.

7. A method of controlling operation of an image deformation apparatus, said method comprising steps of:

an image input device inputting multiple frames of an image obtained by imaging the same subject multiple times;

a reference image decision device deciding a reference image from among the multiple frames of the image that have been input from the image input device;

a target image decision device deciding a target image from among the multiple frames of the image other than the reference image that have been input from the image input device;

a region dividing device dividing the reference image decided by the reference image decision device and the target image decided by the target image decision device into regions that conform to amounts of optical distortion;

a region subdividing device subdividing a common region, which is in the target image and is a region common to the reference image and to the target image, into regions in each of which both amount of optical distortion of the reference image and amount of optical distortion of the target image can be partitioned, in accordance with the amounts of optical distortion in respective ones of the regions of the reference image and regions of the target image divided by the region dividing device; and

a deformation device deforming the target image using the amounts of optical distortion of the reference image and amounts of optical distortion of the target image obtained from the regions subdivided by the region subdividing device, and making a subject in the common region coincide with the reference image.