Image processing apparatus and image processing method

• US 8,565,555 B2
• Filed: 08/16/2010
• Issued: 10/22/2013
• Est. Priority Date: 08/20/2009
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Kotani, Takuya
• Primary Examiner(s): Park, Chan S
• Assistant Examiner(s): Roz, Mark
• Application Number:
  US12/856,971
• Publication Number:
  US 20110043667A1
• Time in Patent Office: 1,163 Days
• Field of Search: None
• US Class Current: 382/299
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 25/48 Increasing resolution by shifting the sensor relative to the scene
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"

Abstract

An image processing apparatus for generating corrected image data from a plurality of input image data by performing an iterative calculation process includes an input unit configured to input the plurality of input image data, an acquisition unit configured to acquire a photographing parameter used for photographing to acquire the input image data, a setting unit configured to set for each image area a number of iterations for generating the corrected image data based on the photographing parameter, and a generation unit configured to generate correction data from the plurality of image data by performing an iterative calculation process on each image area based on the number of iterations set for each image area.

Claims

1. An image processing apparatus for generating corrected image data from a plurality of input image data by performing an iterative calculation process, the apparatus comprising:

an input unit configured to input the plurality of input image data;

an acquisition unit configured to acquire a photographing parameter used for photographing to acquire the input image data;

a setting unit configured to set, for each image area, a number of iterations for generating the corrected image data based on the photographing parameter, wherein a number of iterations for a first image area is different from a number of iterations for a second image area; and

a generation unit configured to generate corrected image data from the plurality of image data by performing an iterative calculation process on each image area based on the number of iterations set for each image area, the generation unit generates the corrected image data from the plurality of input image data by performing super-resolution processing,

wherein the number of iterations for each image area set by the setting unit is set based on an amount of distortion of the image,

wherein the amount of distortion is determined based on a displacement of a pixel in the image.

2. The image processing apparatus according to claim 1, wherein the plurality of input image data input by the input unit is image data indicating an image in which lens aberration is corrected.

3. The image processing apparatus according to claim 1, further comprising an aberration correction unit configured to perform lens aberration correction on the corrected image data generated by the generation unit.

4. The image processing apparatus according to claim 2, wherein an image on which the lens aberration correction is performed is an image on which a keystone correction process is performed.

5. The image processing apparatus according to claim 1, wherein the plurality of input image data is acquired by performing time-division exposure.

6. The image processing apparatus according to claim 1, wherein the image area is set according to an image height of an image indicated by input image data, and

wherein the number of iterations of an image area of high image height is greater than the number of iterations of an image area of low image height.

7. The image processing apparatus according to claim 1, wherein a unit of the image area is a pixel.

8. The image processing apparatus according to claim 1, wherein a unit of the image area is an image height.

9. The image processing apparatus according to claim 1, wherein the setting unit sets, for each area, the number of iterations for generating the corrected image data based on a characteristic of a lens and a photographing parameter of an imaging apparatus used for photographing to acquire the input image data.

10. An image processing method for generating corrected image data from a plurality of input image data by performing an iterative calculation process, the method comprising:

inputting the plurality of input image data;

acquiring a photographing parameter used for photographing to acquire the input image data;

setting, for each image area, a number of iterations for generating the corrected image data based on the photographing parameter, wherein a number of iterations for a first image area is different from a number of iterations for a second image area; and

generating corrected image data from the plurality of image data by performing an iterative calculation process on each image area based on the number of iterations set for each image area, generating the corrected image data from the plurality of input image data by performing super-resolution processing,

wherein the number of iterations for each image area is set based on an amount of distortion of the image,

wherein the amount of distortion is determined based on a displacement of a pixel in the image.

11. A non-transitory computer-readable medium storing a program for causing an image processing apparatus to perform the image processing method comprising:

inputting the plurality of input image data;

acquiring a photographing parameter used for photographing to acquire the input image data;

setting, for each image area, a number of iterations for generating the corrected image data based on the photographing parameter, wherein a number of iterations for a first image area is different from a number of iterations for a second image area; and

generating corrected image data from the plurality of image data by performing an iterative calculation process on each image area based on the number of iterations set for each image area, generating the corrected image data from the plurality of input image data by performing super-resolution processing,

wherein the number of iterations for each image area is set based on an amount of distortion of the image,

wherein the amount of distortion is determined based on a displacement of a pixel in the image.