Image Shooting Apparatus and Blur Correction Method

• US 20090179995A1
• Filed: 01/14/2009
• Published: 07/16/2009
• Est. Priority Date: 01/16/2008
• Status: Abandoned Application

• Current Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Inventors: HATANAKA, Haruo, MORI, Yukio, MURATA, Haruhiko, FUKUMOTO, Shimpei
• Application Number:
  US12/353,430
• Publication Number:
  US 20090179995A1
• Time in Patent Office: Days
• US Class Current: 348/208.600
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory

Abstract

An image shooting apparatus includes: an image-sensing portion adapted to acquire an image by shooting; a blur correction processing portion adapted to correct blur in a first image obtained by shooting based on the first image and a second image shot with an exposure time shorter than the exposure time of the first image; and a control portion adapted to control whether or not to make the blur correction processing portion execute blur correction processing.

Claims

1. An image shooting apparatus comprising:

an image-sensing portion adapted to acquire an image by shooting;

a blur correction processing portion adapted to correct blur in a first image obtained by shooting based on the first image and a second image shot with an exposure time shorter than an exposure time of the first image; and

a control portion adapted to control whether or not to make the blur correction processing portion execute blur correction processing.

2. The image shooting apparatus according to claim 1,

wherein the control portion comprises a blur estimation portion adapted to estimate a degree of blur in the second image, and controls, based on a result of estimation by the blur estimation portion, whether or not to make the blur correction processing portion execute blur correction processing.

3. The image shooting apparatus according to claim 2,

wherein the blur estimation portion estimates the degree of blur in the second image based on a result of comparison between edge intensity of the first image and edge intensity of the second image.

4. The image shooting apparatus according to claim 3, wherein

sensitivity for adjusting brightness of a shot image differs between during shooting of the first image and during shooting of the second image, and

the blur estimation portion executes the comparison through processing involving reducing a difference in edge intensity between the first and second images resulting from a difference in sensitivity between during shooting of the first image and during shooting of the second image.

5. The image shooting apparatus according to claim 2,

wherein the blur estimation portion estimates the degree of blur in the second image based on an amount of displacement between the first and second images.

6. The image shooting apparatus according to claim 2,

wherein the blur estimation portion estimates the degree of blur in the second image based on an estimated image degradation function of the first image as found by use of the first and second images.

7. The image shooting apparatus according to claim 6,

wherein the blur estimation portion refers to values of individual elements of the estimated image degradation function as expressed in a form of a matrix, extracts, out of the values thus referred to, values falling outside a prescribed value range, and estimates the degree of blur in the second image based on a sum value of the values thus extracted.

13. The image shooting apparatus according to claim 1,

wherein the blur correction processing portion handles an image based on the first image as a degraded image and an image based on the second image as an initial restored image, and corrects blur in the first image by use of Fourier iteration.

14. The image shooting apparatus according to claim 1, wherein

the blur correction processing portion comprises an image degradation function derivation portion adapted to find an image degradation function representing blur in the entire first image, and corrects blur in the first image based on the image degradation function, and

the image degradation function derivation portion definitively finds the image degradation function through processing involving

preliminarily finding the image degradation function in a frequency domain from a first function obtained by converting an image based on the first image into a frequency domain and a second function obtained by converting an image based on the second image into a frequency domain, and

revising, by use of a predetermined restricting condition, a function obtained by converting the thus found image degradation function in a frequency domain into a spatial domain.

15. The image shooting apparatus according to claim 1,

wherein the blur correction processing portion merges together the first image, the second image, and a third image obtained by reducing noise in the second image, to thereby generate a blur-corrected image in which blur in the first image has been corrected.

16. The image shooting apparatus according to claim 15,

wherein the blur correction processing portion first merges together the first and third images to generate a fourth image, and then merges together the second and fourth images to generate the blur-corrected image.

17. The image shooting apparatus according to claim 16, wherein

a merging ratio at which the first and third images are merged together is set based on a difference between the first and third images, and

a merging ratio at which the second and fourth images are merged together is set based on an edge contained in the third image.

8. An image shooting apparatus comprising:

an image-sensing portion adapted to acquire an image by shooting;

a blur correction processing portion adapted to correct blur in a first image obtained by shooting based on the first image and one or more second images shot with an exposure time shorter than an exposure time of the first image; and

a control portion adapted to control, based on a shooting parameter of the first image, whether or not to make the blur correction processing portion execute blur correction processing or a number of second images to be used in blur correction processing.

9. The image shooting apparatus according to claim 8,

wherein the control portion comprises:

a second-image shooting control portion adapted to judge whether or not it is practicable to shoot the second image based on the shooting parameter of the first image and control the image-sensing portion accordingly; and

a correction control portion adapted to control, according to a result of judgment of whether or not it is practicable to shoot the second image, whether or not to make the blur correction processing portion execute blur correction processing.

10. The image shooting apparatus according to claim 8, wherein

the control portion comprises a second-image shooting control portion adapted to determine, based on the shooting parameter of the first image, the number of second images to be used in blur correction processing by the blur correction processing portion and control the image-sensing portion so as to shoot the thus determined number of second images,

the second-image shooting control portion determines the number of second images to be one or plural, and

when the number of second images is plural, the blur correction processing portion additively merges together the plural number of second images to generate one merged image, and corrects blur in the first image based on the first image and the merged image.

11. The image shooting apparatus according to claim 8,

wherein the shooting parameter of the first image includes focal length, exposure time, and sensitivity for adjusting brightness of an image during shooting of the first image.

12. The image shooting apparatus according to claim 9,

wherein the second-image shooting control portion sets a shooting parameter of the second image based on the shooting parameter of the first image.

18. The image shooting apparatus according to claim 8,

wherein the blur correction processing portion handles an image based on the first image as a degraded image and an image based on the second image as an initial restored image, and corrects blur in the first image by use of Fourier iteration.

19. The image shooting apparatus according to claim 8, wherein

the blur correction processing portion comprises an image degradation function derivation portion adapted to find an image degradation function representing blur in the entire first image, and corrects blur in the first image based on the image degradation function, and

the image degradation function derivation portion definitively finds the image degradation function through processing involving

preliminarily finding the image degradation function in a frequency domain from a first function obtained by converting an image based on the first image into a frequency domain and a second function obtained by converting an image based on the second image into a frequency domain, and

revising, by use of a predetermined restricting condition, a function obtained by converting the thus found image degradation function in a frequency domain into a spatial domain.

20. The image shooting apparatus according to claim 8,

wherein the blur correction processing portion merges together the first image, the second image, and a third image obtained by reducing noise in the second image, to thereby generate a blur-corrected image in which blur in the first image has been corrected.

21. The image shooting apparatus according to claim 20,

wherein the blur correction processing portion first merges together the first and third images to generate a fourth image, and then merges together the second and fourth images to generate the blur-corrected image.

22. The image shooting apparatus according to claim 21, wherein

a merging ratio at which the first and third images are merged together is set based on a difference between the first and third images, and

a merging ratio at which the second and fourth images are merged together is set based on an edge contained in the third image.

23. A blur correction method comprising:

a blur correction processing step of correcting blur in a first image obtained by shooting based on the first image and one or more second images shot with an exposure time shorter than an exposure time of the first image; and

a controlling step of controlling whether or not to make the blur correction processing step execute blur correction processing.

24. The blur correction method according to claim 23,

wherein the controlling step comprises a blur estimation step of estimating a degree of blur in the second image so that, based on a result of the estimation, whether or not to make the blur correction processing step execute blur correction processing is controlled.

25. A blur correction method comprising:

a blur correction processing step of correcting blur in a first image obtained by shooting based on the first image and one or more second images shot with an exposure time shorter than an exposure time of the first image; and

a controlling step of controlling, based on a shooting parameter of the first image, whether or not to make the blur correction processing step execute blur correction processing or a number of second images to be used in blur correction processing.