Imaging device having function for correcting image shake of acquired image

• US 7,675,546 B2
• Filed: 09/14/2005
• Issued: 03/09/2010
• Est. Priority Date: 09/15/2004
• Status: Expired due to Fees

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Usui, Kazutoshi
• Primary Examiner(s): Villecco; John M
• Application Number:
  US11/660,499
• Publication Number:
  US 20070253732A1
• Time in Patent Office: 1,637 Days
• Field of Search: 348/208.5, 348/208.1, 348/208.2, 348/208.6, 396/52, 396/54, 396/55
• US Class Current: 348/208.5
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time

Abstract

An imaging device photoelectrically converts a subject image to generate image data. The imaging device has a function of selectively performing two types of image vibration correction processings on this image data. The imaging device makes a selection/switching between the image vibration correction processings in accordance with a determination of an exposure period required to shoot the image data.

Claims

1. An imaging device, comprising:

an imaging section photoelectrically converting a subject image over a preset exposure period to generate image data;

a first image vibration correcting section obtaining an image vibration of said image data during said exposure period and performing an image vibration correction on said image data;

a second image vibration correcting section performing an image vibration correction on said image data by allowing said imaging section to perform imaging operations plural times during said exposure period and by registering and composing obtained plural image data; and

a selection control section determining said exposure period based on a threshold value according to a transfer period required to read an image of said imaging section and a count of said imaging operations by said second image vibration correcting section to select one of said first image vibration correcting section and said second image vibration correcting section for the image vibration correction of said image data.

2. The imaging device according to claim 1, wherein:

said first image vibration correcting section applies an inverse filter of a point spread function indicating an image vibration during said exposure period to said image data to correct said image vibration.

3. The imaging device according to claim 2, further comprising:

a vibration detecting section detecting a vibration which causes said image vibration, wherein

said first image vibration correcting section corrects said image vibration of said image data using the inverse filter of the point spread function according to the vibration detected by said vibration detecting section.

4. The imaging device according to claim 3, wherein

said vibration detecting section includes an angular speed sensor.

5. The imaging device according to claim 2, wherein

said second image vibration correcting section registers and composes the plural frames of said divided image data by pattern matching using a block matching method.

6. The imaging device according to claim 1, wherein:

the selecting control section selects said first image vibration correcting section when said exposure period is less than said threshold value and selects said second image vibration correcting section when said exposure period is equal to or more than said threshold value.

7. An imaging device, comprising:

an imaging section photoelectrically converting a subject image to generate image data;

a first image vibration correcting section performing an image vibration correction on said image data;

a second image vibration correcting section performing an image vibration correction different from a first image vibration correction on said image data; and

a selection control section selecting whether said first image vibration correcting section is used or said second image vibration correcting section is used for the image vibration correction of said image data based on an exposure period required for the photoelectric conversion of said image data,

wherein said first image vibration correcting section applies an inverse filter of a point spread function indicating an image vibration during said exposure period to said image data to correct said image vibration;

said second image vibration correcting section corrects the image vibration of said image data by allowing said imaging section to perform imaging operations of plural times obtained by dividing said exposure period and registering and composing obtained plural frames of divided image data; and

said selection control section determines said exposure period by a threshold value according to a transfer period required to read an image of said imaging section and a division exposure count by said second image vibration correcting section and makes the selection between said first image vibration correcting section and said second image vibration correcting section according to a result of the determination.

8. An imaging device, comprising:

an imaging section photoelectrically converting a subject image to generate image data;

a first image vibration correcting section performing an image vibration correction on said image data;

a second image vibration correcting section performing an image vibration correction different from a first image vibration correction on said image data; and

a selection control section selecting whether said first image vibration correcting section is used or said second image vibration correcting section is used for the image vibration correction of said image data based on an exposure period required for the photoelectric conversion of said image data,

wherein said first image vibration correcting section applies an inverse filter of a point spread function indicating an image vibration during said exposure period to said image data to correct said image vibration;

said second image vibration correcting section corrects the image vibration of said image data by allowing said imaging section to perform imaging operations of plural times obtained by dividing said exposure period and registering and composing obtained plural frames of divided image data; and

said selection control section determines said exposure period by a threshold value according to a transfer period required to read an image of said imaging section and a focal length when said image data is shot and makes the selection between said first image vibration correcting section and said second image vibration correcting section according to a result of the determination.

9. An imaging device, comprising:

an imaging section photoelectrically converting a subject image over a preset exposure period to generate image data;

an operational correction section applying an inverse filter of a point spread function indicating an image vibration during said exposure period to said image data to correct said image vibration;

a composite correction section correcting the image vibration of said image data by allowing said imaging section to perform imaging operations of plural times obtained by dividing said exposure period and registering and composing obtained plural frames of divided image data;

an exposure period determining section determining said exposure period by a predetermined threshold value; and

a selection control section performing the image vibration correction by said operational correction section if said exposure period is less than said threshold value and performing the image vibration correction by said composite correction section if said exposure period is equal to or more than said threshold value.

10. The imaging device according to claim 9, wherein

said exposure period determining section determines said threshold value based on a multiplication result obtained by multiplying a transfer period required to read an image of said imaging section by a division exposure count of said composite correction section to make the determination of said exposure period.

11. An imaging device, comprising:

an imaging section photoelectrically converting a subject image over a preset exposure period to generate image data;

an operational correction section applying an inverse filter of a point spread function indicating an image vibration during said exposure period to said image data to correct said image vibration;

a composite correction section correcting the image vibration of said image data by allowing said imaging section to perform imaging operations of plural times obtained by dividing said exposure period and registering and composing obtained plural frames of divided image data;

an exposure period determining section making a threshold determination as to whether or not a difference between a total shooting period required for said plural times of division exposures by said composite correction section and said exposure period is large; and

a selection control section performing the image vibration correction by said operational correction section if it is determined by said exposure period determining section that said difference is large and performing the image vibration correction by said composite correction section if it is determined that said difference is small.

12. An imaging device, comprising:

an imaging section photoelectrically converting a subject image over a preset exposure period to generate image data;

a first image vibration correcting section obtaining an image vibration of said image data during said exposure period and performing an image vibration correction on said image data;

a second image vibration correcting section performing an image vibration correction on said image data by allowing said imaging section to perform imaging operations of plural times during said exposure period and by registering and composing obtained plural image data; and

a selection control section determining said exposure period based on a threshold value according to a transfer period required to read an image of said imaging section and a focal length of when said image data is shot to select one of said first image vibration correcting section and said second image vibration correcting section to be used for the image vibration correction of said image data.

13. An imaging method, comprising:

photoelectrically converting at an imaging section a subject image over a preset exposure period to generate image data;

obtaining at a first image vibration correcting section an image vibration of said image data during said exposure period and performing an image vibration correction on said image data;

performing at a second image vibration correcting section an image vibration correction on said image data by allowing said imaging section to perform imaging operations of plural times during said exposure period and by registering and composing obtained plural image data; and

determining at a selection control section said exposure period based on a threshold value according to a transfer period required to read an image of said imaging section and count of said imaging operations by said second image vibration correction section to select one of said first image vibration correcting section and said second image vibration correcting section to be used for the image vibration correction of said image data.

14. The imaging method according to claim 13, wherein:

said first image vibration correcting section applies an inverse filter of a point spread function indicating an image vibration during said exposure period to said image data to correct said image vibration.

15. The imaging method according to claim 14, wherein

said second image vibration correction section registers and composes the plural frames of said divided image data by pattern matching using a block matching method.

16. The imaging method according to claim 13, further comprising:

detecting at a vibration detecting section a vibration which causes said image vibration, wherein

said first image vibration correcting section corrects said image vibration of said image data using the inverse filter of the point spread function according to the vibration detected by said vibration detecting section.

17. The imaging method according to claim 16, wherein

said vibration detecting section includes an angular speed sensor.

18. An imaging method, comprising:

photoelectrically converting at an imaging section a subject image over a preset exposure period to generate image data;

obtaining at a first image vibration correction section an image vibration of said image data during said exposure period and performing an image vibration correction on said image data;

performing at a second image vibration correcting section an image vibration correction on said image data by allowing said imaging section to perform imaging operations plural times during said exposure period and by registering and composing obtained plural image data; and

determining at a selection control section said exposure period based on a threshold value according to a transfer period required to read an image of said imaging section and a focal length of when said image data is shot to select one of said first image vibration correcting section and said second image vibration correcting section to be used for the image vibration correction of said image data.