Method and apparatus for initiating subsequent exposures based on determination of motion blurring artifacts

• US 7,676,108 B2
• Filed: 08/27/2008
• Issued: 03/09/2010
• Est. Priority Date: 11/10/2004
• Status: Expired due to Fees

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Vision Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Corcoran, Peter
• Primary Examiner(s): Mehta; Bhavesh M
• Assistant Examiner(s): BLOOM, NATHAN J
• Application Number:
  US12/199,680
• Publication Number:
  US 20090046161A1
• Time in Patent Office: 559 Days
• Field of Search: 382/107, 348/208.99, 348/208.1, 348/208.4, 348/208.14, 348/208.16
• US Class Current: 382/255
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/682 Vibration or motion blur correction

Abstract

A digital image acquisition system includes a portable apparatus for capturing digital images and a digital processing component for detecting, analyzing, invoking subsequent image captures and informing the photographer regarding motion blur, and for reducing camera motion blur in an image captured by the apparatus. The digital processing component operates by comparing the image with at least one other image, for example a preview image, of nominally the same scene taken outside the exposure period of the main image. In one embodiment the digital processing component identifies at least one feature in a single preview image which is relatively less blurred than the corresponding feature in the main image, calculates a point spread function (PSF) in respect of such feature, and initiates a subsequent capture if determined that the motion blur exceeds a certain threshold. In another embodiment the digital processing determines the degree of blur by analyzing the motion blur in the captured image itself, and initiates a subsequent capture if determined that the motion blur exceeds a certain threshold. Such real time analysis may use the auto focusing mechanism to qualitatively determine the PSF.

Claims

1. A digital image acquisition system, comprising an apparatus for capturing digital images and a digital processing component for initiating a new image capture upon determining that a threshold camera motion blur has occurred in a captured digital image based on a real time analysis of the captured digital image and at least one further image each acquired with a same sensor, such that at least a same portion of said same sensor captures at least a portion of each of said captured digital image and said at least one further image within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of nominally the same scene as that of the captured digital image, and wherein said digital processing component is arranged first to align at least portions of the image data of said captured digital image and said one or more relatively low resolution reference images, and then to compare the image data of said captured digital image and said one or more relatively low resolution reference images for determining a camera motion blur function, and to initiate said new image capture upon determining that said threshold camera motion blur exists.

2. A system according to claim 1, wherein the determining that a threshold camera motion blur has occurred is based on qualitatively determining a motion blur.

3. A system according to claim 2, wherein the camera motion blur is mathematically defined as a point spread function (PSF).

4. A system according to claim 2, wherein said digital processing component further de-blurs the captured image using said determined camera motion blur function.

5. A system according to claim 2, wherein said qualitatively determining a motion blur is performed using an auto-focus mechanism of the camera as the digital processing component.

6. A system according to claim 1, wherein said digital processing component is configured to inform the photographer if it determines that the captured image is blurred.

7. A system of according to claim 6, wherein the digital image capturing apparatus is configured to capture another image if the digital processing component determines that the captured image is blurred.

8. A system of according to claim 1, wherein the digital image capturing apparatus is configured to capture another image if the digital processing component determines that the captured image is blurred.

9. A system according to claim 1, wherein said digital image acquisition system comprises a portable digital camera comprising a single sensor for capturing said captured digital image and said at least one further image.

10. A system according to claim 1, wherein said digital processing component is located in said portable digital camera.

11. A system according to claim 1, wherein said at least one further image comprises a relatively low resolution reference image.

12. A digital image acquisition system, comprising an apparatus for capturing digital images and a digital processing component for real time analysis of motion blurred artifacts using an auto-focusing mechanism of said digital image acquisition system, wherein said apparatus and digital processing component further for initiating a new image capture upon determining that a threshold camera motion blur has occurred in a captured digital image based on the real time analysis of the captured digital image and at least one further image each acquired with a same sensor, such that at least a same portion of said same sensor captures at least a portion of each of said captured digital image and said at least one further image, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of nominally the same scene as that of the captured digital image, and wherein said digital processing component is arranged first to align at least portions of the image data of said captured digital image and said at least one further image, and then to compare the image data of said captured digital image and said at least one further image for determining a camera motion blur function, and to initiate said new image capture upon determining that said threshold camera motion blur exists.

13. A system according to claim 12, wherein said at least one further image comprises a relatively low resolution reference image.

14. A system according to claim 12, wherein said apparatus and digital processing component further for notifying the photographer upon determining that a threshold camera motion blur has occurred in a captured digital image based on the real time analysis of the captured image and the at least one further image.

15. A system according to claim 14, wherein said at least one further image comprises a relatively low resolution reference image.