METHOD OF DETERMINING PSF USING MULTIPLE INSTANCES OF A NOMINALLY SIMILAR SCENE
4 Assignments
0 Petitions
Accused Products
Abstract
A digital image acquisition system includes a portable apparatus for capturing digital images and a digital processing component for detecting, analyzing and informing the photographer regarding motion blur, and for reducing camera motion blur in an image captured by the apparatus. The digital processing component operates by comparing the image with at least one other image, for example a preview image, of nominally the same scene taken outside the exposure period of the main image. In one embodiment the digital processing component identifies at least one feature in a single preview image which is relatively less blurred than the corresponding feature in the main image, calculates a point spread function (PSF) in respect of such feature, and de-convolves the main image using the PSF. In another embodiment, the digital processing component calculates a trajectory of at least one feature in a plurality of preview images, extrapolates such feature on to the main image, calculates a PSF in respect of the feature, and de-convolves the main image using the PSF. In another embodiment the digital processing unit after determining the degree of blur notifies the photographer of the existing blur or automatically invokes consecutive captures.
133 Citations
27 Claims
-
1. (canceled)
-
2. A portable digital image camera-enabled device, comprising
an image capture component for capturing digital images; - and
a digital processing component including a processor for determining a camera motion blur function in a captured digital image based on a comparison of at least two sets of image data acquired at different times; a same sensor configured to acquire each of said at least two sets of image data, such that at least a same portion of said same sensor captures at least a portion of each of said at least two sets of image data, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of nominally the same scene as that of the captured digital image, and wherein the digital processing component is configured to compare a first set of said sets of image data to a second set of said sets of image data, the second set being taken outside the exposure period of the first set, and wherein the digital processing component is further arranged to determine to de-blur said captured digital image based on determining that the camera motion blur function indicates that sufficient blur exists; and wherein deblurring of the captured digital image by the digital processing component includes calculating the camera motion blur function including a point spread function (PSF) and de-convolving the captured digital image using the point spread function (PSF). - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10)
- and
-
11. A portable digital camera-enabled device, comprising
an image capture component for capturing digital images; -
a digital processing component including a processor for determining a camera motion blur function in a captured digital image based on a comparison of at least two sets of image data acquired at different times; and a same sensor configured to acquire each of said at least two sets of image data, such that at least a same portion of said same sensor captures at least a portion of each of said at least two sets of image data, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of nominally the same scene as that of the captured digital image, and wherein said digital processing component is configured to use a low resolution reference image among said sets of image data as the image data sets that are compared, the low resolution reference image being taken outside the exposure period of the captured digital image, and wherein said digital processing component is further configured to identify at least one characteristic of the reference image which is relatively less blurred than the corresponding characteristic of the captured image, and to calculate said blur function in respect of said characteristic; and wherein the digital processing component is further arranged to de-blur said captured digital image based on determining that the camera motion blur function indicates that sufficient blur exists; and wherein deblurring of the captured digital image by the digital processing component includes calculating the camera motion blur function including a point spread function (PSF) and de-convolving the captured digital image using the point spread function (PSF). - View Dependent Claims (12, 13, 14)
-
-
15. A portable digital camera-enabled device, comprising
an image capture component for capturing digital images; -
a digital processing component including a processor for determining a camera motion blur function in a captured digital image based on a comparison of multiple sets of image data acquired at different times, a same sensor configured to acquired each of said multiple sets of image data, such that at least a same portion of said same sensor captures at least a portion of each of said multiple sets of image data, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of nominally the same scene as that of the captured digital image, and wherein said digital processing component is configured to use multiple low resolution reference images among said sets of data taken at successive points in time, such that the multiple low resolution data sets are taken outside the exposure period of the captured digital image, and wherein said digital processing component is further configured to calculate a trajectory of at least one characteristic in the reference images, extrapolates such characteristic onto the captured image, and to calculate said blur function in respect of said characteristic; and wherein the digital processing component is further arranged to de-blur said captured digital image based upon determining that the camera motion blur function indicates that sufficient blur exists, wherein deblurring of the captured digital image by the digital processing component includes calculating the camera motion blur function including a point spread function (PSF) and de-convolving the captured digital image using the point spread function (PSF). - View Dependent Claims (16, 17, 18)
-
-
19. One or more processor-readable media having code embedded therein for programming a processor to perform a method of deblurring a captured digital image, the method comprising:
-
determining a camera motion blur function in a captured digital image based on a comparison of at least two sets of image data acquired at different times; acquiring each of said at least two sets of image data, such that at least a portion of each of said at least two sets of image data are taken within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of nominally the same scene as that of the captured digital image, comparing a first set of said sets of image data to a second set of said sets of image data, the second set being taken outside the exposure period of the first set, determining to de-blur said captured digital image based on determining that the camera motion blur function indicates that sufficient blur exists; and deblurring the captured digital image including calculating the camera motion blur function including a point spread function (PSF) and de-convolving the captured digital image using the point spread function (PSF). - View Dependent Claims (20, 21)
-
-
22. One or more processor-readable media having code embedded therein for programming a processor to perform a method of deblurring a captured digital image, the method comprising:
-
determining a camera motion blur function in a captured digital image based on a comparison of at least two sets of image data acquired at different times; acquiring each of said at least two sets of image data, such that at least a portion of each of said at least two sets of image data are taken within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of nominally the same scene as that of the captured digital image, selecting a low resolution reference image among said sets of image data for comparing the image data sets, the low resolution reference image being taken outside the exposure period of the captured digital image, and identifying at least one characteristic of the reference image which is relatively less blurred than the corresponding characteristic of the captured image, and calculating said blur function in respect of said characteristic; and determining to de-blur said captured digital image based on determining that the camera motion blur function indicates that sufficient blur exists; and deblurring the captured digital image including calculating the camera motion blur function including a point spread function (PSF) and de-convolving the captured digital image using the point spread function (PSF). - View Dependent Claims (23, 24)
-
-
25. One or more processor-readable media having code embedded therein for programming a processor to perform a method of deblurring a captured digital image, the method comprising:
-
determining a camera motion blur function in a captured digital image based on a comparison of at least two sets of image data acquired at different times; acquiring each of said at least two sets of image data, such that at least a portion of each of said at least two sets of image data are taken within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of nominally the same scene as that of the captured digital image, selecting a low resolution reference image among said sets of image data for comparing the image data sets, the low resolution reference image being taken outside the exposure period of the captured digital image, and calculating a trajectory of at least one characteristic in the reference images, including extrapolating such characteristic onto the captured image, and calculating said blur function in respect of said characteristic; and determining to de-blur said captured digital image based upon determining that the camera motion blur function indicates that sufficient blur exists; and deblurring the captured digital image including calculating the camera motion blur function including a point spread function (PSF) and de-convolving the captured digital image using the point spread function (PSF). - View Dependent Claims (26, 27)
-
Specification