Constrained image deblurring for imaging devices with motion sensing
First Claim
1. A method for deblurring a captured image taken by an imaging device comprising an imaging sensor array for capturing the image during an exposure time and at least one motion sensor, the method comprising the steps of:
- [a] obtaining the captured image;
[b] obtaining a set of motion parameters from the motion sensor related to the motion of the imaging sensor array during the exposure time and wherein at least one of the motion parameters within the set of motion parameters possesses associated interval values such that a family of motion paths may be defined by the set of motion parameters and associated interval values;
[c] obtaining an estimated point spread function that comprises the convolution of an optical point spread function of the imaging device and a motion path selected from the family of motion paths defined by the set of motion parameters and associated interval values;
[d] selecting an estimated deblurred image;
[e] computing a new estimated point spread function based upon the captured image, the estimated deblurred image, and the estimated point spread function;
[f] performing an optimization over the set of motion parameters and associated interval values to find a set of optimized parameter values within the set of motion parameters and associated interval values that yield an optimized point spread function that best fits the new estimated point spread function; and
[g] using the optimized point spread function to compute a new estimated deblurred image.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are disclosed for deblurring a captured image using parametric deconvolution, instead of a blind, non-parametric deconvolution, by incorporating physical constraints derived from sensor inputs, such as a motion sensor, into the deconvolution process to constrain modifications to the point spread function. In an embodiment, a captured image is deblurred using a point spread function obtained from the cross-validation of information across a plurality of image blocks taken from the capture image, which image blocks are deconvolved using parametric deconvolution to constrain modifications to the point spread function.
-
Citations
20 Claims
-
1. A method for deblurring a captured image taken by an imaging device comprising an imaging sensor array for capturing the image during an exposure time and at least one motion sensor, the method comprising the steps of:
-
[a] obtaining the captured image;
[b] obtaining a set of motion parameters from the motion sensor related to the motion of the imaging sensor array during the exposure time and wherein at least one of the motion parameters within the set of motion parameters possesses associated interval values such that a family of motion paths may be defined by the set of motion parameters and associated interval values;
[c] obtaining an estimated point spread function that comprises the convolution of an optical point spread function of the imaging device and a motion path selected from the family of motion paths defined by the set of motion parameters and associated interval values;
[d] selecting an estimated deblurred image;
[e] computing a new estimated point spread function based upon the captured image, the estimated deblurred image, and the estimated point spread function;
[f] performing an optimization over the set of motion parameters and associated interval values to find a set of optimized parameter values within the set of motion parameters and associated interval values that yield an optimized point spread function that best fits the new estimated point spread function; and
[g] using the optimized point spread function to compute a new estimated deblurred image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An imaging device comprising:
-
an imaging sensor array for capturing an image during an exposure time;
a motion sensor that measures a set of motion parameters related to the imaging sensor array'"'"'s motion during the exposure time;
a processor communicatively coupled to the imaging sensor array and adapted to perform the steps comprising;
[a] obtaining a captured image;
[b] obtaining a set of motion parameters from the motion sensor related to the motion of the imaging sensor array during the exposure time and wherein at least one of the motion parameters within the set of motion parameters possesses associated interval values such that a family of motion paths may be defined by the set of motion parameters and associated interval values;
[c] obtaining an estimated point spread function that comprises the convolution of an optical point spread function of the imaging device and a motion path selected from the family of motion paths defined by the set of motion parameters and associated interval values;
[d] obtaining an estimated deblurred image;
[e] computing a new estimated point spread function based upon the captured image, the estimated deblurred image, and the estimated point spread function;
[f] performing an optimization over the set of motion parameters and associated interval values to find a set of optimized parameter values within the set of motion parameters and associated interval values that yield an optimized point spread function that best fits the new estimated point spread function; and
[g] using the optimized point spread function to compute a new estimated deblurred image. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
-
17. A method for deblurring an image comprising:
-
[a] selecting a plurality of image blocks from a captured image, wherein the captured image was obtained from an imaging device with at least one motion sensor;
[b] estimating a point spread function within each of the plurality of image blocks, wherein each point spread function is consistent with a set of motion parameter values taken by the motion sensor during the capturing of the captured image;
[c] employing a deconvolution algorithm to deblur each of the plurality of image blocks wherein a modification to any of the point spread functions of the plurality of image blocks is consistent with the set of motion parameter values taken by the motion sensor during the capturing of the captured image;
[d] selecting a best point spread function from the point spread functions of the plurality of image blocks; and
[e] deblurring the captured image using the best point spread function. - View Dependent Claims (18, 19, 20)
-
Specification