Systems and method for de-blurring motion blurred images

• US 8,009,197 B2
• Filed: 12/22/2008
• Issued: 08/30/2011
• Est. Priority Date: 06/21/2002
• Status: Expired due to Fees

• Current Assignee: Trustees Of Columbia University In The City Of New York (Columbia University)
• Original Assignee: Trustees Of Columbia University In The City Of New York (Columbia University)
• Inventors: Ben-Ezra, Moshe, Nayar, Shree K.
• Primary Examiner(s): Ye; Lin
• Assistant Examiner(s): Cowan; Euel K
• Application Number:
  US12/341,195
• Publication Number:
  US 20090154823A1
• Time in Patent Office: 981 Days
• Field of Search: None
• US Class Current: 348/208.1
• CPC Class Codes: G06T 2207/20201 Motion blur correction
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/682 Vibration or motion blur correction
• CPC Class Codes: H04N 23/6845 by combination of a plurality of images sequentially taken
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

Systems and methods for providing a substantially de-blurred image of a scene from a motion blurred image of the scene are disclosed. An exemplary system includes a primary detector for sensing the motion blurred image and generating primary image information representing the blurred image, a secondary detector for sensing two or more secondary images of the scene and for generating secondary image information representing the two or more secondary images, and a processor for determining motion information from the secondary image information, estimating a point spread function for the motion blurred image from the motion information, and applying the estimated point spread function to the primary image information to generate information representing the substantially de-blurred image.

Claims

1. A method for estimating a point spread function for an image which was blurred due to motion of an image sensor which captured said image, comprising the steps of:

(a) receiving discrete motion information corresponding to said motion of said image sensor;

(b) determining, using a computer processor, a continuous two-dimensional path corresponding to said discrete motion points by interpolating missing data;

(c) partitioning said determined continuous two-dimensional path into a plurality of frames; and

(d) constructing, using a computer processor, equal-area regions within each of said partitioned frames to determine a mean energy value for each of said frames.

2. The method of claim 1, wherein step (b) comprises the step of determining said continuous two-dimensional path corresponding to said discrete motion points by Spline interpolation.

3. The method of claim 1, wherein step (c) comprises the step of partitioning said determined continuous two-dimensional path into said plurality of frames by Voronoi Tessellation.

4. The method of claim 1, further comprising the step of normalizing said determined mean energy values.

5. The method of claim 1, wherein said point spread function is represented by a convolution kernel.