METHOD AND DEVICE FOR REMOVING MOTION BLUR EFFECTS

• US 20100119171A1
• Filed: 07/03/2006
• Published: 05/13/2010
• Est. Priority Date: 07/12/2005
• Status: Active Grant

• Current Assignee: Goodix Technology Co., Ltd. (Shenzhen Goodix Technology Co., Ltd.)
• Original Assignee: NXP B.V. (NXP Semiconductors NV)
• Inventors: Gobert, Jean
• Granted Patent: US 8,559,751 B2
• Time in Patent Office: Days
• US Class Current: 382/255
• CPC Class Codes: G06T 2207/20032 Median filtering
• CPC Class Codes: G06T 2207/20201 Motion blur correction
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51

Abstract

The present invention provides an improved method and device for digital motion blur removal by using motion information extracted from a sequence of images captured immediately before the image to be corrected was captured. In particular, the invention includes estimating (56) motion information of the previous sequence of images and analyzing them based on motion estimation techniques and then extrapolating (58) the motion of the image to be corrected based on the motion estimation in order to remove (62) the motion blur effects in the desired captured image. The various types of devices which may implement the method of the present invention will thereby display (64) blur free digital images.

Claims

1. A method of removing motion blur effects of a digital image (n) that is subject to motion correction, wherein the method comprises:

extracting motion information from a sequence of images (n−

1) captured immediately before a capture of the digital image (n);

extracting timing information of a start time and an end time of the capture of the digital image (n);

generating an estimated motion information for the sequence of images (n−

1) by performing an image to image analysis based on a motion estimation technique using the extracted motion information and the timing information;

extrapolating motion information of the digital image in a time interval between the start time and the end time of the capture of the digital image using the estimated motion information image; and

removing motion blur effects of the digital image by compensating motion of the digital image using the extrapolated motion information.

2. The method according to claim 1, wherein generating estimated motion information comprises providing an estimated motion vector for every pixel or a block of pixels of the image.

3. The method according to claim 2, wherein generating estimated motion information comprises providing an estimated motion vector using a global motion estimation model.

4. The method according to claim 3, wherein using the global motion estimation model from one image to the next image in the sequence of images comprises subdividing the image into blocks, using a block matching algorithm on each block, and producing as many motion block vectors as there are blocks.

5. The method according to claim 4, further comprising using a median filter on block motion vectors and deriving a global motion vector from the median filter.

6. The method according to claim 2, wherein generating estimated motion information comprises providing an estimated motion vector using a block based motion model.

7. The method according to claim 2, wherein generating estimated motion information comprises providing an estimated motion vector using a pixel flow model.

8. The method according to any one of the preceding claims, wherein generating estimated motion information comprises generating motion vectors corresponding to horizontal (dx) and vertical (dy) translations of motion.

9. The method according to any one of the preceding claims, wherein generating estimated motion information comprises generating motion vectors corresponding to rotational translation of motion.

10. The method according to any one of the claims 2 through 9, wherein generating estimated motion information comprises computing, for each motion vector, an approximate function of time, and minimizing an error criteria at estimated offsets of the sequence of images (n−

1).

15. A computer-readable medium associated with the device of any one of claim 10 through 13 having a sequence of instructions stored thereon which, when executed by a microprocessor of the device, causes the processor to:

extract motion information from a sequence of images (n−

1) captured immediately before a capture of the digital image (n);

extract timing information of a start time and an end time of image capture;

generate an estimated motion information of the sequence of images (n−

1) by performing an image to image analysis based on a motion estimation technique using the extracted motion information and the timing information;

extrapolate motion information of the digital image in a time interval between the start time and the end time of the capture of the digital image using the estimated motion information; and

remove motion blur effects of the digital image by compensating motion of the digital image using the extrapolated motion information.

11. A device configured to remove motion blur effects of a digital image (n) subject to motion correction, wherein the device comprises:

an image sensor adapted to extract motion information from a sequence of images (n−

1) captured immediately before a capture of the digital image (n);

a capture module adapted to extract timing information of a start time and an end time of image capture;

a motion estimator adapted to generate an estimated motion information of the sequence of images (n−

1) by performing an image to image analysis based on a motion estimation technique using the extracted motion information and the timing information;

a motion extrapolator adapted to estimate motion information of the digital image in a time interval between the start time and the end time of the image using the estimated motion information; and

a motion deblur module configured to remove motion blur effects of the digital image by compensating motion of the digital image using the extrapolated motion information.

12. The device according to claim 11, wherein the motion estimator provides an estimated motion vector for every pixel of the image using a global motion estimation model.

13. The device according to claim 11, wherein the motion estimator provides an estimated motion vector using a block based motion model.

14. The device according to claim 11, wherein the motion estimator provides an estimated motion vector using a pixel flow model.