Method and apparatus for robust estimation of non-uniform motion blur

• US 9,189,835 B2
• Filed: 11/06/2012
• Issued: 11/17/2015
• Est. Priority Date: 03/06/2012
• Status: Active Grant

• Current Assignee: Postech Academy-Industry Foundation, Samsung Electronics Co. Ltd.
• Original Assignee: Postech Academy-Industry Foundation Pohang University Of Science & Technology, Samsung Electronics Co. Ltd.
• Inventors: Cho, Jung Uk, Lee, Seung Yong, Moon, Young Su, Lee, Shi Hwa, Lee, Chi Young, Cho, Sung Hyun, Cho, Ho Jin
• Primary Examiner(s): Hung, Yubin
• Application Number:
  US13/669,962
• Publication Number:
  US 20130236114A1
• Time in Patent Office: 1,106 Days
• Field of Search: 382/254, 382/255, 348/497, 396/55
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/20201 Motion blur correction
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening

Abstract

A method and apparatus for robust estimation of a non-uniform motion blur that may reduce an amount of the non-uniform motion blur information, that is, a number of homographies by estimating non-uniform motion blur information about a blur in a predetermined area, thereby reducing an amount of time needed to remove the non-uniform motion blur, and may improve accuracy and stability of the non-uniform motion blur information by estimating homographies for an input image while increasing a number of the homographies, iteratively.

Claims

1. A method of estimating a non-uniform motion blur, the method comprising:

receiving an input image comprising a non-uniform motion blur;

estimating homographies for the received input image, the estimated homographies comprising a homograph set;

iteratively increasing a number of estimated homographies in the homography set; and

obtaining a latent image based on a change of an error value of the homography set.

2. The method of claim 1, wherein the iteratively increasing of the number of the estimated homographies further comprises adding a homography based on the estimated homographies, and estimating the added homography, iteratively.

3. The method of claim 1, wherein the iteratively increasing of the number of the estimated homographies comprises progressively increasing the number of the estimated homographies when a reduction of the error value with respect to the homography set including the estimated homographies is greater than or equal to a predetermined reference value.

4. The method of claim 1, wherein the obtaining of the latent image comprises:

performing the estimating of the non-uniform motion blur information corresponding to the homography set and the obtaining of the latent image based on the non-uniform motion blur information, iteratively.

5. The method of claim 4, wherein the obtaining of the latent image further comprises terminating an iterative performance of the estimating of the non-uniform motion blur information and the obtaining of the latent image, based on the change of the error value with respect to the homography set.

6. The method of claim 4, wherein iterative performance of the estimating of the non-uniform motion blur information and the obtaining of the latent image is completed when a reduction of the error value with respect to the homography set is less than a predetermined reference value.

7. The method of claim 4, wherein the obtaining of the latent image further comprises:

restoring a final image from the received input image, based on obtained final non-uniform motion blur information when the iterative performance has completed.

8. The method of claim 1, wherein the received input image corresponds to at least one of a single frame comprising the non-uniform motion blur, a multi-frame comprising the non-uniform motion blur, and a multi-frame comprising a single blurred image comprising the non-uniform motion blur and a single noise image without the blur.

9. The method of claim 1, further comprising determining whether the obtained latent image satisfies a predetermined quality, and re-estimating the non-uniform motion blur information, based on the determining.

10. The method of claim 1, wherein the estimating of the homographies comprises estimating at least two homographies for the received input image, and

wherein the iteratively increasing of the number of the estimated homographies comprises adding a homography between the at least two homographies.

11. The method of claim 10, wherein the iteratively increasing of the number of the estimated homographies further comprising:

normalizing weights for the estimated homographies, using the estimated at least two homographies and the homography between the at least two homographies.

13. A non-transitory computer-readable medium comprising a program for instructing a computer to perform the method of claim 1.

12. A method for robust estimation of a non-uniform motion blur, the method comprising:

calculating, by a processor, homographies of an input image, the calculated homographies comprising a homography set;

iteratively increasing a number of calculated homographies in the homography set; and

obtaining a final image of the input image using the calculated homographies, based on a change of an error value of the homography set.

14. An apparatus for estimating a non-uniform motion blur, the apparatus comprising:

a processor to control one or more processor-executable units;

a receiving unit to receive an input image comprising a non-uniform motion blur;

an estimating unit to

estimate homographies for the received input image, the estimated homographies comprising a homography set, and

iteratively increasing a number of estimated homographies in the homography set; and

an obtaining unit to obtain a latent image based on a change of an error value of the homography set.

15. The apparatus of claim 14, wherein the estimating unit is configured to add a homography based on the estimated homographies and estimate the added homography, iteratively.

16. The apparatus of claim 14, wherein the obtaining unit is configured to perform estimation of the non-uniform motion blur information corresponding to the homography set and obtaining of the latent image based on the non-uniform motion blur information, iteratively.

17. The apparatus of claim 16, wherein the obtaining unit is further configured to complete an iterative performance of the estimation of the non-uniform motion blur information and the obtaining of the latent image, based on the change of the error value with respect to the homography set.

18. The apparatus of claim 14, wherein the obtaining unit is configured to restore a final image from the received input image, based on obtained final non-uniform motion blur information when an iterative performance is completed.

19. The apparatus of claim 14, wherein the input image corresponds to at least one of a single frame comprising the non-uniform motion blur, a multi-frame comprising the non-uniform motion blur, and a multi-frame comprising a single blurred image comprising the non-uniform motion blur and a single noise image without the blur.

20. The apparatus of claim 14, wherein the estimating unit is configured to estimate at least two homographies for the received input image, and add a homography between the at least two homographies.

21. The apparatus of claim 20, further comprising:

a weight normalizing unit to normalize weights for the estimated homographies, using the estimated at least two homographies and the homography between the at least two homographies.