Method and apparatus for uniform lineal motion blur estimation using multiple exposures

• US 6,888,566 B2
• Filed: 12/14/2000
• Issued: 05/03/2005
• Est. Priority Date: 12/14/1999
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Larkin, Kieran Gerard, Gibson, Ian Richard, Yip, Dominic
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US09/735,809
• Publication Number:
  US 20010021224A1
• Time in Patent Office: 1,601 Days
• Field of Search: 348/207.99, 348/208.99, 348/208.1, 348/208.4, 348/208.5, 348/208.6, 348/208.12, 348/208.14, 348/222.1, 250/208.1, 382/254, 382/255, 375/240.12
• US Class Current: 348/208.4
• CPC Class Codes: G06T 7/262 using transform domain methods, e.g. Fourier domain methods
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

A method and apparatus (9) for estimating the blur parameters of blurred images (g₁, g₂) are disclosed. The apparatus (9) has one or more image sensors (10) for capturing the blurred images (g₁, g₂), a plurality of correlators (20, 30) for performing autocorrelation of the blurred image (g₁) and cross-correlation between the two images (g₁, g₂) respectively, and an error function calculator (40) for evaluating an error function over all possible displacements using the results from the correlators (20, 30). The apparatus (9) further includes an extreme locater (50) for finding the displacement with the minimum value for the error function.

Claims

1. A method of estimating motion of a moving object, said method comprising the steps of:

capturing at least first and second blurred images of the moving object, the blur in the first and second blurred images arising from at least motion blur of the object, wherein exposure durations of the first and second blurred images overlap at least partially;

generating an error function, the error function being a function of the first blurred image and the second blurred image;

minimising the error function; and

estimating the motion of the object from the minimised error function.

2. A method according to claim 1, wherein the images are captured with a time difference between a start time of capture of the first blurred image and a start time of capture of the second blurred image.

3. A method according to claim 1, wherein a start time of capture of the first blurred image and a start time of capture of the second blurred image are concurrent.

4. A method according to claim 2, wherein the exposure duration of the first blurred image is substantially equal to the exposure duration of the second blurred image.

5. A method according to claim 2 or 3, wherein the exposure duration of the second blurred image is a predetermined integer multiple of the exposure duration of the first blurred image.

6. A method according to claim 1, wherein an exposure pattern (profile) of the exposure duration of at least one of the first and second blurred images is non-uniform.

7. A method according to claim 6, wherein the exposure pattern (profile) comprises a triangular profile.

8. A method of estimating motion of a moving object, said method comprising the steps of:

capturing at least first and second blurred images of the moving object, the blur in the first and second blurred images arising from at least motion blur of the object, wherein exposure durations of the first and second blurred images overlap at least partially;

generating an error function, the error function comprising a cross-correlation term being a cross-correlation between the first blurred image and the second blurred image;

minimising the generated error function; and

estimating the object motion from the minimised error function.

9. A method according to claim 8, wherein the error function further comprises an auto-correlation term being an auto-correlation of the first blurred image.

10. An apparatus for estimating motion of a moving object, said apparatus comprising:

one or more capture devices for capturing at least first and second blurred images of the moving object, the blur in the first and second blurred images arising from at least motion blur of the object, wherein exposure durations of the first and second blurred images overlap at least partially;

means for generating an error function, the error function being a function of the first blurred image and the second blurred image;

means for minimising the error function; and

means for estimating the motion of the object from the minimised error function.

11. The apparatus according to claim 10, wherein the images are captured with a time difference between a start time of capture of the first blurred image and a start time of capture of the second blurred image.

12. The apparatus according to claim 10, wherein a start time of capture of the first blurred image and a start time of capture of the second blurred image are concurrent.

13. The apparatus according to claim 11, wherein the exposure duration of the first blurred image is substantially equal to the exposure duration of the second blurred image.

14. The apparatus according to claim 11 or 12, wherein the exposure duration of the second blurred image is a predetermined integer multiple of the exposure duration of the first blurred image.

15. The apparatus according to claim 10, wherein an exposure pattern (profile) of the exposure duration of at least one of the first and second blurred images is non-uniform.

16. The apparatus according to claim 15, wherein the exposure pattern (profile) comprises a triangular profile.

17. The apparatus according to claim 10, wherein said means for generating, said means for minimising, and said means for estimation, collectively comprise a computer system incorporating a sequence of program instructions for estimating the motion using the images output from the one or more capture devices.

18. An apparatus for estimating motion of a moving object, said apparatus comprising:

one or more capture devices for capturing at least first and second blurred images of the moving object, the blur in the first and second blurred images arising from at least motion blur of the object, wherein exposure durations of the first and second blurred images overlap at least partially;

means for generating an error function, the error function comprising a cross-correlation term being a cross-correlation between the first blurred image and the second blurred image;

means for minimising the generated error function; and

means for estimating the object motion from the minimised error function.

19. The apparatus according to claim 18, wherein the error function further comprises an auto-correlation term being an auto-correlation of the first blurred image.

20. A computer program product including a computer readable medium incorporating a computer program estimating motion of a moving object, said computer program product comprising:

code for capturing at least first and second blurred images of the moving object, the blur in the first and second blurred images arising from at least motion blur of the object, wherein exposure durations of the first and second blurred images overlap at least partially;

code for generating an error function, the error function being a function of the first blurred image and the second blurred image;

code for minimising the error function; and

code for estimating the motion of the object from the minimised error function.

21. A computer program product according to claim 20, wherein the images are captured with a time difference between a start time of capture of the first blurred image and a start time of capture of the second blurred image.

22. A computer program product according to claim 20, wherein a start time of capture of the first blurred image and a start time of capture of the second blurred image are concurrent.

23. A computer program product according to claim 21, wherein the exposure duration of the first blurred image is substantially equal to the exposure duration of the second blurred image.

24. A computer program product according to claim 21 or 22, wherein the exposure duration of the second blurred image is a predetermined integer multiple of the exposure duration of the first blurred image.

25. A computer program product according to claim 20, wherein an exposure pattern (profile) of the exposure duration of at least one of the first and second blurred images is non-uniform.