Method, system and apparatus for determining distance to an object in a scene

• US 10,026,183 B2
• Filed: 04/29/2016
• Issued: 07/17/2018
• Est. Priority Date: 05/01/2015
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Morgan-Mar, David Peter, Arnison, Matthew Raphael
• Primary Examiner(s): Dang, Duy M
• Application Number:
  US15/142,474
• Publication Number:
  US 20160321819A1
• Time in Patent Office: 809 Days
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20056 Discrete and fast Fourier transform, [DFT, FFT]
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/262 using transform domain methods, e.g. Fourier domain methods
• CPC Class Codes: G06T 7/571 from focus

Abstract

A method of determining at least two motion values of an object moving axially in a scene. A first and second image of the object in the scene is captured with an image capture device. The object is axially displaced in the scene between the captured images with respect to a sensor plane of the image capture device. A variation in blur between the first and second captured images is determined. A scale change of the object between the first and second captured images is determined. Using the determined scale change and variation in blur, at least two motion values of the object in the scene are determined. The motion values identify the depths of the object in the first and second captured images and axial motion of the object in the scene.

Claims

1. A method of determining at least two motion values of an object moving axially in a scene, said method comprising:

capturing a first and second image of the object in the scene with an image capture device, wherein said object is axially displaced in the scene between the captured images with respect to a sensor plane of the image capture device;

determining a variation in blur between said first and second captured images;

determining a scale change of the object between said first and second captured images;

determining, using the determined scale change and variation in blur, at least two motion values of the object in the scene, wherein said motion values identify the depths of the object in the first and second captured images and axial motion of the object in the scene.

2. The method according to claim 1, wherein at least a portion of the variation in blur is caused by a change in image capture device parameters between capturing the first and second image.

3. The method according to claim 1, wherein at least a portion of the variation in blur is caused by motion of the object between capturing the first and second image.

4. The method according to claim 1, further comprising determining scale change and spectral ratio from the images.

5. The method according to claim 1, further comprising determining scale change and spectral ratio using optical modelling.

6. The method according to claim 1, wherein the method is performed during design of an image capture device.

7. The method according to claim 1, wherein the method is performed after image capture.

8. The method according to claim 1, further comprising capturing a third image of the object in the scene.

9. A system for determining at least two motion values of an object moving axially in a scene, said system comprising:

a memory for storing data and a computer program;

a processor coupled to said memory for executing said computer program, said computer program comprising instructions for;

capturing a first and second image of the object in the scene with an image capture device, wherein said object is axially displaced in the scene between the captured images with respect to a sensor plane of the image capture device;

determining a variation in blur between said first and second captured images;

determining a scale change of the object between said first and second captured images;

determining, using the determined scale change and variation in blur, at least two motion values of the object in the scene, wherein said motion values identify the depths of the object in the first and second captured images and axial motion of the object in the scene.

10. An apparatus for determining at least two motion values of an object moving axially in a scene, said apparatus comprising:

means for capturing a first and second image of the object in the scene with an image capture device, wherein said object is axially displaced in the scene between the captured images with respect to a sensor plane of the image capture device;

means for determining a variation in blur between said first and second captured images;

means for determining a scale change of the object between said first and second captured images; and

means for determining, using the determined scale change and variation in blur, at least two motion values of the object in the scene, wherein said motion values identify the depths of the object in the first and second captured images and axial motion of the object in the scene.

11. A non-transitory computer readable medium having a computer program stored thereon for determining at least two motion values of an object moving axially in a scene, said program comprising:

code for capturing a first and second image of the object in the scene with an image capture device, wherein said object is axially displaced in the scene between the captured images with respect to a sensor plane of the image capture device;

code for determining a variation in blur between said first and second captured images;

code for determining a scale change of the object between said first and second captured images; and

code for determining, using the determined scale change and variation in blur, at least two motion values of the object in the scene, wherein said motion values identify the depths of the object in the first and second captured images and axial motion of the object in the scene.