Optical flow computation for moving sensors

• US 5,257,209 A
• Filed: 08/10/1992
• Issued: 10/26/1993
• Est. Priority Date: 06/26/1990
• Status: Expired due to Term

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Markandey, Vishal
• Primary Examiner(s): Black, Thomas G.
• Assistant Examiner(s): AUCHTERLONIE, THOMAS
• Application Number:
  US07/928,521
• Time in Patent Office: 442 Days
• Field of Search: 358/103, 358/105, 358/108, 358/109, 358/125, 358/126, 382/1, 382/44, 382/45, 382/46, 364/456, 364/514, 364/516, 364/517, 364/423
• US Class Current: 701/1
• CPC Class Codes: G01S 11/12 using electromagnetic waves other than radio waves
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments

Abstract

A method for using a computer-based imaging system, which may be in motion, to observe a moving object and determine its motion. The imaging system is used to obtain at least two images separated by a known time interval. The apparent motion of the observed object is expressed in terms of its true optical flow parameters with coefficients that represent the camera motion, projection geometry, and time interval. The result is a system of equations that may be solved for the true optical flow parameters.

Claims

1. A method for determining motion of an object viewed with a moving imaging system having a camera, comprising the steps of:

obtaining a first image of a first scene including the object;

obtaining a second image of a second scene including said object, said second image being separated by a predetermined time interval from said first image, the motion of said object corresponding to apparent optical flow parameters and true optical flow parameters, and the camera of said moving imaging system having camera motion values;

expressing the apparent optical flow parameters as equations having said true optical flow parameters with coefficients in terms of said camera motion values and of said predetermined time interval;

determining said camera motion values from rotational and translational velocities of said camera and from the geometry of a projection to said image;

solving said equations for said true optical flow parameters; and

using said true optical flow parameters to determine said motion of an object.

2. The method of claim 1, wherein said method further comprises the step of determining said apparent optical flow parameters of said object from an observed optical flow field.

3. The method of claim 2, wherein said step of determining said apparent optical flow parameters comprises the step of applying at least square fit to a known form of said parameters.

4. The method of claim 1, wherein said method further comprises the step of determining said camera motion values.

5. The method of claim 1, wherein said step of expressing the apparent optical flow parameters as equations having true optical flow parameters comprises the step of providing a system of eight optical flow parameters.

6. The method of claim 1, wherein said step of expressing the apparent optical flow parameters as equations having true optical flow parameters comprises the step of deriving incremental optical flow velocity components from partial differentiation techniques.

7. A system for use on a moving observation system having a camera, for determining motion of an observed object, comprising:

an imaging system for producing at least two digitized images of said observed object and a background of said observed object, said digitized images being separated in time by a predetermined time interval, the motion of said observed object corresponding to apparent optical flow parameters and true optical flow parameters, and the camera of said moving observation system having camera motion values; and

a computer in communication with said imaging system, for receiving said digitized images and for determining the said true optical flow parameters of said observed object, said computer including instructions to solve for said true optical flow parameters, wherein said true optical flow parameters are expressed in terms of said apparent optical flow parameters with coefficients representing said camera motion values and said time interval, said camera motion values being determined from rotational and translational velocities of said camera and from the geometry of a projection of said image.

8. The system of claim 7, wherein said computer is programmed to determine said apparent and true optical flow parameters from an optical flow field from said digitized images produced by said imaging system.

9. The system of claim 7, wherein said computer is programmed to receive input signals from camera motion measuring devices of said system and to use said input signals to determine said coefficients.