Estimating objects proper motion using optical flow, kinematics and depth information
First Claim
1. A method for detecting proper motion of real-world objects in an image from an image capturing device, the method comprising the steps of:
- acquiring, by an image capturing device, a first image of an object at a first point in time and a second image at a second point in time;
acquiring depth information for each pixel of the first image and the second image,computing a third image, based on the first image or the second image as well as estimated ego-motion of the image capturing device itself between the first point and the second point in time, wherein the ego-motion is estimated based on forward kinematics of the image capturing device and depth information for each pixel of the first image;
computing an ego motion-compensated optical flow by comparing the second image and the third image; and
determining proper motion of the object by evaluating the optical flow based on a likelihood that the optical flow and the estimated ego-motion are consistent with the same physical velocity.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention relates to a method for detecting the proper motion of an real-world object, comprising the steps of acquiring, by an image capturing device (ICD), a first image (I1) of the object at a first point in time (t1) and a second image (I2) at a second point in time (t2); obtaining a third (hypothetical) image (I3), based on an estimated effect of the motion of the image capturing device (ICD) itself (EMF) between the first and the second point in time (t1, t2), wherein the effect of the motion of the image capturing device (ICD) itself is estimated based on the forward kinematics of the image capturing device; determining an optical flow (OF) between the second image (I2) and the third image (I3); and evaluating the optical flow (OF) by incorporating uncertainties of the optical flow (OF) and the ego-motion-flow (EMF) in order to determine the proper motion of the object.
-
Citations
8 Claims
-
1. A method for detecting proper motion of real-world objects in an image from an image capturing device, the method comprising the steps of:
-
acquiring, by an image capturing device, a first image of an object at a first point in time and a second image at a second point in time; acquiring depth information for each pixel of the first image and the second image, computing a third image, based on the first image or the second image as well as estimated ego-motion of the image capturing device itself between the first point and the second point in time, wherein the ego-motion is estimated based on forward kinematics of the image capturing device and depth information for each pixel of the first image; computing an ego motion-compensated optical flow by comparing the second image and the third image; and determining proper motion of the object by evaluating the optical flow based on a likelihood that the optical flow and the estimated ego-motion are consistent with the same physical velocity. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for detecting proper motion of real-world objects in an image from an image capturing device, the system comprising:
-
means for acquiring, by an image capturing device, a first image of an object at a first point in time and a second image at a second point in time; means for acquiring depth information for each pixel of the first image and the second image, means for computing a third image, based on an estimated effect of motion of the image capturing device itself between the first point and the second point in time, wherein the effect of the motion of the image capturing device itself is estimated based on forward kinematics of the image capturing device and depth information for each pixel of the first image; means for determining an ego motion-compensated optical flow by comparing the second image and the third image; and means for determining proper motion of the object by evaluating the optical flow based on a likelihood that the optical flow and the estimated ego-motion are consistent with the same physical velocity by incorporating uncertainties of the optical flow and ego-motion-flow in order to determine the proper motion of the object.
-
Specification