System and Method for Tracking Objects Using Lidar and Video Measurements
First Claim
1. A system for tracking a target from lidar measurements and video images, the system comprising:
- a lidar subsystem configured to direct at least three beams toward the target and to provide a range measurement and a Doppler velocity measurement for each of a plurality of points on the target for each of the at least three beams;
a video subsystem configured to capture a plurality of two-dimensional images of the target; and
a processor configured to;
receive, from the lidar subsystem, the range measurement and the Doppler velocity measurement for each of the plurality of points on the target,receive, from the video subsystem, the plurality of images of the target,estimate a translational velocity component vztrans and angular velocity components ω
x and ω
y for each of the plurality of points on the target from the range measurements and the Doppler velocity measurements from the lidar subsystem,estimate translational velocity components vxtrans and vytrans and the angular velocity component ω
z for each of the plurality of points on the target from two-dimensional position and velocity measurements of at least one feature of the target obtained from the plurality of images of the target and from the estimated velocity component vztrans and the estimated angular velocity components ω
x and ω
y,generate a three-dimensional image of the target using the estimated translational velocity components vxtrans, vytrans, and vztrans and the estimated angular velocity components ω
x, ω
y and ω
z,locate a position on the target using the three-dimensional image of the target, andmonitor the position on the target with at least one of the at least three beams at the position on the target.
8 Assignments
0 Petitions
Accused Products
Abstract
A system uses range and Doppler velocity measurements from a lidar system and images from a video system to estimate a six degree-of-freedom trajectory of a target. The system estimates this trajectory in two stages: a first stage in which the range and Doppler measurements from the lidar system along with various feature measurements obtained from the images from the video system are used to estimate first stage motion aspects of the target (i.e., the trajectory of the target); and a second stage in which the images from the video system and the first stage motion aspects of the target are used to estimate second stage motion aspects of the target. Once the second stage motion aspects of the target are estimated, a three-dimensional image of the target may be generated.
31 Citations
16 Claims
-
1. A system for tracking a target from lidar measurements and video images, the system comprising:
-
a lidar subsystem configured to direct at least three beams toward the target and to provide a range measurement and a Doppler velocity measurement for each of a plurality of points on the target for each of the at least three beams; a video subsystem configured to capture a plurality of two-dimensional images of the target; and a processor configured to; receive, from the lidar subsystem, the range measurement and the Doppler velocity measurement for each of the plurality of points on the target, receive, from the video subsystem, the plurality of images of the target, estimate a translational velocity component vztrans and angular velocity components ω
x and ω
y for each of the plurality of points on the target from the range measurements and the Doppler velocity measurements from the lidar subsystem,estimate translational velocity components vxtrans and vytrans and the angular velocity component ω
z for each of the plurality of points on the target from two-dimensional position and velocity measurements of at least one feature of the target obtained from the plurality of images of the target and from the estimated velocity component vztrans and the estimated angular velocity components ω
x and ω
y,generate a three-dimensional image of the target using the estimated translational velocity components vxtrans, vytrans, and vztrans and the estimated angular velocity components ω
x, ω
y and ω
z,locate a position on the target using the three-dimensional image of the target, and monitor the position on the target with at least one of the at least three beams at the position on the target. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method for tracking a target from lidar measurements from a lidar subsystem and video images from a video subsystem, the method comprising:
-
receiving, from the lidar subsystem, a range measurement and a Doppler velocity measurement for each of a plurality of points on the target for each of at least two beams of the lidar subsystem; receiving, from the video subsystem, a plurality of two-dimensional images of the target; estimating, by a processor, a translational velocity component vztrans and angular velocity components ω
x and ω
y for each of the plurality of points on the target from the range measurements and the Doppler velocity measurements from the lidar subsystem;estimating translational velocity components vxtrans and vytrans and the angular velocity component ω
z for each of the plurality of points on the target from two-dimensional position and velocity measurements of at least one feature of the target obtained from the plurality of images of the target and from the estimated velocity component vztrans and the estimated angular velocity components ω
x and ω
y;generating a three-dimensional image of the target using the estimated translational velocity components vxtrans, vytrans, and vztrans and the estimated angular velocity components ω
x, ω
y and ω
z;locating a position on the target using the three-dimensional image of the target; and monitoring the position on the target by maintaining at least one of the at least three beams at the position on the target. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
Specification