Determining angular rate for line-of-sight to a moving object, with a body-fixed imaging sensor

• US 8,946,606 B1
• Filed: 02/26/2010
• Issued: 02/03/2015
• Est. Priority Date: 03/26/2008
• Status: Active Grant

• Current Assignee: Arete Associates
• Original Assignee: Arete Associates
• Inventors: Frazier, Brian Edward, Dennison, John Charles, Davis, Clayton Houston
• Primary Examiner(s): Gregory, Bernarr
• Application Number:
  US12/660,490
• Time in Patent Office: 1,803 Days
• Field of Search: 244 31- 319, 244 32- 323, 382/100, 382/103, 382/141, 382/181, 382/209, 382/216, 342 52- 55, 342 61- 67, 342 73- 81, 342/175, 342/195
• US Class Current: 244/3.16
• CPC Class Codes: F41G 7/2246 Active homing systems, i.e. comprising both a transmitter and a receiver
• CPC Class Codes: F41G 7/2253 Passive homing systems, i.e. comprising a receiver and do not requiring an active illumination of the target
• CPC Class Codes: F41G 7/2286 using radio waves
• CPC Class Codes: F41G 7/2293 using electromagnetic waves other than radio waves
• CPC Class Codes: F42B 15/01 Arrangements thereon for guidance or control steering arrangements F42B10/60; aircraft flight control B64C; guidance systems other than those installed aboard F41G7/00, F41G9/00; locating by use of radio or other waves G01S; flight control in general G05D1/00; computer aspects G06]
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01S 11/12 using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 13/89 for mapping or imaging
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G01S 3/784 using a mosaic of detectors
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30212 Military
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/269 using gradient-based methods
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

Apparatus/method estimate LOS rotation, to track, approach, pursue, intercept or avoid objects. Vehicle-fixed imagers approach/recede-from objects, recording image series with background. Computations, from images exclusively, estimate rotation vs. the vehicle, applying the estimate. Preferably, recording/estimating provide proportional navigation; scan mirrors extend strapdown-sensor FOR; applying includes measuring “range rate over range”, exclusively from interimage optical flow, using results to optimize proportional-navigation loop gain; estimating includes evaluating interframe optical flow, preregistering roughly as first approximation, selecting sequence anchor points, and applying a second, finer technique developing output registration that'"'"'s a coordinate translation, aligning inertial surroundings. The approximation operates optical flow with efficient embedded registration/mapping, applying a homography matrix to nearby imagery. Alternatively, inexpensive low-quality inertial sensors establish preregistration, deriving a homography matrix. When contrast in the object direction is inadequate, dual sensors yield accurate virtual imaging with an object centroid superposed into background.

Claims

1. A method for estimating line-of-sight rotation rate for use in tracking, approaching, pursuing, intercepting, or avoiding an object;

said method comprising the steps of;

with an imaging sensor fixed to a vehicle that is approaching or receding from the object, recording a series of images of the object together with a background;

based on computations made from the images exclusively, with no direct information about inertial angular body rate or gimbal angle, estimating line-of-sight rotation rate of the object relative to the vehicle; and

applying the estimated line-of-sight rotation rate to track, approach, pursue, intercept or avoid the object.

2. The method of claim 1, wherein:

the image-recording and rate-estimating steps provide proportional navigation.

3. The method of claim 1, wherein the recording step comprises:

operating a scan mirror to extend the total field of regard (FOR) of the sensor; and

notwithstanding the mirror-operating step, still determining the line-of-sight from the images exclusively.

4. The method of claim 1, wherein the recording step comprises:

operating the sensor as a strapdown sensor on the vehicle.

5. The method of claim 1, wherein the applying step further comprises:

also incorporating measurement of “

range rate over range”

determined exclusively from optical flow as between successive images; and

applying the measured “

range rate over range”

in combination with the line-of-sight rotation rate, to optimize proportional-navigation guidance loop gain.

6. The method of claim 1, wherein the estimating step further comprises the substeps of:

evaluating the optical flow between successive frames;

establishing a rough image registration by applying a first, relatively more-approximate image-registration technique;

next selecting anchor points for image sequences; and

then applying a second, relatively finer image-registration technique to establish an output image-registration solution;

wherein the registration solution is a coordinate translation needed to align inertial surroundings of the object.

7. The method of claim 6, wherein the first image-registration technique comprises:

operating an optical-flow procedure with efficient embedded registration and mapping; and

applying a resulting homography matrix to imagery around the object.

8. A method for estimating line-of-sight rotation rate for use in tracking, approaching, pursuing, intercepting, or avoiding an object;

said method comprising the steps of;

operating at least one inexpensive and low-quality inertial rate sensor, to establish a first relatively rough but efficient embedded image registration and mapping;

based on the first registration, generating a homography matrix;

with an imaging sensor fixed to a vehicle that is approaching or receding from the object, recording a series of images of the object together with a background;

based on computations made from the images exclusively, with no direct information about gimbal angle, and with no direct information about inertial angular body rate except as stated in the sensor-operating step above, estimating line-of-sight rotation rate of the object relative to the vehicle; and

applying the estimated line-of-sight rotation rate to track, approach, pursue, intercept or avoid the object;

wherein the estimating step further comprises the substeps of;

evaluating the optical flow between successive frames,

next selecting anchor points for image sequences; and

then applying a second, relatively finer image-registration technique to establish an output image-registration solution;

wherein the registration solution is a coordinate translation for aligning the inertial surroundings of the object.

9. Apparatus for estimating line-of-sight rotation rate for use in tracking, approaching, pursuing, intercepting or avoiding an object;

said apparatus comprising;

at least one imaging sensor fixed to a vehicle that is approaching or receding from the object, wherein the vehicle is not a part of the claimed apparatus;

means for controlling the at least one sensor to record a series of images of such object together with a background;

means for making computations derived exclusively from the images, with no direct information about inertial angular body rate or gimbal angle, and for thereby estimating line-of-sight rotation rate of such object relative to such vehicle; and

means for applying the estimated line-of-sight rotation rate to track, approach, pursue, intercept or avoid such object.

10. The apparatus of claim 9, wherein the vehicle is approaching the object, but contrast in the direction of the object is not adequate for highly accurate measurement;

and wherein;

a first sensor, looking forward, receives said series of images of such object and determines what pixel best represents a centroid of such object, thereby identifying an angle of deviation from a centerline of the first sensor; and

a second sensor, looking aft, receives said series of images of a background scene;

said angle from the first sensor centerline identifies a pixel in the second sensor as such object location;

the first and second sensor are precisely aligned; and

the apparatus comprises means for applying line-of-sight algorithms to the second sensor imagery, substantially as if such object were actually present at the identified pixel in the second, aft sensor.

11. The apparatus of claim 10, wherein:

the sensor-controlling and computation-making means perform proportional navigation.

12. Apparatus for estimating line-of-sight rotation rate for use in tracking, approaching, pursuing, intercepting or avoiding an object;

said apparatus comprising;

a vehicle approaching or receding from such object;

at least one imaging sensor fixed to the approaching or receding vehicle;

means for controlling the sensor to record a series of images of such object together with a background;

means for making computations derived exclusively from the images, with no direct information about inertial angular body rate or gimbal angle, and for thereby estimating line-of-sight rotation rate of such object relative to the vehicle; and

means for applying the estimated line-of-sight rotation rate to track, approach, pursue, intercept or avoid such object.