Inertial measurement with an imaging sensor and a digitized map

• US 8,265,817 B2
• Filed: 07/10/2008
• Issued: 09/11/2012
• Est. Priority Date: 07/10/2008
• Status: Active Grant

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Inventors: Tener, Gene D., Hawkins, Andrew H., Bovankovich, Mark A., Glaros, Louis N.
• Primary Examiner(s): Morgan, Robert
• Assistant Examiner(s): Fuelling, Michael
• Application Number:
  US12/216,758
• Publication Number:
  US 20100010741A1
• Time in Patent Office: 1,524 Days
• Field of Search: 701/220, 701/23, 701412-512, 701/514
• US Class Current: 701/23
• CPC Class Codes: F41G 7/34 based on predetermined target position data
• CPC Class Codes: G01C 21/005 with correlation of navigation data from several sources, e.g. map or contour matching G01C21/30 takes precedence
• CPC Class Codes: G01S 13/876 Combination of several spaced transponders or reflectors of known location for determining the position of a receiver G01S13/874 takes precedence
• CPC Class Codes: G01S 17/875 for determining attitude
• CPC Class Codes: G01S 5/163 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G05D 1/106 Change initiated in response to external conditions, e.g. avoidance of elevated terrain or of no-fly zones
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/75 involving models

Abstract

The present invention relates to a system and method for determining vehicle attitude and position from image data detected by sensors in a vehicle. The invention uses calculated differences between the locations of selected features in an image plane and the location of corresponding features in a terrain map to determine the attitude of the vehicle carrying the sensors with respect to a ground frame of reference.

Claims

1. A method of electro-optical absolute attitude determination of a moving object, the method comprising:

capturing a frame of image data of a first scene with a detector that measures angles of detected features within the captured frame of image data with respect to the detector'"'"'s boresight reference relative to the object;

identifying at least three features from the captured frame of image data of said first scene by

selecting features within the pixel space of the captured frame of image data;

computationally correlating said identified features to features in a map to determine corresponding map locations of said identified features and a location of the object within the map;

calculating, with a processor, the absolute attitude based on the difference between the locations of the at least three features in the captured frame of image data and the locations of the correlated features in the map by

transforming the correlated features from the map into a first set of object space angular coordinates based on the location of the object within the map and the measured angles of the correlated features to generate horizontal, vertical, and arc coordinate values;

tracking the at least three features within image data of a second scene captured subsequent to the first scene;

measuring first relative changes in position of the at least three features in the second scene with respect to the image data of the first scene;

determining, based on the first relative changes in position of the at least three features, a change in attitude of the moving object relative to the at least three features; and

calculating, based on a comparison of the determined change in attitude of the moving object against a previously calculated absolute attitude of the moving object, a new absolute attitude and attitude change rate and attitude change direction for the moving object.

2. The method of claim 1, said determining, a change in attitude of the moving object comprising:

transforming the tracked features from the second scene into a second set of object space angular coordinates based on the location of the moving object within the map and measured angles of the tracked features relative to the detector'"'"'s boresight reference to generate second horizontal, second vertical, and second arc coordinate values; and

computing the horizontal, vertical, and arc coordinate differences between a coordinate from the first set and its correlated coordinate from the second set;

where the previously calculated absolute attitude is the absolute attitude calculated from the first set of object space coordinates.

3. The method of claim 2, further comprising:

calculating a pitch change rate based on vertical values of the coordinate differences.

4. The method of claim 3, said map comprising a listing of known beacon locations.

5. The method of claim 2, further comprising:

calculating a roll change rate based on horizontal values of the coordinate differences.

6. The method of claim 2, further comprising:

calculating a yaw change rate based on arc-length distance values of the coordinate differences.

7. The method of claim 1, said captured frame of image data including object-relative locations of passively-detected transmitter beacons wherein at least one feature of said at least three features comprises a transmitter beacon location.

8. The method of claim 1, said captured frame of image data comprising visible-spectrum imaging data.

9. The method of claim 1, said map comprising a terrain map.

10. The method of claim 1, said previously calculated absolute attitude of said moving object also including a location and movement rate and direction of said moving object.

11. The method of claim 1, further comprising:

tracking the at least three features within image data of a third scene captured subsequent to the second scene;

measuring second relative changes in position of the at least three features in the third scene with respect to the image data of the second scene;

determining, based on the second relative changes in position of the at least three features, the change in attitude of the moving object from the second scene to the third scene relative to the at least three features; and

calculating, based on a comparison of the determined change in attitude of the moving object from the first scene to the second scene and the change in attitude of the moving object from the second scene to the third scene, an attitude change acceleration rate and attitude change acceleration direction for the moving object.

12. The method of claim 1, wherein measuring angles of detected features with respect to the detector'"'"'s boresight reference relative to the object includes calculating a line-of-sight (LOS) unit vector from the detector or sensor to an identified feature;

and

where the LOS unit vector is computed as a function of LOS angles (ε

_yi and ε

_zi) measured relative to the detector or sensor, such that the unit vector (u) is given by the expression;

13. The method of claim 1, the method further comprising:

capturing a second frame of image data of the first scene with a second detector that measures angles of detected features within the second frame of image data with respect to the second detector'"'"'s boresight reference relative to the object; and

identifying said selected features in the captured second frame of image data of said first scene;

where transforming the selected features into a set of object space angular coordinates further includes transforming the selected features into said set of object space angular coordinates based on the measured angles from the second detector, and a known line-of-sight (LOS) boresight angle between the first and second detectors.

14. The method of claim 13, where the first and second detectors have different detection wavelength ranges.

15. A device for electro-optically determining absolute attitude of a moving object, the device comprising:

an imaging sensor that captures a frame of image data of a first scene and that measures the angles of detected features within the captured frame of image data with respect to the sensor'"'"'s boresight reference relative to the object;

a feature identification unit that identifies at least three features in captured frame of image data, the feature identification unit comprising

a feature selection unit that selects features within the pixel space of the captured frame of image data; and

a feature correlation unit that correlates said identified features to a map;

a feature location unit that determines corresponding map locations of the correlated features and a location of the object within the map; and

an attitude calculator that calculates the absolute attitude based on the difference in the locations of at least three features in the frame of image data and the locations of the correlated features in the map, the attitude calculator comprising

a space transformation module that transforms the correlated features from the map into a first set of object space angular coordinates based on the location of the object within the map and the measured angles of the correlated features to generate horizontal, vertical, and arc coordinate values;

a feature tracker that tracks the at least three features within image data of at a second scene captured subsequent to the first scene;

a relative position computer that measures relative changes in position of the at least three features in the second scene with respect to the image data of the first scene, and determines, based on the relative changes in position of the at least three features, the change in attitude of the moving object relative to the at least three features; and

a movement and position calculator that calculates, based on a comparison of the determined change in attitude of the moving object against a previously calculated absolute attitude of the moving object, a new absolute attitude and attitude change rate and attitude change direction for the moving object.

16. The device of claim 15, the relative position computer comprising:

a map transformation module that transforms the tracked features from the second scene into a second set of object space angular coordinates based on the location of the moving object within the map and measured angles of the tracked features relative to the detector'"'"'s boresight reference to generate second horizontal, second vertical, and second arc coordinate values; and

a difference computation unit that computes the horizontal, vertical, and arc coordinate differences between a coordinate from the first set and its correlated coordinate from the second set;

where the previously calculated absolute attitude is the absolute attitude calculated from the first set of object space coordinates.

17. The device of claim 16, the attitude calculator further comprising:

a pitch calculator that calculates a pitch change rate based on vertical values of the coordinate differences.

18. The device of claim 16, the attitude calculator further comprising:

a roll calculator that calculates a roll change rate based on horizontal values of the coordinate differences.

19. The device of claim 16, the attitude calculator further comprising:

a yaw calculator that calculates a yaw change rate based on arc-length distance values of the coordinate differences.

20. The device of claim 15, said captured frame of image data comprising object-relative locations of passively-detected transmitter beacons wherein at least one feature of said at least three features comprises a transmitter beacon location.

21. The device of claim 15, said imaging sensor comprising a visible-spectrum imaging sensor.

22. The device of claim 15, further comprising a memory unit that stores said map, wherein the map includes a terrain map.

23. The device of claim 15, said previously calculated absolute attitude of said moving object also including a location, and movement rate and direction of said moving object.

24. The device of claim 15, further comprising:

an acceleration feature tracker that tracks the at least three features within image data of a third scene captured subsequent to the second scene;

an acceleration position computer that determines, based on relative changes in position of the at least three features, the change in attitude of the moving object from the second scene to the third scene relative to the at least three features; and

an acceleration calculator that calculates, based on a comparison of the determined change in position of the moving object from the first scene to the second scene and the determined change in position of the moving object from the second scene to the third scene, an attitude acceleration rate and attitude acceleration direction for the moving object.

25. The device of claim 15, the device further comprising:

a second imaging sensor that captures a second frame of image data of the first scene and measures the angles of detected features within the second frame of image data with respect to the second detector'"'"'s boresight reference relative to the object;

where the feature identification unit identifies the selected features in the second frame of image data; and

where the space transformation module transforms the selected features into a set of object space angular coordinates by also transforming the selected features into said set of object space angular coordinates based on the measured angles from the second detector, and a known line-of-sight (LOS) boresight angle between the first and second detectors.

26. The device of claim 25, where the first and second detectors have different detection wavelengths.