2D VEHICLE LOCALIZING USING GEOARCS

• US 20180061055A1
• Filed: 08/30/2016
• Published: 03/01/2018
• Est. Priority Date: 08/30/2016
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Owechko, Yuri
• Granted Patent: US 10,402,675 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 2207/10044 Radar image
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/344 involving models
• CPC Class Codes: G06T 7/75 involving models

Abstract

Examples include methods, systems, and articles for localizing a vehicle relative to an imaged surface configuration. Localizing the vehicle may include selecting pairs of features in an image acquired from a sensor supported by the vehicle having corresponding identified pairs of features in a reference representation of the surface configuration. A three-dimensional geoarc may be generated based on an angle of view of the sensor and the selected feature pair in the reference representation. In some examples, a selected portion of the geoarc disposed a known distance of the vehicle away from the portion of the physical surface configuration may be determined. Locations where the selected portions of geoarcs for selected feature pairs overlap may be identified. In some examples, the reference representation may be defined in a three-dimensional space of volume elements (voxels), and voxels that are included in the highest number of geoarcs may be determined.

Claims

1. A method for spatial localization comprising:

acquiring from a sensor supported by a vehicle an image of a portion of a physical surface configuration from a position spaced away from the physical surface configuration by a known distance;

identifying features in the acquired image;

associating identified features in the acquired image with identified features in a reference representation of the portion of the physical surface configuration;

selecting a plurality of pairs of features in the acquired image having corresponding identified pairs of features in the reference representation;

for each selected feature pair in the acquired image,

determining an angle of view between the pair of features from the sensor,

generating a three-dimensional geoarc associating the determined angle of view and the selected feature pair in the reference representation, and

determining a selected portion of the geoarc disposed the known distance away from the portion of the physical surface configuration; and

identifying locations where the selected portions of the geoarcs for the selected feature pairs overlap.

2. The method of claim 1, where the reference representation is a two-dimensional representation of the portion of the physical surface configuration extending along a ground plane, and wherein determining a selected portion of the geoarc includes determining a sensor plane at the known distance above the ground plane and identifying an intersection of the sensor plane with the geoarc.

3. The method of claim 2, further comprising, for each selected feature pair, translating the intersection of the sensor plane with the geoarc onto the ground plane, and associating the identified locations where the selected portions of the geoarcs overlap, with corresponding locations on the reference representation.

4. The method of claim 3, further comprising selecting a location on the reference representation corresponding to where the selected portions of the geoarcs overlap the most as the location on the reference representation corresponding to the location of the vehicle in the geoarc in the sensor plane.

5. The method of claim 1, further comprising, for each selected feature pair, translating the selected portion of the geoarc onto the reference representation, and associating the identified locations where the selected portions of the geoarcs overlap with corresponding locations on the reference representation.

6. The method of claim 1, wherein identifying locations where the selected portions of the geoarcs for the selected feature pairs overlap includes dividing an area of the reference representation of the portion of the physical surface configuration into a plurality of divisions, and identifying separately for each division locations in the respective division where the selected portions of the geoarcs for the selected feature pairs overlap.

7. The method of claim 6, wherein identifying separately for each division locations in the respective division where the selected portions of the geoarcs for the selected feature pairs overlap includes identifying, for a plurality of the plurality of divisions concurrently, locations in the respective division where the selected portions of the geoarcs for the selected feature pairs overlap.

8. The method of claim 7, where the sensor has a known field of view, and wherein dividing an area of the reference representation of the portion of the physical surface configuration into a plurality of divisions includes dividing the area of the reference representation of the portion of the physical surface configuration into the plurality of divisions each having an area less than the known field of view.

9. A vehicle comprising:

a sensor configured to produce an image of a portion of a physical surface configuration from a position spaced away from the portion of the physical surface configuration by a known distance; and

a data processing system communicatively coupled to the sensor, the data processing system configured to;

store a reference representation of the portion of the physical surface configuration and features identified in the reference representation,

identify features in the acquired image;

associate identified features in the acquired image with identified features in the reference representation,

select a plurality of pairs of features in the acquired image having corresponding identified pairs of features in the reference representation, and

for each selected feature pair in the acquired image,

determine an angle of view between the pair of features from the sensor,

generate a three-dimensional geoarc associating the determined angle of view and the selected feature pair in the reference representation, and

determine a selected portion of the geoarc disposed the known distance away from the portion of the physical surface configuration; and

identify locations where the selected portions of the geoarcs for the selected feature pairs overlap.

10. The vehicle of claim 9, where the reference representation is a two-dimensional representation extending along a ground plane, and wherein the data processing system is further configured to determine a sensor plane at the known distance above the ground plane and identify an intersection of the sensor plane with the geoarc.

11. The vehicle of claim 10, wherein the data processing system is further configured to, for each selected feature pair, translate the intersection of the sensor plane onto the ground plane, and associate the identified locations where the selected portions of the geoarcs overlap, with corresponding locations on the reference representation.

12. The vehicle of claim 11, wherein the data processing system is further configured to select a location on the reference representation corresponding to where the selected portions of the geoarcs overlap the most as the location on the reference representation corresponding to the location of the vehicle in the geoarc in the sensor plane.

13. The vehicle of claim 9, wherein the data processing system is further configured to, for each selected feature pair, translate the selected portion of the geoarc onto the reference representation, and associate the identified locations where the selected portions of the geoarcs overlap with corresponding locations on the reference representation.

14. The vehicle of claim 9, wherein the data processing system is further configured to divide an area of the reference representation of the portion of the physical surface configuration into a plurality of divisions, and identify separately for each division locations in the respective division where the selected portions of the geoarcs for the selected feature pairs overlap.

15. The vehicle of claim 14, wherein the data processing system is further configured to identify, for a plurality of the plurality of divisions concurrently, locations in the respective division where the selected portions of the geoarcs for the selected feature pairs overlap.

16. The vehicle of claim 15, where the sensor has a known field of view, and wherein the data processing system is further configured to divide the area of the reference representation of the portion of the physical surface configuration into the plurality of divisions each having an area less than the known field of view.

17. A computer program product, comprising:

at least one computer readable storage medium having computer readable program instructions embodied therewith, the computer readable program instructions, when executed by a processor, configuring the processor to;

store a reference representation of the portion of the physical surface configuration and features identified in the reference representation;

receive and store an image produced by a sensor supported by a vehicle of a portion of a physical surface configuration from a position spaced away from the physical surface configuration by a known distance;

identify features in the received image;

associate identified features in the acquired image with identified features in the reference representation,

select a plurality of pairs of features in the received image having corresponding identified pairs of features in the reference representation,

for each selected feature pair in the received image,

determine an angle of view between the pair of features from the sensor,

generate a three-dimensional geoarc associating the determined angle of view and the selected feature pair in the reference representation, and

determine a selected portion of the geoarc disposed the known distance away from the portion of the physical surface configuration; and

identify locations where the selected portions of the geoarcs for the selected feature pairs overlap.

18. The computer program product of claim 17, where the reference representation is a two-dimensional representation extending along a ground plane, and wherein the computer readable program instructions, when read by the processor further configure the processor to determine a sensor plane at the known distance above the ground plane and identify an intersection of the sensor plane with the geoarc.

19. The computer program product of claim 18, wherein the computer readable program instructions, when read by the processor further configure the processor to, for each selected feature pair, translate the intersection of the sensor plane onto the ground plane, and associate the identified locations where the selected portions of the geoarcs overlap, with corresponding locations on the reference representation.

20. The computer program product of claim 17, wherein the computer readable program instructions, when read by the processor further configure the processor to divide an area of the reference representation of the portion of the physical surface configuration into a plurality of divisions, and identify separately for each division locations in the respective division where the selected portions of the geoarcs for the selected feature pairs overlap.