Method and Apparatus for Representing a Map Element and Method and Apparatus for Locating a Vehicle / Robot

• US 20180165544A1
• Filed: 11/20/2017
• Published: 06/14/2018
• Est. Priority Date: 06/18/2015
• Status: Active Grant

• Current Assignee: Bayerische Motoren Werke AG
• Original Assignee: Bayerische Motoren Werke AG
• Inventors: ISERT, Carsten, JIANG, Wanli, LI, Qianshan
• Granted Patent: US 10,643,103 B2
• Time in Patent Office: Days
• CPC Class Codes: G01C 21/30 Map- or contour-matching
• CPC Class Codes: G01C 21/3635 Guidance using 3D or perspective road maps
• CPC Class Codes: G01C 21/3863 Structures of map data
• CPC Class Codes: G05D 1/0231 using optical position detecting means position-fixing by using electromagnetic waves other than radio waves, e.g. optical position detecting means G01S5/16
• CPC Class Codes: G06F 18/2137 based on criteria of topology preservation, e.g. multidimensional scaling or self-organising maps
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59

Abstract

A method and an apparatus are provided for representing a map element and for locating a vehicle/robot based thereupon. The method for representing a map element includes: generating a Gaussian Mixture Model for the map element; generating a signature for identifying the map element, wherein the signature includes properties of the map element; and generating a Signatured Gaussian Mixture Model for representing the map element, wherein the Signatured Gaussian Mixture Model includes the Gaussian Mixture Model and the signature.

Claims

1. A computer-implemented method for representing a map element, comprising the acts of:

generating a Gaussian Mixture Model for the map element;

generating a signature for identifying the map element, wherein the signature comprises properties of the map element; and

generating a Signatured Gaussian Mixture Model for representing the map element,

wherein the Signatured Gaussian Mixture Model comprises the Gaussian Mixture Model and the signature.

2. The method according to claim 1, wherein the map element is a geometry or point cluster in a digital map or an image segment in an image.

3. The method according to claim 1, wherein generating the Gaussian Mixture Model for the map element comprises:

using Gaussian Mixture Models of geometric primitives to approximate a shape of the map element.

4. The method according to claim 3, wherein the geometric primitives comprise at least one of:

a line segment, an arc segment, a spiral segment, a planar rectangle, a planar triangle, a planar circle/sphere, a planar ellipse, a sphere surface patch, a cylinder surface patch, a 3D cube, a 3D sphere and a 3D cylinder.

5. The method according to claim 1, wherein the properties of the map element comprise at least of one of type, reflectivity and flatness of the map element.

6. The method according to claim 1, wherein the Signatured Gaussian Mixture Model further comprises an existence probability of the map element.

7. A computer implemented method for locating a vehicle/robot, comprising the acts of:

reading a Signatured Gaussian Mixture Map for a map section which the vehicle/robot is currently located in, wherein the Signatured Gaussian Mixture Map comprises Signatured Gaussian Mixture Models for map elements within the map section, and wherein the Signatured Gaussian Mixture Models are generated by using the method according to claim 1;

generating Signatured Gaussian Mixture Models for map elements within a real-time point cloud or an image acquired by the vehicle/robot through using the method;

establishing one or more correspondences between the Signatured Gaussian Mixture Map and the Signatured Gaussian Mixture Models for the map elements within the real-time point cloud or image based on signatures of the Signatured Gaussian Mixture Models for the map elements within the real-time point cloud or image; and

matching the Signatured Gaussian Mixture Map with the Signatured Gaussian Mixture Models for the map elements within the real-time point cloud or image based on the one or more correspondences established.

8. The method according to claim 7, further comprising the act of:

reading information on the map section which the vehicle/robot is currently located in.

9. The method according to claim 7, further comprising the act of:

reading information on prior pose of the vehicle/robot and data reflecting the uncertainty area of the prior pose.

10. The method according to claim 7, wherein matching the Signatured Gaussian Mixture Map with the Signatured Gaussian Mixture Models for map elements within the realtime point cloud or image comprises:

optimizing a Euclidean distance between the Signatured Gaussian Mixture Map and the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image.

11. The method according to claim 10, wherein optimizing the Euclidean distance between the Signatured Gaussian Mixture Map and the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image comprises:

optimizing the Euclidean distance with pose of the vehicle/robot constrained on predefined space and within the uncertainty area.

15. An apparatus for locating a vehicle/robot, comprising:

a memory, having computer executable instructions stored therein; and

a processor, coupled to the memory and configured to;

read a Signatured Gaussian Mixture Map for a map section which the vehicle/robot is currently located in, wherein the Signatured Gaussian Mixture Map comprises Signatured Gaussian Mixture Models for map elements within the map section, and wherein the Signatured Gaussian Mixture Models are generated by using the method according to claim 1;

generate Signatured Gaussian Mixture Models for map elements within a realtime point cloud or an image acquired by the vehicle/robot through using the method;

establish one or more correspondences between the Signatured Gaussian Mixture Map and the Signatured Gaussian Mixture Models for map elements within the realtime point cloud or image based on signatures of the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image; and

match the Signatured Gaussian Mixture Map with the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image based on the correspondence established.

16. The apparatus according to claim 15, wherein the processor is further configured to:

read information on prior pose of the vehicle/robot and data reflecting the uncertainty area of the prior pose.

17. The apparatus according to claim 15, wherein matching the Signatured Gaussian Mixture Map with the Signatured Gaussian Mixture Models for map elements within the realtime point cloud or image comprises:

optimizing the Euclidean distance between the Signatured Gaussian Mixture Map and the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image.

18. The apparatus according to claim 17, wherein optimizing the Euclidean distance between the Signatured Gaussian Mixture Map and the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image comprises:

optimizing the Euclidean distance with pose of the vehicle/robot constrained on predefined space and within the uncertainty area.

21. A non-transient storage medium having instructions stored thereon that when executed cause a processor to implement computer-implemented method for locating a vehicle/robot, comprising:

instructions for causing the processor to read a Signatured Gaussian Mixture Map for a map section which the vehicle/robot is currently located in, wherein the Signatured Gaussian Mixture Map comprises Signatured Gaussian Mixture Models for map elements within the map section, and wherein the Signatured Gaussian Mixture Models are generated by using the method according to claim 1;

instructions for causing the processor to generate Signatured Gaussian Mixture Models for map elements within a real-time point cloud or an image acquired by the vehicle/robot through using the method;

instructions for causing the processor to establish one or more correspondences between the Signatured Gaussian Mixture Map and the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image based on signatures of the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image; and

instructions for causing the processor to match the Signatured Gaussian Mixture Map with the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image based on the one or more correspondences established.

24. An apparatus for locating vehicle/robot, comprising:

a Signature Gaussian Mixture Map read unit configured to read Signature Gaussian Mixture Map for a map section which the vehicle/robot is currently located in, wherein the Signatured Gaussian Mixture Map comprises Signatured Gaussian Mixture Models for map elements within the map section, and wherein the Signatured Gaussian Mixture Models are generated by using the method according to claim 1;

a Signatured Gaussian Mixture Model generation unit configured to generate Signatured Gaussian Mixture Models for map elements within a real-time point cloud or an image acquired by the vehicle/robot using the method;

a correspondence establishing unit configured to establish one or more correspondences between the Signatured Gaussian Mixture Map and the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image based on signatures of the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image; and

a matching unit configured to match the Signatured Gaussian Mixture Map with the Signatured Gaussian Mixture Models for map elements within the real-time point cloud or image based on the one or more correspondences established.

25. A vehicle comprising the apparatus according to claim 24.

12. An apparatus for representing a map element, comprising:

a memory, having computer executable instructions stored therein; and

a processor, coupled to the memory and configured to;

generate a Gaussian Mixture Model for the map element;

generate a signature for identifying the map element, wherein the signature comprises properties of the map element; and

generate a Signatured Gaussian Mixture Model for representing the map element, wherein the Signatured Gaussian Mixture Model comprises the Gaussian Mixture Model and the signature.

13. The apparatus according to claim 12, wherein generating a Gaussian Mixture Model for the map element comprises:

using Gaussian Mixture Models of geometric primitives to approximate a shape of the map element.

14. The apparatus according to claim 12, wherein the Signatured Gaussian Mixture Model further comprises an existence probability of the map element.

19. A non-transient storage medium having instructions stored thereon that when executed cause a processor to implement computer-implemented method for representing a map element, comprising:

instructions for causing the processor to generate a Gaussian Mixture Model for the map element;

instructions for causing the processor to generate a signature for identifying the map element, wherein the signature comprises properties of the map element; and

instructions for causing the processor to generate a Signatured Gaussian Mixture Model for representing the map element, wherein the Signatured Gaussian Mixture Model comprises the Gaussian Mixture Model and the signature.

20. The non-transient storage medium according to claim 19, wherein the Signatured Gaussian Mixture Model further comprises an existence probability of the map element.

22. An apparatus for representing a map element, comprising:

a Gaussian Mixture Model generation unit configured to generate a Gaussian Mixture Model for the map element;

a signature generation unit configured to generate a signature for identifying the map element, wherein the signature comprises properties of the map element; and

a Signatured Gaussian Mixture Model generation unit configured to generate a Signatured Gaussian Mixture Model for representing the map element, wherein the Signatured Gaussian Mixture Model comprises the Gaussian Mixture Model and the signature.

23. The apparatus according to claim 22, wherein the Signatured Gaussian Mixture Model further comprises an existence probability of the map element.