Systems and methods for environment sensing using radar

• US 10,317,519 B2
• Filed: 09/12/2016
• Issued: 06/11/2019
• Est. Priority Date: 04/15/2016
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Rohani, Mohsen, Zhang, Song
• Primary Examiner(s): Gregory, Bernarr E
• Application Number:
  US15/262,634
• Publication Number:
  US 20180106896A1
• Time in Patent Office: 1,002 Days
• CPC Class Codes: G01S 13/426 Scanning radar, e.g. 3D radar G01S13/66 takes precedence
• CPC Class Codes: G01S 13/87 Combinations of radar systems, e.g. primary radar and secondary radar
• CPC Class Codes: G01S 13/89 for mapping or imaging
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 2013/93273 on the top of the vehicles
• CPC Class Codes: G01S 2013/93275 in the bumper area

Abstract

A method and system for generating a three dimensional map of an environment based on information acquired by radar. The system includes a ground-based vehicle, and a scanning radar, or combination of radars, that scans the surrounding environment in one or more vertical planes or along azimuth angles. The radar may be an electrical beam steering and scanning radar or a combination electrical beam scanning radar and mechanical scanning radar. Dynamic objects within the environment may also be identified and removed with the remaining static objects being used to generate a three dimensional map of the surrounding environment and to perform localization within the three dimensional map.

Claims

1. A sensing system, comprising:

a ground-based vehicle configured to move in a direction of travel;

at least one radar system mountable to the ground-based vehicle, each radar system configured to emit radio waves in a beam to scan along azimuth angles at different fixed elevation angles or in one or more vertical planes, capture electromagnetic radiation, and generate radar data based on the captured electromagnetic radiation while the vehicle is moving;

memory operably coupled to each radar system to receive the radar data from each radar system and to store the radar data; and

a processor operably coupled to the memory, the processor configured to execute computer instructions stored in the memory, the computer instructions causing the processor to;

receive speed information and positioning information of the vehicle from a controller of vehicle while the vehicle is moving;

generate a three dimensional map of an environment surrounding the vehicle based on the radar data received from the memory, the speed information and the positioning information of the vehicle, and the three-dimensional map including objects; and

generate a second three-dimensional map of a static environment surrounding the vehicle by identifying dynamic objects from objects included in the three-dimensional map of the environment and removing the dynamic objects from the three-dimensional map.

2. The sensing system of claim 1, wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to control the at least one radar system to emit radio waves to scan along azimuth angles at one or more fixed elevation angles.

3. The sensing system of claim 1, wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to control the at least one radar system to emit radio waves to scan in one or more vertical planes at one or more fixed azimuth angles.

4. The sensing system of claim 1, wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to control the at least one radar system to emit radio waves to scan along azimuth angles at one or more fixed elevation angles in a sequence.

5. The sensing system of claim 1 wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to control the at least one radar system to emit radio waves to scan the vertical planes at one or more fixed azimuth angles in a sequence.

6. The sensing system of claim 1 wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to process the radar data to generate 3D point clouds or radar images and wherein the three-dimensional map is generated based on the 3D point clouds or the radar images.

7. The sensing system of claim 1 wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to control the at least one radar system to scan along azimuth angles at a respective fixed elevation angle.

8. The sensing system of claim 1 wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to control the at least one radar system to emit a first scan along first azimuth angles and a second scan along second azimuth angles at the different fixed elevation angles.

9. The sensing system of claim 1 wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to control the at least one radar system to emit each scan in the one or more vertical planes is along elevation angles at a respective fixed azimuth angle.

10. The sensing system of claim 1 wherein the processor is further configured to execute computer instructions stored on the memory to cause the processor to control the at least one radar system to emit a first scan in a first vertical plane and a second scan in a second vertical plane at different fixed azimuth angles.

11. The sensing system of claim 1, wherein the at least one radar system comprising a plurality of radar systems mountable to the vehicle.

12. The sensing system of claim 1 wherein the processor is configured to generate a position of the vehicle based on at least one of the three dimensional map of the environment or the second three dimensional map of the environment.

13. A method for radar sensing from a ground-based vehicle, using at least one radar system mountable to the ground-based vehicle, the method comprising:

controlling each radar system to emit radio waves in a beam to scan along azimuth angles at different fixed elevation angles or in one or more vertical planes;

processing, at each radar system, electromagnetic radiation captured by the radar system to generate radar data while the vehicle is moving;

receiving speed information and positioning information of the vehicle from a controller of vehicle while the vehicle is moving;

generating a three dimensional map of an environment surrounding the vehicle based on the radar data generated by each radar system, the speed information, and the positioning information, the three-dimensional map including objects; and

generating a second three dimensional map, of a static environment surrounding the vehicle, by identifying and removing dynamic objects from the objects included in the three-dimensional map.

14. The method of claim 13 wherein said emitting comprises emitting radio waves to scan along azimuth angles at one or more fixed elevation angles.

15. The method of claim 13 wherein said emitting comprises emitting radio waves to scan in one or more vertical planes at one or more fixed azimuth angles.

16. The method of claim 13 wherein said emitting comprises emitting the radio waves to scan along azimuth angles at one or more fixed elevation angles in a sequence.

17. The method of claim 13 wherein said emitting comprises emitting the radio waves to scan the vertical planes at one or more fixed azimuth angles in a sequence.

18. The method of claim 13 further comprising processing the radar data to generate 3D point clouds or radar images, and wherein the three-dimensional map is generated based on the 3D point clouds or the radar images.

19. The method of claim 13 wherein said emitting comprises emitting a first scan along first azimuth angles and a second scan along second azimuth angles at the different fixed elevation angles.

20. A radar sensing system comprising:

at least one radar system mountable to a vehicle, each radar system configured to emit radio waves in a beam to scan along first angular coordinates at one or more fixed second angular coordinates, wherein the first angular coordinates are perpendicular to the second angular coordinates, capture electromagnetic radiation, and generate radar data based on the captured electromagnetic radiation while the vehicle is moving;

memory operably coupled to each radar system to receive and store the radar data generated by each radar system; and

a processor operably coupled to the memory, the processor configured to execute computer instructions stored on the memory, the computer instructions causing the processor to;

receive speed information and positioning information of the vehicle from a controller of vehicle while the vehicle is moving;

process the radar data received from the memory to determine an environment surrounding the vehicle and identify static and dynamic objects around the vehicle;

generate a three dimensional map of an environment surrounding the vehicle based on the determined environment and the identified static objects.