Systems and methods for displaying route information

• US 9,625,264 B1
• Filed: 01/20/2016
• Issued: 04/18/2017
• Est. Priority Date: 01/20/2016
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Ali, Syed, Imanishi, Masayuki
• Primary Examiner(s): Zanelli, Michael J
• Application Number:
  US15/001,434
• Time in Patent Office: 454 Days
• CPC Class Codes: G01C 21/28 with correlation of data from several navigational instruments
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself

Abstract

A method for displaying route information to a driver of a vehicle. The method includes comparing map data and a physical environment in which the vehicle is traveling, identifying differences between the map data and the physical environment in which the vehicle is traveling, and notifying the driver of the differences between the map data and the physical environment.

Claims

1. A method for displaying route information to a driver of a vehicle comprising:

comparing map data and a physical environment in which the vehicle is traveling;

identifying differences between the map data and the physical environment in which the vehicle is traveling; and

notifying the driver of the differences between the map data and the physical environment in which the vehicle is traveling;

wherein

the map data is three-dimensional map data.

2. The method of claim 1, further comprising displaying the comparison of map data and the physical environment in which the vehicle is traveling by projecting the map data on a heads-up display (HUD) of the vehicle.

3. The method of claim 1, further comprising displaying the comparison of map data and the physical environment in which the vehicle is traveling on a monitor within the vehicle showing the map data overlaid on a live camera image of the physical environment.

4. The method of claim 1, wherein the map data includes at least one of road lane markers, guard rails, barriers, walls, traffic, light poles, gates, fences, garage doors, and toll booths.

5. The method of claim 1, further comprising identifying differences between the map data and the physical environment by comparing the map data to the physical environment sensed using at least one of the following:

sensors onboard the vehicle, sensors onboard other vehicles, sensors on infrastructure, sensors on buildings, sensors on obstacles, travel paths of surrounding vehicles, traffic reports, and traffic sensors.

6. The method of claim 5, wherein the sensors include at least one of a camera, radar, and lidar.

7. The method of claim 1, further comprising identifying differences between the map data and the physical environment by comparing the map data to the physical environment sensed by sensors of surrounding vehicles and communicated to the driver'"'"'s vehicle using vehicle-to-vehicle communication.

8. The method of claim 1, further comprising identifying differences between the map data and the physical environment by comparing the map data to the physical environment sensed by sensors of infrastructure of the physical environment and communicated to the driver'"'"'s vehicle using vehicle-to-infrastructure communication.

9. The method of claim 1, further comprising autonomously driving the vehicle based solely on the map data.

10. The method of claim 9, further comprising autonomously directing the vehicle to take evasive action when the map data does not match the physical environment.

11. A method for displaying route information to a driver of a vehicle comprising:

autonomously piloting the vehicle based on map data; and

displaying to the driver a comparison of the map data and a physical environment in which the vehicle is traveling.

12. The method of claim 11, further comprising:

identifying differences between the map data and the physical environment in which the vehicle is traveling;

notifying the driver of the differences between the map data and the physical environment in which the vehicle is traveling; and

prompting the driver to take manual control of the vehicle based on identified differences between the map data and the physical environment in which the vehicle is traveling;

wherein the map data is three-dimensional map data.

13. The method of claim 11, wherein the map data includes lane markers, buildings, guardrails, light posts, tunnels, walls, and bridges overlaid on the physical environment using at least one of a heads-up-display and a monitor displaying a camera image of the physical environment.

14. The method of claim 11, further comprising identifying differences between the map data and the physical environment by comparing the map data to the physical environment sensed using at least one of the following:

sensors onboard the vehicle;

sensors onboard other vehicles;

sensors on infrastructure;

sensors on obstacles;

travel paths of surrounding vehicles;

traffic reports;

traffic sensors;

sensors of surrounding vehicles and communicated to the driver'"'"'s vehicle using vehicle-to-vehicle communication;

sensors of infrastructure of the physical environment and communicated to the driver'"'"'s vehicle using vehicle-to-infrastructure communication;

wherein the sensors include at least one of a camera, radar, and lidar.

15. A system for displaying route information to a driver of a vehicle comprising:

an autonomous driving module configured to pilot the vehicle using three-dimensional map data only;

at least one sensor configured to detect features of the physical environment in which the vehicle is traveling;

a comparison module configured to compare the map data and the features detected by the sensor of the physical environment in which the vehicle is traveling, and identify differences between the map data and the physical environment; and

a display configured to display the map data relative to the physical environment in which the vehicle is traveling and differences between the map data and the physical environment.

16. The system of claim 15, wherein the at least one sensor includes at least one of the following:

sensors onboard the vehicle;

sensors onboard other vehicles;

sensors on infrastructure; and

sensors on obstacles;

wherein the at least one sensor includes at least one of a camera, radar, and lidar.

17. The system of claim 15, wherein the comparison module is further configured to compare the map data with at least one of the following:

travel paths of surrounding vehicles;

traffic reports; and

traffic sensors.

18. The system of claim 15, wherein:

the comparison module is further configured to compare the map data to the physical environment sensed by sensors of infrastructure of the physical environment and communicated to the driver'"'"'s vehicle using vehicle-to-infrastructure communication; and

the comparison module is further configured to compare the map data to the physical environment sensed by sensors of surrounding vehicles and communicated to the driver'"'"'s vehicle using vehicle-to-vehicle communication.

19. The system of claim 15, wherein:

the comparison module is further configured to compare the map data to road shape defined by at least one of the following;

surrounding structures;

lane markers;

travel path of at least one leading vehicle;

trees;

road curb; and

paved versus unpaved areas.