VISUAL GUIDANCE FOR VEHICLE NAVIGATION SYSTEM

• US 20100131197A1
• Filed: 11/21/2008
• Published: 05/27/2010
• Est. Priority Date: 11/21/2008
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations Incorporated (General Motors Company)
• Inventors: Sadekar, Varsha, Zhang, Wende
• Granted Patent: US 9,459,113 B2
• Time in Patent Office: Days
• US Class Current: 701/209
• CPC Class Codes: G01C 21/36 Input/output arrangements for on-board computers
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams

Abstract

A system and method that provide a video-based vehicle navigation system. The system positions an arrow on the video display that shows the specific turning direction for the vehicle for route guidance purposes. To determine the proper position of the guidance arrow, the process determines a distance from the current vehicle position to the location where the vehicle needs to turn using any suitable information, such as GPS position, range measurements and map information. The process then positions the guidance arrow on the ground at the turning location in world coordinates, and projects the guidance arrow onto the image. The camera can be calibrated to the ground using various techniques, such as an online automatic calibration process that uses detected objects in the scene around the vehicle.

Claims

1. A method for identifying a turn for a vehicle in association with a vehicle navigation system, said method comprising:

determining a vehicle route having a vehicle destination;

providing a video image of a scene in front of the vehicle as the vehicle is traveling along the route;

determining a distance from a current vehicle position to a turning location along the route; and

projecting a guidance arrow onto the video image that identifies where the driver should turn the vehicle at the turning location to follow the route.

2. The method according to claim 1 wherein determining the distance from the vehicle position to the turning location includes using a vehicle GPS position, rang measurements and navigation map information.

3. The method according to claim 2 wherein determining the range measurements includes using vehicle radar and/or a stereo-camera.

4. The method according to claim 1 wherein projecting the guidance arrow onto the display includes first placing a virtual guidance arrow on the ground at the turning location in world coordinates.

5. The method according to claim 1 wherein providing a video image of a scene in front of the vehicle includes providing a video image using a camera.

6. The method according to claim 5 further comprising calibrating the camera so that the orientation of the video image relative to the ground is known.

7. The method according to claim 6 wherein calibrating the camera includes using an offline calibration process.

8. The method according to claim 6 wherein calibrating the camera includes automatically calibrating the camera using an online calibration process.

9. The method according to claim 8 wherein calibrating the camera includes employing range measurements and GPS information to determine infrastructure and distances to objects in the image, associating two-dimensional image points with their three-dimensional positions based on object detection and determining a camera rotation matrix and a translation vector using a two-dimensional image point and a corresponding three-dimensional position.

10. The method according to claim 9 wherein calibrating the camera includes using GPS messages that include information identifying other vehicles including the license plate numbers of other vehicles.

11. The method according to claim 9 wherein calibrating the camera includes using vehicle-to-vehicle communications and vehicle-to-infrastructure communications.

12. The method according to claim 1 wherein providing a video image of a scene includes using a display screen in the vehicle.

13. The method according to claim 1 wherein providing a video image of a scene includes using a display screen on a windshield of the vehicle.

14. A method for identifying a turn for a vehicle in association with a vehicle navigation system, said method comprising:

determining a vehicle route having a vehicle destination;

providing a video image from a camera of a scene in front of the vehicle as the vehicle is traveling along the route;

automatically calibrating the camera using an online camera calibration process so that the orientation of the camera relative to the ground is known; and

projecting a guidance arrow onto the video image that identifies where the driver should turn the vehicle at a turning location to follow the route, wherein projecting a guidance arrow onto the video image includes determining a distance from a current vehicle position to the turning location using a vehicle GPS position, range measurements and/or navigation map information.

15. The method according to claim 14 wherein determining the range measurements includes using vehicle radar and/or a stereo-camera.

16. The method according to claim 14 wherein projecting the guidance arrow onto the display includes first placing a virtual guidance arrow on the ground at the turning location in world coordinates.

17. The method according to claim 14 wherein calibrating the camera includes employing range measurements and GPS information to determine infrastructure and distances to objects in the image, associating two-dimensional image points with their three-dimensional positions based on object detection and determining a camera rotation matrix and a translation vector using a two-dimensional image point and a corresponding three-dimensional position.

18. A system for identifying a turn for a vehicle in association with a vehicle navigation system, said system comprising:

means for determining a vehicle route having a vehicle destination;

means for providing a video image of a scene in front of the vehicle as the vehicle is traveling along the route;

means for determining a distance from a current vehicle position to a turning location along the route; and

means for projecting a guidance arrow onto the video image that identifies where the driver should turn the vehicle at the turning location to follow the route.

19. The system according to claim 18 further comprising means for automatically calibrating the camera using an online calibration process, said means for calibrating the camera employing range measurements and GPS information to determine infrastructure and distances to objects in the image, associating two-dimensional image points with their three-dimensional positions based on object detection and determining a camera rotation matrix and a translation vector using a two-dimensional image point and a corresponding three-dimensional position.

20. The system according to claim 18 wherein the means for determining a distance from a current vehicle position to a turning location along the route uses a vehicle GPS position, rang measurements and navigation map information.