Method for the display of navigation instructions using an augmented-reality concept

• US 20110153198A1
• Filed: 12/06/2010
• Published: 06/23/2011
• Est. Priority Date: 12/21/2009
• Status: Abandoned Application

• Current Assignee: Navisus, LLC
• Original Assignee: Navisus, LLC
• Inventors: Kokkas, Nikolaos, Schubert, Jochen
• Application Number:
  US12/961,279
• Publication Number:
  US 20110153198A1
• Time in Patent Office: Days
• US Class Current: 701/201
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams

Abstract

A method with which navigation instructions are displayed on a screen. Preferably, using an augmented-reality approach whereby the path to the destination and 3D mapping objects such as buildings and landmarks are highlighted on a video feed of the surrounding environment ahead of the user. The invention is designed to run within embodiments the likes of Personal Digital Assistants (PDAs), smartphones or in-dash vehicle infotainment systems, displaying in real-time a video feed of the path ahead while superimposing transparent cartographic information with navigation instructions. The aim is to improve the user'"'"'s navigation experience by making it easier to relate to the real world with 3D maps and representative navigation instructions. This method makes it safer to view the navigation screen and the user can locate landmarks, narrow streets and the final destination more easily.

Claims

1. A method for the display of navigation instructions, which have been generated as a function of a user defined destination, whereby the current position of the user is recorded using GNSS satellite systems, the orientation of the user is established through azimuth information from a GNSS sensor and a digital compass, the field of view in front of a user is recorded by a video camera and the video image is augmented for navigation by superimposing navigation instructions assembled using the output data from said sensors.

2. A method according to claim 1, where the navigation instructions are displayed as a function of the user'"'"'s position and orientation using 3D mapping data with spatially varying vertical elevations including but not limited to 3D paths and 3D buildings, and can be related to the user visually, by drawing them onto the video image, as well as acoustically through street and landmark names.

3. A method according to claim 2, where the navigation path, which augments the live video feed, is drawn consistently using graphical semi-transparency to allow for objects or subjects which appear in front of the camera to be seen on the navigation screen also.

4. A method according to claim 2, where the horizontal positional accuracy of the user is enhanced by implementing a method which analyses the user'"'"'s x,y position in relation to the available path network by computing the perpendicular distance to the nearest path section.

5. A method according to claim 2, where the vertical positional accuracy of the user is enhanced by calculating the user'"'"'s height on the basis of the 3D path elevation plus a user defined height depending on either the type of vehicle used or a user'"'"'s physical height.

8. A method according to claim 1, where the navigation instructions are displayed on the screen of a portable device including but not limited to PDAs and smartphones, as well as on in-dash vehicle infotainment systems.

6. A method where the field of view of the camera used for user navigation, is adjusted for correct superimposition of perspective navigation instructions by replicating the focal length, principal point and lens distortions of the video camera model in a graphical rendering engine.

7. A method where POI and user destination information along the driven path or navigation path are displayed through the use of “

billboards”

, which are projected onto the live video stream at their respective semantic location.