Three dimensional routing

• US 9,116,011 B2
• Filed: 10/21/2011
• Issued: 08/25/2015
• Est. Priority Date: 10/21/2011
• Status: Active Grant

• Current Assignee: HERE Global B.V. (HERE Holding Corporation)
• Original Assignee: HERE Global B.V. (HERE Holding Corporation)
• Inventors: Lynch, James D.
• Primary Examiner(s): Mawari, Redhwan k
• Assistant Examiner(s): King, Rodney P
• Application Number:
  US13/278,546
• Publication Number:
  US 20130103303A1
• Time in Patent Office: 1,404 Days
• Field of Search: 701/400, 701/410, 701/431, 701/436, 701/438, 701/523, 701/537, 345/48, 345/419, 345/428, 382/154
• US Class Current: 1/1
• CPC Class Codes: A61B 3/0058 for multiple images
• CPC Class Codes: A61B 3/10 Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

One or more systems, devices, and/or methods for three dimensional routing are disclosed. For example, one embodiment includes receiving image data selected based on a viewer perspective from a memory. The image data is correlated with a depthmap generated from an optical distancing system and correlated with route data calculated from an origin point to a destination point using a geographical database and a routing algorithm. The controller compares a first distance, from the viewer perspective to a point correlated with the route data, to a second distance, derived from the depth map at the point. If the comparison indicates that the first distance is closer to the viewer perspective than the second distance, the controller inserts at least one pixel of a navigation illustration into the image data. The image data including the navigation illustration is transmitted to or stored in a memory.

Claims

1. A method comprising:

receiving, from a memory, image data selected based on a viewer perspective;

correlating the image data with a depthmap generated from an optical distancing system;

correlating the image data with pedestrian route data calculated for a pedestrian route from an origin point to a destination point using a geographical database;

comparing, with a controller, a first distance from the viewer perspective to a point correlated with the pedestrian route data to a second distance derived from the depth map at the point;

if the comparison indicates that the first distance is closer to the viewer perspective than the second distance, then inserting at least one pixel of a navigation illustration into the image data along the pedestrian route; and

repeating comparing the first distance and the second distance inserting at least one pixel of the navigation illustration into the image data at a plurality of subsequent pixel locations to draw a navigation icon.

2. The method of claim 1, wherein the pedestrian route data includes at least one segment designated as a pedestrian path.

3. The method of claim 1, wherein the navigation illustration comprises an indication of direction.

4. The method of claim 1,

wherein the navigation icon is redrawn to simulate movement along a route defined by the pedestrian route data from the origin point to the destination point.

5. The method of claim 1, further comprising:

selecting the navigation illustration from a library of navigation illustrations stored in the memory based on the origin point or the destination point.

6. The method of claim 1, further comprising:

identifying the origin point based on a location of a mobile device including the controller.

7. The method of claim 1, further comprising:

if the comparison indicates that the first distance is farther from the viewer perspective than the second distance, then inserting at least one pixel of a line representing the route data without removing any image data.

8. The method of claim 1, further comprising:

selecting the pedestrian route data according to at least one pedestrian accessibility mode.

9. The method of claim 1, wherein the optical distancing system is a light detection and ranging (LIDAR) system.

10. The method of claim 1, wherein the optical distancing system emits structured infrared light.

20. The method of claim 1, wherein the navigation illustration is defined by a scale factor proportional to the second distance derived from the depth map.

11. An apparatus comprising:

a memory configured to store three dimensional geographic data correlated with pedestrian route data calculated from an origin point to a destination point; and

a controller configured to select an image correlated with a depth map and compare depth values for multiple pixel locations to a distance from a viewer perspective to the route data, wherein the controller is configured to insert a navigation illustration in the image at pixel locations where the depth values indicate that the pedestrian route data is closer than objects associated with the depth values.

12. The apparatus of claim 11, wherein the navigation illustration comprises an icon.

13. The apparatus of claim 11, wherein the navigation illustration comprises an indication of direction from the origin point to the destination point.

14. The apparatus of claim 11, further comprising:

position circuitry configured to generate the origin point based on a location of the apparatus.

15. The apparatus of claim 11, wherein the pedestrian route data is selected according to a pedestrian mode.

16. The apparatus of claim 11, wherein the optical distancing system is a light detection and ranging (LIDAR) system or a system that emits structured infrared light.

17. A non-transitory computer readable medium having stored thereon a computer program configured to provide three dimensional routing in a panoramic image, the program comprising instructions to:

receive the panoramic image including image data from a memory;

correlate, with a controller, the image data with a depthmap generated from an optical distancing system;

correlate, with the controller, the image data with pedestrian route data calculated from an origin point to a destination point using a geographical database;

transmit the panoramic image including a navigation illustration based on the pedestrian route data;

compare, with the controller, a first distance to a second distance, wherein the first distance is from a viewer perspective to a point correlated with the pedestrian route data, and the second distance is derived from the depth map at the point;

if the comparison indicates the route data is closer to the viewer perspective, then inserting a navigation icon into the image data; and

if the comparison indicates an object in the panoramic image is closer to the viewer perspective, then inserting a dotted line into the image data.

18. The non-transitory computer readable medium of claim 17, wherein the pedestrian route data is selected according to a pedestrian mode.

19. The non-transitory computer readable medium of claim 17, wherein the optical distancing system is a light detection and ranging (LIDAR) system or a system that emits structured infrared light.