Street-level guidance via route path

• US 9,638,538 B2
• Filed: 10/14/2014
• Issued: 05/02/2017
• Est. Priority Date: 10/14/2014
• Status: Active Grant

• Current Assignee: Uber Technologies, Inc.
• Original Assignee: Uber Technologies, Inc.
• Inventors: Otero Diaz, Ana Lilia, Lee, Hae Jin, Cabrera-Cordon, Luis Eduardo, Kim, Doyop
• Primary Examiner(s): Nguyen, John Q
• Assistant Examiner(s): ODEH, NADEEM N
• Application Number:
  US14/514,227
• Publication Number:
  US 20160102992A1
• Time in Patent Office: 931 Days
• Field of Search: 701436, 701437, 701532
• CPC Class Codes: G01C 21/3423 Multimodal routing, i.e. combining two or more modes of transportation, where the modes can be any of, e.g. driving, walking, cycling, public transport
• CPC Class Codes: G01C 21/3635 Guidance using 3D or perspective road maps
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G01C 21/3667 Display of a road map G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635
• CPC Class Codes: G01C 21/3673 Labelling using text of road map data items, e.g. road names, POI names
• CPC Class Codes: G01C 21/3676 Overview of the route on the road map

Abstract

A street-level view can realistically reflect that objects occlude depicted route paths. Such objects can include guardrails, buildings, or any of a variety of other objects as described herein. A superior user experience that portrays route paths while taking real-world geometry into account can result.

Claims

1. A computer-implemented method comprising:

accessing a digital map, the map representing locations and including information about the represented locations;

the information further including a scene depiction and geometry associated with the scene depiction;

determining a location of a viewpoint associated with a mobile device;

generating a street-level view depicting a scene from a perspective of the location of the viewpoint according to the digital map;

determining a route path between a starting point and a destination; and

generating a depiction of the route path by;

superimposing the route path over the street-level view;

determining that an object of varying thickness is situated between the viewpoint and the route path based on the information included in the digital map;

responsive to determining the object is situated between the viewpoint and the route path, determining a portion of the route path to be occluded by the object; and

displaying the depiction of the route path superimposed over the street-level view on the mobile device, the displayed route path occluded by the object at the determined portion, the occlusion varying according to the varying thickness of the object.

2. The method of claim 1 wherein:

the route path comprises a turn; and

the occluded portion of the depiction of the route path is beyond the turn.

3. The method of claim 1 further comprising:

depicting a street name on an un-occluded portion of the depicted route path for a street onto which the route path turns.

4. The method of claim 1 further comprising:

depicting a visual device other than the route path at a tum location where the route path turns;

wherein at least a portion of the visual device is depicted as occluded by a second object situated between the viewpoint and the visual device in the scene.

5. The method of claim 1 further comprising:

determining whether the mobile device is approaching the scene by comparing a current location of the mobile device to a scene location of the scene; and

responsive to determining that the current location of the mobile device is approaching the scene, displaying the street-level view of the scene.

6. The method of claim 1 wherein:

the stored geometry is based on a lidar scan of a geographical location associated with the scene.

7. The method of claim 1 further comprising:

generating and depicting a street-level view of a destination of the route path, wherein the street-level view of the destination comprises a graphical indication as to on which side of a street the destination lies.

8. The method of claim 1 wherein:

the route path is portrayed as part of step-by-step route directions; and

the step-by-step route directions comprise a sequential list, and the sequential list comprises at least one other street-level view comprising a second portion of the route path depicted as occluded by a second object.

9. The method of claim 1 wherein the object comprises:

a building;

a guardrail;

terrain;

a fence;

or a vehicle.

10. The computer implemented method of claim 1, wherein the generating a depiction of the route path further comprises determining from the digital map the varying thickness of the object, and a degree of the occlusion increases with the varying thickness of the object.

11. The computer-implemented method of claim 10, wherein the object is displayed with partial opacity, and a degree of opacity and the degree of the occlusion increase with the varying thickness of the object.

12. A system comprising:

one or more non-transitory computer-readable media storing a digital map representing locations and including information about street-level views, wherein the information comprises scene depictions associated with the street-level views and geometries associated with the street-level views;

a street-level view generator comprising a processor configured to;

determine a location of a viewpoint associated with a mobile device;

generate a street-level view depicting a scene from a perspective of the location of the viewpoint according to the digital map;

determine a route path between a starting location and a destination location; and

generate a depiction of the route path by;

superimposing the route path over the street-level view;

determining that an object of varying thickness is situated between the viewpoint and the route path based on information included in the digital map;

responsive to determining the object is situated between the viewpoint and the route path, determining a portion of the route path to be occluded by the object;

and display the depiction of the route path superimposed over the street-level view on the mobile device, the displayed route path occluded by the object at the determined portion, the occlusion varying according to the varying thickness of the object.

13. The system of claim 12 wherein:

the viewpoint comprises a current location of the mobile device on which the street-level view is displayed.

14. The system of claim 12, wherein the generating a depiction of the route path further comprises determining from the digital map the varying thickness of the object, and a degree of the occlusion increases with the varying thickness of the object.

15. The system of claim 14, wherein the object is displayed with partial opacity, and a degree of opacity and the degree of the occlusion increase with the varying thickness of the object.

16. The system of claim 12, wherein:

the route path comprises a turn; and

the occluded portion of the depiction of the route path is beyond the turn.

17. The system of claim 12 wherein:

the stored geometry is based on a lidar scan of a geographical location associated with the scene.

18. The system of claim 12, wherein

the route path is portrayed as part of step-by-step route directions;

and

the step-by-step route directions comprise a sequential list, and the sequential list comprises at least one other street-level view comprising a second portion of the route path depicted as occluded by a second object.

19. The system of claim 12 wherein the processor is further configured to:

depict a visual device other than the route path at a turn location where the route path turns;

wherein at least a portion of the visual device is depicted as occluded by a second object situated between the viewpoint and the visual device in the scene.

20. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform steps comprising:

accessing a map, the map representing locations and including information about the represented locations, the information further including a scene depiction and geometry associated with the scene depiction;

determining a location of a viewpoint associated with a mobile device;

generating a street-level view depicting a scene from a perspective of the location of the viewpoint according to the map;

determining a route path between a starting point and a destination; and

generating a depiction of the route path by;

superimposing the route path over the street-level view;

determining that an object of varying thickness is situated between the viewpoint and the route path based on the information included in the map;

responsive to determining the object is situated between the viewpoint and the route path, determining a portion of the route path to be occluded by the object; and

displaying the depiction of the route path superimposed over the street-level view on the mobile device, the displayed route path occluded by the object at the determined portion, the occlusion varying according to the varying thickness of the object.