Panoramic images within driving directions

• US 8,428,873 B2
• Filed: 03/24/2009
• Issued: 04/23/2013
• Est. Priority Date: 03/24/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Chau, Stephen, Lafon, Stephane, Shao, Jie, Szybalski, Andrew Timothy, Vincent, Luc
• Primary Examiner(s): Misiaszek, Michael
• Application Number:
  US12/410,033
• Publication Number:
  US 20090240431A1
• Time in Patent Office: 1,491 Days
• Field of Search: 701200-226, 701400-541
• US Class Current: 701/436
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams

Abstract

Embodiments of the present invention enable displaying a plurality of driving direction steps that form a driving directions path between a start address and a destination address; receiving input selecting a driving direction step of said plurality of driving direction steps; and displaying a panoramic image of a geographic area where a driving action associated with said selected driving direction step would be performed by a driver. In other embodiments, the panoramic image is replaced and/or complemented with one or more of 3D models, full-motion video, full-motion video of 360 degrees images, and live feeds from video cameras to provide enhanced driving directions.

Claims

1. A method for displaying panoramic images within driving directions, comprising:

(a) displaying a plurality of driving direction steps that form a driving directions path between a start address and a destination address;

(b) receiving user input selecting a driving direction step of the plurality of driving direction steps;

(c) displaying a panoramic image of a geographic area where a driving action associated with the selected driving direction step would be performed by a driver;

(d) displaying a first navigation control on the panoramic image, wherein the first navigation control illustrates the driving action associated with the driving direction step;

(e) simulating the driving action when the first navigation control is selected;

(f) determining that the panoramic image is sufficiently proximate to the driving directions path based on a polyline representative of the driving directions path, the polyline including one or more segments and one or more vertices; and

(g) determining whether the sufficient proximity of the panoramic image to the driving directions path is based on a nearest vertex of the one or more vertices of the polyline, or on a nearest segment of the one or more segments of the polyline;

(h) in a case where the sufficient proximity is based on the nearest vertex, rendering a first segment and a second segment of the polyline, adjacent to the nearest vertex, on the panoramic image; and

(i) in a case where the sufficient proximity corresponds to the nearest segment, rendering a third segment and a fourth segment of the polyline, both parallel to the nearest segment, on the panoramic image.

2. The method of claim 1, wherein step (a) comprises displaying the plurality of driving direction steps using one or more of a map view and a driving directions panel.

3. The method of claim 2, wherein step (a) further comprises at least one of:

displaying a step-by-step list of the plurality of driving direction steps within the driving directions panel;

displaying a first visual indicator in association with the driving direction step in the driving directions panel, the first visual indicator indicating that a panoramic image is available for the driving direction step;

overlaying a graphical illustration of the plurality of driving direction steps on a road map that encompasses the plurality of driving direction steps within the map view; and

displaying a second visual indicator in association with the driving direction step within the map view.

4. The method of claim 3, wherein step (a) comprises displaying the first visual indicator and second visual indicator, and wherein step (c) comprises displaying the panoramic image when at least one of the first visual indicator and second visual indicator is selected.

5. The method of claim 1, wherein step (c) comprises:

orienting the panoramic image such that the panoramic image shows the geographic area from a viewpoint of the driver performing the driving action.

6. The method of claim 1, further comprising:

displaying a driving direction overlay associated with the driving direction step on the panoramic image.

7. The method of claim 1, wherein simulating the driving action comprises:

changing an orientation of the panoramic image when no panoramic image is available for a directly adjacent geographic area in the direction of the first navigation control; and

displaying a panoramic image of the directly adjacent geographic area when a panoramic image is available for the directly adjacent geographic area.

8. The method of claim 1, wherein step (c) comprises displaying the panoramic image within a panoramic image bubble associated with the driving direction step.

9. The method of claim 8, wherein step (c) further comprises displaying one or more of:

(i) a driving direction text description that describes the driving action associated with the driving direction step;

(ii) a previous driving direction link;

(iii) a next driving direction link;

(iv) a driving direction step number that indicates an order of the driving direction within the plurality of driving direction steps;

(v) a zoom in link;

(vi) a help link; and

(vii) a full-screen mode link.

10. The method of claim 9, further comprising:

displaying a panoramic image associated with a previous driving direction step when the previous driving direction link is selected;

displaying a panoramic image associated with a next driving direction step when the next driving direction link is selected;

displaying a zoomed in view of the map view when the zoom in link is selected; and

displaying the panoramic image as a full-screen image when the full-screen mode link is selected.

11. The method of claim 9, wherein step (c) comprises displaying the previous driving direction link and next driving direction link, the method further comprising:

displaying the previous driving direction link and the next driving direction link as disabled when no panoramic image is available for the previous driving direction step and the next driving direction step, respectively.

12. The method of claim 1, wherein the method is performed within any one of:

(i) a mobile handset;

(ii) a portable navigation device;

(iii) an in-car navigation device.

36. The method of claim 1, further comprising:

(d) receiving the plurality of driving direction steps from a driving directions server;

(e) receiving a plurality of panoramic images selected according to the driving directions path from a panorama server; and

(f) associating each of the plurality of panoramic images with one or more segments of the driving directions path.

37. The method of claim 36, wherein one or more of the segments of the driving directions path is associated with one or more of the driving direction steps.

38. The method of claim 36, wherein one or more of the segments of the driving directions path includes one or more of the driving direction steps.

39. The method of claim 36, wherein step (d) comprises receiving the plurality of driving direction steps from the driving directions server, encoded as a set of locations on a map.

40. The method of claim 39, wherein step (e) comprises receiving the plurality of panoramic images selected according to the set of locations from the panorama server.

41. The method of claim 1, wherein said the panoramic image is sufficiently proximate to the driving directions path when the panoramic image is within a specified distance from at least one of a vertex of the polyline and a segment of the polyline.

42. The method of claim 41, wherein a vertex of the polyline represents a driving direction step on the driving directions path represented by the polyline.

43. The method of claim 1, wherein the panoramic image is sufficiently proximate to the driving directions path, further comprising:

(e) determining if a next panoramic image from said panoramic image is sufficiently proximate to the driving directions path;

(f) when the next panoramic image is not sufficiently proximate to the driving directions path, rendering one or more segments of the polyline to indicate that the user has navigated off the driving directions path.

13. A system for displaying panoramic images within driving directions, comprising:

a processor;

a driving directions module that displays a plurality of driving direction steps that form a driving directions path between a start address and a destination address and that receives user input selecting a driving direction step of the plurality of driving direction steps; and

a panorama viewer that displays a panoramic image of a geographic area where a driving action associated with the selected driving direction step would be performed by a driver,

wherein the panorama viewer further displays a first panoramic navigation control on the panoramic image, wherein the first panoramic navigation control illustrates the driving action associated with the selected driving direction step, and simulates the driving action when the first panoramic navigation control is selected, and

wherein the panorama viewer renders one or more segments of a polyline representative of the driving directions path on the panoramic image when the panoramic image is sufficiently proximate to the driving directions path;

one or more first modules that;

determine the location of the panoramic image;

determine a distance from the location of the panoramic image to a nearest vertex of the polyline;

determine a distance from the location of the panoramic image to a nearest segment of the polyline;

associate the panoramic image with the nearest vertex when the panoramic image is sufficiently close to the nearest vertex based on a specified distance;

associate the panoramic image with the nearest segment of the polyline when the panoramic image is not sufficiently proximate to the nearest vertex but is sufficiently close to the nearest segment based on the specified distance;

wherein

when the panoramic image is sufficiently proximate to the driving directions path, determine the one or more segments of the polyline to render on the panoramic image; and

a second module that;

selects a first segment and a second segment of the polyline, immediately adjacent to the nearest vertex to render on the panoramic image, when the panoramic image is associated with the nearest vertex of the polyline; and

selects a third segment and a fourth segment of the polyline both parallel to the nearest segment of the polyline to render on the panoramic image, when the panoramic image is associated with the nearest segment.

14. The system of claim 13, wherein the driving directions module further displays at least one of:

a step-by-step list of the plurality of driving direction steps within a driving directions panel;

a first visual indicator in association with the driving direction step in the driving directions panel, the first visual indicator indicating that a panoramic image is available for the driving direction step;

a graphical illustration of the plurality of driving direction steps on a road map that encompasses the plurality of driving direction steps within a map view; and

a second visual indicator in association with the driving direction step within the map view.

15. The system of claim 14, wherein the driving directions module displays the first visual indicator and second visual indicator, and wherein the panorama viewer displays the panoramic image when at least one of the first visual indicator and second visual indicator is selected.

16. The system of claim 13, wherein the panorama viewer orients the panoramic image such that the panoramic image shows the geographic area from a similar viewpoint as that of the driver performing the driving action.

17. The system of claim 13, wherein the panorama viewer displays a driving direction overlay associated with the selected driving direction step on the panoramic image.

18. The system of claim 13, wherein the panorama viewer simulates the driving action by changing an orientation of the panoramic image when no panoramic image is available for a directly adjacent geographic area in the direction of the first navigation control;

and

displaying a panoramic image of the directly adjacent geographic area when a panoramic image is available for the directly adjacent geographic area.

19. The system of claim 13, wherein the panorama viewer displays the panoramic image within a panoramic image bubble associated with the driving direction step.

20. The system of claim 19, wherein the panorama viewer further displays one or more of:

(i) a driving direction text description that describes the driving action associated with the selected driving direction step;

(ii) a previous driving direction link;

(iii) a next driving direction link;

(iv) a driving direction step number that indicates an order of the selected driving direction step within the plurality of driving direction steps;

(v) a zoom in link;

(vi) a help link; and

(vii) a full-screen mode link.

21. The system of claim 20, wherein the panorama viewer further displays:

a panoramic image associated with a previous driving direction step when the previous driving direction link is selected;

a panoramic image associated with a next driving direction step when the next driving direction link is selected;

a zoomed in view of the map view when the zoom in link is selected; and

a full-screen image of the panoramic image when the full-screen mode link is selected.

22. The system of claim 20, wherein the panorama viewer displays the previous driving direction link and next driving direction link, and wherein the panorama viewer displays the previous driving direction link and the next driving direction link as disabled when no image is available for the previous driving direction step and the next driving direction step, respectively.

23. The system of claim 13, wherein the system is within any one of:

(i) a mobile handset;

(ii) a portable navigation device;

(iii) an in-car navigation device.

44. The system of claim 13, wherein the driving directions module receives the plurality of driving direction steps from a driving directions server;

further comprising;

a third module that receives a plurality of panoramic images selected according to the driving directions path from a panorama server; and

a fourth module that associates each of the plurality of panoramic images with one or more segments of the driving directions path.

45. The system of claim 44, wherein one or more of the segments of the driving directions path is associated with one or more of the driving direction steps.

46. The system of claim 44, wherein one or more of the segments of the driving directions path includes one or more of the driving direction steps.

47. The system of claim 44, wherein the driving directions module receives the plurality of driving direction steps from the driving directions server, encoded as a set of locations on a map.

48. The system of claim 47, wherein the third module receives v plurality of panoramic images selected according to the set of locations from the panorama server.

49. The system of claim 13, wherein the panoramic image is sufficiently proximate to the driving directions path when the panoramic image is within a specified distance from at least one of a vertex of the polyline and a segment of the polyline.

50. The system of claim 49, wherein a vertex of the polyline represents a driving direction step on the driving directions path represented by the polyline.

51. The system of claim 13, wherein the panoramic image is sufficiently proximate to the driving directions path, wherein the one or more first modules determine if a next panoramic image from the panoramic image is sufficiently proximate to the driving directions path;

and when the next panoramic image is not sufficiently proximate to the driving directions path, the panorama viewer renders one or more segments of the polyline to indicate that the user has navigated off the driving directions path.

24. A computer program product comprising a non-transitory computer useable medium having computer program logic recorded thereon for enabling a processor to display panoramic images within driving directions, the computer program logic comprising:

first means for enabling a processor to display a plurality of driving direction steps that form a driving directions path between a start address and a destination address;

means for enabling a processor to receive user input selecting a driving direction step of the plurality of driving direction steps;

second means for enabling a processor to display a panoramic image of a geographic area where a driving action associated with the selected driving direction step would be performed by a driver,

means for enabling a processor to display a first navigation control on the panoramic image, wherein the first navigation control illustrates the driving action associated with the driving direction step;

means for enabling a processor to simulate the driving action when said first navigation control is selected; and

means for enabling a processor to render one or more segments of a polyline, which is representative of the driving directions path and which includes one or more segments and one or more vertices, on the panoramic image when the panoramic image is sufficiently proximate to the driving directions path, by;

determining that the panoramic image is sufficiently proximate to the driving directions path based on the polyline;

determining whether the sufficient proximity of the panoramic image to the driving directions path is based on a nearest vertex of the one or more vertices of the polyline, or on a nearest segment of the one or more segments of the polyline;

in a case where the sufficient proximity is based on the nearest vertex, rendering a first segment and a second segment of the polyline, adjacent to the nearest vertex, on the panoramic image; and

in a case where the sufficient proximity corresponds to the nearest segment, rendering a third segment and a fourth segment of the polyline, both parallel to the nearest segment, on the panoramic image.

25. The computer program product of claim 24, wherein the first means comprises means for enabling a processor to display the plurality of driving direction steps using one or more of a map view and a driving directions panel.

26. The computer program product of claim 25, wherein the first means further comprises at least one of:

means for enabling a processor to display a step-by-step list of the plurality of driving direction steps within the driving directions panel;

means for enabling a processor to display a first visual indicator in association with the driving direction step in the driving directions panel, the first visual indicator indicating that a panoramic image is available for the driving direction step;

means for enabling a processor to overlay a graphical illustration of the plurality of driving direction steps on a road map that encompasses the plurality of driving direction steps within the map view; and

means for enabling a processor to display a second visual indicator in association with the driving direction step within the map view.

27. The computer program product of claim 26, wherein the second means comprises means for enabling a processor to display the panoramic image when at least one of the first visual indicator and second visual indicator is selected.

28. The computer program product of claim 24, wherein the second means comprises:

means for enabling a processor to orient the panoramic image such that the panoramic image shows the geographic area from a viewpoint of the driver performing the driving action.

29. The computer program product of claim 24, further comprising:

means for enabling a processor to display a driving direction overlay associated with the driving direction step on the panoramic image.

30. The computer program product of claim 24, wherein the means for enabling a processor to simulate comprises:

means for enabling a processor to change an orientation of the panoramic image when no panoramic image is available for a directly adjacent geographic area in the direction of the first navigation control; and

means for enabling a processor to display a panoramic image of the directly adjacent geographic area when a panoramic image is available for the directly adjacent geographic area.

35. The computer program product of claim 24, wherein the computer program product is used within any one of:

(i) a mobile handset;

(ii) a portable navigation device;

(iii) an in-car navigation device.

31. The computer program product of 24, wherein the second means comprises means for enabling a processor to display the panoramic image within a panoramic image bubble associated with the driving direction step.

32. The computer program product of claim 31, wherein the second means further comprises means for enabling a processor to display one or more of:

(i) a driving direction text description that describes the driving action associated with the driving direction step;

(ii) a previous driving direction link;

(iii) a next driving direction link;

(iv) a driving direction step number that indicates an order of the driving direction within the plurality of driving direction steps;

(v) a zoom in link;

(vi) a help link; and

(vii) a full-screen mode link.

33. The computer program product of claim 32, further comprising:

means for enabling a processor to display a panoramic image associated with a previous driving direction step when the previous driving direction link is selected;

means for enabling a processor to display a panoramic image associated with a next driving direction step when the next driving direction link is selected;

means for enabling a processor to display a zoomed in view of the map view when the zoom in link is selected; and

means for enabling a processor to display the panoramic image as a full-screen image when the full-screen mode link is selected.

34. The computer program product of claim 32, further comprising:

means for enabling a processor to display the previous driving direction link and the next driving direction link as disabled when no panoramic image is available for the previous driving direction step and the next driving direction step, respectively.