Panoramic Images Within Driving Directions

• US 20090240431A1
• Filed: 03/24/2009
• Published: 09/24/2009
• Est. Priority Date: 03/24/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Szybalski, Andrew Timothy, Vincent, Luc, Lafon, Stephane, Chau, Stephen, Shao, Jie
• Granted Patent: US 8,428,873 B2
• Time in Patent Office: Days
• US Class Current: 701/208
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams

Abstract

Embodiments of the present invention enable displaying a plurality of driving direction steps that form a driving directions path between a start address and a destination address; receiving input selecting a driving direction step of said plurality of driving direction steps; and displaying a panoramic image of a geographic area where a driving action associated with said selected driving direction step would be performed by a driver. In other embodiments, the panoramic image is replaced and/or complemented with one or more of 3D models, full-motion video, full-motion video of 360 degrees images, and live feeds from video cameras to provide enhanced driving directions.

Claims

1. A method for displaying panoramic images within driving directions, comprising:

(a) displaying a plurality of driving direction steps that form a driving directions path between a start address and a destination address;

(b) receiving input selecting a driving direction step of said plurality of driving direction steps; and

(c) displaying a panoramic image of a geographic area where a driving action associated with said selected driving direction step would be performed by a driver.

2. The method of claim 1, wherein step (a) comprises displaying said plurality of driving direction steps using one or more of a map view and a driving directions panel.

3. The method of claim 2, wherein step (a) further comprises at least one of:

displaying a step-by-step list of said plurality of driving direction steps within said driving directions panel;

displaying a first visual indicator in association with said driving direction step in said driving directions panel, said first visual indicator indicating that a panoramic image is available for said driving direction step;

overlaying a graphical illustration of said plurality of driving direction steps on a road map that encompasses said plurality of driving direction steps within said map view; and

displaying a second visual indicator in association with said driving direction step within said map view.

4. The method of claim 3, wherein step (c) comprises displaying said panoramic image when at least one of said first visual indicator and second visual indicator is selected.

5. The method of claim 1, wherein step (c) comprises:

orienting said panoramic image such that said panoramic image shows said geographic area from a viewpoint of said driver performing said driving action.

6. The method of claim 1, further comprising:

(d) displaying a driving direction overlay associated with said driving direction step on said panoramic image.

7. The method of claim 1, further comprising:

(d) displaying a first navigation control on said panoramic image, wherein said first navigation control illustrates said driving action associated with said driving direction step.

8. The method of claim 7, further comprising:

(e) simulating said driving action when said first navigation control is selected, wherein simulating said driving action comprises;

changing an orientation of said panoramic image when no panoramic image is available for a directly adjacent geographic area in the direction of said first navigation control; and

displaying a panoramic image of said directly adjacent geographic area when a panoramic image is available for said directly adjacent geographic area.

9. The method of claim 1, wherein step (c) comprises displaying said panoramic image within a panoramic image bubble associated with said driving direction step.

10. The method of claim 9, wherein step (c) further comprises displaying one or more of:

(i) a driving direction text description that describes said driving action associated with said driving direction step;

(ii) a previous driving direction link;

(iii) a next driving direction link;

(iv) a driving direction step number that indicates an order of said driving direction within said plurality of driving direction steps;

(v) a zoom in link;

(vi) a help link; and

(vii) a full-screen mode link.

11. The method of claim 10, further comprising:

(d) displaying a panoramic image associated with a previous driving direction step when said previous driving direction link is selected;

(e) displaying a panoramic image associated with a next driving direction step when said next driving direction link is selected;

(f) displaying a zoomed in view of said map view when said zoom in link is selected; and

(g) displaying said panoramic image as a full-screen image when said full-screen mode link is selected.

12. The method of claim 10, further comprising:

displaying said previous driving direction link and said next driving direction link as disabled when no panoramic image is available for said previous driving direction step and said next driving direction step, respectively.

13. The method of claim 1, wherein the method is performed within any one of:

(i) a mobile handset;

(ii) a portable navigation device;

(iii) an in-car navigation device.

39. The method of claim 1, further comprising:

(d) receiving said plurality of driving direction steps from a driving directions server;

(e) receiving a plurality of panoramic images selected according to said driving directions path from a panorama server; and

(f) associating each of said plurality of panoramic images with one or more segments of said driving directions path.

40. The method of claim 39, wherein one or more of said segments of said driving directions path is associated with one or more of said driving direction steps.

41. The method of claim 39, wherein one or more of said segments of said driving directions path includes one or more of said driving direction steps.

42. The method of claim 39, wherein step (d) comprises receiving said plurality of driving direction steps from said driving directions server, encoded as a set of locations on a map.

43. The method of claim 42, wherein step (e) comprises receiving said plurality of panoramic images selected according to said set of locations from said panorama server.

44. The method of claim 1, further comprising:

(d) rendering one or more segments of a polyline representative of said driving directions path on said panoramic image when said panoramic image is sufficiently proximate to said driving directions path.

45. The method of claim 44, wherein said panoramic image is sufficiently proximate to said driving directions path when said panoramic image is within a specified distance from at least one of a vertex of said polyline and a segment of said polyline.

46. The method of claim 45, wherein a vertex of said polyline represents a driving direction step on said driving directions path represented by said polyline.

47. The method of claim 45, further comprising one or more of:

(e) determining the location of said panoramic image;

(f) determining a distance from the location of said panoramic image to a nearest vertex of said polyline;

(g) determining a distance from the location of said panoramic image to a nearest segment of said polyline;

(h) associating said panoramic image with said nearest vertex when said panoramic image is sufficiently close to said nearest vertex based on a specified distance;

(i) associating said panoramic image with said nearest segment of said polyline when said panoramic image is not sufficiently proximate to said nearest vertex but is sufficiently close to said nearest segment based on said specified distance; and

(j) when said panoramic image is sufficiently proximate to said driving directions path, determining said one or more segments of said polyline to render on said panoramic image.

48. The method of claim 47, wherein step (j) comprises:

(k) selecting a first segment and a second segment of said polyline, immediately adjacent to said nearest vertex to render on said panoramic image, when said panoramic image is associated with said nearest vertex of said polyline; and

(l) selecting a third segment and a fourth segment of said polyline both parallel to said nearest segment of said polyline to render on said panoramic image, when said panoramic image is associated with said nearest segment.

49. The method of claim 44, when said panoramic image is sufficiently proximate to said driving directions path, further comprising:

(e) determining if a next panoramic image from said panoramic image is sufficiently proximate to said driving directions path;

(f) when said next panoramic image is not sufficiently proximate to said driving directions path, rendering one or more segments of said polyline to indicate that the user has navigated off said driving directions path.

14. A system for displaying panoramic images within driving directions, comprising:

a driving directions module that displays a plurality of driving direction steps that form a driving directions path between a start address and a destination address and that receives input selecting a driving direction step of said plurality of driving direction steps; and

a panorama viewer that displays a panoramic image of a geographic area where a driving action associated with said selected driving direction step would be performed by a driver.

15. The system of claim 14, wherein said driving directions module further displays at least one of:

a step-by-step list of said plurality of driving direction steps within a driving directions panel;

a first visual indicator in association with said driving direction step in said driving directions panel, said first visual indicator indicating that a panoramic image is available for said driving direction step;

a graphical illustration of said plurality of driving direction steps on a road map that encompasses said plurality of driving direction steps within a map view; and

a second visual indicator in association with said driving direction step within said map view.

16. The system of claim 15, wherein said panorama viewer displays said panoramic image when at least one of said first visual indicator and second visual indicator is selected.

17. The system of claim 14, wherein said panorama viewer orients said panoramic image such that said panoramic image shows said geographic area from a similar viewpoint as that of said driver performing said driving action.

18. The system of claim 14, wherein said panorama viewer displays a driving direction overlay associated with said selected driving direction step on said panoramic image.

19. The system of claim 14, wherein said panorama viewer displays a first panoramic navigation control on said panoramic image, wherein said first panoramic navigation control illustrates said driving action associated with said selected driving direction step.

20. The system of claim 19, wherein said panorama viewer simulates said driving action when said first panoramic navigation control is selected, wherein said panorama viewer:

changes an orientation of said panoramic image when no panoramic image is available for a directly adjacent geographic area in the direction of said first navigation control; and

displays a panoramic image of said directly adjacent geographic area when a panoramic image is available for said directly adjacent geographic area.

21. The system of claim 14, wherein said panorama viewer displays said panoramic image within a panoramic image bubble associated with said driving direction step.

22. The system of claim 21, wherein said panorama viewer further displays one or more of:

(i) a driving direction text description that describes said driving action associated with said selected driving direction step;

(ii) a previous driving direction link;

(iii) a next driving direction link;

(iv) a driving direction step number that indicates an order of said selected driving direction step within said plurality of driving direction steps;

(v) a zoom in link;

(vi) a help link; and

(vii) a full-screen mode link.

23. The system of claim 22, wherein said panorama viewer further displays:

a panoramic image associated with a previous driving direction step when said previous driving direction link is selected;

a panoramic image associated with a next driving direction step when said next driving direction link is selected;

a zoomed in view of said map view when said zoom in link is selected; and

a full-screen image of said panoramic image when said full-screen mode link is selected.

24. The system of claim 22, wherein said panorama viewer displays said previous driving direction link and said next driving direction link as disabled when no image is available for said previous driving direction step and said next driving direction step, respectively.

25. The system of claim 14, wherein the system is within any one of:

(i) a mobile handset;

(ii) a portable navigation device;

(iii) an in-car navigation device.

50. The system of claim 14, wherein said driving directions module receives said plurality of driving direction steps from a driving directions server;

further comprising;

a first module that receives a plurality of panoramic images selected according to said driving directions path from a panorama server; and

a second module that associates each of said plurality of panoramic images with one or more segments of said driving directions path.

51. The system of claim 50, wherein one or more of said segments of said driving directions path is associated with one or more of said driving direction steps.

52. The system of claim 50, wherein one or more of said segments of said driving directions path includes one or more of said driving direction steps.

53. The system of claim 50, wherein said driving directions module receives said plurality of driving direction steps from said driving directions server, encoded as a set of locations on a map.

54. The system of claim 53, wherein said first module receives said plurality of panoramic images selected according to said set of locations from said panorama server.

55. The system of claim 14, wherein said panorama viewer renders one or more segments of a polyline representative of said driving directions path on said panoramic image when said panoramic image is sufficiently proximate to said driving directions path.

56. The system of claim 55, wherein said panoramic image is sufficiently proximate to said driving directions path when said panoramic image is within a specified distance from at least one of a vertex of said polyline and a segment of said polyline.

57. The system of claim 56, wherein a vertex of said polyline represents a driving direction step on said driving directions path represented by said polyline.

58. The system of claim 55, further comprising one or more third modules that:

determine the location of said panoramic image;

determine a distance from the location of said panoramic image to a nearest vertex of said polyline;

determine a distance from the location of said panoramic image to a nearest segment of said polyline;

associate said panoramic image with said nearest vertex when said panoramic image is sufficiently close to said nearest vertex based on a specified distance;

associate said panoramic image with said nearest segment of said polyline when said panoramic image is not sufficiently proximate to said nearest vertex but is sufficiently close to said nearest segment based on said specified distance; and

when said panoramic image is sufficiently proximate to said driving directions path, determine said one or more segments of said polyline to render on said panoramic image.

59. The system of claim 58, further comprising a fourth module that:

selects a first segment and a second segment of said polyline, immediately adjacent to said nearest vertex to render on said panoramic image, when said panoramic image is associated with said nearest vertex of said polyline; and

selects a third segment and a fourth segment of said polyline both parallel to said nearest segment of said polyline to render on said panoramic image, when said panoramic image is associated with said nearest segment.

60. The system of claim 55, when said panoramic image is sufficiently proximate to said driving directions path, wherein said one or more third modules determine if a next panoramic image from said panoramic image is sufficiently proximate to said driving directions path;

and

when said next panoramic image is not sufficiently proximate to said driving directions path, said panorama viewer renders one or more segments of said polyline to indicate that the user has navigated off said driving directions path.

26. A computer program product comprising a computer useable medium having computer program logic recorded thereon for enabling a processor to display panoramic images within driving directions, the computer program logic comprising:

first means for enabling a processor to display a plurality of driving direction steps that form a driving directions path between a start address and a destination address;

means for enabling a processor to receive input selecting a driving direction step of said plurality of driving direction steps; and

second means for enabling a processor to display a panoramic image of a geographic area where a driving action associated with said selected driving direction step would be performed by a driver.

27. The computer program product of claim 26, wherein said first means comprises means for enabling a processor to display said plurality of driving direction steps using one or more of a map view and a driving directions panel.

28. The computer program product of claim 27, wherein said first means further comprises at least one of:

means for enabling a processor to display a step-by-step list of said plurality of driving direction steps within said driving directions panel;

means for enabling a processor to display a first visual indicator in association with said driving direction step in said driving directions panel, said first visual indicator indicating that a panoramic image is available for said driving direction step;

means for enabling a processor to overlay a graphical illustration of said plurality of driving direction steps on a road map that encompasses said plurality of driving direction steps within said map view; and

means for enabling a processor to display a second visual indicator in association with said driving direction step within said map view.

29. The computer program product of claim 28, wherein said second means comprises means for enabling a processor to display said panoramic image when at least one of said first visual indicator and second visual indicator is selected.

30. The computer program product of claim 26, wherein said second means comprises:

means for enabling a processor to orient said panoramic image such that said panoramic image shows said geographic area from a viewpoint of said driver performing said driving action.

31. The computer program product of claim 26, further comprising:

means for enabling a processor to display a driving direction overlay associated with said driving direction step on said panoramic image.

32. The computer program product of claim 26, further comprising:

means for enabling a processor to display a first navigation control on said panoramic image, wherein said first navigation control illustrates said driving action associated with said driving direction step.

33. The computer program product of claim 32, further comprising:

means for enabling a processor to simulate said driving action when said first navigation control is selected, wherein said means for enabling a processor to simulate comprises;

means for enabling a processor to change an orientation of said panoramic image when no panoramic image is available for a directly adjacent geographic area in the direction of said first navigation control; and

means for enabling a processor to display a panoramic image of said directly adjacent geographic area when a panoramic image is available for said directly adjacent geographic area.

34. The computer program product of claim 26, wherein said second means comprises means for enabling a processor to display said panoramic image within a panoramic image bubble associated with said driving direction step.

35. The computer program product of claim 34, wherein said second means further comprises means for enabling a processor to display one or more of:

(i) a driving direction text description that describes said driving action associated with said driving direction step;

(ii) a previous driving direction link;

(iii) a next driving direction link;

(iv) a driving direction step number that indicates an order of said driving direction within said plurality of driving direction steps;

(v) a zoom in link;

(vi) a help link; and

(vii) a full-screen mode link.

36. The computer program product of claim 34, further comprising:

means for enabling a processor to display a panoramic image associated with a previous driving direction step when said previous driving direction link is selected;

means for enabling a processor to display a panoramic image associated with a next driving direction step when said next driving direction link is selected;

means for enabling a processor to display a zoomed in view of said map view when said zoom in link is selected; and

means for enabling a processor to display said panoramic image as a full-screen image when said full-screen mode link is selected.

37. The computer program product of claim 35, further comprising:

means for enabling a processor to display said previous driving direction link and said next driving direction link as disabled when no panoramic image is available for said previous driving direction step and said next driving direction step, respectively.

38. The computer program product of claim 26, wherein the computer program product is used within any one of:

(i) a mobile handset;

(ii) a portable navigation device;

(iii) an in-car navigation device.