Interactive digital map including context-based photographic imagery

• US 10,126,913 B1
• Filed: 11/05/2013
• Issued: 11/13/2018
• Est. Priority Date: 11/05/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Ho, Kelvin, Siegel, Jonathan, Leong, Su Chuin
• Primary Examiner(s): Merlino, David P.
• Application Number:
  US14/072,329
• Time in Patent Office: 1,834 Days
• Field of Search: None
• CPC Class Codes: G01C 21/3635 Guidance using 3D or perspective road maps
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

A mapping system presents geographically relevant images. The images may be relevant to a search entered by the user, directions requested by the user, or any other factor relevant to the user'"'"'s relationship to the displayed map. Moreover, the images may change in response to user actions or other factors, wherein new images “bubble up” as user context changes. The mapping system may display geographically relevant images by way of an information card presented in response to a user interacting with a point on a digital map. The user may interact with any of the geographically relevant images, causing an indicator of the map location associated with the image to be presented. Alternatively or additionally, a user interaction with a geographically relevant image may cause an interactive panoramic presentation of street-level imagery to be presented.

Claims

1. A method in a computing device for providing efficient access to interactive street-level imagery for geographic locations, the method comprising:

generating, by one or more processors, content for a digital map of a geographic area;

identifying, by the one or more processors, a current geographic context for the digital map corresponding to a plurality of current context signals indicative of a user'"'"'s relationship to the content of the digital map, the plurality of current context signals comprising at least one application-specific context signal and at least one general context signal, the at least one general context signal comprising traffic information;

generating, by the one or more processors, an extended geographic context in accordance with a plurality of extended context signals not explicitly provided for or defined by the plurality of current context signals, the plurality of extended context signals including viewport display information and a user preference, the viewport display information comprising at least one of a speed at which the viewport is moving and a direction at which the viewport is moving;

identifying, by the one or more processors, a plurality of relevant map objects in the digital map in accordance with the extended geographic context;

selecting, by the one or more processors, a plurality of street-level images, each street-level image being selected for incorporation as part of an information card associated with a corresponding one of the plurality of map objects for presentation with the digital map;

receiving, by the one or more processors, a selection of one of the plurality of map objects;

in response to the received selection, generating, by the one or more processors, the information card including the street-level image associated with the selected map object;

overlaying the information card on the digital map at a location remote from and not touching the selected map object;

receiving, by the one or more processors, a selection of the street-level image of the information card;

receiving, by the one or more processors, a request to activate an interactive panoramic presentation of street-level imagery corresponding to the selection of the street-level image of the information card; and

generating, by the one or more processors, the interactive panoramic presentation of street-level imagery by replacing the digital map and the information card overlaying a portion of the digital map.

2. The method of claim 1, wherein:

the plurality of current context signals includes a search query received from the user that specifies a set of one or more search terms; and

the plurality of extended context signals further includes one or more terms related to the search query.

3. The method of claim 1, wherein generating the interactive panoramic presentation of street-level imagery includes providing, by the one or more processors, a 3D walkthrough environment.

4. The method of claim 1, wherein the application-specific context signals include one or more selected from the group consisting of:

a map layer used for displaying the digital map;

a user interaction with the digital map; and

sensor information.

5. The method of claim 4, wherein the user interaction is a request for navigation entered by the user.

6. The method of claim 1, wherein the general context signals include one or more selected from the group consisting of:

(i) a current time and/or date;

(ii) user preferences;

(iii) user historical information;

(iv) event information;

(v) weather information; and

(vi) third-party information.

7. The method of claim 1, wherein the plurality of extended context signals includes at least one of a category of potential interest to the user or a preference of the user.

8. The method of claim 1, wherein identifying the plurality of relevant map objects includes rating a relevance of one or more map objects in accordance with the one or more map objects'"'"' relation to the extended geographic context.

9. The method of claim 8, wherein an object profile of each of the one or more map object includes at least one of:

(i) location coordinates of a particular map object;

(ii) a textual description of the particular map object;

(iii) a reference to a user-submitted photographic image of the particular map object;

(iv) a references to a user review related to the particular map object;

or

(v) a category tag assigned to the particular map object.

10. A non-transitory computer-readable medium storing thereon instructions for providing efficient access to interactive street-level imagery for geographic locations, wherein the instructions, when executed on one or more processors, cause a computing device to:

generate content for a digital map of a geographic area;

identify a current geographic context for the digital map corresponding to a plurality of current context signals indicative of a user'"'"'s relationship to content of the digital map, the plurality of current context signals comprising at least one application-specific context signal and at least one general context signal, the at least one general context signal comprising traffic information;

generate an extended geographic context in accordance with a plurality of extended context signals not explicitly provided for or defined by the plurality of current context signals, the plurality of extended context signals including viewport display information and a user preference, the viewport displaying information comprising at least one of a speed at which the viewport is moving and a direction at which the viewport is moving;

identify a plurality of relevant map objects in the digital map in accordance with the extended geographic context;

select a plurality of street-level images, each street-level image being selected for incorporation as part of an information card associated with a corresponding one of the plurality of map objects for presentation with the digital;

receive a selection of one of the plurality of map objects;

in response to the received selection, generate the information card including the street-level image associated with the selected map object;

overlay the information card on the digital map at a location remote from and not touching the selected map object;

receive a selection of the street-level image of the information card;

receive a request to activate an interactive panoramic presentation of street-level imagery corresponding to the selection of the street-level image of the information card; and

generate the interactive panoramic presentation of street-level imagery by replacing the digital map and the information card overlaying a portion of the digital map.

11. The computer-readable medium of claim 10, wherein:

the plurality of current context signals includes a search query received from the user that specifies a set of one or more search terms; and

the plurality of extended context signals further includes one or more terms related to the search query.

12. The computer-readable medium of claim 10, wherein generating the interactive panoramic presentation of street-level imagery includes providing a 3D walkthrough environment.

13. The computer-readable medium of claim 10, wherein identifying the plurality of relevant map objects includes determining relevance of one or more map objects in accordance with an object profile for each of the one or more map objects.

14. A system for providing efficient access to interactive street-level imagery for geographic locations, the system comprising:

one or more processors; and

a non-transitory computer-readable medium coupled to the one or more processors, the computer-readable medium storing thereon instructions that, when executed by at least one of the one or more processors, cause the at least one of the one or more processors to;

generate content for a digital map of a geographic area;

identify a current geographic context for the digital map corresponding to a plurality of current context signals indicative of a user'"'"'s relationship to content of the digital map, the plurality of current context signals comprising at least one application-specific context signal and at least one general context signals, the at least one general context signal comprising traffic information;

generate an extended geographic context in accordance with a plurality of extended context signals not explicitly provided for or defined by the plurality of current context signals, the plurality of extended context signals including viewport display information and a user preference, the viewport display information comprising at least one of a speed at which the viewport is moving and a direction at which the viewport is moving;

identify a plurality of relevant map objects in the digital map in accordance with the extended geographic context;

select a plurality of street-level images, each street-level image being selected for incorporation as part of an information card associated with a corresponding one of the plurality of map objects for presentation with the digital;

receive a selection of one of the plurality of map objects;

in response to the received selection, generate the information card including the street-level image associated with the selected map object;

overlay the information card on the digital map at a location remote from and not touching the selected map object;

receive a selection of the street-level image of the information card;

receive a request to activate an interactive panoramic presentation of street-level imagery corresponding to the selection of the street-level image of the information card; and

generate the interactive panoramic presentation of street-level imagery by replacing the digital map and the information card overlaying a portion of the digital map.

15. The system of claim 14, wherein:

the plurality of current context signals includes a search query received from the user that specifies a set of one or more search terms; and

the plurality of extended context signals further includes one or more terms related to the search query.

16. The system of claim 14, wherein the one or more processors are configured to generate the interactive panoramic presentation of street-level imagery by providing a 3D walkthrough environment.

17. The system of claim 14, wherein the one or more processors are configured to identify the plurality of relevant map objects by determining relevance of one or more map objects in accordance with an object profile for each of the one or more map objects.