Automatic discovery of popular landmarks

• US 8,676,001 B2
• Filed: 05/12/2008
• Issued: 03/18/2014
• Est. Priority Date: 05/12/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Brucher, Fernando A., Buddemeier, Ulrich, Adam, Hartwig, Neven, Hartmut
• Primary Examiner(s): Wu, Jingge
• Application Number:
  US12/119,359
• Publication Number:
  US 20090279794A1
• Time in Patent Office: 2,136 Days
• Field of Search: 382305-306, 707626-633
• US Class Current: 382/306
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 7/08 Sorting, i.e. grouping record carriers in numerical or other ordered sequence according to the classification of at least some of the information they carry by merging two or more sets of carriers in ordered sequence G06F7/16
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85

Abstract

In one embodiment the present invention is a method for populating and updating a database of images of landmarks including geo-clustering geo-tagged images according to geographic proximity to generate one or more geo-clusters, and visual-clustering the one or more geo-clusters according to image similarity to generate one or more visual clusters. In another embodiment, the present invention is a system for identifying landmarks from digital images, including the following components: a database of geo-tagged images; a landmark database; a geo-clustering module; and a visual clustering module. In other embodiments the present invention may be a method of enhancing user queries to retrieve images of landmarks, or a method of automatically tagging a new digital image with text labels.

Claims

1. A method for populating and updating a database of images of landmarks comprising:

(a) geo-clustering geo-tagged images according to geographic proximity and irrespective of tags other than tags having geo-location codes or unique user identifiers associated with the geo-tagged images to generate one or more geo-clusters, wherein the geographic proximity is determined based upon geo-location codes of the respective geo-tagged images; and

(b) visual-clustering respective ones of the generated one or more geo-clusters according to image similarity to generate one or more visual clusters for each of the generated one or more geo-clusters, wherein the generated one or more geo-clusters are input to the visual clustering without being selected using tags other than tags having geo-location codes or unique user identifiers,

wherein said visual-clustering includes selecting visual clusters based on a region graph, wherein each node of the region graph corresponds to a respective image from the one or more geo-clusters and a link between two nodes of the region graph represents at least one matching feature between the respective images corresponding to the two nodes, and wherein respective connected subtrees of the region graph are selected as visual clusters.