Method and apparatus for recognizing and localizing landmarks from an image onto a map
First Claim
1. A method for recognizing landmark buildings shown in an input image and locating recognized landmark buildings on a map with related information, the method comprising:
- capturing a set of training images of one landmark building and learning a model of the landmark building from the set of training images;
determining similarity scores for image pairs of different ones of said training images;
clustering the training images into a set of prototypes based upon the similarity scores of said each pair of training images;
storing said set of models learned for a set of landmark buildings to a storage device to build a first model database, wherein each model of one landmark building from said set of landmark buildings has a record in said database indexed by an identifier code for said landmark building, and each prototype has a record in said database linked to the record of corresponding landmark building model;
capturing an input image of a candidate building;
calculating the similarity score between said input image and each model stored in the model database;
recognizing the building in said input image based on the largest value of the similarity scores between said input image and the models stored in the first database;
locating the recognized landmark building on an electronic map;
retrieving information related to the recognized landmark building from a second database operative under control of a processor circuit; and
displaying the related information of the recognized landmark building on a display device to an end user.
1 Assignment
0 Petitions
Accused Products
Abstract
Method and apparatus for recognizing landmark buildings in an image and then locating the recognized landmark buildings onto a map together with related information wherein a first database is employed to store models formed by mathematical set descriptions of landmark buildings which are learned from a set of training images of a model-learning module captured by an imaging device for each building, and a second database is employed to store the related information of each landmark building. The model of each landmark building is represented as a set of features and the geometric relationship between them by clustering the salient features extracted from a set of training images of the landmark building.
-
Citations
15 Claims
-
1. A method for recognizing landmark buildings shown in an input image and locating recognized landmark buildings on a map with related information, the method comprising:
-
capturing a set of training images of one landmark building and learning a model of the landmark building from the set of training images; determining similarity scores for image pairs of different ones of said training images; clustering the training images into a set of prototypes based upon the similarity scores of said each pair of training images; storing said set of models learned for a set of landmark buildings to a storage device to build a first model database, wherein each model of one landmark building from said set of landmark buildings has a record in said database indexed by an identifier code for said landmark building, and each prototype has a record in said database linked to the record of corresponding landmark building model; capturing an input image of a candidate building; calculating the similarity score between said input image and each model stored in the model database; recognizing the building in said input image based on the largest value of the similarity scores between said input image and the models stored in the first database; locating the recognized landmark building on an electronic map; retrieving information related to the recognized landmark building from a second database operative under control of a processor circuit; and displaying the related information of the recognized landmark building on a display device to an end user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system for recognizing landmark buildings in an image and for locating the recognized buildings on a map with related information, the system comprising:
-
at least one processor circuit and at least one storage, said circuit and storage configured for; learning models of landmark buildings from a set of training images stored in a first database operative under control of at the least one processor circuit, said learning for each landmark building comprising; determining a similarity score between each pair of the training images within said set; clustering the training images into a set of prototypes based on the similarity score of each pair of training images; and storing the set of prototypes to the at least one storage to build a model database of the landmark buildings for subsequent comparison with input images of candidate buildings; and at least one processor circuit, at least one storage and a display device configured for; inputting an image of a candidate building to the at least one processor circuit; calculating a similarity score of the input image to a model of each landmark building, said calculating comprising comparing local salient features extracted from the input image with local salient features of prototypes of landmark buildings stored in a model database, in order to recognize the landmark building; locating the recognized building on an electronic map; retrieving information related to the recognized building from a second database operative under control of the at least one processor circuit; and displaying the related information of the recognized landmark building on the display device to an end user. - View Dependent Claims (13)
-
-
14. An apparatus for use in a system for recognizing landmark buildings in an image and for locating the recognized buildings on a map with related information, the system comprising:
-
at least one processor circuit and at least one storage, said circuit and storage configured for; learning models of landmark buildings from a set of training images stored in a first database operative under control of at the least one processor circuit, said learning for each landmark building comprising; determining a similarity score between each pair of the training images within said set; clustering the training images into a set of prototypes based on the similarity score of each pair of training images; and storing the set of prototypes to the at least one storage to build a model database of the landmark buildings for subsequent comparison with input images of candidate buildings; and at least one processor circuit, at least one storage and a display device configured for; inputting an image of a candidate building to the at least one processor circuit; calculating a similarity score of the input image to a model of each landmark building, said calculating comprising comparing local salient features extracted from the input image with local salient features of prototypes of landmark buildings stored in a model database, in order to recognize the landmark building; locating the recognized building on an electronic map; retrieving information related to the recognized building from a second database operative under control of the at least one processor circuit; and displaying the related information of the recognized landmark building on the display device to an end user.
-
-
15. An apparatus for use in a system for recognizing landmark buildings in an image and for locating the recognized buildings on a map with related information, the system comprising:
-
at least one processor circuit and at least one storage, said circuit and storage configured for; capturing a set of training images of one landmark building and learning a model of the landmark building from the set of training images; determining similarity scores for image pairs of different ones of said training images; clustering the training images into a set of prototypes based upon the similarity scores of said each pair of training images; storing said set of models learned for a set of landmark buildings to a storage device to build a first model database, wherein each model of one landmark building from said set of landmark buildings has a record in said database indexed by an identifier code for said landmark building, and each prototype has a record in said database linked to the record of corresponding landmark building model; inputting an input image of a candidate building; calculating the similarity score between said input image and each model stored in the first model database; recognizing the building in said input image based on the closest value of the similarity scores between said input image and the models stored in the first model database; locating the recognized landmark building on an electronic map; retrieving information related to the recognized landmark building from a second database operative under control of a processor circuit; and providing the related information of the recognized landmark building to an end user.
-
Specification