Matching an approximately located query image against a reference image set
First Claim
1. A computer-implemented method comprising:
- obtaining, using one or more computing devices, (i) an image of an object, and (ii) data indicating an uncorrected location associated with the image;
selecting, using the one or more computing devices, a particular geographic area based on the uncorrected location associated with the image;
identifying, using the one or more computing devices, from among a collection of reference images that are each associated with a respective location, a first subset of the reference images (i) that are each associated with a respective geo-location within the particular geographic area that is selected based on the uncorrected location associated with the image, and (ii) against which the obtained image of the object are to be compared;
identifying, using the one or more computing devices and based on comparing the obtained image to one or more reference images of the first subset of reference images, a second subset of the first subset of reference images that are classified as images of the object;
generating, using the one or more computing devices, a corrected location to associate with the image of the object based on one or more of the respective geo-locations associated with the reference images of the second subset; and
providing, using the one or more computing devices, a request for information about the object in the image, wherein the request includes (i) the image of the object, and (ii) data indicating the corrected location associated with the image.
2 Assignments
0 Petitions
Accused Products
Abstract
Aspects of the invention pertain to matching a selected image/photograph against a database of reference images having location information. The image of interest may include some location information itself, such as latitude/longitude coordinates and orientation. However, the location information provided by a user'"'"'s device may be inaccurate or incomplete. The image of interest is provided to a front end server, which selects one or more cells to match the image against. Each cell may have multiple images and an index. One or more cell match servers compare the image against specific cells based on information provided by the front end server. An index storage server maintains index data for the cells and provides them to the cell match servers. If a match is found, the front end server identifies the correct location and orientation of the received image, and may correct errors in an estimated location of the user device.
81 Citations
20 Claims
-
1. A computer-implemented method comprising:
-
obtaining, using one or more computing devices, (i) an image of an object, and (ii) data indicating an uncorrected location associated with the image; selecting, using the one or more computing devices, a particular geographic area based on the uncorrected location associated with the image; identifying, using the one or more computing devices, from among a collection of reference images that are each associated with a respective location, a first subset of the reference images (i) that are each associated with a respective geo-location within the particular geographic area that is selected based on the uncorrected location associated with the image, and (ii) against which the obtained image of the object are to be compared; identifying, using the one or more computing devices and based on comparing the obtained image to one or more reference images of the first subset of reference images, a second subset of the first subset of reference images that are classified as images of the object; generating, using the one or more computing devices, a corrected location to associate with the image of the object based on one or more of the respective geo-locations associated with the reference images of the second subset; and providing, using the one or more computing devices, a request for information about the object in the image, wherein the request includes (i) the image of the object, and (ii) data indicating the corrected location associated with the image. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising:
one or more computing devices and one or more storage devices storing instructions that are operable, when executed by the one or more computing devices, to cause the one or more computing devices to perform operations comprising; obtaining (i) an image of an object, and (ii) data indicating an uncorrected location associated with the image; selecting a particular geographic area based on the uncorrected location associated with the image; identifying from among a collection of reference images that are each associated with a respective location, a first subset of the reference images (i) that are each associated with a respective geo-location within the particular geographic area that is selected based on the uncorrected location associated with the image, and (ii) against which the obtained image of the object are to be compared; identifying, based on comparing the obtained image to one or more reference images of the first subset of reference images, a second subset of the first subset of reference images that are classified as images of the object; generating a corrected location to associate with the image of the object based on one or more of the respective geo-locations associated with the reference images of the second subset; and providing a request for information about the object in the image, wherein the request includes (i) the image of the object, and (ii) data indicating the corrected location associated with the image. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
15. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computing devices which, upon such execution, cause the one or more computing devices to perform operations comprising:
-
obtaining (i) an image of an object, and (ii) data indicating an uncorrected location associated with the image; selecting a particular geographic area based on the uncorrected location associated with the image; identifying from among a collection of reference images that are each associated with a respective location, a first subset of the reference images (i) that are each associated with a respective geo-location within the particular geographic area that is selected based on the uncorrected location associated with the image, and (ii) against which the obtained image of the object are to be compared; identifying, based on comparing the obtained image to one or more reference images of the first subset of reference images, a second subset of the first subset of reference images that are classified as images of the object; generating a corrected location to associate with the image of the object based on one or more of the respective geo-locations associated with the reference images of the second subset; and providing a request for information about the object in the image, wherein the request includes (i) the image of the object, and (ii) data indicating the corrected location associated with the image. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification