SYSTEMS AND METHODS FOR IMAGE-FEATURE-BASED RECOGNITION
First Claim
1. A server for determining information relating to an image captured by a mobile device, the server comprising a processor for executing one or more modules comprising:
- a query receiving module for receiving, from the mobile device, a query including a plurality of query image feature descriptors associated with the captured image;
a candidate feature descriptors retrieval module for;
determining, for at least one of the query image feature descriptors, a plurality of first addresses using a plurality of functions, anddetermining, within an address space associated with the plurality of first addresses at a reference image database, a number of duplicate reference image feature descriptors, wherein a plurality of duplicates of at least one reference image feature descriptor is mapped using the plurality of functions to at least one second address at the reference image database;
a candidate images retrieval module for selecting one or more reference image feature descriptors based on the determined number of duplicate reference image feature descriptors;
wherein, based on the selected reference image feature descriptors, the server is further configured to perform the steps of;
determining information associated with the selected reference image feature descriptors, andproviding the information associated with the selected reference image feature descriptors to the mobile device.
4 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems are described herein that allow a user to capture a single image snapshot from video, print, or the world around him or her, and obtain additional information relating to the media itself or items of interest displayed in the snapshot. A fingerprint of the snapshot is used as a query and transmitted to the server. Image Feature-Based Recognition, as described herein, uses a feature index to identify a smaller set of candidate matches from a larger database of images based on the fingerprint. Novel methods and systems using a distance metric and a radical hash table design exploit probabilistic effects and allow distinct image features to be preferred over redundant ones, allowing only the more distinctive data points to remain resident within the index, yielding a lean index that can be quickly used in the identification process.
-
Citations
19 Claims
-
1. A server for determining information relating to an image captured by a mobile device, the server comprising a processor for executing one or more modules comprising:
-
a query receiving module for receiving, from the mobile device, a query including a plurality of query image feature descriptors associated with the captured image; a candidate feature descriptors retrieval module for; determining, for at least one of the query image feature descriptors, a plurality of first addresses using a plurality of functions, and determining, within an address space associated with the plurality of first addresses at a reference image database, a number of duplicate reference image feature descriptors, wherein a plurality of duplicates of at least one reference image feature descriptor is mapped using the plurality of functions to at least one second address at the reference image database; a candidate images retrieval module for selecting one or more reference image feature descriptors based on the determined number of duplicate reference image feature descriptors; wherein, based on the selected reference image feature descriptors, the server is further configured to perform the steps of; determining information associated with the selected reference image feature descriptors, and providing the information associated with the selected reference image feature descriptors to the mobile device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer-implemented method for determining information relating to an image captured by a mobile device, the method comprising:
-
receiving, from the mobile device, a query including a plurality of query image feature descriptors associated with the captured image; determining, for at least one of the query image feature descriptors, a plurality of first addresses using a plurality of functions; determining, within an address space associated with the plurality of first addresses at a reference image database, a number of duplicate reference image feature descriptors, wherein a plurality of duplicates of at least one reference image feature descriptor is mapped using the plurality of functions to at least a second address at the reference image database; selecting one or more reference image feature descriptors based on the determined number of duplicate reference image feature descriptors; determining information associated with the selected reference image feature descriptors; and providing the information associated with the selected reference image feature descriptors to the mobile device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A non-transitory computer-readable storage medium having stored thereon a program containing instructions that, when executed by a computer, cause the computer to execute a method for determining information relating to an image captured by a mobile device, the method comprising:
-
receiving, from the mobile device, a query including a plurality of query image feature descriptors associated with the captured image; determining, for at least one of the query image feature descriptors, a plurality of first addresses using a plurality of functions; determining, within an address space associated with the plurality of first addresses at a reference image database, a number of duplicate reference image feature descriptors, wherein a plurality of duplicates of at least one reference image feature descriptor is mapped using the plurality of functions to at least a second address at the reference image database; selecting one or more reference image feature descriptors based on the determined number of duplicate reference image feature descriptors; determining information associated with the selected reference image feature descriptors; and providing the information associated with the selected reference image feature descriptors to the mobile device.
-
Specification