Systems and methods for image-feature-based recognition
First Claim
1. A server for identifying and transmitting to a mobile device additional information relating to a query image obtained by a user with a mobile device, the server comprising:
- a reference image database storing one or more reference feature descriptors associated with one or more reference images, wherein at least one reference image feature descriptor is mapped to a plurality of first addresses within an address space in the reference image database using a plurality of functions, and wherein the plurality of functions is configured to map one or more feature descriptors to the same address space; and
a processor for executing one or more modules comprising;
a query receiving module for receiving, from the mobile device, a first query including one or more query image feature descriptors;
a candidate feature descriptors retrieval module for;
calculating, for each of the one or more query image feature descriptors, a plurality of second addresses using the plurality of functions, andfor each of the plurality of second addresses, determining a number of duplicate reference image feature descriptors stored within a pre-defined region of the reference image database;
a candidate images retrieval module for;
selecting a set of reference image feature descriptors based on the determined number of duplicate reference image feature descriptors;
an image matching module for;
comparing the selected set of reference image feature descriptors with the one or more query image feature descriptors to determine if any of the one or more reference images match the query image;
wherein, if a matching reference image is determined, the server is further configured to perform the steps of;
obtaining additional information associated with the at least one matching reference image from an annotation database, andtransmitting the additional information to the mobile device for displaying as additional information relating to the at least one item of interest to the user.
4 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems are described herein that allow a user to capture a single image snapshot from video, print, or the world around him or her, and obtain additional information relating to the media itself or items of interest displayed in the snapshot. A fingerprint of the snapshot is used as a query and transmitted to the server. Image Feature-Based Recognition, as described herein, uses a feature index to identify a smaller set of candidate matches from a larger database of images based on the fingerprint. Novel methods and systems using a distance metric and a radical hash table design exploit probabilistic effects and allow distinct image features to be preferred over redundant ones, allowing only the more distinctive data points to remain resident within the index, yielding a lean index that can be quickly used in the identification process.
-
Citations
13 Claims
-
1. A server for identifying and transmitting to a mobile device additional information relating to a query image obtained by a user with a mobile device, the server comprising:
-
a reference image database storing one or more reference feature descriptors associated with one or more reference images, wherein at least one reference image feature descriptor is mapped to a plurality of first addresses within an address space in the reference image database using a plurality of functions, and wherein the plurality of functions is configured to map one or more feature descriptors to the same address space; and a processor for executing one or more modules comprising; a query receiving module for receiving, from the mobile device, a first query including one or more query image feature descriptors; a candidate feature descriptors retrieval module for; calculating, for each of the one or more query image feature descriptors, a plurality of second addresses using the plurality of functions, and for each of the plurality of second addresses, determining a number of duplicate reference image feature descriptors stored within a pre-defined region of the reference image database; a candidate images retrieval module for; selecting a set of reference image feature descriptors based on the determined number of duplicate reference image feature descriptors; an image matching module for; comparing the selected set of reference image feature descriptors with the one or more query image feature descriptors to determine if any of the one or more reference images match the query image; wherein, if a matching reference image is determined, the server is further configured to perform the steps of; obtaining additional information associated with the at least one matching reference image from an annotation database, and transmitting the additional information to the mobile device for displaying as additional information relating to the at least one item of interest to the user. - View Dependent Claims (2, 3, 8, 9, 10, 11, 12)
-
-
4. A computer-implemented method for identifying and displaying additional information relating to a first query image obtained by a user with a mobile device, the method comprising:
-
receiving, from the mobile device, a first query including one or more query image feature descriptors corresponding to at least one item of interest to the user included in the first query image; responsive to receiving the first query, performing a similarity search, wherein the similarity search comprises; for each of the query image feature descriptors, calculating a plurality of addresses using a plurality of functions; for each of the plurality of addresses, determining a number of duplicate reference image feature descriptors stored within a certain region of a reference image database storing one or more reference image feature descriptors, each of the reference image feature descriptors being associated with at least one reference image, wherein at least one reference image feature descriptor is mapped to a plurality of addresses within an address space in the reference image database using the plurality of functions, and wherein the plurality of functions is configured to map one or more feature descriptors to the same address space; and determining one or more candidate reference images based on a number of duplicate reference image feature descriptors within the certain region of the reference image database associated with each of the plurality of addresses; comparing the feature descriptors for the one or more candidate reference images to the query image feature descriptors to determine if there is a match; and if there is a match, acquiring additional information associated with the match; and transmitting, to the mobile device, the additional information associated with the match for displaying to the user. - View Dependent Claims (5, 6, 7, 13)
-
Specification