Systems and methods for image-feature-based recognition
First Claim
1. A device for identifying and displaying additional information relating to an item of interest, the device comprising a processor for executing one or more modules comprising:
- an image acquisition module for acquiring a first query image including the item of interest;
a feature descriptor generation module for extracting a plurality of first query image feature descriptors associated with the first query image;
a fingerprint generation module for;
generating a first query fingerprint based on the extracted first query image feature descriptors; and
transmitting the first query fingerprint to a server, wherein the first query fingerprint enables the server to perform, based on the first query fingerprint, a similarity search in a database storing a plurality of reference image feature descriptors and to acquire one or more candidate images associated with at least one of the reference image feature descriptors retrieved from the database by mapping the query feature descriptors to addresses, or adjacent addresses, to which reference image feature descriptors are most frequently mapped; and
an image matching module for determining whether the first query image matches with at least one of the one or more candidate images;
wherein the determination at the image matching module enables acquisition of additional information associated with at least one of the one or more candidate images for displaying as additional information relating to the at least one item of interest to the user.
4 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems are described herein that allow a user to capture a single image snapshot from video, print, or the world around him or her, and obtain additional information relating to the media itself or items of interest displayed in the snapshot. A fingerprint of the snapshot is used as a query and transmitted to the server. Image Feature-Based Recognition, as described herein, uses a feature index to identify a smaller set of candidate matches from a larger database of images based on the fingerprint. Novel methods and systems using a distance metric and a radical hash table design exploit probabilistic effects and allow distinct image features to be preferred over redundant ones, allowing only the more distinctive data points to remain resident within the index, yielding a lean index that can be quickly used in the identification process.
-
Citations
16 Claims
-
1. A device for identifying and displaying additional information relating to an item of interest, the device comprising a processor for executing one or more modules comprising:
-
an image acquisition module for acquiring a first query image including the item of interest; a feature descriptor generation module for extracting a plurality of first query image feature descriptors associated with the first query image; a fingerprint generation module for; generating a first query fingerprint based on the extracted first query image feature descriptors; and transmitting the first query fingerprint to a server, wherein the first query fingerprint enables the server to perform, based on the first query fingerprint, a similarity search in a database storing a plurality of reference image feature descriptors and to acquire one or more candidate images associated with at least one of the reference image feature descriptors retrieved from the database by mapping the query feature descriptors to addresses, or adjacent addresses, to which reference image feature descriptors are most frequently mapped; and an image matching module for determining whether the first query image matches with at least one of the one or more candidate images; wherein the determination at the image matching module enables acquisition of additional information associated with at least one of the one or more candidate images for displaying as additional information relating to the at least one item of interest to the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer-implemented method for identifying and displaying additional information relating to an image obtained by a user with a mobile device, the method being implemented by the mobile device and comprising:
-
acquiring a first query image comprising at least one item of interest to the user about which additional information is to be displayed; extracting a plurality of first features from the first query image, wherein the first features correspond to the at least one item of interest; generating a first query, wherein the first query includes the extracted first features; transmitting the first query to a server, wherein the first query enables the server to acquire one or more reference images by mapping the query feature descriptors to addresses, or adjacent addresses, to which reference image feature descriptors are most frequently mapped and to determine, based on the one or more reference images acquired based on the first query, that the server stores additional information about the at least one item of interest; and receiving, from the server, the additional information about the at least one item of interest; and displaying the additional information about the at least one item of interest to the user. - View Dependent Claims (14, 15, 16)
-
Specification