Scalable image matching
First Claim
1. A computing system, comprising:
- a processor; and
memory including instructions that, when executed by the processor, cause the computing system to;
receive a query image from a client computing device;
extract feature descriptors from the query image;
compare at least a portion of the extracted feature descriptors to a set of compressed cluster centers corresponding to a set of database images to determine a matching score, the compressed cluster centers at least partially formed by a set of compressed descriptors storing identifying information for at least one associated feature, the identifying information corresponding to identifying information including at least one of a position, a scale, or an orientation, and the identifying information occupying a majority of a file size of the compressed descriptor, wherein each of the compressed cluster centers is assigned at least one visual word corresponding to at least one feature descriptor;
rank the set of database images based on the matching score; and
select a highest ranking database image of the set of closest matching database images as a match for the query image.
0 Assignments
0 Petitions
Accused Products
Abstract
Various embodiments may increase scalability of image representations stored in a database for use in image matching and retrieval. For example, a system providing image matching can obtain images of a number of inventory items, extract features from each image using a feature extraction algorithm, and transform the same into their feature descriptor representations. These feature descriptor representations can be subsequently stored and used to compare against query images submitted by users. Though the size of each feature descriptor representation isn'"'"'t particularly large, the total number of these descriptors requires a substantial amount of storage space. Accordingly, feature descriptor representations are compressed to minimize storage and, in one example, machine learning can be used to compensate for information lost as a result of the compression.
-
Citations
20 Claims
-
1. A computing system, comprising:
-
a processor; and memory including instructions that, when executed by the processor, cause the computing system to; receive a query image from a client computing device; extract feature descriptors from the query image; compare at least a portion of the extracted feature descriptors to a set of compressed cluster centers corresponding to a set of database images to determine a matching score, the compressed cluster centers at least partially formed by a set of compressed descriptors storing identifying information for at least one associated feature, the identifying information corresponding to identifying information including at least one of a position, a scale, or an orientation, and the identifying information occupying a majority of a file size of the compressed descriptor, wherein each of the compressed cluster centers is assigned at least one visual word corresponding to at least one feature descriptor; rank the set of database images based on the matching score; and select a highest ranking database image of the set of closest matching database images as a match for the query image. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-implemented method, comprising:
-
receiving a query image from a client computing device; extracting feature descriptors from the query image; comparing at least a portion of the extracted feature descriptors to a set of compressed cluster centers corresponding to a set of database images to determine a matching score, wherein each of the compressed cluster centers is assigned at least one visual word corresponding to at least one feature descriptor, and the compressed cluster center is at least partially formed by a set of compressed descriptors storing identifying information for at least one associated feature of the compressed cluster center, the identifying information including at least one of a position, a scale, or an orientation, and the identifying information occupying a majority of a file size of the compressed descriptor; ranking the set of database images based on the matching score; and selecting a highest ranking database image of the set of closest matching database images as a match for the query image. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable storage medium including instructions stored thereon which, when executed by a processor, cause the processor to:
-
receive a query image from a client computing device; extract feature descriptors from the query image; compare at least a portion of the extracted feature descriptors to a set of compressed cluster centers corresponding to a set of database images to determine a matching score, wherein each of the compressed cluster centers is assigned at least one visual word corresponding to at least one feature descriptor, and the compressed cluster center is at least partially formed by a set of compressed descriptors storing identifying information for at least one associated feature of the compressed cluster center, the identifying information occupying a majority of a file size of the compressed descriptor; rank the set of database images based on the matching score; and select a highest ranking database image of the set of closest matching database images as a match for the query image. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification