Histogram methods and systems for object recognition
First Claim
Patent Images
1. A method for matching test imagery to reference imagery, comprising the acts:
- generating color histogram data that corresponds to test imagery captured by a camera-equipped mobile device;
matching said test imagery color histogram data with color histogram data that corresponds to reference imagery, said matching being performed by a hardware processor of said camera-equipped mobile device;
said test imagery histogram data and said reference imagery histogram data comprising values corresponding to a plurality of quantized bins; and
said matching including determining one or more of the following;
a. a number of occupied bins in the test and reference imagery histograms;
b. a number of occupied bins common to both the test imagery and reference imagery histograms;
c. a number of occupied bins combined between both the test imagery and reference imagery histograms;
d. a number of pixels common to both the test imagery and reference imagery histograms (histogram intersection);
e. a percentage of occupied bins of the test imagery histogram that are occupied in the reference imagery histogram;
f. a ratio of said histogram intersection to number of occupied bins of the test imagery histogram;
g. nonzero bins of test imagery histogram;
h. nonzero bins of reference imagery histogram;
i. nonzero bins of test imagery histogram that are a subset of nonzero bins of reference imagery histogram;
j. a number of nonzero bins of test imagery histogram that are a subset of nonzero bins of reference imagery histogram;
k. nonzero bins of reference imagery histogram that are a subset of nonzero bins of test imagery histogram; and
l. a number of nonzero bins of reference imagery histogram that are a subset of nonzero bins of test imagery histogram.
0 Assignments
0 Petitions
Accused Products
Abstract
A multidimensional histogram is used to characterize an image (or object), and is used to identify candidate matches with one or more reference images (or objects). An exemplary implementation employs hue information for two of the dimensions, and a second derivative function based on luminance for a third dimension. The simplicity and speed of the detailed arrangements make them well suited for use with cell phones and other mobile devices, which can use the technology for image/object recognition, e.g., in visual search applications.
-
Citations
20 Claims
-
1. A method for matching test imagery to reference imagery, comprising the acts:
-
generating color histogram data that corresponds to test imagery captured by a camera-equipped mobile device; matching said test imagery color histogram data with color histogram data that corresponds to reference imagery, said matching being performed by a hardware processor of said camera-equipped mobile device; said test imagery histogram data and said reference imagery histogram data comprising values corresponding to a plurality of quantized bins; and said matching including determining one or more of the following; a. a number of occupied bins in the test and reference imagery histograms; b. a number of occupied bins common to both the test imagery and reference imagery histograms; c. a number of occupied bins combined between both the test imagery and reference imagery histograms; d. a number of pixels common to both the test imagery and reference imagery histograms (histogram intersection); e. a percentage of occupied bins of the test imagery histogram that are occupied in the reference imagery histogram; f. a ratio of said histogram intersection to number of occupied bins of the test imagery histogram; g. nonzero bins of test imagery histogram; h. nonzero bins of reference imagery histogram; i. nonzero bins of test imagery histogram that are a subset of nonzero bins of reference imagery histogram; j. a number of nonzero bins of test imagery histogram that are a subset of nonzero bins of reference imagery histogram; k. nonzero bins of reference imagery histogram that are a subset of nonzero bins of test imagery histogram; and l. a number of nonzero bins of reference imagery histogram that are a subset of nonzero bins of test imagery histogram. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method for matching test imagery to reference imagery, comprising the acts:
-
generating color histogram data that corresponds to test imagery captured by a camera-equipped mobile device; matching said test imagery color histogram data with color histogram data that corresponds to reference imagery, said matching being performed by a hardware processor of said camera-equipped mobile device; said test imagery histogram data and said reference imagery histogram data comprising values corresponding to a plurality of quantized bins; and said matching including disregarding bins of the test imagery histogram that are unoccupied in the reference imagery histogram, and performing a comparison between remaining bins of the test imagery histogram and bins of the reference imagery histogram. - View Dependent Claims (17)
-
-
18. A method for matching test imagery to reference imagery, comprising the acts:
-
generating color histogram data that corresponds to test imagery captured by a camera-equipped mobile device; matching said test imagery color histogram data with color histogram data that corresponds to reference imagery, said matching being performed by a hardware processor of said camera-equipped mobile device; said test imagery histogram data and said reference imagery histogram data comprising values corresponding to a plurality of quantized bins; and said matching including (a) checking whether at least a majority of occupied bins of the test imagery histogram are a subset of the occupied bins in the reference imagery histogram, and (b) checking that counts of at least some of the bins in the test imagery histogram are larger than corresponding counts for the reference imagery histogram; wherein test imagery can be matched to reference imagery despite zooming-in. - View Dependent Claims (19, 20)
-
Specification