Signal detection, recognition and tracking with feature vector transforms
First Claim
Patent Images
1. A method of object recognition comprising:
- receiving a sequence of images captured of a scene by an image sensor;
using a hardware processor of a computer system, performing a feature vector transform on plural images in the sequence of the images to produce N-dimensional feature vector per pixel of the plural images, the feature vector transform producing for each pixel in an array of pixels, a first vector component corresponding to plural comparisons between a center pixel and pixels at plural directions around the center pixel for a first scale, and second vector component corresponding to plural comparisons between the center pixel and pixels at plural directions around the center pixel for a second scale,wherein N is a number of dimensions of the N-dimensional feature vector;
wherein the plural comparisons at the first and second scales comprise quantized differences, and the quantized differences are encoded in a first data structure representing magnitude and direction of the quantized differences at each of the first and second scales; and
using a hardware processor of a computer system, deriving a second data structure characterizing geometry of an object in the scene from N-dimensional feature vectors represented using the first data structure, obtaining a pixel patch geometrically registered to the geometry of the object, and identifying the object by processing the registered pixel patch with a digital watermark reader to extract an identifier, a barcode reader to extract an identifier, or a trained classifier to identify the object according to training images for the object.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for obtaining object geometry in which image frames of a scene (e.g., video frames from a user passing a smartphone camera over an object) are transformed into dense feature vectors, and feature vectors are processed to obtain geometry of an object in the scene. The object geometry is determined from the feature vectors. Feature vector transforms are leveraged in a signal processing method for object identification (e.g., using machine learning classification), digital watermark or bar code reading and image recognition.
28 Citations
15 Claims
-
1. A method of object recognition comprising:
-
receiving a sequence of images captured of a scene by an image sensor; using a hardware processor of a computer system, performing a feature vector transform on plural images in the sequence of the images to produce N-dimensional feature vector per pixel of the plural images, the feature vector transform producing for each pixel in an array of pixels, a first vector component corresponding to plural comparisons between a center pixel and pixels at plural directions around the center pixel for a first scale, and second vector component corresponding to plural comparisons between the center pixel and pixels at plural directions around the center pixel for a second scale, wherein N is a number of dimensions of the N-dimensional feature vector; wherein the plural comparisons at the first and second scales comprise quantized differences, and the quantized differences are encoded in a first data structure representing magnitude and direction of the quantized differences at each of the first and second scales; and using a hardware processor of a computer system, deriving a second data structure characterizing geometry of an object in the scene from N-dimensional feature vectors represented using the first data structure, obtaining a pixel patch geometrically registered to the geometry of the object, and identifying the object by processing the registered pixel patch with a digital watermark reader to extract an identifier, a barcode reader to extract an identifier, or a trained classifier to identify the object according to training images for the object. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A non-transitory, computer readable medium, on which is stored instructions, which when executed by a processor, perform steps comprising:
-
receiving a sequence of images captured of a scene by an image sensor; performing a feature vector transform on plural images in the sequence of the images to produce N-dimensional feature vector per pixel of the plural images, the feature vector transform producing for each pixel in an array of pixels, a first vector component corresponding to plural comparisons between a center pixel and pixels at plural directions around the center pixel for a first scale, and second vector component corresponding to plural comparisons between the center pixel and pixels at plural directions around the center pixel for a second scale, wherein N is a number of dimensions of the N-dimensional feature vector; wherein the plural comparisons at the first and second scales comprise quantized differences, and the quantized differences are encoded in a first data structure representing magnitude and direction of the quantized differences at each of the first and second scales; and deriving a second data structure characterizing geometry of an object in the scene from N-dimensional feature vectors represented using the first data structure, obtaining a pixel patch geometrically registered to the geometry of the object, and identifying the object by processing the registered pixel patch with a digital watermark reader to extract an identifier, a barcode reader to extract an identifier, or a trained classifier to identify the object according to training images for the object. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A system comprising:
-
an image sensor for capturing a sequence of images captured of a scene by an image sensor; a hardware processor configured with instructions to perform a feature vector transform on plural images in the sequence of the images to produce N-dimensional feature vector per pixel of the plural images, the feature vector transform producing for each pixel in an array of pixels, a first vector component corresponding to plural comparisons between a center pixel and pixels at plural directions around the center pixel for a first scale, and second vector component corresponding to plural comparisons between the center pixel and pixels at plural directions around the center pixel for a second scale, wherein N is a number of dimensions of the N-dimensional feature vector; wherein the plural comparisons at the first and second scales comprise quantized differences, and the quantized differences are encoded in a first data structure representing magnitude and direction of the quantized differences at each of the first and second scales; and a hardware processor configured with instructions to characterize geometry of an object in the scene from N-dimensional feature vectors represented using the first data structure; a hardware processor configured with instructions to register a pixel patch to the geometry of the object; and a hardware processor configured with instructions to identify the registered pixel patch based on a digital watermark, barcode or trained classifier that has been trained on training images for the object. - View Dependent Claims (12, 13, 14, 15)
-
Specification