System and method for detecting and tracking features in images
First Claim
1. A method for detecting blinking of a subject and tracking eye movement in a series of images, comprising the steps of:
- detecting a feature in a set of images corresponding to a subject'"'"'s eye;
comparing the feature to a template of a closed eye;
determining whether the detected feature matches the template; and
if the detected feature matches the template, indicating that a subject blinked; and
training a shape model for tracking the eye of the subject using clustered shape subspaces.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for tracking features is provided which allows for the tracking of features that move in a series of images. A training set of images is processed to produce clustered shape subspaces corresponding to the set of images, such that non-linear shape manifolds in the images are represented as piecewise, overlapping linear surfaces that are clustered according to similarities in perspectives. A landmark-based training algorithm (e.g., ASM) is applied to the clustered shape subspaces to train a model of the clustered shape subspaces and to create training data. A subsequent image is processed using the training data to identify features in the target image by creating an initial shape, superimposing the initial shape on the target image, and then iteratively deforming the shape in accordance with the model until a final shape is produced corresponding to a feature in the target image.
-
Citations
20 Claims
-
1. A method for detecting blinking of a subject and tracking eye movement in a series of images, comprising the steps of:
-
detecting a feature in a set of images corresponding to a subject'"'"'s eye; comparing the feature to a template of a closed eye; determining whether the detected feature matches the template; and if the detected feature matches the template, indicating that a subject blinked; and training a shape model for tracking the eye of the subject using clustered shape subspaces. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A method for detecting blinking of a subject and estimating a pose angle of the subject in a series of images, comprising the steps of:
-
detecting a feature in a set of images corresponding to a subject'"'"'s eye; comparing the feature to a template of a closed eye; determining whether the detected feature matches the template; and if the detected feature matches the template, indicating that a subject blinked; and estimating a pose angle of a subject in a target image by learning Mixture of Experts models for shapes and using feature shapes to predict tilt, pitch and yaw of a head. - View Dependent Claims (18, 19, 20)
-
Specification