GESTURE TRACKING AND CLASSIFICATION
First Claim
1. A method of tracking the position of a body part, such as a hand, in captured images, the method comprising:
- capturing colour images of a region to form a set of captured images;
identifying contiguous skin-colour regions within an initial image of the set of captured images;
defining regions of interest containing the skin-coloured regions;
extracting image features in the regions of interest, each image feature relating to a point in a region of interest;
and then, for successive pairs of images comprising a first image and a second image, the first pair of images having as the first image the initial image and a later image, following pairs of images each including as the first image the second image from the preceding pair and a later image as the second image;
extracting image features, each image feature relating to a point in the second image;
determining matches between image features relating to the second image and image features relating to in each region of interest in the first image;
determining the displacement within the image of the matched image features between the first and second images;
disregarding matched features whose displacement is not within a range of displacements;
determining regions of interest in the second image containing the matched features which have not been disregarded;
determining the direction of movement of the regions of interest between the first image and the second image.
1 Assignment
0 Petitions
Accused Products
Abstract
A method of tracking the position of a body part, such as a hand, in captured images, the method comprising capturing (10) colour images of a region to form a set of captured images; identifying contiguous skin-colour regions (12) within an initial image of the set of captured images; defining regions of interest (16) containing the skin-coloured regions; extracting (18) image features in the regions of interest, each image feature relating to a point in a region of interest; and then, for successive pairs of images comprising a first image and a second image, the first pair of images having as the first image the initial image and a later image, following pairs of images each including as the first image the second image from the preceding pair and a later image as the second image: extracting (22) image features, each image feature relating to a point in the second image; determining matches (24) between image features relating to the second image and image features relating to in each region of interest in the first image; determining the displacement within the image of the matched image features between the first and second images; disregarding (28) matched features whose displacement is not within a range of displacements; determining regions of interest (30) in the second image containing the matched features which have not been disregarded; and determining the direction of movement (34) of the regions of interest between the first image and the second image.
-
Citations
28 Claims
-
1. A method of tracking the position of a body part, such as a hand, in captured images, the method comprising:
-
capturing colour images of a region to form a set of captured images; identifying contiguous skin-colour regions within an initial image of the set of captured images; defining regions of interest containing the skin-coloured regions; extracting image features in the regions of interest, each image feature relating to a point in a region of interest; and then, for successive pairs of images comprising a first image and a second image, the first pair of images having as the first image the initial image and a later image, following pairs of images each including as the first image the second image from the preceding pair and a later image as the second image; extracting image features, each image feature relating to a point in the second image; determining matches between image features relating to the second image and image features relating to in each region of interest in the first image; determining the displacement within the image of the matched image features between the first and second images; disregarding matched features whose displacement is not within a range of displacements; determining regions of interest in the second image containing the matched features which have not been disregarded; determining the direction of movement of the regions of interest between the first image and the second image. - View Dependent Claims (2, 4, 6, 7, 11, 12, 14, 15, 18, 19, 20, 24, 27, 28)
-
-
3. (canceled)
-
5. (canceled)
-
8-10. -10. (canceled)
-
13. (canceled)
-
16-17. -17. (canceled)
- 21. A method of classifying a gesture, such as a hand gesture, based upon a time-ordered series of movement directions each indicating the direction of movement of a body part in a given frame of a stream of captured images, the method comprising comparing the series of movement directions with a plurality of candidate gestures each comprising a series of strokes, the comparison with each candidate gesture comprising determining a score for how well the series of movement directions fits the candidate gesture.
Specification