Three dimensional close interactions
First Claim
1. A method of detecting and tracking at least one feature associated with an extremity of a user in a three-dimensional scene using depth images of the scene, the method comprising the steps of:
- a) segmenting at least one region of interest within each depth image;
b) determining at least one object of interest that corresponds to a limb of the user within the segmented depth image;
c) tracking each limb with respect to time;
d) identifying an extremity associated with each limb;
e) tracking each identified extremity with respect to time;
isolating each identified extremity from its associated limb;
g) determining parameters relating to each isolated extremity;
h) identifying at least one feature in each isolated extremity; and
i) tracking each identified feature with respect to time.
1 Assignment
0 Petitions
Accused Products
Abstract
Described herein is a method for detecting, identifying and tracking hand, hand parts, and fingers on the hand (500) of a user within depth images of a three-dimensional scene. Arms of a user are detected, identified, segmented from the background of the depth images, and tracked with respect to time. Hands of the user are identified and tracked and the location and orientation of its parts, including the palm and the fingers (510, 520, 530, 540, 550) are determined and tracked in order to produce output information enabling gesture interactions.
17 Citations
18 Claims
-
1. A method of detecting and tracking at least one feature associated with an extremity of a user in a three-dimensional scene using depth images of the scene, the method comprising the steps of:
-
a) segmenting at least one region of interest within each depth image; b) determining at least one object of interest that corresponds to a limb of the user within the segmented depth image; c) tracking each limb with respect to time; d) identifying an extremity associated with each limb; e) tracking each identified extremity with respect to time; isolating each identified extremity from its associated limb; g) determining parameters relating to each isolated extremity; h) identifying at least one feature in each isolated extremity; and i) tracking each identified feature with respect to time. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A non-transitory computer readable medium storing a program causing a computer to execute a method for performing the steps of the method of detecting and tracking at least one feature associated with an extremity of a user in a three-dimensional scene using depth images of the scene, the method comprising the steps of:
-
a) segmenting at least one region of interest within each depth image; b) determining at least one object of interest that corresponds to a limb of the user within the segmented depth image; c) tracking each limb with respect to time; d) identifying an extremity associated with each limb; e) tracking each identified extremity with respect to time; f) isolating each identified extremity from its associated limb; g) determining parameters relating to each isolated extremity; h) identifying at least one feature in each isolated extremity; and i) tracking each identified feature with respect to time.
-
-
18. A gesture recognition system for detecting and tracking at least one feature associated with an extremity of a user in a three-dimensional scene using depth images of the scene, the gesture recognition system including a computerised system capable of performing the following steps:
-
a) segmenting at least one region of interest within each depth image; b) determining at least one object of interest that corresponds to a limb of the user within the segmented depth image; c) tracking each limb with respect to time; d) identifying an extremity associated with each limb; e) tracking each identified extremity with respect to time; f) isolating each identified extremity from its associated limb; g) determining parameters relating to each isolated extremity; h) identifying at least one feature in each isolated extremity; and i) tracking each identified feature with respect to time.
-
Specification