TRACKING BIMANUAL MOVEMENTS
2 Assignments
0 Petitions
Accused Products
Abstract
Hands may be tracked before, during, and after occlusion, and a gesture may be recognized. Movement of two occluded hands may be tracked as a unit during an occlusion period. A type of synchronization characterizing the two occluded hands during the occlusion period may be determined based on the tracked movement of the occluded hands. Based on the determined type of synchronization, it may be determined whether directions of travel for each of the two occluded hands change during the occlusion period. Implementations may determine that a first hand and a second hand are occluded during an occlusion period, the first hand having come from a first direction and the second hand having come from a second direction. The first hand may be distinguished from the second hand after the occlusion period based on a determined type of synchronization characterizing the two hands, and a behavior of the two hands.
-
Citations
41 Claims
-
1-20. -20. (canceled)
-
21. A method for determining whether directions of travel for each of two occluded hands changes, the method comprising:
-
tracking movement of two occluded hands as a unit during an occlusion period; and determining whether directions of travel for each of the two occluded hands change during the occlusion period.
-
-
22. A method of identifying an observed bimanual hand gesture, the method comprising:
-
tracking movement of a first hand during an observed bimanual gesture; tracking movement of a second hand during the observed bimanual gesture; determining a first set of] measures of likelihoods that the tracked movement of the first hand corresponds to one or more known bimanual gestures; determining a second set of measures of likelihoods that the tracked movement of the second hand corresponds to the one or more known bimanual gestures; based on the first set of measures of the likelihoods that the tracked movement of the first hand corresponds to the one or more known bimanual gestures and the second set of measures of the likelihoods that the tracked movement of the second hand corresponds to the one or more known bimanual gestures, identifying a particular one of the one or more known bimanual gestures as corresponding to the observed bimanual gesture. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29)
-
-
30. A method of identifying an observed bimanual hand gesture, the method comprising:
-
tracking movement of a first hand during a first non-occluded segment of an observed bimanual gesture; tracking movement of a second hand during the first non-occluded segment of the observed bimanual gesture; determining that the first and second hands are occluded, wherein a determination that the first and second hands are occluded signals a beginning of an occluded segment of the observed bimanual gesture; tracking movement of the first and second hands as a unit during the occluded segment of the observed bimanual gesture; determining that the first and second hands are no longer occluded, wherein a determination that the first and second hands are no longer included signals a beginning of a second non-occluded segment of the observed bimanual gesture; distinguishing, after determining that the first and second hands are no longer occluded, the first hand from the second hand; after distinguishing the first hand from the second hand, tracking movement of the first hand during the second non-occluded end segment of the observed bimanual gesture; after distinguishing the first hand from the second hand, tracking movement of the second hand during the second non-occluded segment of the observed bimanual gesture; determining a first set of measures of likelihoods that the tracked movement of the first hand during the first non-occluded segment corresponds to one or more known bimanual gestures; determining a second set of measures of likelihoods that the tracked movement of the second hand during the first non-occluded segment corresponds to the one or more known bimanual gestures; determining a third set of measures of likelihoods that the tracked movement of the first and second hands as a unit during the occluded segment corresponds to the one or more known bimanual gestures; determining a fourth set of measures of likelihoods that the tracked movement of the first hand during the second non-occluded segment corresponds to the one or more known bimanual gestures; determining a fifth set of measures of likelihoods that the tracked movement of the second hand during the second non-occluded segment corresponds to the one or more known bimanual gestures; and identifying a particular one of the one or more known bimanual gestures as corresponding to the observed bimanual gesture based on the first set of measures of the likelihoods that the tracked movement of the first hand during the first non-occluded segment corresponds to the one or more known bimanual gestures, the second set of measures of the likelihoods that the tracked movement of the second hand during the first non-occluded segment corresponds to the one or more known bimanual gestures, the third set of measures of the likelihoods that the tracked movement of the first and second hands as a unit during the occluded segment corresponds to the one or more known bimanual gestures, the fourth set of measures of likelihoods that the tracked movement of the first hand during the second non-occluded segment corresponds to the one or more known bimanual gestures, and the fifth set of measures of likelihoods that the tracked movement of the second hand during the second non-occluded segment corresponds to the one or more known bimanual gestures. - View Dependent Claims (31, 32, 33, 34)
-
-
35. A computer program product for identifying an observed bimanual hand gesture, the computer program product being tangibly embodied in a machine readable medium and comprising instructions that, when read by a machine, operate to cause a data processing apparatus to:
-
track movement of a first hand during an observed bimanual gesture; track movement of a second hand during the observed bimanual gesture; determine a first set of measures of likelihoods that the tracked movement of the first hand corresponds to one or more known bimanual gestures; determine a second set of measures of likelihoods that the tracked movement of the second hand corresponds to the one or more known bimanual gestures; and identify a particular one of the one or more known bimanual gestures as corresponding to the observed bimanual gesture based on the first set of measures of the likelihoods that the tracked movement of the first hand corresponds to the one or more known bimanual gestures and the second set of measures of the likelihoods that the tracked movement of the second hand corresponds to the one or more known bimanual gestures.
-
-
36. A system for identifying an observed bimanual hand gesture, the system comprising:
-
a first hand tracking means for tracking movement of a first hand during an observed bimanual gesture; a second hand tracking means for tracking movement of a second hand during the observed bimanual gesture; a first determining means for determining a first set of measures of likelihoods that the tracked movement of the first hand corresponds to one or more known bimanual gestures; a second determining means for determining a second set of measures of likelihoods that the tracked movement of the second hand corresponds to the one or more known bimanual gestures; and a first bimanual gesture identifying means for identifying a particular one of the one or more known bimanual gestures as corresponding to the observed bimanual gesture based on the first set of measures of the likelihoods that the tracked movement of the first hand corresponds to the one or more known bimanual gestures and the second set of measures of the likelihoods that the tracked movement of the second hand corresponds to the one or more known bimanual gestures.
-
-
37. A computer program product, tangibly embodied in a machine readable medium, the computer program product comprising instructions that, when read by a machine, operate to cause a data processing apparatus to:
-
recognize an occlusion segment and a non-occlusion segment of a bimanual gesture; recognize, from a non-occlusion segment, separate left hand and right hand gestures; input the recognized left hand and right hand gestures and the recognized occlusion segment into nodes of a Bayesian network; and automatically recognize the bimanual gesture based on inputting the recognized left hand and right hand gestures and the recognized occlusion segment into nodes of a Bayesian network.
-
-
38. A computer program product, tangibly embodied in a machine readable medium, the computer program product comprising instructions that, when read by a machine, operate to cause a data processing apparatus to:
-
track movements of two hands; predict an occlusion period based on the tracked movements; and automatically recognize a bimanual gesture based on the predicted occlusion period.
-
-
39. A computer program product, tangibly embodied in a machine readable medium, the computer program product comprising instructions that, when read by a machine, operate to cause a data processing apparatus to:
-
track movements of two hands; segment the movement into a beginning non-occluded segment, at least one middle non-occluded segment, an end non-occluded segment, and at least one occluded segment; and automatically recognize a bimanual gesture based on the segmented movement.
-
-
40. A computer program product, tangibly embodied in a machine readable medium, the computer program product comprising instructions that, when read by a machine, operate to cause a data processing apparatus to:
-
recognize a non-occluded bimanual gesture; recognize separate left hand and right hand gestures from the non-occluded bimanual gesture; input the recognized left hand and right hand gestures into nodes of a Bayesian network; and automatically recognize the bimanual gesture based on inputting the recognized left hand and right hand gestures into nodes of a Bayesian network.
-
-
41. A computer program product, tangibly embodied in a machine readable medium, the computer program product comprising instructions that, when read by a machine, operate to cause a data processing apparatus to:
-
track a gesture, further comprising; predicting an occlusion period, detecting a movement of two occluded hands during the occlusion period, the two occluded hands being tracked as a unit, determining a type of synchronization characterizing the two occluded hands during the occlusion period based on the tracked movement of the two occluded hands, and determining, based on the determined type of synchronization, whether directions of travel for each of the two occluded hands change during the occlusion period; and automatically recognize the tracked gesture.
-
Specification