METHOD AND SYSTEM FOR HUMAN-TO-COMPUTER GESTURE BASED SIMULTANEOUS INTERACTIONS USING SINGULAR POINTS OF INTEREST ON A HAND
1 Assignment
0 Petitions
Accused Products
Abstract
Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions from depth images provided by a range finding imaging system. The method enables recognition of simultaneous gestures from detection, tracking and analysis of singular points of interests on a single hand of a user and provides contextual feedback information to the user. The singular points of interest of the hand: include hand tip(s), fingertip(s), palm centre and centre of mass of the hand, and are used for defining at least one representation of a pointer. The point(s) of interest is/are tracked over time and are analysed to enable the determination of sequential and/or simultaneous “pointing” and “activation” gestures performed by a single hand.
-
Citations
66 Claims
-
1-40. -40. (canceled)
-
41. A method for providing natural human-to-computer interaction based on a three-dimensional hand gesture recognition system, the method comprising the steps of:
-
a) imaging a scene including at least one hand of at least one user; b) processing the imaged scene to determine at least two points of interest associated with said at least one hand; c) tracking said at least two points of interest to provide a tracked movement of each point of interest with respect to time; d) analysing said tracked movement of each point of interest; e) determining, from the analysis of said tracked movement, the simultaneous performance of an activation gesture based on two points of interest, and a pointing gesture based on a single point of interest; and f) using said determined performance of said activation gesture and said pointing gesture for human-to-computer interaction. - View Dependent Claims (42, 43, 44, 45, 47, 48, 49, 50, 58, 59, 60, 61, 62, 63, 64, 66)
-
- 52. A method according to claim 51, wherein said pointing gesture is performed by a single point of interest and said activation gesture is performed by two points of interest.
-
65. A three-dimensional hand gesture recognition system, the system comprising an imaging system capable of imaging a scene including at least one hand of at least one user and an interactive computer system associated with the imaging system, the interactive computer system being capable of performing the following steps:
-
i) processing the imaged scene to determine at least two points of interest associated with said at least one hand; ii) tracking said at least two points of interest to provide a tracked movement of each point of interest with respect to time; iii) analysing said tracked movement of each point of interest; iv) determining, from the analysis of said tracked movement, the simultaneous performance of an activation gesture based on two points of interest, and a pointing gesture based on a single point of interest; and v) using said determined performance of said activation gesture and said pointing gesture for human-to-computer interaction.
-
Specification