NATURAL GESTURE BASED USER INTERFACE METHODS AND SYSTEMS
First Claim
1. A method for interacting with a user interface system using gesture recognition, the method comprising the steps of:
- a) forming at least one multi-dimensional representation of a scene within a field of view of at least one multi-dimensional imaging system;
b) performing a multi-dimensional constrained clustering operation on said multi-dimensional representation to provide a clustered representation of said scene; and
c) identifying point of interest candidates from said clustered representation which can be used for gesture recognition; and
d) controlling said user interface system in accordance with recognised gestures;
wherein step c) comprises identifying at least one cluster that is connected to only one other cluster and which exhibits coherent motion as a point of interest candidate.
1 Assignment
0 Petitions
Accused Products
Abstract
Described herein is a user interface that provides contextual feedback, controls and interface elements on a display screen of an interactive three-dimensional imaging system. A user interacts with the interface to provide control signals in accordance with those recognised by the system to a makes use of at least one POI in a three-dimensional scene that is imaged by the imaging system to provide control signals for the user interface. Control signals are provided by means of gestures which are analysed in real-time by gesture recognition processes that analyse statistical and geometrical properties of POI motion and trajectories.
46 Citations
20 Claims
-
1. A method for interacting with a user interface system using gesture recognition, the method comprising the steps of:
-
a) forming at least one multi-dimensional representation of a scene within a field of view of at least one multi-dimensional imaging system; b) performing a multi-dimensional constrained clustering operation on said multi-dimensional representation to provide a clustered representation of said scene; and c) identifying point of interest candidates from said clustered representation which can be used for gesture recognition; and d) controlling said user interface system in accordance with recognised gestures; wherein step c) comprises identifying at least one cluster that is connected to only one other cluster and which exhibits coherent motion as a point of interest candidate. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 18, 19, 20)
-
-
16. A system for interacting with a user interface system using gesture recognition, the system comprising:
-
means for forming at least one multi-dimensional representation of a scene within a field of view of at least one multi-dimensional imaging system; means for performing a multi-dimensional constrained clustering operation on said multi-dimensional representation to provide a clustered representation of said scene; and means for identifying point of interest candidates from said clustered representation which can be used for gesture recognition; and means for controlling said user interface system in accordance with recognised gestures; wherein the means for identifying points of interest candidates comprises means for identifying at least one cluster that is connected to only one other cluster and which exhibits coherent motion as a point of interest candidate.
-
Specification