General spatial-gesture grammar user interface for touchscreens, high dimensional touch pad (HDTP), free-space camera, and other user interfaces
First Claim
1. A system implementing a spatial-gesture user interface, the system comprising:
- at least one processor for running at least one algorithm, the least one algorithm forreceiving an input stream of spatial measurements made over an interval of time by at least one spatial user interface sensor;
recognizing a sequence of individual gestemes from the input stream of measurements, each gesteme comprising primitive gesture segment elements;
determining from the sequence of gestemes that the user'"'"'s execution a first gesture has been completed, and determining from the sequence of gestemes that a first specific gesture is represented by the first sequence of gestemes;
determining from the sequence of gestemes that the user'"'"'s execution a second gesture has been completed, and determining from the sequence of gestemes that a second specific gesture is represented by the second sequence of gestemes;
imposing an interpretation of the first specific gesture and second specific gesture based on at least a first grammatical rule,wherein the algorithm recognizes the first specific gesture and the second specific gesture according to the particular sequence of gestemes recognized from the input stream of measurements made over an interval of time by the at least one spatial user interface sensor, andwherein the algorithm reports at least the interpretation as output information.
2 Assignments
0 Petitions
Accused Products
Abstract
A system for a spatial-gesture user interface employing grammatical rules at various levels. Various distinct subset of the gestemes can be concatenated in space and time to construct a distinct gestures. Real-time spatial-gesture information measured by a spatial-gesture user interface is processed to at least a recognized sequence of specific gestemes and that the sequence of gestemes that the user'"'"'s execution a gesture has been completed. The specific gesture rendered by the user is recognized according to the sequence of gestemes. Many additional features are then provided from this foundation, including gesture grammars, structured-meaning gesture-lexicon, imposed interpretations, context, and the use of gesture-rendering prosody. The invention can be used to provide very general spatial-gesture grammar user interface for touchscreens, high dimensional touch pad (hdtp), free-space camera, and other user interfaces.
-
Citations
21 Claims
-
1. A system implementing a spatial-gesture user interface, the system comprising:
-
at least one processor for running at least one algorithm, the least one algorithm for receiving an input stream of spatial measurements made over an interval of time by at least one spatial user interface sensor; recognizing a sequence of individual gestemes from the input stream of measurements, each gesteme comprising primitive gesture segment elements; determining from the sequence of gestemes that the user'"'"'s execution a first gesture has been completed, and determining from the sequence of gestemes that a first specific gesture is represented by the first sequence of gestemes; determining from the sequence of gestemes that the user'"'"'s execution a second gesture has been completed, and determining from the sequence of gestemes that a second specific gesture is represented by the second sequence of gestemes; imposing an interpretation of the first specific gesture and second specific gesture based on at least a first grammatical rule, wherein the algorithm recognizes the first specific gesture and the second specific gesture according to the particular sequence of gestemes recognized from the input stream of measurements made over an interval of time by the at least one spatial user interface sensor, and wherein the algorithm reports at least the interpretation as output information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A system for controlling an application operating on a processor with a spatial-gesture user interface, the system comprising:
-
A processor for receiving a gesture information measured by a spatial-gesture user interface and for executing an algorithm for recognizing gestemes comprising distinct primitive gesture segments; recognizing gestures from sequences of gestemes, and from this transforming the sequences of gestemes into a sequence of gestures; and imposing an interpretation of the first specific gesture and second specific gesture based on at least a first grammatical rule, wherein the algorithm transforms at least two of (a) the sequence of gestures, (b) the imposed interpretation, and (c) a provided context into a particular command for use in controlling a software application; and wherein the system transmits the particular command to the application.
-
Specification