HUMAN USER INTERFACES UTILIZING INTERRUPTION OF THE EXECUTION OF A FIRST RECOGNIZED GESTURE WITH THE EXECUTION OF A RECOGNIZED SECOND GESTURE

• US 20120229398A1
• Filed: 03/07/2012
• Published: 09/13/2012
• Est. Priority Date: 03/07/2011
• Status: Active Grant

• Current Assignee: NRI R&D Patent Licensing, LLC (Advanced Touchscreen and Gesture Technologies, LLC)
• Original Assignee: Lester F. Ludwig
• Inventors: ZALIVA, Vadim
• Granted Patent: US 8,797,288 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06F 40/268 Morphological analysis

Abstract

A method is provided for a user interface recognizing the interruption of the execution of a first gesture with the execution of a second gesture. Measured information responsive to user interaction actions made by a user is received from a user interface sensor. At least one operation is applied to the measured information to produce a sequence of symbols or gestemes. The sequence of symbols is first used to determine that the user'"'"'s execution of a first gesture has been interrupted. The sequence of symbols is used to determine that the user'"'"'s execution of a second gesture has been started and completed resuming the first gesture. The sequence of symbols is used to determine that the user'"'"'s execution a first gesture has been completed. Both the first and second gestures are recognized. Semantic content can be assigned to the existence of and various details regarding the interruption and gestures involved.

Claims

1. A method for a user interface recognizing the interruption of the execution of a first gesture with the execution of a second gesture, the method comprising:

receiving measured information from a user interface sensor, the measured information responsive to user interaction actions made by a user;

applying at least one operation to the measured information to produce a sequence of gestemes, each gesteme produced by the at least one operation responsive to an associated portion of a user interaction actions made by the user;

determining from the sequence of gestemes that the user'"'"'s execution of a first gesture has been interrupted;

determining from the sequence of gestemes that the user'"'"'s execution of a second gesture has been started and completed before the first gesture has been resumed; and

determining from the sequence of gestemes that the user'"'"'s execution of the first gesture has been completed;

wherein the first gesture is recognized and the second gesture is recognized.

2. The method of claim 1 wherein the recognized interruption of the trajectory of the first gesture is used to convey semantic content:

3. The method of claim 1 wherein point of the interruption within the trajectory of the first gesture is used to convey semantic content.

4. The method of claim 1 wherein the combination of the first gesture and the second gesture is used to convey additional semantic content beyond that of the first gesture and the second gesture in isolation.

5. The method of claim 1 wherein the combination of the first gesture, the second gesture, and the location of the interruption within the first gesture is used to convey additional semantic content beyond that of the first gesture and the second gesture in isolation.

6. The method of claim 1 wherein the at least one operation comprises a threshold test.

7. The method of claim 1 wherein the at least one operation comprises a vector quantization provided by a vector quantizer.

8. The method of claim 1 wherein the at least one operation comprises a matched filter.

9. The method of claim 1 wherein the at least one operation comprises a state machine.

10. The method of claim 1 wherein the second gesture comprises only one gesteme.

11. A method for a user interface recognizing the interruption of the execution of a first gesture with the execution of a second gesture, the method comprising:

receiving measured information from a user interface sensor, the measured information responsive to user interaction actions made by a user;

applying at least one operation to the measured information to produce a sequence of symbols, each symbol produced by the at least one operation responsive to an associated portion of a user interaction actions made by the user;

determining from the sequence of symbols that the user'"'"'s execution of a first gesture has been interrupted;

determining from the sequence of symbols that the user'"'"'s execution of a second gesture has been started and completed before the first gesture has been resumed; and

determining from the sequence of symbols that the user'"'"'s execution of the first gesture has been completed;

wherein the first gesture is recognized and the second gesture is recognized.

12. The method of claim 11 wherein the recognized interruption of the trajectory of the first gesture is used to convey semantic content.

13. The method of claim 11 wherein point, of the interruption within the trajectory of the first gesture is used to convey semantic content.

14. The method of claim 11 wherein the combination of the first gesture and the second gesture is used to convey additional semantic content beyond that of the first gesture and the second gesture in isolation.

15. The method of claim 11 wherein the combination of the first gesture, the second gesture, and the location of the interruption within the first gesture is used to convey additional semantic content beyond that of the first gesture and the second gesture in isolation.

16. The method of claim 11 wherein the at least one operation comprises a threshold test.

17. The method of claim 16 wherein the at least one operation comprises the threshold tests wherein the velocity or acceleration of a measured value or calculated value exceeded a specified reference value shape recognition.

18. The method of claim 11 wherein the at least one operation comprises shape recognition.

19. The method of claim 11 wherein the at least one operation comprises a state machine.

20. The method of claim 11 wherein the second gesture comprises only one symbol.