Method and system for training a user how to perform gestures

• US 7,627,834 B2
• Filed: 11/15/2004
• Issued: 12/01/2009
• Est. Priority Date: 09/13/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Jarrett, Robert J., Pettiross, Jeffrey W., Keely, Leroy B., Lerner, Matthew Rubin, Duncan, Rick, Viji, Sriram, Rimas-Ribikauskas, Emily K.
• Primary Examiner(s): Campbell; Joshua D
• Assistant Examiner(s): Alvesteffer; Stephen
• Application Number:
  US10/986,996
• Publication Number:
  US 20060055684A1
• Time in Patent Office: 1,842 Days
• Field of Search: 715/863, 715/705, 434/362
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A system and method for determining whether a flick gesture has occurred is described. A flick gesture is a simple gesture that may be easily detected and is characterized by minimal interference with other applications or gestures.

Claims

1. A method for training a user how to perform gestures on a user interface of a computing device, the method comprising:

receiving a user input during a gesture training session, wherein receiving the user input includes determining when a user input occurs in at least one of a group of predefined regions of the user interface, wherein each predefined region is associated with an action to be fired, each predefined region being a section of a circle, the center of the circle being a starting point of the user input;

mapping at least one of a speed, a direction or a straightness of the user input in the predefined regions;

determining, by a processor of the computing device, if the user input is a correctly performed gesture and has been performed a fixed number of times, wherein a correctly performed gesture comprises at least one of a correct speed, a correct direction or a correct straightness, wherein the user input for the correct speed, the correct direction, or the correct straightness is received in the group of predefined regions, and wherein the user input of the correct speed is distinguishable from a normal user input, wherein the normal user input comprises at least one of a drag-drop, a double actuation, a press and hold, or a hold and drag;

providing an instruction to the user on how to properly perform a flick gesture, wherein the instruction being based on at least one previous attempt by the user to perform the flick gesture, wherein the instruction includes a request to perform the flick gesture faster, a request to perform the flick gesture straighter and a request to perform the flick gesture in a specified direction;

providing an indication as to whether each gesture has been correctly performed; and

ending the gesture training session.

2. The method according to claim 1, further comprising the step of:

in response to a negative result from the determining step, requesting the user to repeat the input.

3. The method according to claim 1, wherein in response to a negative result from the determining step, indicating that the user input was correctly recognized as a gesture.

4. The method according to claim 1, wherein the gesture is a flick gesture.

5. The method according to claim 1, further comprising the step of:

displaying instructions to the user on how to correctly perform the gesture.

6. The method according to claim 1, further comprising the step of:

modifying thresholds associated with the determining step in response to the user input.

7. The method according to claim 1, further comprising the step of:

receiving user input that indicates the user has opted out of additional training.

8. The method according to claim 1, wherein receiving the user input includes sensing a user'"'"'s finger in proximity to a digitizer of the computing device.

9. A system for training a user how to perform gestures, the system comprising:

an input device for receiving a user input during a gesture training session, wherein receiving the user input includes determining a user input occurs in at least one of a group of predefined regions of the user interface, wherein each predefined region is associated with an action to be fired, each predefined region being a section of a circle, the center of the circle being about the starting point of the user input;

a processor in communication with the input device, the processor configured to;

map at least one of a speed, a direction or a straightness of the user input received at the group of predefined regions;

determine if the user input is a correctly performed gesture and has been performed a fixed number of times, wherein a correctly performed gesture comprises at least one of a correct speed, a correct direction or a correct straightness, wherein the user input for the correct speed, the correct direction, or the correct straightness is received in the group of predefined regions, and wherein a user input of the correct speed is distinguishable from a normal user input wherein the normal user input comprises at least one of a drag-drop, a double actuation, a press and hold, or a hold and drag;

provide an instruction to the user on how to properly perform a flick gesture, wherein the instruction being based on at least one previous attempt by the user to perform the flick gesture, wherein the instruction includes a request to perform the flick gesture faster and a request to perform the flick gesture straighter than at least one previous attempt by the user;

provide an indication as to whether each gesture has been correctly performed; and

end the gesture training session.

10. The system according to claim 9, wherein in response to the user input corresponding to a negative result, the processor is configured to request the user to repeat the input in response to determining.

11. The system according to claim 9, wherein in response to the user input corresponding to a negative result, the processor is configured to indicate to the user that the user input was correctly recognized as a gesture.

12. The system according to claim 9, wherein the gesture is a flick gesture.

13. The system according to claim 9, further comprising, a display device that displays instructions to the user on how to correctly perform the gesture.

14. The system according to claim 9, wherein the processor is further configured to modify thresholds associated with the determination if the user input is a correctly performed gesture.

15. The system according to claim 9, wherein the input device is further configured to receive user input that indicates the user has opted out of additional training.

16. The system according to claim 9, wherein the user input is received via a user'"'"'s finger in proximity to the input device.

17. A computer-readable storage medium having a program stored thereon, the program for training a user how to perform gestures, the program configured to be executed by a processor of a computing device, the method comprising:

receiving a user input during a gesture training session, wherein receiving the user input includes determining when a user input occurs in at least one of a group of predefined regions, wherein each predefined region is associated with an action to be fired, each predefined region being a section of a circle, the center of the circle being about the starting point of the user input;

mapping at least one of a speed, a direction or a straightness of the user input received at the group of predefined regions;

determining if the user input is a correctly performed gesture and has been performed a fixed number of times, wherein a correctly performed gesture comprises at least one of a correct speed, a correct direction or a correct straightness, wherein the user input for the correct speed, the correct direction, or the correct straightness is received in the group of predefined regions and wherein the user input being of the correct speed is distinguishable from a normal user input, wherein the normal user input comprises at least one of a drag-drop, a double actuation, a press and hold, or a hold and drag;

providing an instruction to the user on how to properly perform a flick gesture, wherein the instruction being based on at least one previous attempt by the user to perform the flick gesture, wherein the instruction includes a request to perform the flick gesture faster and a request to perform the flick gesture in a specified direction;

providing an indication as to whether each gesture has been correctly performed; and

ending the gesture training session.

18. The computer-readable storage medium according to claim 17, further comprising, in response to a negative result from the determining step, requesting the user to repeat the input.

19. The computer-readable storage medium according to claim 17, wherein in response to a negative result from determining if the user input is a correctly performed gesture and has been performed a fixed number of times, the indication indicates to the user that the user input was correctly recognized as a gesture.

20. The computer-readable storage medium according to claim 17, wherein the gesture is a flick gesture.

21. The computer-readable storage medium according to claim 17, further comprising displaying instructions to the user on how to correctly perform the gesture.

22. The computer-readable storage medium according to claim 17, further comprising modifying thresholds associated with the determining step in response to the user input.

23. The computer-readable storage medium according to claim 17, further comprising receiving user input that indicates the user has opted out of additional training.

24. The computer-readable storage medium according to claim 17, wherein receiving the user input includes sensing a user'"'"'s finger by the computing device.

25. A system for training a user to perform a gesture, the system comprising:

an input that receives electronic ink created by a user during a gesture training session, wherein receiving the user input includes determining when a user input occurs in at least one of a group of predefined regions of the user interface, the electronic ink pertaining to a training session, wherein each predefined region is associated with an action to be fired, each predefined region being a section of a circle, the center of the circle being about a starting point of the user input;

a storage; and

a processor connected to the input and the storage, the processor configured to operate in one of an operational mode and a training mode, where in the training mode, the processor is configured to;

map at least one of a speed, a direction, or a straightness of the electronic ink, at the group of predefined regions;

determine if the electronic ink is a properly performed gesture, wherein a properly performed gesture comprises at least one of a correct speed, a correct direction or a correct straightness, wherein the user input for the correct speed, the correct direction, or the correct straightness is received in the group of predefined regions, and wherein a user input being of the correct speed is distinguishable from a normal user input wherein the normal user input comprises at least one of a drag-drop, a double actuation, a press and hold, or a hold and drag;

provide an instruction to the user on how to properly perform a flick gesture, wherein the instruction being based on at least one previous attempt by the user to perform the flick gesture, wherein the instruction includes a request to perform the flick gesture straighter than at least one previous attempt by the user and a request to perform the flick gesture in a specified direction;

provide an indication as to whether the gesture has been correctly performed; and

determine that the gesture has been performed a fixed number of times.

26. The system according to claim 25, wherein the properly performed gesture is a flick gesture.

27. The system according to claimed 25, further comprising:

a display; and

a digitizer associated with the display, the digitizer creating the electronic ink by sensing movement of a stylus controlled by the user.

28. The system according to claimed 25, further comprising:

a display; and

a digitizer associated with the display, the digitizer creating the electronic ink by sensing movement of a user'"'"'s finger.