System and Method for Developing and Classifying Touch Gestures

• US 20130120279A1
• Filed: 11/20/2009
• Published: 05/16/2013
• Est. Priority Date: 11/20/2009
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Plichta, Jakub, Kukulski, Tim, Beckert, Joerg
• Granted Patent: US 8,436,821 B1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Various embodiments of a system and methods for touch gesture recognition are described. A software developer may create a set of custom touch gestures by training a gesture development tool. A new touch gesture may be input to the tool by repeatedly executing the gesture on a touch-enabled device or by depicting parameters of the gesture in a graphical language. A developer may provide a software command associated with the gesture. A unique, software-recognizable gesture descriptor may be created to represent each gesture. The gesture descriptor, a unique identifier of the gesture descriptor and the command associated with the gesture may all be stored as an entry in a configuration file. The file may be embedded in a software application and may be used by a gesture classification module to translate user touch gestures applied to the software application into commands to be executed by the software application.

Claims

1. A method, comprising:

performing a definition process for defining a touch gesture based on a user'"'"'s repeatedly physically executing the same touch gesture on a touch-enabled device, wherein each iteration of said repeatedly physically executing the same touch gesture comprises;

capturing a plurality of parameters of the touch gesture based on user input physically applied by the user to a touch-sensitive surface of the touch-enabled device to define the touch gesture, wherein each captured parameter of the plurality of captured parameters represents a characteristic of the touch gesture and includes values captured at particular points in time during the iteration;

generating a descriptor for the touch gesture, wherein the descriptor is a representation of the pluralities of parameters captured from the user input during the iterations of said repeatedly physically executing the same touch gesture;

storing the descriptor;

associating the descriptor for the touch gesture with a command to be executed in response to receiving the touch gesture; and

storing the descriptor and an association of the touch gesture with the command.

2. The method of claim 1, further comprising:

receiving user input indicating a start of the touch gesture definition process.

3. The method of claim 2, further comprising receiving an indication from the user that said repeatedly physically executing the same touch gesture is complete prior to said generating the descriptor.

4. The method of claim 1, further comprising:

indicating to the user whether a sufficient number of the iterations of said repeatedly physically executing the same touch gesture has been performed to define the touch gesture; and

wherein said generating the descriptor is performed in response to determining that a sufficient number of the iterations of said repeatedly physically executing the same touch gesture has been performed to define the touch gesture.

5. The method of claim 1, wherein the descriptor for the touch gesture is based on a combination of parameters from the pluralities of parameters.

6. The method of claim 1, wherein the plurality of parameters of the touch gesture is specified according to a gesture definition language.

7. The method of claim 1, wherein said storing the association of the touch gesture with the command comprises associating a unique identifier for the touch gesture with the command and wherein the unique identifier is based on the descriptor for the touch gesture.

8. The method of claim 1, further comprising;

determining a tolerance for one or more of the plurality of parameters of the touch gesture, wherein the tolerance specifies a range of values within which a parameter of another touch gesture is considered equivalent to a corresponding parameter of the touch gesture;

storing the tolerance.

9. A computer-readable storage medium storing program instructions executable on a computer to implement a gesture development tool configured to:

perform a definition process for defining a touch gesture based on a user'"'"'s repeatedly physically executing the same touch gesture on a touch-enabled device, wherein each iteration of said repeatedly physically executing the same touch gesture comprises;

capturing a plurality of parameters of the touch gesture based on user input physically applied by the user to a touch-sensitive surface of the touch-enabled device to define the touch gesture, wherein each captured parameter of the plurality of captured parameters represents a characteristic of the touch gesture and includes values captured at particular points in time during the iteration;

generate a descriptor for the touch gesture, wherein the descriptor is a representation of the pluralities of parameters captured from the received user input during the iterations of said repeatedly physically executing the same touch gesture;

store the descriptor;

associate the descriptor for the touch gesture with a command to be executed in response to receiving the touch gesture; and

store the descriptor and an association of the touch gesture with the command.

10. The medium of claim 9, wherein the gesture development tool is further configured to perform:

receiving user input indicating a start of the touch gesture definition process.

11. The medium of claim 10, wherein the gesture development tool is further configured to receive an indication from the user that said repeatedly physically executing the same touch gesture is complete prior to said generating the descriptor.

12. The medium of claim 9, wherein the gesture development tool is further configured to perform:

indicating to the user whether a sufficient number of the iterations of said repeatedly physically executing the same touch gesture has been performed to define the touch gesture; and

wherein said generating the descriptor is performed in response to determining that a sufficient number of the iterations of said repeatedly physically executing the same touch gesture has been performed to define the touch gesture.

13. The medium of claim 9, wherein the descriptor for the touch gesture is based on a combination of parameters from the pluralities of parameters.

14. The medium of claim 9, wherein the plurality of parameters of the touch gesture is specified according to a gesture definition language.

15. The medium of claim 9, wherein said storing the association of the touch gesture with the command comprises associating a unique identifier for the touch gesture with the command and wherein the unique identifier is based on the descriptor for the touch gesture.

16. The medium of claim 9, further comprising;

determining a tolerance for one or more of the plurality of parameters of the touch gesture, wherein the tolerance specifies a range of values within which a parameter of another touch gesture is considered equivalent to a corresponding parameter of the touch gesture; and

storing the tolerance.

17. A computer-readable storage medium storing program instructions executable on a computer to implement a gesture classification module configured to:

receive a plurality of parameters applied to a touch-sensitive surface of a touch-enabled device, wherein the plurality of parameters represent a touch gesture, and wherein the touch gesture indicates a command for a software application executing on the touch-enabled device;

analyze the plurality of parameters to create a gesture descriptor corresponding to the touch gesture, wherein the gesture descriptor is a representation of the plurality of parameters of the touch gesture;

compare the gesture descriptor to a set of existing gesture descriptors;

determine one or more existing gesture descriptors that match the gesture descriptor; and

return one or more identifiers of the one or more existing gesture descriptors determined to match the gesture descriptor, wherein the one or more identifiers are used in the software application to determine the command.

18. The medium of claim 17, wherein the one or more existing gesture descriptors are determined to match the gesture descriptor based on a closeness tolerance between each of the one or more existing gesture descriptors and the gesture descriptor.

19. The medium of claim 18,

wherein said returning comprises returning an identifier of one of the one or more existing gesture descriptors which is determined to be a closest match to the gesture descriptor based on a closeness tolerance between the one existing gesture descriptor and the gesture descriptor that indicates that the one existing gesture descriptor is a closer match to the gesture descriptor than the other existing gesture descriptors of the one or more existing gesture descriptors;

and

wherein the software application accesses data associating identifiers with commands to determine the command based on the returned identifier.

20. The medium of claim 18,

wherein said returning comprises returning a plurality of identifiers;

wherein a plurality of existing gesture descriptors corresponding to the plurality of identifiers are determined to be the plurality of existing gesture descriptors most closely matching the gesture descriptor based on a closeness tolerance between each of the plurality of existing gesture descriptors and the gesture descriptor; and

wherein the software application accesses data associating identifiers with commands to determine a plurality of commands based on the plurality of returned identifiers and selects a command based on current contextual information associated with the software application.