GESTURE INFERRED VOCABULARY BINDINGS

• US 20130159938A1
• Filed: 12/16/2011
• Published: 06/20/2013
• Est. Priority Date: 12/16/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: James, Alex, Pizzo, Michael, Castro, Pablo, Flasko, Michael Justin, Olson, Lance, Clark, Jason, Jayadevan, Siddharth
• Granted Patent: US 9,292,094 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

The subject disclosure relates to annotating data based on gestures. Gestures include user interaction with a client device or client software. Gestures are tracked and associated with data. In an aspect, client context associated with a gesture is also tracked. The gestures are then employed to determine a global term to associate with the data. In an aspect, a look-up table comprising a pre-defined relationship between gestures and a global term can be employed. In another aspect, an inference component employ context information in conjunction with the tracked gestures to determine a global term to assign to data. After a global term is determined for data based on a gesture, an annotation file for the data can be created associating the data with the global term.

Claims

1. A computer-implemented system, comprising:

a tracking component configured to track a gesture and associate the gesture with data, wherein the gesture includes user interaction with a client; and

an analysis component configured to determine a global term to assign to the data based on the gesture.

2. The computer-implemented system of claim 1, further comprising:

a data store configured to store a look-up table that associates gestures with global terms, wherein the analysis component is configured to employ the look-up table to determine the global term to assign to the data.

3. The computer-implemented system of claim 2, wherein the look-up table further associates the gestures with the global terms based on at least one of a client identity or a data-type.

4. The computer-implemented system of claim 1, wherein the tracking component is further configured to track context information associated with the gesture;

the computer-implemented system further comprising;

an inference component configured to determine the global term to assign to the data based on the context information.

5. The computer-implemented system of claim 4, wherein the context information includes a response to the gesture by the client.

6. The computer-implemented system of claim 4, wherein the context information includes an annotation on the data, wherein the annotation includes an association of an other global term with the data.

7. The computer-implemented system of claim 1, further comprising:

an annotation component configured to generate an annotation file comprising an assignment of the global term to the data.

8. A method, comprising:

tracking a gesture, wherein the gesture includes user interaction with a client;

associating the gesture with data; and

determining a global term to assign to the data based on the gesture.

9. The method of claim 8, further comprising:

associating gestures with global terms in a look-up table; and

employing the look-up table in the determining the global term to assign to the data based on the gesture.

10. The method of claim 8, further comprising:

associating gestures with global terms in a look-up table based on at least one of a client identity or a data-type; and

employing the look-up table in the determining the global term to assign to the data based on the gesture.

11. The method of claim 8, further comprising:

tracking context information associated with the gesture, wherein the determining the global term to assign to the data based on the gesture further comprises determining the global term to assign to the data based on the context information.

12. The method of claim 11, wherein the context information includes a response to the gesture by the client.

13. The method of claim 11, wherein the context information includes an annotation on the data, wherein the annotation includes an association of an other global term with the data.

14. The method of claim 13, further comprising:

employing a search engine external from the client to find suggested global terms based on the other global term; and

employing the suggested global terms in the determining the global term to assign to the data based on the gesture.

15. The method of claim 8, further comprising:

generating an annotation file comprising an assignment of the global term to the data.

16. The method of claim 15, further comprising:

sending the annotation file to an external data store.

17. A computer readable storage medium comprising computer executable instructions that, in response to execution, cause a computing system to perform operations, comprising:

tracking a gesture, wherein the gesture includes user interaction with a client;

associating the gesture with data; and

determining a global term to assign to the data based on the gesture.

18. The computer readable storage medium of claim 17, the operations further comprising:

associating gestures with global terms in a look-up table; and

employing the look-up table in the determining the global term to assign to the data based on the gesture.

19. The computer readable storage medium of claim 18, the operations further comprising:

associating gestures with global terms in a look-up table based on at least one of a client identity or a data-type; and

employing the look-up table in the determining the global term to assign to the data based on the gesture.

20. The computer readable storage medium of claim 18, the operations further comprising:

tracking context information associated with the gesture, wherein the determining the global term to assign to the data based on the gesture further comprises determining the global term to assign to the data based on the context information.