GESTURES, INTERACTIONS, AND COMMON GROUND IN A SURFACE COMPUTING ENVIRONMENT

• US 20100149090A1
• Filed: 12/15/2008
• Published: 06/17/2010
• Est. Priority Date: 12/15/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wilson, Andrew David, Jones, F. David, Izadi, Shahram, Horvitz, Eric J., Morris, Meredith June, Benko, Hrvoje, Butler, David Alexander, Hodges, Stephen E., Hinckley, Kenneth P., Russ, V. Kevin, LeProwse, Shawn R., Sands, Ian M., Kunz, William Ben
• Granted Patent: US 9,134,798 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04L 67/01 Protocols

Abstract

Aspects relate to detecting gestures that relate to a desired action, wherein the detected gestures are common across users and/or devices within a surface computing environment. Inferred intentions and goals based on context, history, affordances, and objects are employed to interpret gestures. Where there is uncertainty in intention of the gestures for a single device or across multiple devices, independent or coordinated communication of uncertainty or engagement of users through signaling and/or information gathering can occur.

Claims

1. A system that facilitates implementation of actions in a surface computing environment, comprising:

a tracking component that recognizes at least one gesture and distinguishes the gesture from one or more common gestures;

a recognition component that provides an indication that the at least one gesture is recognized; and

an implementation component that executes an action automatically or after confirmation of an interpretation of the at least one gesture.

2. The system of claim 1, further comprises a synchronization component that dynamically groups two or more users, the gesture tracking component recognizes duplicate gestures from the group of users.

3. The system of claim 2, the synchronization component associates at least one task with the group of users and limits access to the at least one task to the group of users.

4. The system of claim 2, the synchronization component utilizes gaze tracking to group the two or more users.

5. The system of claim 1, further comprising a relationship component that associates two or more users based on a historical interaction, a common task, or combinations thereof.

6. The system of claim 1, further comprising a context module that defines and interprets the at least one gesture as a function of a user context, an environment context, or combinations thereof.

7. The system of claim 1, the tracking component gathers gesture information from a device associated with a first user to recognize and distinguish the at least one gesture.

8. The system of claim 1, further comprising an interaction component that conveys information related to user interactions within the surface computing environment.

9. The system of claim 1, the recognition component solicits information if the gesture is not understood.

10. The system of claim 1, further comprising a machine learning and reasoning component that automates at least one system component.

11. The system of claim 1, the recognition component gathers information or provides one or more signals to determine the interpretation of the at least one gesture if there is uncertainty related to the interpretation.

12. A method for enabling gestures in a surface computing environment, comprising:

detecting a gesture within a surface computing environment;

ascertaining the gesture is a request for implementation of an action; and

providing feedback on the gesture to indicate that the gesture was detected.

13. The method of claim 12, ascertaining the gesture is a request for implementation of an action comprises distinguishing the gesture from one or more common gestures.

14. The method of claim 12, further comprising:

ascertaining there is uncertainty related to an interpretation of the gesture; and

gathering information from one or more users to clarify the gesture interpretation.

15. The method of claim 12, the feedback is a request for further information or automatic implementation of the action.

16. The method of claim 12, further comprising:

grouping two or more users based on a common task, function, purpose, or combinations thereof;

recognizing duplicate action requests from the group of users; and

selectively implementing one of the duplicate action requests.

17. The method of claim 12, further comprising:

interpreting the gesture as a function of a user context, an environment context, or combinations thereof; and

implementing the action based on the interpretation.

18. The method of claim 12, further comprises associating two or more users based on a historical interaction, a common task, gaze tracking, or combinations thereof.

19. A computer-readable medium having stored thereon the following computer executable components:

means for detecting a gesture within a surface computing environment;

means for determining if the gesture is a request for implementation of an action, a duplicate request, or an undefined gesture;

means for ignoring the gesture if the gesture is a duplicate request or an undefined gesture;

means for conveying feedback if the gesture is a request for implementation of an action; and

means for selectively implementing the action after conveyance of the feedback.

20. The computer-readable medium of claim 19, further comprising:

means for associating two or more users based on gaze tracking, a common task, function, or purpose, the means for ignoring the gesture ignores a duplicate request from at least one of the users; and

means for selectively implementing one of the duplicate action requests.