Gesture Tool

• US 20100306713A1
• Filed: 05/29/2009
• Published: 12/02/2010
• Est. Priority Date: 05/29/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Horbach, David Jason Christopher, Mihelich, Mark, Puls, Matthew Jon, Lee, Kyungsuk David, Geisner, Kevin, Markovic, Relja, Snook, Gregory N., Tomlin, Arthur Charles, Latta, Stephen
• Granted Patent: US 8,856,691 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials

Abstract

Systems, methods and computer readable media are disclosed for a gesture tool. A capture device captures user movement and provides corresponding data to a gesture recognizer engine and an application. From that, the data is parsed to determine whether it satisfies one or more gesture filters, each filter corresponding to user-performed gesture. The data and the information about the filters is also sent to a gesture tool, which displays aspects of the data and filters. In response to user input corresponding to a change in a filter, the gesture tool sends an indication of such to the gesture recognizer engine and application, where that change occurs.

Claims

1. A computer system, comprising:

a processor;

a tool executing on the processor that facilitates the adjustment of parameters of a gesture filter of an application that is designed to recognize whether a user of the application has performed a particular gesture from data comprising information about position or movement of the user, the tool operating to;

receive data captured by a capture device, the data comprising information representing user position or movement;

display a visual representation of the position or movement represented by the received data;

display a representation of an output of the gesture filter in response to the received data;

receive, via a user interface of the display, a change to a parameter of the gesture filter of the application; and

alter the gesture filter according to the received change.

2. The system of claim 1, the tool further operating to:

receive the change from the visual representation across a communications network.

3. The system of claim 1 wherein the visual representation of at least one aspect of the user data is further comprises a list comprising at least one gesture filter associated with the application.

4. The system of claim 3 wherein the tool operating to display a visual representation is further operating to, in response to user selection of a gesture filter from the list, displaying at least one adjustable parameter of the selected gesture filter.

5. The system of claim 3 wherein the tool configured to display a visual representation is further configured to display a skeletal map associated with the data, and in response to user selection of a gesture filter from the list, display an indication of at least one part of the skeletal map associated with the selected gesture filter.

6. The system of claim 3 wherein the tool configured to display a visual representation is further configured to, in response to user selection of a gesture filter from the list, display at least one output of the selected gesture filter.

7. The system of claim 3 wherein at least one output is displayed as a graph of a value of the output over time.

8. The system of claim 3 wherein each gesture filter of the list is specified by the application.

9. The system of claim 1 wherein the user data is recorded, the tool further operating to:

adjust the rate or direction of display of the visual representation.

10. A method for altering visualized parameters for a gesture filter of an application, comprising:

receiving data captured by a capture device, the data comprising information about user position or movement;

displaying a visual output of the application;

displaying a visual representation of at least one aspect of the user data;

receiving, via a user interface of the display, a change to a parameter of the gesture filter of the application; and

altering the gesture filter corresponding to the received change.

11. The method of claim 10 wherein the data is either received from the capture device as it is captured, or the data is received from a storage location where the data is stored as it is captured.

12. The method of claim 10 wherein the visual representation and the visual output are either displayed on a single display device or displayed on separate display devices.

13. The method of claim 12 wherein the wherein the visual representation and the visual output are either displayed on a single display device through either a split-screen or picture-in-picture.

14. The method of claim 10 wherein the data comprises at least one from a set, the set comprising:

skeletal data, visible color data, infra-red color data, and depth data.

15. The method of claim 10 wherein the visual representation comprises an overlay of color data corresponding to the captured data and skeletal mapping data corresponding to the captured data.

16. The method of claim 10 wherein the visual output comprises a list of a plurality of gesture filters of the application, further comprising:

in response to user selection of a selected gesture filter of the plurality of gesture filters, displaying the visual representation of at least one aspect of the user data, the visual representation corresponding to the selected gesture filter.

17. The method of claim 10 wherein the visual representation comprises a skeletal map of at least part of the user corresponding to the data, further comprising:

displaying an indication in the visual representation of at least one part of the skeletal map that corresponds to a selected gesture filter.

18. The method of claim 10, further comprising:

storing the data captured by the capture device.

19. The method of claim 10 wherein the visual representation comprises a value, a range of values, or a bound of the parameter.

20. A computer-readable storage medium bearing computer-readable instructions that, when executed on a processor, cause the processor to perform operations comprising:

receiving data captured by a capture device, the data comprising information about user position or movement;

displaying a visual output of the application;

displaying a visual representation of at least one aspect of the user data;

receiving, via a user interface of the display, a change to a parameter of the gesture filter of the application; and

altering the gesture filter corresponding to the received change.