Standard Gestures

• US 8,487,938 B2
• Filed: 02/23/2009
• Issued: 07/16/2013
• Est. Priority Date: 01/30/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Latta, Stephen G., Tsunoda, Kudo, Geisner, Kevin, Markovic, Relja, Bennett, Darren Alexander
• Primary Examiner(s): Tung, Kee M
• Assistant Examiner(s): Wu, Sing-Wai
• Application Number:
  US12/391,150
• Publication Number:
  US 20100194762A1
• Time in Patent Office: 1,604 Days
• Field of Search: None
• US Class Current: 345/473
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Systems, methods and computer readable media are disclosed for grouping complementary sets of standard gestures into gesture libraries. The gestures may be complementary in that they are frequently used together in a context or in that their parameters are interrelated. Where a parameter of a gesture is set with a first value, all other parameters of the gesture and of other gestures in the gesture package that depend on the first value may be set with their own value which is determined using the first value.

Claims

1. A method for providing a package of complementary gesture filters to an application, comprising:

providing a package comprising a plurality of filters, each filter comprising information about a gesture, at least one filter being complementary with at least one other filter in the package;

receiving an indication of assigning a first value to a parameter of a first filter, the parameter defining an attribute of a motion or pose to be made by a user for it to be recognized that the user has performed the gesture of the first filter;

assigning the first value to the parameter;

assigning a second value to a second parameter of a second filter, the second value determined using the first value, the second value being determined using the first value based on a proportional relationship, an inversely proportional relationship, a linear relationship, an exponential relationship, or a function that takes the first value as an input; and

processing data indicative of the user'"'"'s motion or pose with the first filter and the parameter to determine an output indicative of whether the user'"'"'s motion or pose invokes the gesture of the first filter.

2. The method of claim 1, wherein the parameter of the first filter represents a body part, a volume of space, a velocity, a direction of movement, an angle, a two-dimensional (2D) plane, or a place where a movement occurs.

3. The method of claim 1, wherein the gesture comprises a crouch, a jump, a lean, an arm throw, a toss, a swing, a dodge, a kick, or a block.

4. The method of claim 1, wherein a filter is complementary with at least one other filter in the package when (i) that filter has at least one parameter that is determined based on a parameter of the at least one other filter in the package, (ii) that filter represents a gesture that is commonly made by a user within a short time period of a gesture represented by the at least one other filter in the package, or (iii) the gesture represented by that filter is capable of being made simultaneously with a gesture represented by the at least one other filter in the package.

5. The method of claim 1, wherein the indication of assigning the first value to the parameter is received as a result of the user making the gesture.

6. The method of claim 1, wherein the first value is a fixed value, a range, or a value with a tolerance.

7. The method of claim 1, wherein the package contains complementary gesture filters for a particular genre, and wherein the genre is one of a first-person shooter, action, driving, or sports genre.

8. The method of claim 1, wherein the application is a video game or an operating system.

9. The method of claim 1, further comprising:

receiving an indication of assigning a third value to the second parameter; and

assigning the third value to the second parameter.

10. The method of claim 9, further comprising:

assigning a fourth value to the first parameter, the fourth value determined using the third value.

11. The method of claim 1, wherein the indication of assigning the first value to the parameter of the first filter is received from the application.

12. The method of claim 1, wherein the indication of assigning the first value to the parameter of the first filter is received as a result of a context of the application being changed.

13. The method of claim 1, wherein the second filter comprises a child of the first filter.

14. The method of claim 1, wherein the second filter is a stacked filter comprising the first filter.

15. A system for providing a package of complementary filters to an application, each filter comprising information about a gesture, comprising:

a processor; and

a memory communicatively coupled to the processor when the system is operational, the memory bearing processor executable instructions that, when executed on the processor, cause the system to at least;

receive data corresponding to at least one image of at least part of a user;

determine that the data corresponds to a first filter;

determine that the data is indicative of it being likely that the user performed a motion or pose that corresponds to the gesture of the first filter;

determine that how a second filter is to be used to identify whether a corresponding gesture is performed is to be modified in response to determining that the data is indicative of it being likely that the user performed the motion or pose that corresponds to the gesture of the first filter; and

evaluate the data with the modified second filter to determine an output indicative of whether the data is indicative of the user performing a motion or pose that corresponds to the gesture of the second filter.

16. The system of claim 15, wherein the output comprises a confidence level, and wherein the instructions that, when executed on the processor cause the system to at least evaluate the data with the modified second filter to determine the output indicative of whether the data is indicative of the user performing a motion or pose that corresponds to the gesture of the second filter further cause the system to at least:

alter the confidence level of the second filter based on a confidence level of the first filter.

17. The system of claim 15, wherein the memory further bears instructions that, when executed on the processor, cause the system to at least:

parse the data for each filter in the package to determine if the data indicates a match with one or more of the filters of the package, before parsing the data for a filter not in the package.

18. The system of claim 15, wherein the memory further bears instructions that, when executed on the processor, cause the system to at least:

parse the data for each other filter in the package that can be parsed simultaneously with the at least one filter that corresponds to the data before parsing the data for a filter that cannot be parsed simultaneously with the at least one filter that corresponds to the data.

19. A computer readable storage device, comprising computer readable instructions that when executed on a computer, cause the computer to perform operations comprising:

providing a package comprising a plurality of filters, each filter comprising information about a gesture, each filter being complementary with at least one other filter in the package, a gesture being input by a user making a motion or pose associated with that gesture that is captured by a distance camera;

receiving an indication of assigning a first value to a parameter of a first filter, the parameter defining an attribute of a motion or pose to be made by a user for it to be recognized that the user has performed the gesture of the first filter;

assigning the first value to the parameter; and

assigning a second value to a second parameter of a second filter, the second value determined using the first value, the second value being determined using the first value based on a proportional relationship, an inversely proportional relationship, a linear relationship, an exponential relationship, or a function that takes the first value as an input.