EXTENDING STANDARD GESTURES

• US 20100306716A1
• Filed: 05/29/2009
• Published: 12/02/2010
• Est. Priority Date: 05/29/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Perez, Kathryn Stone
• Application Number:
  US12/475,295
• Publication Number:
  US 20100306716A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 13/807 Gliding or sliding on surfaces, e.g. using skis, skates or boards
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 13/833 Hand-to-hand fighting, e.g. martial arts competition A63F13/837 takes precedence
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/8029 Fighting without shooting
• CPC Class Codes: A63F 2300/8041 Skating using skis, skates or board
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

In a system that utilizes gestures for controlling aspects of an application, strict requirements for success may limit approachability or accessibility for different types of people. The system may receive data reflecting movement of a user and remap a standard gesture to correspond to the received data. Following the remapping, the system may receive data reflecting skeletal movement of a user, and determine from that data whether the user has performed one or more standard and/or remapped gestures. In an exemplary embodiment, a gesture library comprises a plurality of gestures. Where these gestures are complementary with each other, they may be grouped into gesture packages. A gesture package may include gestures that are packaged as remapped gestures or a gesture package may include options for remapping standard gestures to new data.

Claims

1. A method for remapping a gesture, the method comprising:

selecting a gesture filter that corresponds to the gesture for remapping;

receiving data from a capture device that is representative of a user'"'"'s motion in a physical space; and

remapping the gesture to the user'"'"'s motion, wherein remapping the gesture comprises modifying the gesture filter to correspond to the received data.

2. The method of claim 1, wherein the gesture filter comprises base information about the gesture, and remapping the gesture to the user'"'"'s motion comprises modifying the base information to correspond to the received data.

3. The method of claim 2, further comprising assigning permissible tolerances for recognizing the gesture to the modified base information.

4. The method of claim 1, further comprising identifying an intended control based on the data received from the capture device, wherein selecting the gesture filter comprises selecting the gesture filter that corresponds to a gesture for the intended control.

5. The method of claim 1, further comprising collecting a history of data representative of the user'"'"'s motion the physical space, wherein remapping the gesture to the user'"'"'s motion comprises remapping the gesture to correspond to the history data representative of the user'"'"'s motion.

6. The method of claim 5, further comprising detecting a repeated variation between the history of data representative of the user'"'"'s motion in the physical space and requirements of a gesture filter for an expected gesture, wherein the gesture for remapping is the expected gesture.

7. The method of claim 1, further comprising generating a profile with information about the remapped gesture, wherein the profile can be loaded for at least one of system-wide use, application use, a user associated to the profile, or a user that is not associated with the profile.

8. The method of claim 1, further comprising receiving a request to remap the gesture, wherein the gesture filter is selected that corresponds to the request.

9. The method of claim 1, further comprising determining if the received data is representative of a remapped gesture.

10. The method of claim 9, wherein determining if received data is representative of a remapped gesture comprises receiving data reflecting skeletal movement of a user, and comparing the data to the gesture filter that corresponds to the remapped gesture.

11. The method of claim 9, further comprising displaying a visual representation of the user that maps to the user'"'"'s motion, and animating at least a portion of the visual representation to correspond to the remapped gesture.

12. The method of claim 1, wherein modifying the gesture filter comprises modifying a parameter of the gesture filter that represents a body part, a volume of space, a velocity, a direction of movement, an angle, a two-dimensional (2D) plane, or a place where a movement occurs.

13. A system for remapping a gesture, the system comprising:

a capture device, wherein the capture device receives data that is representative of a user'"'"'s motion in a physical space; and

a processor, wherein the processor executes computer executable instructions, and wherein the computer executable instructions comprise instructions for;

selecting a gesture filter that corresponds to the gesture for remapping; and

remapping the gesture to the user'"'"'s motion, wherein remapping the gesture comprises modifying the gesture filter to correspond to the received data.

14. The system of claim 13, wherein the gesture filter comprises base information about the gesture, and remapping the gesture to the user'"'"'s motion comprises modifying the base information to correspond to the received data.

15. The system of claim 14, further comprising assigning permissible tolerances to the modified base information.

16. The system of claim 13, further comprising identifying an intended control based on the data received from the capture device, wherein selecting the gesture filter comprises selecting the gesture filter that corresponds to a gesture for the intended control.

17. The system of claim 13, further comprising collecting a history of data representative of the user'"'"'s motion the physical space, wherein remapping the gesture to the user'"'"'s motion comprises remapping the gesture to correspond to the history data representative of the user'"'"'s motion.

18. The system of claim 17, further comprising detecting a repeated variation between the history of data representative of the user'"'"'s motion in the physical space and requirements of a gesture filter for an expected gesture, wherein the gesture for remapping is the expected gesture.

19. The system of claim 13, further comprising generating a profile with information about the remapped gesture, wherein the system is configured to load the profile for at least one of system-wide use, application use, a user associated with the profile, or a user that is not associated with the profile.

20. The system of claim 13, further comprising a display device for displaying a visual representation of the user that maps to the user'"'"'s motion, wherein at least a portion of the visual representation is animated to correspond to the remapped gesture.

21. The system of claim 13, further comprising receiving a request to remap the gesture, wherein the gesture filter is selected that corresponds to the request.

22. A method for remapping a package of complementary gesture filters, the method comprising:

providing a package comprising a plurality of filters, each filter comprising information about a gesture, at least one filter being complementary with at least one other filter in the package;

remapping a first value to a first parameter of a first filter to correspond to data received from a capture device that is representative of a user'"'"'s motion in a physical space;

remapping a second value to a second parameter of a second filter, the second value determined using the first value.

23. The method of claim 22, wherein a recognizer engine sets the first parameter for a first gesture with the first value, and remaps a value of any other parameters of that gesture or any other gestures in the package that are dependent upon the first value of the first gesture.

24. The method of claim 22, wherein modifying the gesture filter comprises modifying a parameter of the first filter that represents a body part, a volume of space, a velocity, a direction of movement, an angle, a two-dimensional (2D) plane, or a place where a movement occurs.

25. The method of claim 22, wherein a filter is complementary with the at least one other filter in the package when (i) that filter has at least one parameter that is determined based on a parameter of the at least one other filter in the package, (ii) that filter represents a gesture that is commonly made by a user within a short time period of a gesture represented by the at least one other filter in the package, or (iii) the gesture represented by that filter is capable of being made simultaneously with a gesture represented by the at least one other filter in the package.

26. The method of claim 22, wherein the second value is determined using the first value based on a proportional relationship, an inversely proportional relationship, a linear relationship, an exponential relationship, or a function that takes the first value as an input.