ASSIGNING GESTURE DICTIONARIES

• US 20110173204A1
• Filed: 01/08/2010
• Published: 07/14/2011
• Est. Priority Date: 01/08/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wilson, Andy, Galore, Janet, Kipman, Alex A., Murillo, Oscar E.
• Granted Patent: US 8,631,355 B2
• Time in Patent Office: Days
• US Class Current: 707/741
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/67 adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1018 Calibration; Key and button assignment
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6027 using adaptive systems learning from user actions, e.g. for skill level adjustment
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Techniques for assigning a gesture dictionary in a gesture-based system to a user comprise capturing data representative of a user in a physical space. In a gesture-based system, gestures may control aspects of a computing environment or application, where the gestures may be derived from a user'"'"'s position or movement in a physical space. In an example embodiment, the system may monitor a user'"'"'s gestures and select a particular gesture dictionary in response to the manner in which the user performs the gestures. The gesture dictionary may be assigned in real time with respect to the capture of the data representative of a user'"'"'s gesture. The system may generate calibration tests for assigning a gesture dictionary. The system may track the user during a set of short gesture calibration tests and assign the gesture dictionary based on a compilation of the data captured that represents the user'"'"'s gestures.

Claims

1. A method for assigning a gesture dictionary, the method comprising:

capturing data representative of a user in a physical space;

processing the captured data to identify input gesture data for the user;

correlating the input gesture data to at least one of a plurality of gesture dictionaries; and

assigning the at least one of the plurality of gesture dictionaries to the user, wherein the gesture dictionary corresponds to the input gesture data.

2. The method of claim 1, further comprising requesting explicit gesture feedback from the user via instructions to the user to perform a gesture.

3. The method of claim 2, wherein the instructions comprise a display of a command and a request to the user to perform the gesture that corresponds to the command.

4. The method of claim 1, further comprising passively tracking the user and compiling captured data for processing to identify the input gesture data.

5. The method of claim 4, further comprising manipulating circumstances of an output to the user to elicit particular input gesture data.

6. The method of claim 1, wherein correlating the input gesture data to at least one of the plurality of gesture dictionaries comprises correlating the input gesture data to a cluster of gesture dictionaries.

7. The method of claim 1, wherein the user is a first user and correlating the input gesture data to the at least one of the plurality of gesture dictionaries comprises correlating the input gesture data of the first user to an input gesture data of a second user, and assigning a gesture dictionary assigned to the second user to the first user.

8. The method of claim 1, wherein the at least one of the plurality of gesture dictionaries is associated an identifier, wherein the identifier identifies when to implement the at least one of the plurality of gesture dictionaries.

9. The method of claim 8, wherein the identifier is at least one of an operating system, an application, a user, a feature of a user, a location, a type of application, a hardware configuration, a software configuration, a culture, current user, geography, demography, linguistic, culture, or a style.

10. The method of claim 1, The method of claim 1, wherein the gesture dictionary is assigned to the user in real time upon capturing the data representative of the user.

11. The method of claim 1, the method further comprising:

compiling captured data representative of the user;

identifying at least one identifier associated with the user;

correlating the at least one identifier to the plurality of gesture dictionaries;

assigning a portion of each of the plurality of gesture dictionaries correlating to the identifier to the user, such that a combination of the gesture recognition data from each of the plurality of gesture dictionaries is assigned to the user.

12. The method of claim 1, further comprising:

identifying a level of failure of the input gesture data to correspond to the gesture recognition data in the gesture dictionary, and

providing instructional feedback to the user.

13. A method for generating a gesture dictionary for assignment, the method comprising:

compiling gesture recognition data;

clustering the gesture recognition data in to a hierarchy of gesture dictionaries;

selecting an exemplary gesture from the gesture recognition data in the cluster of gesture dictionaries;

capturing data representative of the exemplary gesture performed by a user; and

assigning the cluster of gesture dictionaries to the user, wherein the cluster corresponds to the exemplary gesture as performed by the user.

14. The method of claim 13, further comprising requesting explicit gesture feedback from the user via instructions to the user to perform the exemplary gesture.

15. The method of claim 13, further comprising passively tracking the user and compiling captured data for processing to identify the input gesture data.

16. The method of claim 13, wherein the hierarchy of gesture dictionaries comprise complimentary gesture recognition data.

17. The method of claim 13, wherein the user is a first user and assigning the cluster of gesture dictionaries to the first user comprises correlating the input gesture data of the first user to an input gesture data of a second user, and assigning a cluster assigned to the second user to the first user.

18. A system for assigning a gesture dictionary, the system comprising:

a capture device component, wherein the capture device component captures data representative of a user in a physical space; and

a processor, wherein the processor executes computer executable instructions, and wherein the computer executable instructions comprise instructions for;

processing the captured data to identify input gesture data for the user;

correlating the input gesture data to at least one of a plurality of gesture dictionaries; and

assigning the at least one of the plurality of gesture dictionaries to the user,

wherein the gesture dictionary corresponds to the input gesture data.

19. The system of claim 18, further comprising requesting explicit gesture feedback from the user via instructions to the user to perform a gesture.

20. The system of claim 19, further comprising a display device, wherein the instructions comprise a display of a command on the display device and a request to the user to perform the gesture that corresponds to the command.

21. The system of claim 18, further comprising passively tracking the user and compiling captured data for processing to identify the input gesture data.