Assigning gesture dictionaries

• US 9,468,848 B2
• Filed: 12/12/2013
• Issued: 10/18/2016
• Est. Priority Date: 01/08/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Murillo, Oscar E., Wilson, Andy, Kipman, Alex A., Galore, Janet
• Primary Examiner(s): Vu, Thanh
• Application Number:
  US14/105,043
• Publication Number:
  US 20140109023A1
• Time in Patent Office: 1,041 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/67 adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1018 Calibration; Key and button assignment
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6027 using adaptive systems learning from user actions, e.g. for skill level adjustment
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Techniques for assigning a gesture dictionary in a gesture-based system to a user comprise capturing data representative of a user in a physical space. In a gesture-based system, gestures may control aspects of a computing environment or application, where the gestures may be derived from a user'"'"'s position or movement in a physical space. In an example embodiment, the system may monitor a user'"'"'s gestures and select a particular gesture dictionary in response to the manner in which the user performs the gestures. The gesture dictionary may be assigned in real time with respect to the capture of the data representative of a user'"'"'s gesture. The system may generate calibration tests for assigning a gesture dictionary. The system may track the user during a set of short gesture calibration tests and assign the gesture dictionary based on a compilation of the data captured that represents the user'"'"'s gestures.

Claims

1. A method for assigning a gesture dictionary, comprising:

determining a characteristic of a user that is independent of a motion or pose made by the user;

correlating the characteristic of the user to a first gesture dictionary of a plurality of gesture dictionaries, each gesture dictionary of the plurality of gesture dictionaries identifying a set of input commands to a computer that may be invoked by a performance of a corresponding gesture;

assigning the first gesture dictionary to the user, the first gesture dictionary corresponding to the characteristic; and

processing captured data with the first gesture dictionary to identify whether a second motion or pose by the user in the captured data invokes an input command to the computer.

2. The method of claim 1, wherein determining the characteristic of the user that is independent of a motion or pose made by the user comprises:

determining whether the user is left handed or right handed.

3. The method of claim 1, wherein the user is a first user and correlating the characteristic of the user to the first gesture dictionary comprises:

correlating the characteristic of the first user to a characteristic of a second user, and assigning a gesture dictionary assigned to the second user to the first user.

4. The method of claim 1, wherein correlating the characteristic of the user to the first gesture dictionary comprises:

correlating the characteristic of the user to a cluster of gesture dictionaries.

5. The method of claim 1, wherein the first gesture dictionary is associated an identifier, identifier identifying when to implement the first gesture dictionary.

6. The method of claim 5, wherein the identifier is at least one of an operating system, an application, a user, a feature of a user, a location, a type of application, a hardware configuration, a software configuration, a culture, current user, geography, demography, linguistic, culture, or a style.

7. The method of claim 1, wherein the gesture dictionary is assigned to the user in real time upon capturing the characteristic of the user.

8. The method of claim 1, wherein assigning the first gesture dictionary to the user comprises:

assigning a portion of each of the plurality of gesture dictionaries to the user, such that a combination of data from each of the plurality of gesture dictionaries is assigned to the user.

9. A system for assigning a gesture dictionary, comprising:

a memory bearing instructions that, upon execution by a processor, cause the system at least to;

determine a characteristic of a user that is independent of a motion or pose made by the user;

correlate the characteristic of the user to a first gesture dictionary of a plurality of gesture dictionaries, each gesture dictionary of the plurality of gesture dictionaries identifying a set of input commands to a computer that may be invoked by a performance of a corresponding gesture;

assign the first gesture dictionary to the user, the first gesture dictionary corresponding to the characteristic; and

process captured data with the first gesture dictionary to identify whether a second motion or pose by the user in the captured data invokes an input command to the computer.

10. The system of claim 9, wherein the instructions that, upon execution by the processor, cause the system at least to determine the characteristic of the user that is independent of a motion or pose made by the user further cause the system at least to:

determine whether the user is left handed or right handed.

11. The system of claim 9, wherein the user is a first user and wherein the instructions that, upon execution by the processor, cause the system at least to correlate the characteristic of the user to the first gesture dictionary further cause the system at least to:

correlate the characteristic of the first user to a characteristic of a second user, and assigning a gesture dictionary assigned to the second user to the first user.

12. The system of claim 9, wherein the instructions that, upon execution by the processor, cause the system at least to correlate the characteristic of the user to the first gesture dictionary further cause the system at least to:

correlate the characteristic of the user to a cluster of gesture dictionaries.

13. The system of claim 9, wherein the first gesture dictionary is associated an identifier, identifier identifying when to implement the first gesture dictionary.

14. The system of claim 13, wherein the identifier is at least one of an operating system, an application, a user, a feature of a user, a location, a type of application, a hardware configuration, a software configuration, a culture, current user, geography, demography, linguistic, culture, or a style.

15. The system of claim 9, wherein the gesture dictionary is assigned to the user in real time upon capturing the characteristic of the user.

16. The system of claim 9, wherein the instructions that, upon execution by the processor, cause the system at least to assign the first gesture dictionary to the user further cause the system at least to:

assign a portion of each of the plurality of gesture dictionaries to the user, such that a combination of data from each of the plurality of gesture dictionaries is assigned to the user.

17. A computer-readable storage device for assigning a gesture dictionary, bearing computer-executable instructions that, when executed on a computer, cause the computer to perform operations comprising:

determining a characteristic of a user that is independent of a motion or pose made by the user;

correlating the characteristic of the user to a first gesture dictionary of a plurality of gesture dictionaries, each gesture dictionary of the plurality of gesture dictionaries identifying a set of input commands to the computer that may be invoked by a performance of a corresponding gesture;

assigning the first gesture dictionary to the user, the first gesture dictionary corresponding to the characteristic; and

processing captured data with the first gesture dictionary to identify whether a second motion or pose by the user in the captured data invokes an input command to the computer.

18. The computer-readable storage device of claim 17, wherein determining the characteristic of the user that is independent of a motion or pose made by the user comprises:

determining whether the user is left handed or right handed.

19. The computer-readable storage device of claim 17, wherein the user is a first user and correlating the characteristic of the user to the first gesture dictionary comprises:

correlating the characteristic of the first user to a characteristic of a second user, and assigning a gesture dictionary assigned to the second user to the first user.

20. The computer-readable storage device of claim 17, wherein correlating the characteristic of the user to the first gesture dictionary comprises:

correlating the characteristic of the user to a cluster of gesture dictionaries.