Assigning gesture dictionaries

• US 10,398,972 B2
• Filed: 09/16/2016
• Issued: 09/03/2019
• Est. Priority Date: 01/08/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Murillo, Oscar E., Wilson, Andy D., Kipman, Alex A., Galore, Janet E.
• Primary Examiner(s): Vu, Thanh T
• Application Number:
  US15/267,591
• Publication Number:
  US 20170144067A1
• Time in Patent Office: 1,082 Days
• Field of Search: None
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/67 adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1018 Calibration; Key and button assignment
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6027 using adaptive systems learning from user actions, e.g. for skill level adjustment
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Techniques for assigning a gesture dictionary in a gesture-based system to a user comprise capturing data representative of a user in a physical space. In a gesture-based system, gestures may control aspects of a computing environment or application, where the gestures may be derived from a user'"'"'s position or movement in a physical space. In an example embodiment, the system may monitor a user'"'"'s gestures and select a particular gesture dictionary in response to the manner in which the user performs the gestures. The gesture dictionary may be assigned in real time with respect to the capture of the data representative of a user'"'"'s gesture. The system may generate calibration tests for assigning a gesture dictionary. The system may track the user during a set of short gesture calibration tests and assign the gesture dictionary based on a compilation of the data captured that represents the user'"'"'s gestures.

Claims

1. A method for assigning a gesture dictionary, comprising:

determining a characteristic of a user that is independent of motions or poses made by the user;

assigning a first gesture dictionary to the user based on the characteristic determined, the first gesture dictionary including a set of commands for processing by a computer;

capturing data indicative of a gesture of the user;

processing the captured gesture data using the first gesture dictionary to determine whether the captured gesture of the user corresponds to a command in the set of commands; and

invoking the command if the processing of the captured gesture of the user is determined to correspond to the command.

2. The method of claim 1, wherein determining the characteristic of the user that is independent of motions or poses made by the user comprises determining whether the user is left handed or right handed.

3. The method of claim 1, wherein the user is a first user and assigning the first gesture dictionary to the user comprises correlating the characteristic of the first user to a characteristic of a second user, and assigning a gesture dictionary assigned to the second user to the first user.

4. The method of claim 1, wherein assigning the first gesture dictionary to the user comprises correlating the characteristic of the user to a cluster of gesture dictionaries.

5. The method of claim 1, further comprising associating the first gesture dictionary to an identifier that identifies when to implement the first gesture dictionary.

6. The method of claim 5, wherein the identifier is at least one of an operating system, an application, a user, a feature of a user, a location, a type of application, a hardware configuration, a software configuration, a culture, current user, geography, demography, linguistic, culture, or a style.

7. The method of claim 1, further comprising assigning at least a gesture set to a plurality of users sharing at least said characteristic of the user.

8. The method of claim 1, wherein assigning the first gesture dictionary to the user comprises assigning a portion of each of a plurality of gesture dictionaries to the user such that a combination of data from each of the plurality of gesture dictionaries is assigned to the user.

9. A system for assigning a gesture dictionary, comprising:

a processor; and

a memory bearing instructions that, upon execution by the processor, cause the system at least to;

determine a characteristic of a user that is independent of motions or poses made by the user;

assign a first gesture dictionary to the user based on the characteristic determined, the first gesture dictionary including a set of commands for processing in accordance with a corresponding gesture;

capture data indicative of a gesture of the user;

process the captured gesture data using the first gesture dictionary to determine whether the captured gesture of the user corresponds to a command in the set of commands; and

invoking the command if the processing of the captured gesture of the user is determined to correspond to the command.

10. The system of claim 9, wherein the instructions that, upon execution by the processor, cause the system at least to determine the characteristic of the user that is independent of motions or poses made by the user further cause the system at least to determine whether the user is left handed or right handed.

11. The system of claim 9, wherein the user is a first user and wherein the instructions that, upon execution by the processor, cause the system at least to assign the first gesture dictionary to the user based on the characteristic determined further cause the system at least to correlate the characteristic of the first user to a characteristic of a second user and to assign a gesture dictionary assigned to the second user to the first user.

12. The system of claim 9, wherein the instructions that, upon execution by the processor, cause the system at least to assign the first gesture dictionary to the user based on the characteristic determined further cause the system at least to correlate the characteristic of the user to a cluster of gesture dictionaries.

13. The system of claim 9, wherein the memory further bears instructions that, upon execution by the processor, cause the system at least to associate the first gesture dictionary to an identifier that identifies when to implement the first gesture dictionary.

14. The system of claim 13, wherein the identifier is at least one of an operating system, an application, a user, a feature of a user, a location, a type of application, a hardware configuration, a software configuration, a culture, current user, geography, demography, linguistic, culture, or a style.

15. The system of claim 9, further comprising assigning at least a gesture set to a plurality of users sharing at least said characteristic of the user.

16. The system of claim 9, wherein the instructions that, upon execution by the processor, cause the system at least to assign the first gesture dictionary to the user further cause the system at least to assign a portion of each of a plurality of gesture dictionaries to the user such that a combination of data from each of the plurality of gesture dictionaries is assigned to the user.

17. A computer-readable storage device bearing computer-executable instructions that, when executed on a computer, cause the computer to for assign a gesture dictionary by performing operations comprising:

determining a characteristic of a user that is independent of motions or poses made by the user;

assigning a first gesture dictionary to the user based on the characteristic determined, the first gesture dictionary including a set of commands for processing by a computer;

capturing data indicative of a gesture of the user;

processing the captured gesture data using the first gesture dictionary to determine whether the captured gesture of the user corresponds to a command in the set of commands; and

invoking the command if the processing of the captured gesture of the user is determined to correspond to the command.

18. The computer-readable storage device of claim 17, wherein instructions for determining the characteristic of the user that is independent of motions or poses made by the user comprises instructions that when executed by the processor cause the processor to determine whether the user is left handed or right handed.

19. The computer-readable storage device of claim 17, wherein the user is a first user and instructions for assigning the first gesture dictionary to the user comprises instructions that when executed by the processor cause the processor to correlate the characteristic of the first user to a characteristic of a second user and to assign a gesture dictionary assigned to the second user to the first user.

20. The computer-readable storage device of claim 17, wherein instructions for assigning the first gesture dictionary to the user comprises instructions that when executed by the processor cause the processor to correlate the characteristic of the user to a cluster of gesture dictionaries.