GESTURE PERSONALIZATION AND PROFILE ROAMING

• US 20110093820A1
• Filed: 10/19/2009
• Published: 04/21/2011
• Est. Priority Date: 10/19/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lobb, Kenneth Alan, Kipman, Alex Aben-Athar, Molnar, Joseph Reginald Scott, Zhang, Zhengyou
• Granted Patent: US 9,400,548 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/424 involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/71 using secure communication between game devices and game servers, e.g. by encrypting game data or authenticating players
• CPC Class Codes: A63F 13/77 involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
• CPC Class Codes: A63F 13/79 involving player-related data, e.g. identities, accounts, preferences or play histories
• CPC Class Codes: A63F 2300/1018 Calibration; Key and button assignment
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/208 for storing personal settings or data of the player
• CPC Class Codes: A63F 2300/401 Secure communication, e.g. using encryption or authentication
• CPC Class Codes: A63F 2300/532 using secure communication, e.g. by encryption, authentication
• CPC Class Codes: A63F 2300/552 for downloading to client devices, e.g. using OS version, hardware or software profile of the client device
• CPC Class Codes: A63F 2300/5546 using player registration data, e.g. identification, account, preferences, game history
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A gesture-based system may have default or pre-packaged gesture information, where a gesture is derived from a user'"'"'s position or motion in a physical space. In other words, no controllers or devices are necessary. Depending on how a user uses his or her gesture to accomplish the task, the system may refine the properties and the gesture may become personalized. The personalized gesture information may be stored in a gesture profile and can be further updated with the latest data. The gesture-based system may use the gesture profile information for gesture recognition techniques. Further, the gesture profile may be roaming such that the gesture profile is available in a second location without requiring the system to relearn gestures that have already been personalized on behalf of the user.

Claims

1. A method for generating a personalized gesture profile, the method comprising:

receiving data of a physical space, wherein the data is representative of a user'"'"'s gesture in the physical space;

identifying characteristics of the user'"'"'s gesture from the data; and

generating the gesture profile associated with a user;

populating the user'"'"'s gesture profile with personalized gesture information for the user'"'"'s gesture based on the characteristics of the user'"'"'s gesture.

2. The method of claim 1, further comprising providing the user'"'"'s gesture profile for roaming in a network.

3. The method of claim 1, further comprising identifying variations of the user'"'"'s gesture from default gesture information, wherein the personalized gesture information is indicative of the variations from the default gesture information.

4. The method of claim 1, wherein the generation of the gesture profile is initiated by at least one of a computing environment, a host, a system administrator, a client, or the user.

5. The method of claim 1, wherein the gesture profile is initiated with at least one of user profile data, a context of the user, a context of a computing environment, or input by the user.

6. The method of claim 1, further comprising recognizing the user'"'"'s gesture by comparing the received data to the personalized gesture information in the generated gesture profile.

7. The method of claim 6, wherein the personalized gesture information in the gesture profile at least one of supplements, replaces, or supersedes default gesture information.

8. The method of claim 1, wherein the characteristics of the user'"'"'s gesture comprises at least one of a user'"'"'s facial expression, a body position, language, speech patterns, a skeletal movement, a word spoken, history data, or voice recognition information, text, geometric data, a speed, a volume of space, a size, a shape, a depth, a series of images, an angle, a distance between points, a user'"'"'s preference, or a height.

9. The method of claim 1, further comprising storing the gesture profile in at least one of a local media, a remote media, in a cache, on a local computing environment, on a remote computing environment, on a removable media, or on non-removable media.

10. The method of claim 1, further comprising activating the gesture profile in response to a triggering event, wherein the triggering event is at least one of a user identity, a computing environment powering on, the user logging on, an execution of an application, a recognition of the computing environment, or a request by the user.

11. The method of claim 1, wherein the personalized gesture information is derived from the received data and is representative of a user'"'"'s position or motion in the physical space.

12. The method of claim 1, further comprising actively requesting the user to perform the gesture for identifying characteristics of the user'"'"'s gesture.

13. The method of claim 1, wherein the gesture profile comprises segments and at least one segment is applicable to at least one of an application, the user, a computing environment, or a physical environment.

14. The method of claim 1, wherein the gesture profile comprises at least one of a computer representation of information associated with the user, a mathematical expression, a collection of wire frame snapshots, image data, animations, text, geometric data, a speed, a volume of space, a size, a shape, a depth, a series of images, an angle, a distance between points, a user'"'"'s preference, or a height.

15. A method for roaming a gesture profile, the method comprising:

identifying the gesture profile associated with a user,

wherein the gesture profile comprises personalized gesture information for the user, and wherein the personalized gesture information is derived from data captured by a capture device and representative of a user'"'"'s gesture in a physical space; and

roaming the gesture profile via a network connection.

16. The method of claim 15, further comprising receiving a request for the gesture profile.

17. The method of claim 15, further comprising activating the gesture profile based on an identity of the user.

18. The method of claim 15, further comprising identifying the user from user profile data by comparing the user profile data to at least one of a user'"'"'s scanned or estimated body size, a skeletal model, a body model, a voice sample, a password, facial features, body features, a scanned fingerprint, a gesture, a user limitation, or a user tendency.

19. The method of claim 15, wherein roaming the gesture profile comprises seamless sharing of the gesture profile between computing environments or application in a network.

20. A method of gesture recognition based on a user'"'"'s gesture profile, the method comprising:

activating a gesture profile associated with a user,

wherein the gesture profile comprises personalized gesture information for the user, and wherein the personalized gesture information is derived from data captured by a capture device and representative of a user'"'"'s position or motion in a physical space; and

recognizing a user'"'"'s gesture by comparing the received data to the personalized gesture information in the gesture profile.

21. The method of claim 20, wherein recognizing the user'"'"'s gesture further comprises analyzing specification data that identifies aspects of a local computing environment.