VISUAL REPRESENTATION EXPRESSION BASED ON PLAYER EXPRESSION

• US 20110007142A1
• Filed: 07/09/2009
• Published: 01/13/2011
• Est. Priority Date: 07/09/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Kipman, Alex, Wilson, Andrew, Perez, Kathryn Stone, Burton, Nicholas D.
• Granted Patent: US 8,390,680 B2
• Time in Patent Office: Days
• US Class Current: 348/77
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

Using facial recognition and gesture/body posture recognition techniques, a system can naturally convey the emotions and attitudes of a user via the user'"'"'s visual representation. Techniques may comprise customizing a visual representation of a user based on detectable characteristics, deducting a user'"'"'s temperament from the detectable characteristics, and applying attributes indicative of the temperament to the visual representation in real time. Techniques may also comprise processing changes to the user'"'"'s characteristics in the physical space and updating the visual representation in real time. For example, the system may track a user'"'"'s facial expressions and body movements to identify a temperament and then apply attributes indicative of that temperament to the visual representation. Thus, a visual representation of a user, such as an avatar or fanciful character, can reflect the user'"'"'s expressions and moods in real time.

Claims

1. A method for applying attributes indicative of a user'"'"'s temperament to a visual representation, the method comprising:

rendering the visual representation of a user;

receiving data of a physical space, wherein the data is representative of the user in the physical space;

analyzing at least one detectable characteristic to deduct the user'"'"'s temperament; and

applying attributes indicative of the user'"'"'s temperament to the visual representation.

2. The method of claim 1, wherein applying attributes indicative of the user'"'"'s temperament to the visual representation is performed in real time with respect to the receipt of the data of the physical space.

3. The method of claim 1, wherein the visual representation is at least one of an avatar, a character, a cursor, or a stock model.

4. The method of claim 1, wherein the at least one detectable characteristic comprise at least one of a user'"'"'s characteristics, a user'"'"'s physical features, a user'"'"'s behavior, a user'"'"'s speech pattern, a user'"'"'s voice, a gesture, history data, or an application status.

5. The method of claim 1, wherein the data is representative of at least one of a user'"'"'s characteristics in the physical space.

6. The method of claim 1, further comprising applying at least one of a user'"'"'s characteristics to the visual representation.

7. The method of claim 1, wherein receiving data of the physical space comprises receiving data via a capture device.

8. The method of claim 1, wherein analyzing detectable characteristics to deduct the user'"'"'s temperament comprises a comparison of at least one of the detectable characteristics to a table that correlates characteristics to a particular temperament.

9. The method of claim 1, wherein the user'"'"'s temperament comprises at least one of generally negative, generally positive, ambivalent, bored, happy, sad, frustrated, excited, or angry.

10. The method of claim 1, further comprising:

tracking changes to the at least one detectable characteristic to deduct changes to the user'"'"'s temperament; and

applying updates to the attributes indicative of the user'"'"'s temperament to correspond to the deducted changes in the user'"'"'s temperament.

11. The method of claim 1, further comprising selecting attributes indicative of the user'"'"'s temperament from a plurality of attributes that correspond to the user'"'"'s temperament.

12. A system for applying attributes indicative of a user'"'"'s temperament to a visual representation, the system comprising:

a camera component, wherein the camera component receives data of a scene, wherein the data is representative of a user in a physical space; and

a processor, wherein the processor executes computer executable instructions, and wherein the computer executable instructions comprise instructions for;

rendering the visual representation of the user;

analyzing at least one detectable characteristic to deduct the user'"'"'s temperament; and

applying attributes indicative of the user'"'"'s temperament to the visual representation.

13. The system of claim 12, wherein applying attributes indicative of the user'"'"'s temperament to the visual representation is performed in real time with respect to the receipt of the data of the physical space.

14. The system of claim 12, further comprising a memory that stores a table that provides characteristics that correlate to a particular temperament.

15. A method for applying attributes indicative of a temperament to a visual representation, the method comprising:

rendering the visual representation of a user;

receiving data of a physical space, wherein the data is representative of a temperament identity gesture; and

applying attributes indicative of the temperament associated with the temperament identity gesture to the visual representation;

16. The method of claim 15, wherein applying attributes indicative of the temperament to the visual representation is performed in real time with respect to the receipt of the data of the physical space.

17. The method of claim 15, wherein the visual representation is at least one of an avatar, a character, a cursor, or a stock model.

18. The method of claim 15, further comprising applying at least one of a user'"'"'s characteristics to the visual representation, wherein the data further comprises data representative of the user'"'"'s characteristics.

19. The method of claim 15, wherein receiving data of the physical space comprises receiving data via a capture device.

20. The method of claim 15, wherein the temperament comprises at least one of generally negative, generally positive, ambivalent, bored, happy, sad, frustrated, excited, or angry.

21. The method of claim 15, further comprising:

providing a filter representing the temperament identity gesture, the filter comprising base information about the temperament identity gesture; and

applying the filter to the data and determining an output from the base information about the temperament identity gesture.

22. The method of claim 15, further comprising selecting attributes indicative of the temperament from a plurality of attributes that correspond to the user'"'"'s temperament.