METHODS AND SYSTEMS FOR DEFINING OR MODIFYING A VISUAL REPRESENTATION

• US 20100302138A1
• Filed: 05/29/2009
• Published: 12/02/2010
• Est. Priority Date: 05/29/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Keane, Brian Eugene, Poot, Rudy Jacobus
• Application Number:
  US12/475,297
• Publication Number:
  US 20100302138A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A system may track a user'"'"'s motions or gestures performed in a physical space and map them to a visual representation of the user. The user'"'"'s gestures may be translated to a control in a system or application space, such as to open a file or to execute a punch in a punching game. Similarly, the user'"'"'s gestures may be translated to a control in the system or application space for making modifications to a visual representation. A visual representation may be a display of a virtual object or a display that maps to a target in the physical space. In another example embodiment, the system may track the target in the physical space over time and apply modifications or updates to the visual representation based on the history data.

Claims

1. A method for applying a modification to a visual representation, the method comprising:

rendering the visual representation;

receiving data of a scene, wherein the data includes data representative of a user'"'"'s modification gesture in a physical space;

modifying the visual representation based on the user'"'"'s modification gesture, wherein the modification gesture is a gesture that maps to a control for modifying a characteristic of the visual representation.

2. The method of claim 1, wherein the visual representation rendered is a visual representation of at least one of a virtual object or a target in the physical space.

3. The method of claim 1, further comprising mapping captured motion from the physical space to the modified visual representation.

4. The method of claim 1, wherein the modification gesture triggers entry into a modification mode.

5. The method of claim 1, further comprising recognizing the modification gesture, wherein recognizing the modification gesture comprises:

providing a filter representing at least one modification gesture, the filter comprising base information about the at least one modification gesture;

receiving the image data of a scene that is captured by a camera;

applying the filter to the image data and determining an output from the base information about the at least one modification gesture; and

applying the modification to the visual representation that corresponds to the at least one modification gesture.

6. The method of claim 1, wherein the modification is at least one of behavioral, emotional, physical, a speech pattern, or a voice.

7. The method of claim 1, further comprising receiving the depth image of the physical space, wherein the depth image includes data representative of a human target in the physical space, and the visual representation maps to the human target.

8. The method of claim 1, wherein the visual representation is selected from a plurality of stock models.

9. The method of claim 1, wherein the visual representation is of a user, and the user'"'"'s modification gesture in the physical space is mapped to the visual representation.

10. The method of claim 1, wherein the modification gesture comprises hand control.

11. The method of claim 1, wherein the modification gesture comprises physical motion of a user'"'"'s body part to be modified.

12. The method of claim 1, wherein rendering a visual representation comprises rendering a visual representation of a user having at least detected characteristics of the user.

13. The method of claim 10, wherein the detected characteristic is a physical characteristic of the user in the physical space that is captured by a capture device.

14. A system for applying a modification to a visual representation, the system comprising:

a camera component, wherein the camera component receives data of a scene, wherein the data includes data representative of a user'"'"'s modification gesture in a physical space; and

a processor, wherein the processor executes computer executable instructions, and wherein the computer executable instructions comprise instructions for;

rendering the visual representation;

modifying the visual representation based on the user'"'"'s modification gesture, wherein the modification gesture is a gesture that maps to a control for modifying a characteristic of the visual representation.

15. The system of claim 14, further comprising a display device for displaying the visual representation and the modified visual representation.

16. The system of claim 14, further comprising mapping captured motion from the physical space to the modified visual representation.

17. The system of claim 14, wherein the visual representation rendered is of at least one of a virtual object or a target in the physical space.

18. The system of claim 14, further comprising a gesture recognition engine, wherein the gesture recognition engine:

provides a filter representing at least one modification gesture, the filter comprising base information about the at least one modification gesture;

receives the image data of a scene that is captured by a camera;

applies the filter to the image data and determining an output from the base information about the at least one modification gesture; and

applies the modification to the visual representation that corresponds to the at least one modification gesture.

19. The system of claim 14, wherein the capture device receives depth image data of the physical space, wherein the depth image data includes data representative of a human target in the physical space, and the visual representation maps to the human target.

20. The system of claim 14, wherein the visual representation is of a user, and the user'"'"'s modification gesture in the physical space is mapped to the visual representation.

21. The system of claim 14, wherein the modification gesture comprises at least one of hand control or physical motion of a user'"'"'s body part to be modified.

22. The system of claim 14, wherein rendering a visual representation comprises rendering a visual representation of a user having at least detected characteristics of the user.