BIONIC MOTION

• US 20110221755A1
• Filed: 03/12/2010
• Published: 09/15/2011
• Est. Priority Date: 03/12/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Geisner, Kevin, Mount, Brian James, Middleton, Zachary T., Willoughby, Christopher, Osborn, Dan, Bennett, Darren, Markovic, Relja, Deaguero, Joel, Latta, Stephen G., Snook, Gregory N.
• Application Number:
  US12/722,587
• Publication Number:
  US 20110221755A1
• Time in Patent Office: Days
• US Class Current: 345/474
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/833 Hand-to-hand fighting, e.g. martial arts competition A63F13/837 takes precedence
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: A63F 2300/8029 Fighting without shooting
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A camera that can sense motion of a user is connected to a computing system (e.g., video game apparatus or other type of computer). The computing system determines an action corresponding to the sensed motion of the user and determines a magnitude of the sensed motion of the user. The computing system creates and displays an animation of an object (e.g., an avatar in a video game) performing the action in a manner that is amplified in comparison to the sensed motion by a factor that is proportional to the determined magnitude. The computing system also creates and outputs audio/visual feedback in proportion to a magnitude of the sensed motion of the user.

Claims

1. A method for providing amplified motion, comprising:

using a camera to sense motion of a user;

in response to sensing the motion of the user, creating and displaying an animation of an object performing the motion of the user in a manner that is amplified in comparison to the motion of the user; and

creating and outputting audio/visual feedback in proportion to a magnitude of the sensed motion of the user.

2. The method of claim 1, wherein:

the using a camera to sense motion includes using a depth camera to sense a depth image and determining the motion of the user from the depth image.

3. The method of claim 1, further comprising:

determining the magnitude of the sensed motion of the user, the motion of the user is amplified by a factor that is proportional to the magnitude of the sensed motion of the user.

4. The method of claim 1, wherein:

the creating and displaying the animation of an object performing the motion of the user includes creating and displaying the object starting the motion when the user starts the motion and completing the motion when the user completes the motion.

5. The method of claim 1, wherein:

the object is an avatar in a video game.

6. The method of claim 1, further comprising:

determining an intent of the user for performing the motion, the creating and displaying an animation is based on the determined intent.

7. The method of claim 1, wherein:

the object is an avatar in a video game; and

the method further comprises determining to amplify the motion of the user based on context of the avatar in the video game at the time of the motion of the user.

8. The method of claim 1, further comprising:

determining a gesture corresponding to the motion of the user, the animation of the object performing the motion of the user includes the object performing the gesture.

9. The method of claim 1, further comprising:

determining an action corresponding to the motion of the user, the animation of the object performing the motion of the user includes the object performing the action.

10. The method of claim 9, further comprising:

determining the magnitude of the sensed motion of the user, the motion of the user is amplified by a factor that is proportional to the determined magnitude of the sensed motion of the user, the using a camera to sense motion includes using a depth camera to sense a depth image and determining the motion of the user from the depth image, the object is an avatar in a video game.

11. A system that can provide amplified motion, comprising:

a camera that can sense motion of a user; and

a computer connected to the camera to receive data from the camera that indicates the motion of the user, the computer determines an action corresponding to the sensed motion of the user and determines a magnitude of the sensed motion of the user, the computer creates and displays an animation of an avatar in a video game performing the action in a manner that is amplified in comparison to the sensed motion by a factor that is proportional to the determined magnitude.

12. The system of claim 11, wherein:

the camera is a depth camera and the data from the camera includes a depth image.

13. The system of claim 11, wherein:

the action is a gesture; and

the animation of the avatar in the video game performing the action includes the avatar performing the gesture.

14. The system of claim 11, wherein:

the computer determines an intent of the user for performing the motion, the computer creates and displays the animation based on the determined intent.

15. The system of claim 11, wherein:

The magnitude of the sensed motion includes distance per time interval.

16. The system of claim 11, wherein:

the computer creates and displays an animation of an avatar in a video game performing the action such that the avatar starts the action at a start of the action by the user and the object ends the action at an end of the action by the user.

17. One or more processor readable storage devices having processor readable code embodied on said one or more processor readable storage devices, the processor readable code for programming one or more processors to perform a method comprising:

receiving data from a camera that indicates motion of a user;

determining an action corresponding to the motion of the user indicated by the received data, including determining the start of the action by the user and determining the end of the action by the user; and

creating and displaying an animation of an object in an application performing the action in a manner that is amplified in comparison to the sensed motion of the user such that the object starts the action at the start of the action by the user and the object ends the action at the end of the action by the user.

18. One or more processor readable storage devices according to claim 17, wherein:

receiving data from a camera that indicates motion of a user includes receiving a depth image from the camera.

19. One or more processor readable storage devices according to claim 17, wherein:

the object is an avatar in a video game;

the determining the action corresponding to the motion of the user includes recognizing a gesture; and

the animation of the object performing the action is an animation of the avatar performing the gesture in synchronization with the user.

20. One or more processor readable storage devices according to claim 19, further comprising:

providing visual feedback in proportion to velocity of the gesture by the user.