ACTION SELECTION GESTURING

• US 20120309535A1
• Filed: 05/31/2011
• Published: 12/06/2012
• Est. Priority Date: 05/31/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Langridge, Adam Jethro, Simmons, Guy, Molyneux, Peter Douglas, Matthews, Christopher
• Granted Patent: US 8,657,683 B2
• Time in Patent Office: Days
• US Class Current: 463/39
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/80 Special adaptations for executing a specific game genre or game mode
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Gestures of a computer user are observed with a depth camera. A first gesture of the computer user is identified as one of a plurality of different action selection gestures, each action selection gesture associated with a different action performable within an interactive interface controlled by gestures of the computer user. A second gesture is identified as a triggering gesture that causes performance of the action associated with the action selection gesture.

Claims

1. A data-holding subsystem holding instructions executable by a logic subsystem to:

render a spell-casting game for display on a display device;

receive a virtual skeleton including a plurality of joints, the virtual skeleton providing a machine readable representation of a game player observed with a depth camera; and

identify a first gesture of the virtual skeleton as one of a plurality of different spell selection gestures, each spell selection gesture associated with a different spell castable within the spell-casting game by a player character controlled by gestures of the game player.

2. The data-holding subsystem of claim 1, further holding instructions executable by a logic subsystem to:

identify a second gesture of the virtual skeleton as a spell casting gesture; and

responsive to identifying the second gesture, cast the spell associated with the first gesture within the spell-casting game.

3. The data-holding subsystem of claim 2, wherein a same spell casting gesture causes casting of each of the different spells associated with the plurality of different spell selection gestures when that spell has been readied by the associated spell selection gesture.

4. The data-holding subsystem of claim 2, wherein the spell is cast with a magnitude proportional to a magnitude of the first gesture.

5. The data-holding subsystem of claim 4, further holding instructions executable by a logic subsystem to:

output a spell magnitude visual displayable to the game player to visually indicate a magnitude with which the spell is readied.

6. The data-holding subsystem of claim 1, further holding instructions executable by a logic subsystem to:

translate a position of one or more joints of the virtual skeleton as a ready posture; and

acknowledge the ready posture before readying the spell associated with the first gesture for casting.

7. The data-holding subsystem of claim 6, further holding instructions executable by a logic subsystem to:

output a spell ready visual displayable to the game player to visually indicate activation of a spell-casting game mode.

8. The data-holding subsystem of claim 1, further holding instructions executable by a logic subsystem to:

output a spell selection visual displayable to the game player to visually indicate which of the different spells castable within the spell-casting game is readied for casting.

9. The data-holding subsystem of claim 1, further holding instructions executable by a logic subsystem to:

identify an audible command as one of a plurality of different spell selection commands, each spell selection command associated with a different spell castable by the player character within the spell-casting game.

10. The data-holding subsystem of claim 1, further holding instructions executable by a logic subsystem to:

identify an audible command while in a spell-casting game mode; and

augment an aspect of a spell in accordance with the audible command.

11. A method of executing a spell-casting game on a computing system, the method comprising:

observing gestures of a game player with a depth camera;

identifying a first gesture of the game player as one of a plurality of different spell selection gestures, each spell selection gesture associated with a different spell castable within the spell-casting game by a player character controlled by gestures of the game player.

12. The method of claim 11, further comprising:

identifying a second gesture of the game player as a spell casting gesture; and

responsive to identifying the second gesture, casting the spell associated with the first gesture within the spell-casting game.

13. The method of claim 11, wherein a same spell casting gesture causes casting of each of the different spells associated with the plurality of different spell selection gestures when that spell has been readied by the associated spell selection gesture.

14. The method of claim 11, wherein the spell associated with the first gesture is cast with a magnitude proportional to a magnitude of the first gesture.

15. The method of claim 14, further comprising:

outputting a spell magnitude visual displayable to the game player to visually indicate a magnitude with which the spell is readied.

16. The method of claim 11, further comprising:

translating a position of one or more joints of a virtual skeleton as a ready posture; and

acknowledging the ready posture before readying the spell associated with the first gesture for casting.

17. The method of claim 11, further comprising:

outputting a spell ready visual displayable to the game player to visually indicate activation of a spell casting game mode.

18. An entertainment system, comprising:

a peripheral input to receive depth images from a depth camera;

a display output to output an interactive interface to a display device;

a logic subsystem operatively connectable to the depth camera via the peripheral input and to the display device via the display output;

a data holding subsystem holding instructions executable by the logic subsystem to;

receive from the depth camera one or more depth images of a world space scene including a computer user;

model the computer user with a virtual skeleton including a plurality of joints;

translate a position of one or more joints of the virtual skeleton as a selected one of a plurality of different action selection gestures, each action selection gesture associated with a different action performable within the interactive interface;

translate a position of one or more joints of the virtual skeleton as an action trigger gesture; and

responsive to identifying the action trigger gesture, perform within the interactive interface the action associated with the selected action selection gesture.

19. The entertainment system of claim 18, wherein a same action trigger gesture triggers each of the different actions associated with the plurality of different action selection gestures when that action has been readied by the associated action selection gesture.

20. The entertainment system of claim 18, further holding instructions executable by a logic subsystem to:

translate a position of one or more joints of the virtual skeleton as a ready posture; and

acknowledge the ready posture before readying an action associated with an action selection gesture.