Motion Assessment Using a Game Controller

• US 20090258703A1
• Filed: 04/02/2009
• Published: 10/15/2009
• Est. Priority Date: 04/09/2008
• Status: Abandoned Application

• Current Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Brunstetter, Aaron Philip
• Application Number:
  US12/417,384
• Publication Number:
  US 20090258703A1
• Time in Patent Office: Days
• US Class Current: 463/36
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/80 Special adaptations for executing a specific game genre or game mode
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/572 Communication between players during game play of non game information, e.g. e-mail, chat, file transfer, streaming of audio and streaming of video
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands

Abstract

A technique is disclosed for motion assessment of an individual using a game controller in connection with interactive media, e.g. a multiplayer game, such as Simon says, where game play is based, at least in part, upon coordinated or directed physical interaction of multiple players.

Claims

1. An apparatus for motion assessment of an individual in connection with interactive media, comprising:

a plurality of participant locations;

a video camera at each participant location for capturing movements of each participant at each said participant location; and

a processor programmed to execute instructions for comparing said captured movements of each participant at each of said participant locations against any of a reference movement, an expected or elicited movement, or a movement of one or more other participants.

2. The apparatus of claim 1, said interactive media comprising:

a multiplayer game in which game play is based, at least in part, upon coordinated or directed physical interaction of multiple players.

3. The apparatus of claim 1, said interactive media comprising:

a game in which at least one said participant location comprises a master site from which one or more participants issue instructions and/or demonstrates movements, which are captured via a video camera at said master site and communicated to each other of said participant locations;

said each other of said participant locations comprising game play sites at each of which one or more participants respond to said instructions pursuant to game play, and wherein actions of participants at said participant locations are captured via a video camera at a corresponding game play site and communicated to said processor and/or said master site.

4. The apparatus of claim 2, further comprising:

a game server, in communication with said plurality of participant locations via a network, programmed to execute instructions for any of coordinating game play, scoring game play, and providing image and voice recognition functions.

5. The apparatus of claim 1, further comprising:

at least one additional motion capture modality comprising any of an ultrasonic motion detection device, a magnetic motion capture device, an RF or IR motion capture device, a pressure sensitive device, a device that tracks gravitational forces and/or acceleration, a device that is held in the hand or attached to a participant'"'"'s body, and a device for capturing motion images in three dimensions.

6. The apparatus of claim 1, said processor programmed to execute instructions for detecting multiple participants at a same participant location and tracking their motions separately pursuant to game play.

7. The apparatus of claim 1, said processor programmed to execute instructions for receiving and executing voice commands received from one or more participants via a microphone a said or more participant'"'"'s locations.

8. The apparatus of claim 1, said processor programmed to execute instructions for any of evaluating, critiquing, ranking, and scoring said captured movements, for any of each individual participant, groups of participants, and pursuant to a competition between two or more participants.

9. The apparatus of claim 1, said processor programmed to execute instructions for identifying both the identity of a participant, if there are multiple participants at a location, by recognizing each participant'"'"'s face;

and by tracking movement each participant'"'"'s head, arms, legs, and torso, to identify a pose of the participant'"'"'s body for purposes of comparison with that of a master and/or an arc of movement of the participant'"'"'s body to identify compliance of the participant with more complex movements.

10. The apparatus of claim 1, said processor programmed to execute instructions for determining if a participant is not present at a participant location or has left the view of a camera at said participant location.

11. The apparatus of claim 1, said processor programmed to execute instructions for performing any of motion-capture video analysis.

12. The apparatus of claim 1, said processor programmed to execute instructions for demonstrating a desired movement or other instruction to one or more participants, for analyzing and comparing captured motions of said one or more participants responsive to said demonstrating relative to an ideal motion, and for judging and/or grading how well said one or more participants mimicked the movement that was so demonstrated.

13. The apparatus of claim 12, wherein said movement is a complex movement;

and wherein portions of said movement are weighted relative to their difficulty, and/or accuracy and/or precision required.

14. The apparatus of claim 1, said processor programmed to execute instructions for accessing a library of motion templates.

15. The apparatus of claim 1, said processor programmed to execute instructions for using physical objects at each participant location pursuant to interaction with said interactive media and/or for identifying and/or tracking physical objects are each participant location.

16. A computer implemented method for motion assessment of an individual in connection with interactive media, comprising the steps of:

providing a plurality of participant locations;

capturing movements of each participant at each said participant location with a video camera; and

comparing said captured movements of each participant at each of said participant locations against any of a reference movement, an expected or elicited movement, or a movement of one or more other participants.

17. The method of claim 16, said interactive media comprising:

a multiplayer game in which game play is based, at least in part, upon coordinated or directed physical interaction of multiple players.

18. The method of claim 16, said interactive media comprising:

a game in which at least one said participant location comprises a master site from which one or more participants issue instructions and/or demonstrates movements, which are captured via a video camera at said master site and communicated to each other of said participant locations;

said each other of said participant locations comprising game play sites at each of which one or more participants respond to said instructions pursuant to game play, and wherein actions of participants at said participant locations are captured via a video camera at a corresponding game play site and communicated to said processor and/or said master site.

19. An electronic storage medium containing computer instructions for executing a method for motion assessment of an individual in connection with interactive media, comprising the steps of:

providing a plurality of participant locations;

capturing movements of each participant at each said participant location with a video camera; and

comparing said captured movements of each participant at each of said participant locations against any of a reference movement, an expected or elicited movement, or a movement of one or more other participants.