SYSTEM FOR TRACKING USER MANIPULATIONS WITHIN AN ENVIRONMENT

• US 20110086708A1
• Filed: 12/14/2010
• Published: 04/14/2011
• Est. Priority Date: 07/27/2002
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Marks, Richard L., Zalewski, Gary M., Mao, Xiadong
• Granted Patent: US 8,675,915 B2
• Time in Patent Office: Days
• US Class Current: 463/36
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/424 involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: A63F 13/60 Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
• CPC Class Codes: A63F 13/79 involving player-related data, e.g. identities, accounts, preferences or play histories
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6072 of an input signal, e.g. pitch and rhythm extraction, voice recognition
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/042 by opto-electronic means

Abstract

Systems, methods and for analyzing game control input data are disclosed. A machine-readable medium having embodied thereon instructions for analyzing game control input data is also disclosed.

Claims

1. A system for tracking user manipulations within an environment, comprising:

a user-movable object having at least one LED light source and a diffuser configured to diffuse light from the light source;

a first analyzer operable to receive first input channel information indicative of a position of the object from a diffuse image of the LED light source within an image obtainable from an image capture device, the first analyzer being further operable to analyze the first input channel information to generate first output information for registering user manipulations of the object by a computer program during execution of the program;

a second analyzer operable to receive second input channel information from a second input channel that is different from the first input channel, the second input channel information being representative of the user manipulations of the object, the second analyzer further being operable to analyze the second channel information to generate second output information for registering user manipulations of the object by the program during execution of the program; and

a programmable mixer operable to select information regarding a first aspect of the user manipulations from the first output information and to select information regarding a second aspect of the user manipulations from the second output information and to generate mixed output information for supply to the program based on the selected first output information and the selected second output information.

2. The system of claim 1 wherein the mixer is operable to generate the mixed output information further based on distribution values for the first output information and the second output information.

3. The system of claim 2, wherein the distribution values are defined by the mixer.

4. The system of claim 2, wherein the distribution values are defined by defined by the program.

5. The system of claim 2, wherein the distribution values are a result of the mixer identifying a particular quality of data coming from the first and second analyzers and making a dynamic adjustment of the distribution values.

6. The system of claim 2, wherein the distribution values are a result of building a historical knowledge base of when particular data is of particular value in a particular environment.

7. The system of claim 2, wherein the distribution values are defined in response to particularities of the program.

8. The system of claim 1, wherein the second input channel information includes information obtainable using a type of sensor that is different from the image capture device.

9. The system of claim 1, wherein the second input channel information is obtainable from an inertial sensor.

10. The system of claim 1, wherein the second input channel information is obtainable from an acoustic pick-up device.

11. The system of claim 10, wherein the acoustic pick-up device includes one or more microphones.

12. The system of claim 1, further comprising a third analyzer operable to receive third input channel information from a third input channel, the third input channel information being representative of the user manipulations within the environment, the third analyzer further being operable to analyze the third channel information to generate third output information for registering the user manipulations by the program during execution of the program, wherein the programmable mixer is operable to select information regarding a third aspect of the user manipulations from the third output information and to generate the mixed output information for supply to the program based on each of the selected first output information, selected second output information and selected third output information.

13. The system of claim 12, wherein the third input channel information includes information obtainable using a first type of sensor and the second input channel information includes information obtainable using a second type of sensor different from the first type of sensor.

14. The system of claim 13, wherein the third input channel information includes information obtainable by tracking movement of at least a portion of a user'"'"'s body.

15. The system of claim 1, wherein the second analyzer includes an inertial analyzer and the second input channel information includes inertial information obtainable by an inertial sensor.

16. The system of claim 15, wherein the inertial sensor includes at least one of an accelerometer or a gyroscope.

17. The system of claim 1, wherein the second input channel information includes information obtainable by transducing a voice within the environment.

18. The system of claim 1, wherein the second input channel information includes information indicative of a position of a voice within the environment.

19. The system of claim 1, wherein the second input channel information includes information indicative of a position of an acoustic signal generator within the environment.

20. The system of claim 1, wherein the second input channel information includes information indicative of a position of a user-movable acoustic signal generator within the environment.

21. The system of claim 1 wherein at least some of the first input channel information, first input channel information or second input channel information is representative of an acceleration of the user-manipulable object within the environment.

22. The system of claim 1 wherein at least some of the first input channel information, first input channel information or second input channel information is representative of a velocity of the user-manipulable object within the environment.

23. The system of claim 1 wherein at least some of the first input channel information, first input channel information or second input channel information is representative of an orientation of the user-manipulable object within the environment.

24. The of claim 23, wherein the orientation of the user-manipulable object includes information indicative of at least one of pitch, yaw and roll.

25. The system of claim 1, wherein at least some of the first input channel information or the second input channel information is representative of the position of the object within a coordinate space defined by at least two orthogonal axes.

26. The system of claim 1, wherein at least some of the first input channel information or the second input channel information is representative of a position of the object within a coordinate space defined by at least three orthogonal axes.