METHOD AND SYSTEM FOR APPLYING GEARING EFFECTS TO VISUAL TRACKING

• US 20060252541A1
• Filed: 05/06/2006
• Published: 11/09/2006
• Est. Priority Date: 07/27/2002
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Zalewski, Gary M., Mao, Xiadong, Marks, Richard
• Granted Patent: US 9,474,968 B2
• Time in Patent Office: Days
• US Class Current: 463/36
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/424 involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/50 Controlling the output signals based on the game progress
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/6018 where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6072 : of an input signal, e.g. pitch and rhythm extraction, voice recognition
• CPC Class Codes: A63F 2300/64 : for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/66 : for rendering three dimensional images

Abstract

Methods and systems for interactive interfacing with a computer gaming system are provided. The computer gaming system includes a video capture device for capturing image data. One method includes displaying an input device to the video capture device, where the input device has a plurality of lights that are modulated so as to convey positioning of the input device and communication data that is to be interpreted by the computer gaming system based on analysis of the captured image data and a state of the plurality of lights. This method also includes defining movement of an object of a computer game that is to be executed by the computer gaming system, such that the movement of the object may be mapped to movements in position of the input device as detected in the captured image data. The method then establishes a gearing between the movement of the object of the computer game verses the movements in position of the input device. The gearing defines a ratio between movements in position of the input device and movements of the object. The gearing can be set dynamically by the game, by the user, or can be preset by software or user configured in accordance with a gearing algorithm.

Claims

1. A method for interactive interfacing with a computer gaming system, the computer gaming system including a video capture device for capturing image data, comprising:

displaying an input device to the video capture device, the input device including a plurality of lights so as to convey positioning of the input device that is to be interpreted by the computer gaming system based on analysis of the captured image data;

defining an action that is to be executed by the computer gaming system, the action being in response to movements in position of the input device as detected in the captured image data; and

establishing a gearing between the action verses the movements in position of the input device;

wherein the gearing establishes a ratio between movements in position of the input device the actions.

2. A method for interactive interfacing with a computer gaming system as recited in claim 1, wherein the movements in position of the input device are detected within a volume of space that is captured by the video capture device.

3. A method for interactive interfacing with a computer gaming system as recited in claim 1, further comprising,

continuously analyzing the captured image data to identify the movements in position of the input device;

continuously updating action based on the identified movements in position of the input device; and

determining whether the gearing has been updated.

4. A method for interactive interfacing with a computer gaming system as recited in claim 3, further comprising,

if it is determined that the gearing has been updated, the updated gearing is applied while resuming processing of the action, before a next action or gradually over time.

5. A method for interactive interfacing with a computer gaming system as recited in claim 3, wherein when the gearing has been updated, the computer gaming system uses the updated gearing so as to impact the current action.

6. A method for interactive interfacing with a computer gaming system as recited in claim 1, wherein the plurality of lights are defined from light emitting diodes.

7. A method for interactive interfacing with a computer gaming system as recited in claim 1, wherein a state of the plurality of lights is represented by a setting of ON/OFF combinations of the plurality of lights.

8. A method for interactive interfacing with a computer gaming system as recited in claim 1, wherein modulating the plurality of lights enables tracking of the input device so as to identify the movements in position.

9. A method for interactive interfacing with a computer gaming system as recited in claim 1, wherein movements in the input device are analyzed to identify coordinate information of the input device and the coordinate information is converted into vector data that is applied to the action, and the action includes an indication of an amount of movement by an object of a computer game being executed by the computer gaming system.

10. A method for interactive interfacing with a computer gaming system as recited in claim 9, wherein the vector data is scaled in response to updates in the gearing.

11. A method for interactive interfacing with a computer gaming system as recited in claim 9, wherein the vector data is scaled by multiplying the vector data with a gearing amount defined by the gearing.

12. Computer readable media including program instructions for interactive interfacing with a computer gaming system, the computer gaming system including a video capture device for capturing image data, the computer readable media comprising:

program instructions for detecting the display of an input device to the video capture device, the input device conveying positioning of the input device and communication data that is to be interpreted by the computer gaming system based on analysis of the captured image data;

program instruction for defining movement of an object of a computer game that is to be executed by the computer gaming system, the movement of the object being mapped to movements in position of the input device as detected in the captured image data; and

program instructions for establishing a gearing between the movement of the object of the computer game verses the movements in position of the input device, the gearing being configured to establish a user adjustable ratio between movements in position of the input device and movements of the object.

13. The computer readable media of claim 12, further comprising,

program instructions for at least periodically analyzing the captured image data to identify the movements in position of the input device;

program instructions for at least periodically mapping the movement to the object based on the identified movements in position of the input device; and

program instructions for determining whether the gearing has been adjusted during the mapping.

14. The computer readable media of claim 12, further comprising,

program instructions for determining that the gearing has been adjusted during the mapping, the adjusted gearing is applied before a next movement of the object, during the current movement of the object or gradually during a current movement of the object.

15. A system for enabling dynamic user interactivity between user actions and actions to be performed by an object of a computer program, comprising:

a computing system,

a image capture device being coupled to the computing system;

a display, the display receiving input from the computing system; and

an input device for interfacing with the computer program that is to be executed by the computing system, the input device having a gearing control for establishing a ratio between movement of the input device as mapped to actions to be applied to an object, the object being defined by the computer program and executed by the computing system, and the movement of the input device being identified by the image capture device and the actions when applied to the object are illustrated on the display with a noticeable gearing value as set by the gearing control of the input device.

16. A system as recited in claim 15, wherein the gearing value is capable of being set before, during or after interactivity with the object of the computer program.

17. A system as recited in claim 15, wherein the computer program is an interactive application.

18. A system as recited in claim 17, wherein the interactive application is a video game.

19. A system as recited in claim 17, wherein the input device is a controller or a hand-held object.

20. A system as recited in claim 19, wherein the controller or hand-held object includes light emitting diodes for detecting position.

21. A system as recited in claim 19, wherein the controller or hand-held object includes a speaker for communicating sound or ultrasonic signals to cause the computing system to trigger the action.

22. A system as recited in claim 19, wherein the controller or hand-held object includes a microphone for receiving input from a user for communicating with the computing system to trigger an action by the computer program.

23. An apparatus for enabling dynamic user interactivity between user actions and actions to be performed by a computer program, the apparatus comprising:

an input device for interfacing with the computer program that is to be executed by a computing system, the input device having a gearing control for establishing a scaled value between movement data of the input device as mapped to an action to be applied by the computer program.

24. An apparatus as recited in claim 23, wherein the gearing is capable of being set before, during or after interactivity with the computer program.

25. An apparatus as recited in claim 23, wherein the input device is a controller or hand-held object that includes light emitting diodes for detecting position.

26. An apparatus as recited in claim 25, wherein the controller or hand-held object includes a speaker for communicating sound or ultrasonic signals to cause the computing system to trigger an action.

27. An apparatus as recited in claim 25, wherein the controller or hand-held object includes a microphone for receiving input from a user for communicating with the computing system to trigger an action by the computer program.