Computer Image and Audio Processing of Intensity and Input Devices for Interfacing with a Computer Program

• US 20100033427A1
• Filed: 10/16/2009
• Published: 02/11/2010
• Est. Priority Date: 07/27/2002
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Marks, Richard L., Zalewski, Gary M., Mao, Xiadong
• Granted Patent: US 8,019,121 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/218 using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6081 generating an output signal, e.g. under timing constraints, for spatialization
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: H04N 1/00127 Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00129 with a display device, e.g. CRT or LCD monitor with a television apparatus H04N1/00283; arrangements for control of display devices G09G
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 2101/00 Still video cameras

Abstract

A method and system for determining an intensity value of an interaction with a computer program is described. The method and device includes capturing an image of a capture zone, identifying an input object in the image, identifying an initial value of a parameter of the input object, capturing a second image of the capture zone, and identifying a second value of the parameter of the input object. The parameter identifies one or more of a shape, color, or brightness of the input object and is affected by human manipulation of the input object. The extent of change in the parameter is calculated, which is the difference between the second value and the first value. An activity input is provided to the computer program, the activity input including an intensity value representing the extent of change of the parameter. A method for detecting an intensity value from sound generating input objects, and a computer video game are also described.

Claims

1. A method for determining an intensity value of an interaction with a computer program, the method including:

capturing an image of a capture zone;

identifying a representation of an input object in the image;

identifying an initial value of a parameter of the input object, the parameter identifying one or more of a shape, color, or brightness of the input object, the parameter being affected by human manipulation of the input object;

capturing a second image of the capture zone;

identifying a second value of the parameter of the input object;

determining an extent of change in the parameter, the extent of change being the difference between the second value and the first value; and

providing an activity input to the computer program, the activity input including an intensity value representing the extent of change of the parameter.

2. The method of claim 1, wherein the input object is a deformable object, the parameter representing an aspect ratio of the input object, the parameter being affected by squeezing the input object.

3. The method of claim 1, wherein the input object is a deformable object comprising a material that changes color in response to being deformed, the parameter being a color of the object, the color being affected by squeezing the object.

4. The method of claim 1, wherein the input object is an implement having a grip, the implement including illuminating means responsive to how tight the grip is squeezed, the parameter being one of a brightness or color of the illuminating means.

5. The method of claim 4, wherein the implement is a toy gun, the grip includes a trigger, and the illuminating means is responsive to how tightly the trigger is squeezed.

6. The method of claim 1, wherein the input object is an implement having a grip, the implement including illuminating means comprising a plurality of illuminators, wherein the illuminating energizes a number of the illuminators in response to how tight the grip is squeezed, the illuminating means comprising a plurality of illuminators, the parameter being the number of illuminators that are energized.

7. The method of claim 6, wherein the implement is a toy gun, the grip includes a trigger, and the illuminating means is responsive to how tightly the trigger is squeezed.

8. A system for determining an intensity value of an interaction with a computer program, comprising:

an input object, the input object configured for human manipulation and for interaction with the computer program;

a monitoring device, the monitor capturing information comprising one of images or audio from a capture zone in a vicinity of the monitoring device;

a computing device configured to execute the computer program and interface with the input object and the monitoring device, the computer program receiving data representative of the information captured by the monitoring device, the computer program analyzing the data and calculating an intensity value representing an intensity of the human manipulation of the input object.

9. The system of claim 8, wherein the input object is a deformable object and the monitoring device includes a video camera for capturing images of the input object, the intensity value representing an aspect ratio of the input object, the aspect ratio being altered by squeezing the input object.

10. The system of claim 8, wherein the input object is an implement having a grip, the implement including illuminating means that changes brightness and/or color in response to how tight the grip is squeezed, wherein the monitoring device includes a video camera for capturing images of the input object, the intensity value representing one of a brightness or color of the illuminating means.

11. The system of claim 10, wherein the implement is a toy gun, the grip includes a trigger, and the illuminating means is responsive to how tightly the trigger is squeezed.

12. The system of claim 8, wherein the input object is an implement having a grip, the implement including illuminating means comprising a plurality of illuminators, wherein the illuminating energizes a number of the illuminators in response to how tight the grip is squeezed;

and further wherein the monitoring device includes a video camera for capturing images of the input object, the intensity value representing the number of illuminators that are energized.

13. The system of claim 12, wherein the implement is a toy gun, the grip includes a trigger, and the illuminating means is responsive to how tightly the trigger is squeezed.

14. The system of claim 8, wherein the input object generates sound in response to the human manipulation, the sound having a changing parameter in response to the intensity of the human manipulation, the changing parameter comprising one of loudness, pitch, or rapidity, the monitoring device including a microphone for capturing the sound generated by the input object, the intensity value changing parameter.

15. The system of claim 8, wherein the computer program is one selected from a game, a communication system, an entertainment system, or an interactive application.