Peripheral device having light emitting objects for interfacing with a computer gaming system claim of priority

• US 8,295,549 B2
• Filed: 08/12/2011
• Issued: 10/23/2012
• Est. Priority Date: 07/27/2002
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Marks, Richard L., Mao, Xiadong, Zalewski, Gary M.
• Primary Examiner(s): Lu, Tom Y
• Application Number:
  US13/209,301
• Publication Number:
  US 20110294579A1
• Time in Patent Office: 438 Days
• Field of Search: 382/103
• US Class Current: 382/103
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/218 using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6081 generating an output signal, e.g. under timing constraints, for spatialization
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: H04N 1/00127 Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00129 with a display device, e.g. CRT or LCD monitor with a television apparatus H04N1/00283; arrangements for control of display devices G09G
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 2101/00 Still video cameras

Abstract

A peripheral device for communicating with a computer gaming system having an image capture device associated therewith is provided. The image capture device is configured to capture image data of the peripheral device and the computer system is configured to exchange wireless communication data with the peripheral device. The peripheral device includes a body having a first location and a second location, where the first location is defined for a first light emitting object and the second location is defined for a second light emitting object. The first and second illuminating objects having a size that is identifiable in captured image data. The first location on the body is at a fixed predetermined distance from the second location. The peripheral device includes one or more buttons, and circuitry interfaced with the first and second light emitting objects. Also included is circuitry interfaced with a motion sensing device, and circuitry for the exchange of wireless communication data between the peripheral device and the computer gaming system. The wireless communication data includes data associated with the light emitting objects, the one or more buttons, and the motion sensing device.

Claims

1. A peripheral device for communicating with a computer gaming system having an image capture device associated therewith, the image capture device configured to capture image data of the peripheral device and the computer system configured to exchange wireless communication data with the peripheral device, the peripheral device comprising:

a body having a first location and a second location, the first location is defined for a first light emitting object and the second location is defined for a second light emitting object, the first and second light emitting objects having a size that is identifiable in captured image data;

the first location on the body being at a fixed predetermined distance from the second location;

one or more buttons;

circuitry interfaced with the first and second light emitting objects, the circuitry configured to set the first and second light emitting objects to enable tracking of X and Y position and depth Z, the depth Z defined between the image capture device and the peripheral device, the circuitry further receiving motion data from a motion sensing device, the motion data used to produce one or more movement vectors at the computer gaming system to identify an orientation of the peripheral device; and

the circuitry being operable to exchange wireless communication data between the peripheral device and the computer gaming system, the wireless communication data including data associated with the light emitting objects, the one or more buttons, and the motion data.

2. The peripheral device as recited in claim 1, wherein the peripheral device is a video game controller.

3. The peripheral device as recited in claim 1, wherein the peripheral device connects to a video game controller.

4. The peripheral device as recited in claim 1, wherein the peripheral device that includes the first and second light emitting objects at the fixed predetermined distance is in a shape of a gun having a trigger button for pointing at targets, or in a shape of a game controller having two handle regions for human hands.

5. The peripheral device as recited in claim 1, wherein the fixed predefined position of the first and second light emitting objects produce the depth Z information in the captured image data processed by the computer gaming system, wherein the depth Z information is calculated by identifying a change in separation of the first and second light emitting objects, such that a closer separation is indicative of a greater depth Z and a further separation is indicative of a smaller depth Z.

6. The peripheral device as recited in claim 1, wherein at least one of the light emitting objects are housed in a translucent plastic material.

7. The peripheral device as recited in claim 1, further comprising:

an interface connector.

8. The peripheral device as recited in claim 7, wherein the interface connector is a USB connection.

9. The peripheral device as recited in claim 1, further comprising a battery.

10. The peripheral device as recited in claim 1, wherein the circuitry is defined by one or more circuits.

11. The peripheral device as recited in claim 1, further comprising a vibration device.

12. The peripheral device as recited in claim 1, further including a speaker for emitting sound.

13. The peripheral device as recited in claim 1, wherein at least one of first and second light emitting objects is defined from one of a spherical shape, an imperfect spherical shape, a half sphere, a dome, a cube, or a circular-like shape.

14. The peripheral device as recited in claim 1, wherein the motion sensing device includes an accelerometer.

15. The peripheral device as recited in claim 1, wherein the circuitry for the exchange of wireless communication data includes one of a Wi-Fi™

device, a Bluetooth™

device, an infrared (IR) device, or a radio communication device.

16. A peripheral device for communicating with a computer gaming system having an image capture device associated therewith, the image capture device configured to capture image data of the peripheral device and the computer system configured to exchange wireless communication data with the peripheral device, the peripheral device comprising:

a body having a first location and a second location that is spaced from first location by a fixed predetermined distance, the first location is defined for a first light emitting object and the second location is defined for a second light emitting object, the first and second light emitting objects having a size that is identifiable in captured image data, wherein the size provides data regarding depth of the body relative to the image capture device;

circuitry interfaced with the first and second light emitting objects, the circuitry configured to set the first and second light emitting objects to enable tracking of X, Y and Z position, the circuitry being coupled to a motion sensing device that captures motion data of the body as it is moved in a space in front of the image capture device, the first and second lights and the motion data being used to identify the position and orientation of the peripheral device during interfacing with the computer gaming system, the circuitry further being operable to exchange wireless communication data between the peripheral device and the computer gaming system.

17. The peripheral device as recited in claim 16, wherein the fixed predetermined distance further provides depth data based on one of the detected size of at least one of the light emitting objects or a relative positioning of the light emitting objects as detected in the captured image data.

18. The peripheral device as recited in claim 16, wherein the circuitry for the exchange of wireless communication data includes one of a Wi-Fi™

device, or a Bluetooth™

device, or an infrared (IR) device, or a radio communication device.

19. A peripheral device for communicating with a computing system using an image capture device, the image capture device configured to capture image data of the peripheral device and the computing system configured to exchange wireless communication data with the peripheral device during game play, the peripheral device comprising:

a body having a pair of handles to enabling holding by human hands, a top surface with a plurality of buttons, and a front surface having a plurality of lights, at least two of the plurality of lights having a predefined space separation there-between;

a motion capture device disposed in the body; and

circuitry in the body, the circuitry defined for controlling the plurality of lights and the motion capture device, the circuitry configured to set the plurality of lights in one of a tracking mode and a transmission mode, the tracking mode configured to turn on at least two of the plurality of lights and the transmission mode configured to modulate selected ones of the plurality of lights between an on and off state, the modulated lights configured to encode data that is detected by the computing system from image frames captured by the image capture device, the circuitry being operable to interleave between the tracking mode and transmission mode during game play.

20. The peripheral device of claim 19, wherein position of the peripheral device relative to the display device is obtained from data of the motion capture device, at least two of the lights as captured in analyzed image frames obtained from the image capture device, or combinations the motion capture device and the analyzed image frames.