HAND-HELD CONTROLLER HAVING DETECTABLE ELEMENTS FOR TRACKING PURPOSES

• US 20060282873A1
• Filed: 05/08/2006
• Published: 12/14/2006
• Est. Priority Date: 07/27/2002
• Status: Abandoned Application

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Mao, Xiadong, Marks, Richard, Zalewski, Gary
• Application Number:
  US11/382,251
• Publication Number:
  US 20060282873A1
• Time in Patent Office: Days
• US Class Current: 725/133
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1025 details of the interface with the game device, e.g. USB version detection
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image

Abstract

Some embodiments provide a tracking device for use in obtaining information for controlling an execution of a game program by a processor for enabling an interactive game to be played by a user. The tracking device comprises a body having a section to be oriented towards a screen when a progress of a game provided via execution of the game apparatus is displayed upon the screen; and at least one photonically detectable (“PD”) element assembled with the body, a position of the photonically detectable element within an image being recordable by an image capture device when the section is oriented at least partly towards the screen, wherein positions of the PD element at different points in time are quantifiable to quantify movement of the body in space.

Claims

1. A tracking device for use in obtaining information for controlling an execution of a game program by a processor for enabling an interactive game to be played by a user, comprising:

a body having a section to be oriented towards a screen when a progress of a game provided via execution of the game apparatus is displayed upon the screen; and

at least one photonically detectable (“

PD”

) element assembled with the body, a position of the photonically detectable element within an image being recordable by an image capture device when the section is oriented at least partly towards the screen, wherein positions of the PD element at different points in time are quantifiable to quantify movement of the body in space.

2. The tracking device as claimed in claim 1, wherein the body is mountable to a game controller, the game controller including a game controller body and at least one input device assembled with the game controller body, the input device manipulable by a user to register an input from the user.

3. An apparatus including the tracking device and the game controller as claimed in claim 2.

4. The tracking device as claimed in claim 1, wherein the PD element includes a retro-reflector.

5. The tracking device as claimed in claim 1, wherein the PD element has a color having high contrast relative to a color of a portion of said body adjacent to said PD element.

6. The tracking device as claimed in claim 1, wherein each of the at least one PD element includes a pattern including at least two different textures, the textures differing in at least one of brightness, color or roughness.

7. The tracking device as claimed in claim 1, wherein the PD element includes a light source.

8. The tracking device as claimed in claim 7, wherein the light source includes at least one light emitting diode (“

LED”

).

9. The tracking device as claimed in any one of claims 1 through 6 including two of said at least one PD element, the two PD elements defining a line.

10. The tracking device as claimed in any one of claims 1 through 6 including three of said at least one PD element, the three PD elements defining a triangle.

11. The tracking device as claimed in any one of claims 1 through 6 including four of said at least one PD element, the four PD elements defining four lines.

12. The tracking device as claimed in claim 11, wherein the four PD elements define a rectangle.

13. The tracking device as claimed in claim 10, claim 11 or claim 12, wherein the PD elements include light sources and at least one of the light sources is distinguishable from the other light sources by a characteristic relating to the light output by the at least one light source.

14. The tracking device as claimed in claim 13, wherein the at least one light source is distinguishable from the other light sources by at least one of a strobe frequency, an on-off duty cycle, a timing of an on interval within an on-off cycle, or a spectral content of the output of the light source.

15. The tracking device as claimed in any one of claims 1 through 10, wherein the body of the tracking device is mountable to the user'"'"'s body.

16. The tracking device as claimed in claims 1, 2 or 3, further comprising a communications interface operable to conduct digital communications with at least one of the processor, the game controller or both the processor and the game controller.

17. The tracking device as claimed in claim 16, wherein the communications interface includes a universal asynchronous receiver transmitter (“

UART”

).

18. The tracking device as claimed in claim 17, wherein the UART is operable to perform at least one of receiving a control signal for controlling an operation of the tracking device, or for transmitting a signal from the tracking device for communication with another device.

19. The tracking device as claimed in claims 16 or 15, wherein the communications interface includes a universal serial bus (“

USB”

) controller.

20. The tracking device as claimed in claim 17, wherein the USB controller is operable to perform at least one of receiving a control signal for controlling an operation of the tracking device, or for transmitting a signal from the tracking device for communication with another device.

21. An apparatus including the tracking device as claimed in any one of claims 1 through 17, and a processor operable to execute a game program to display a progress of a game on a screen to enable the game to be interactively played by a user, wherein the position of PD element is recordable by an image capture device located in a vicinity of the screen, the processor being operable to detect the position of the PD element within the image using information output by the image capture device.

22. The apparatus as claimed in claim 21, wherein the processor is operable to detect user input information for controlling execution of the game program from the information output by the image capture device.

23. The apparatus as claimed in claim 21, wherein the processor is operable to obtain a series of samples representative of acceleration of said body in space at different points in time from information output by the image capture device.

24. The apparatus as claimed in claim 23, wherein the processor is operable to determine a velocity of said body using said series of samples.

25. The apparatus as claimed in claim 24, wherein the processor is operable to determine the velocity by integrating acceleration values obtained from the series of samples over an interval of time.

26. The apparatus as claimed in claim 23, wherein the processor is operable to determine a displacement of the body in space by first integrating acceleration values obtained from said series of samples over an interval of time and then integrating a result of said first integrating.

27. The apparatus as claimed in claim 26, wherein the processor is operable to determine a position of the body in space by determining the displacement in relation to a previously determined position.

28. The apparatus as claimed in claim 23, wherein the tracking device includes at least two of the PD elements and the processor is operable to obtain a series of samples representative of acceleration of said body in at least two degrees of freedom in space using the information output by the image capture device.

29. The apparatus as claimed in claim 23, wherein the tracking device includes at least three of the PD elements and the processor is operable to obtain a series of samples representative of acceleration of said body in at least three degrees of freedom using the information output by the image capture device.

30. The apparatus as claimed in claim 29, wherein the at least three degrees of freedom include movement along three axes x, y and z, each of said axes being orthogonal to every other of said axes.

31. The apparatus as claimed in claim 29, wherein the at least three degrees of freedom include pitch, yaw and roll.

32. The apparatus as claimed in claim 30, wherein the processor is operable to quantify the movement in six degrees of freedom, said six degrees of freedom including said three degrees of freedom and pitch, yaw and roll.

33. A controller, comprising:

a body;

one or more buttons disposed on the body; and

one or more detectable elements disposed on the body that are arranged in an array.

34. A controller in accordance with claim 33, wherein the one or more detectable elements comprises four LEDs.

35. A controller in accordance with claim 33, wherein the array is a linear array.

36. A controller in accordance with claim 33, wherein the one or more detectable elements are attached to a front portion of the body that faces away from a user when the controller is properly held by the user.

37. A controller in accordance with claim 33, wherein the one or more detectable elements are configured to be strobed.

38. A controller in accordance with claim 33, wherein the one or more detectable elements are configured to be modulated.

39. A controller in accordance with claim 33, wherein the one or more detectable elements are each configured to operate at a different frequency.

40. A method of making a controller, comprising the steps of:

forming a body;

disposing one or more buttons on the body; and

attaching one or more detectable elements to the body, wherein the one or more detectable elements are arranged in an array.

41. A method in accordance with claim 40, wherein the one or more detectable elements comprises four LEDs.

42. A method in accordance with claim 40, wherein the array comprises a linear array.

43. A method in accordance with claim 40, wherein the one or more detectable elements are attached to a front portion of the body that faces away from a user when the controller is properly held by the user.

44. A method in accordance with claim 40, wherein the one or more detectable elements are configured to be strobed.

45. A method in accordance with claim 40, wherein the one or more detectable elements are configured to be modulated.

46. A method in accordance with claim 40, wherein the one or more detectable elements are each configured to operate at a different frequency.