Tracking device for use in obtaining information for controlling game program execution

• US 10,086,282 B2
• Filed: 05/08/2006
• Issued: 10/02/2018
• Est. Priority Date: 07/27/2002
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Mao, Xiaodong, Marks, Richard L., Zalewski, Gary M.
• Primary Examiner(s): Clarke, Jr., Robert T
• Application Number:
  US11/382,252
• Publication Number:
  US 20060274032A1
• Time in Patent Office: 4,530 Days
• Field of Search: 345158, 463 36- 39, 73510
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/424 involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6072 of an input signal, e.g. pitch and rhythm extraction, voice recognition
• CPC Class Codes: G01P 15/00 Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
• CPC Class Codes: G01P 2015/0805 being provided with a particular type of spring-mass-system for defining the displacement of a seismic mass due to an external acceleration

Abstract

A tracking device for use in obtaining information for controlling an execution of a game program by a processor for enabling an interactive game to be played by a user and related apparatus are disclosed.

Claims

1. A tracking device comprising:

an inertial sensor unit mountable to a body of a game controller, wherein the inertial sensor unit is operable to produce information usable by a processor for quantifying a movement of the body through space, wherein the information is usable by the processor for controlling execution of a game program, wherein the inertial sensor unit includes (i) a single mass elastically coupled to a frame for translational and rotational movement relative to the frame with respect to each of two or more different axes; and

(ii) two or more displacement sensors, wherein each of the two or more displacement sensors are operable to generate a displacement signal related to a displacement of the single mass relative to the frame, wherein the displacement sensors are positioned such that a first combination of displacement signals from the two or more displacement sensors can be analyzed by the processor or another processor to determine an angle of rotation of the frame with respect to one of the two or more different axes and a second combination of displacement signals from the two or more displacement sensors can be analyzed by the processor or another processor to determine a motion of the frame with respect to the same one or a different one of the two or more different axes; and

a visible light source mountable to the body of the game controller and configured to be detected by an image capture unit coupled to the processor, wherein a position of the visible light source detected by the image capture unit is used by the processor or another processor to correct a drift in the information provided to the processor from the inertial sensor.

2. The tracking device as claimed in claim 1, wherein the game controller includes at least one input device assembled with the body of the game controller, wherein the input device is manipulable by a user to register an input from the user.

3. The tracking device as claimed in claim 1, wherein the body of the game controller is mountable to a user'"'"'s body.

4. The tracking device as claimed in claim 1 or 3, wherein the information usable by a processor for quantifying a movement of the body through space includes information quantifying a first component of the movement of the body of the game controller along a first axis.

5. The tracking device as claimed in claim 4, wherein the information usable by a processor for quantifying a movement of the body through space includes information quantifying a second component of the movement along a second axis orthogonal to the first axis.

6. The tracking device as claimed in claim 5, wherein the information usable by a processor for quantifying a movement of the body through space includes information quantifying a third component of the movement along a third axis orthogonal to the first and second axes.

7. The tracking device as claimed in claim 4, 5, or 6, wherein the inertial sensor unit includes at least one accelerometer.

8. The tracking device as claimed in claim 4, 5, or 6, wherein the inertial sensor unit includes at least one mechanical gyroscope.

9. The tracking device as claimed in claim 8, wherein the inertial sensor unit includes at least one laser gyroscope.

10. The tracking device as claimed in claim 1, wherein the information usable by a processor for quantifying a movement of the body through space includes information quantifying the movement of the body of the game controller in at least three degrees of freedom.

11. The tracking device as claimed in claim 10, wherein the three degrees of freedom include pitch, yaw and roll.

12. The tracking device as claimed in claim 11, wherein the three degrees of freedom include an x-axis, a y-axis, and a z-axis, each of the x-axis, y-axis and the z-axis being orthogonal with respect to each other of the x-axis, y-axis, and z-axis.

13. The tracking device as claimed in claim 12, wherein the inertial sensor unit is operable to quantify the movement in six degrees of freedom, the six degrees of freedom including the three degrees of freedom and pitch, yaw and roll.

14. The tracking device as claimed in any of claims 4, 5, 6, 10, 11, 12, and 13, the tracking device being further operable to obtain a series of samples representative of acceleration of the body along at least one axis at different points in time from the information produced by the inertial sensor.

15. The tracking device as claimed in claim 14, further comprising the processor, wherein the processor is operable to determine a velocity of the body using the series of samples.

16. The tracking device as claimed in claim 15, wherein the processor is operable to determine the velocity by integrating acceleration values obtained from the series of samples over an interval of time.

17. The tracking device as claimed in claim 14, wherein the processor is operable to determine a displacement of the body in space by first integrating acceleration values obtained from the series of samples over an interval of time and then integrating a result of the first integrating over the interval of time.

18. The tracking device as claimed in claim 17, wherein the processor is operable to determine the displacement in relation to a prior-determined position to determine a present position of the body in space.

19. An apparatus including the tracking device as claimed in claim 1, the apparatus further comprising:

the processor, wherein the processor is configured to execute a program to provide an interactive game playable by the user in accordance with input obtained by processing the information produced by the inertial sensor unit.

20. The tracking device as claimed in claim 1 or 2, further comprising a communications interface operable to conduct digital communications with at least one of the processor, the game controller or both the processor and the game controller.

21. The tracking device as claimed in claim 20, wherein the communications interface includes a universal asynchronous receiver transmitter (“

UART”

).

22. The tracking device as claimed in claim 21, wherein the UART is operable to perform at least one of receiving a control signal for controlling an operation of the tracking device, or for transmitting a signal from the tracking device for communication with another device.

23. The tracking device as claimed in claim 20 or 21, wherein the communications interface includes a universal serial bus (“

USB”

) controller.

24. The tracking device as claimed in claim 23, wherein the USB controller is operable to perform at least one of receiving a control signal for controlling an operation of the tracking device, or for transmitting a signal from the tracking device for communication with another device.

25. The apparatus as claimed in claim 19, wherein the processor is operable to determine a velocity of the body using a series of samples.

26. The apparatus as claimed in claim 25, wherein the processor is operable to determine the velocity by integrating acceleration values obtained from the series of samples over an interval of time.

27. The apparatus as claimed in claim 19, wherein the processor is operable to determine a displacement of the body in space by first integrating acceleration values obtained from a series of samples over an interval of time and then integrating a result of the first integrating.

28. The apparatus as claimed in claim 19, the processor is operable to determine a position of the body in space by determining the displacement in relation to a previously determined position.

29. A game controller, comprising:

a body;

at least one input device assembled with the body, the input device manipulable by a user to register an input from the user;

an inertial sensor unit mounted to the body, wherein the inertial sensor unit is operable to produce information for quantifying a movement of said body through space, wherein the inertial sensor unit includes (i) a single mass elastically coupled to a frame for translational and rotational movement relative to the frame with respect to each of two or more different axes; and

(ii) two or more displacement sensors, wherein each of the two or more displacement sensors is operable to generate a displacement signal related to a displacement of the single mass relative to the frame, wherein the displacement sensors are positioned such that a first combination of displacement signals from the two or more displacement sensors can be analyzed by a processor to determine an angle of rotation of the frame with respect to one of the two or more different axes and a second combination of displacement signals from the two or more displacement sensors can be analyzed by the processor or another processor to determine a motion of the frame with respect to the same one or a different one of the two or more different axes; and

a visible light source mounted to the body of the game controller and configured to be detected by an image capture unit, wherein a position of the visible light source detected by the image capture unit is used by the processor or another processor to correct for a drift in the determination of position and/or angle of rotation of the game controller.

30. A method for tracking a controller of a video game system, comprising:

generating one or more signals from an inertial sensor unit mounted to the controller for the video game system, wherein the inertial sensor unit includes (i) a single mass elastically coupled to a frame for translational and rotational movement relative to the frame with respect to each of two or more different axes; and

(ii) two or more displacement sensors, wherein each of the two or more displacement sensors is operable to generate corresponding displacement signals related to a displacement of the single mass relative to the frame, wherein the displacement sensors are positioned such that a first combination of displacement signals from the two or more displacement sensors can be analyzed by a processor to determine an angle of rotation of the frame with respect to one of the two or more different axes and a second combination of displacement signals from the two or more displacement sensors can be analyzed by the processor or another processor to determine a motion of the frame with respect to the same one or a different one of the two or more different axes;

analyzing with the processor or another processor the corresponding displacement signals to identify the first or second combination of displacement signals and determine position and/or angle of rotation information for the controller with respect to the two or more different axes;

correcting with the processor or another processor a drift in the determination of position and/or angle of rotation of the controller by detecting a position of a visible light source mounted to the controller with an image capture unit; and

utilizing the position and/or angle of rotation information during play of a video game on the video game system.

31. A method for use in providing input to a system, comprising the steps of:

generating one or more signals from an inertial sensor unit mounted to a controller for the system, wherein the inertial sensor unit includes (i) a single mass elastically coupled to a frame for translational and rotational movement relative to the frame with respect to each of two or more different axes; and

(ii) two or more displacement sensors, wherein each of the two or more displacement sensors is operable to generate a signal related to a displacement of the single mass relative to the frame, wherein the displacement sensors are positioned such that they produce particular combinations of signals that can be analyzed by a processor to determine an angle of rotation and a motion of the frame with respect to one of the two or more different axes;

analyzing displacement sensor signals from the two or more displacement sensors to determine position and angle of rotation information for the controller with respect to one of the two or more different axes;

correcting with the processor or another processor a drift in the determination of position and/or angle of rotation of the controller by detecting with an image capture unit a position of a visible light source mounted to the controller;

comparing the determined position and angle of rotation information with predetermined position information associated with one or more commands; and

changing a state of the system if the determined position and/or angle of rotation information matches predetermined position information for a command of the one or more commands.