Inertially trackable hand-held controller

• US 9,682,320 B2
• Filed: 07/31/2014
• Issued: 06/20/2017
• Est. Priority Date: 07/22/2002
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Zalewski, Gary M., Marks, Richard L., Mao, Xiaodong
• Primary Examiner(s): Sasinowski, Andrew
• Assistant Examiner(s): Castiaux, Brent D
• Application Number:
  US14/448,622
• Publication Number:
  US 20140342827A1
• Time in Patent Office: 1,055 Days
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1031 using a wireless connection, e.g. Bluetooth, infrared connections
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands

Abstract

A game controller includes an image capture unit; a body; at least one input device assembled with the body, the input device manipulable by a user to register an input from the user; an inertial sensor operable to produce information for quantifying a movement of said body through space; and at least one light source assembled with the body; and a processor coupled to the image capture unit and the inertial sensor. The processor is configured to track the body by analyzing a signal from the inertial sensor and analyzing an image of the light source from the image capture unit. The processor is configured to establish a gearing between movement of the body and actions to be applied by a computer program.

Claims

1. A game controller, comprising:

an image capture unit;

a body;

at least one input device assembled with the body, the input device manipulable by a user to register an input from the user;

an inertial sensor operable to produce information for quantifying a movement of said body through space;

at least one light source assembled with the body;

a processor coupled to the image capture unit and the inertial sensor, wherein the processor is configured to track the body by analyzing a signal from the inertial sensor and analyzing an image of the light source from the image capture unit; and

wherein the processor is configured to establish a gearing between movement of the body and actions to be applied by a computer program, wherein one or more of the actions to be applied by the computer program includes generation of a noise, wherein changes in the gearing between the movement of the body and the generation of the noise vary a degree of response of the noise to the movement of the body during movement of the body as the noise is being generated, wherein the movement of the body is determined from inertial forces detected by the inertial sensor, or from analysis of the image from the image capture unit, or from both inertial forces detected by the inertial sensor and analysis of the image from the image capture unit, wherein the gearing changes during movement of the body.

2. The game controller as claimed in claim 1, further comprising a signal encoder and an infrared signal transmitter operable to transmit an infrared signal over the air using a signal from the signal encoder, the signal encoder being programmable to encode the signal with a selected one of a plurality of signaling codes for reception by an electronic device having an infrared receiver and a signal decoder operable with the selected one signaling code.

3. The game controller as claimed in claim 1, wherein the body includes a housing holdable by hand, and the input device includes an element movable by the user relative to the body of the game controller to register the input from the user.

4. The game controller as claimed in claim 3, wherein the housing includes a handgrip graspable by hand.

5. The game controller as claimed in claim 1, wherein the body of the game controller is mountable to the user'"'"'s body.

6. The game controller as claimed in claim 1, wherein said inertial sensor is operable to produce information for quantifying a first component of said movement of the body along a first axis.

7. The game controller as claimed in claim 6, wherein said inertial sensor is operable to produce information for quantifying a second component of said movement along a second axis orthogonal to said first axis.

8. The game controller as claimed in claim 7, wherein said inertial sensor is operable to produce information for quantifying a third component of said movement along a third axis orthogonal to said first and second axes.

9. The game controller as claimed in claim 6, wherein said inertial sensor includes at least one accelerometer.

10. The game controller as claimed in claim 6, wherein said inertial sensor includes at least one mechanical gyroscope.

11. The game controller as claimed in claim 10, wherein said inertial sensor includes at least one laser gyroscope.

12. The game controller as claimed in claim 1, wherein said inertial sensor is operable to produce information for quantifying the movement of the body in at least three degrees of freedom.

13. The game controller as claimed in claim 12, wherein the three degrees of freedom include pitch, yaw and roll.

14. The game controller as claimed in claim 13, wherein the three degrees of freedom include an x-axis, a y-axis, and a z-axis, each of said x-axis, y-axis and said z-axis being orthogonal with respect to each other of said to said x-axis, a y-axis, and z-axis.

15. The game controller as claimed in claim 14, wherein said inertial sensor is operable to quantify the movement in six degrees of freedom, said six degrees of freedom including said three degrees of freedom and pitch, yaw and roll.

16. The game controller as claimed in claim 6, the game controller being further operable to obtain a series of samples representative of acceleration of said body along at least one axis at different points in time from the information produced by the inertial sensor.

17. The game controller as claimed in claim 16, further comprising a processor operable to determine a velocity of said body using said series of samples.

18. The game controller as claimed in claim 17, wherein the processor is operable to determine said velocity by integrating acceleration values obtained from said series of samples over an interval of time.

19. The game controller as claimed in claim 16, wherein the processor is operable to determine a displacement of said body in space by first integrating acceleration values obtained from said series of samples over an interval of time and then integrating a result of said first integrating over the interval of time.

20. The game controller as claimed in claim 19, wherein the processor is operable to determine the displacement in relation to a prior-determined position to determine a present position of the body in space.

21. An apparatus including the game controller as claimed in claim 16, the apparatus further comprising:

a. a processor operable to execute a program to provide an interactive game playable by the user in accordance with input through said user-manipulable input device, the processor being operable to determine a velocity of said body using said series of samples.

22. The apparatus as claimed in claim 21, wherein the processor is operable to determine said velocity by integrating acceleration values obtained from said series of samples over an interval of time.

23. The apparatus as claimed in claim 21, wherein the processor is operable to determine a displacement of said body in space by first integrating acceleration values obtained from said series of samples over an interval of time and then integrating a result of said first integrating.

24. The apparatus as claimed in claim 21, wherein the processor is operable to determine a position of the body in space by determining the displacement in relation to a previously determined position.

25. The game controller as claimed in claim 1 wherein gearing means controls a multidimensional gearing amount and modifies each dimension of a multidimensional movement vector according to a corresponding dimension of the gearing amount.

26. The game controller as claimed in claim 1 wherein the changes in the gearing depend on a particular time interval during an action event occurring in the course of execution of the program.

27. The game controller of claim 1, further comprising logic for detecting a change in the light source;

and logic for triggering a mode change command at a main program run through a computing device, in response to a detected change in the light source as caused by a press in the button of the hand held input object, the mode change triggering an action for interfacing with one or more objects illustrated on the display screen.

28. The game controller of claim 1, wherein the gearing changes as a result of movement of the body.

29. The game controller of claim 1, further comprising a diffuser assembled with the body proximate the light source, wherein the diffuser is configured to diffuse light from the light source, wherein the image capture unit is separate from the body.

30. The game controller of claim 29, wherein analyzing the image of the light source includes determining a centroid of a diffuse image of the light source that has been diffused by the diffuser and tracking the centroid.

31. A game controller, comprising:

an image capture unit;

a body;

at least one input device assembled with the body, the input device manipulable by a user to register an input from the user;

an inertial sensor operable to produce information for quantifying a movement of said body through space;

at least one light source assembled with the body;

a processor coupled to the image capture unit and the inertial sensor, wherein the processor is configured to track the body by analyzing a signal from the inertial sensor and analyzing an image of the light source from the image capture unit; and

wherein the processor is configured to establish a gearing between movement of the body and actions to be applied by a computer program, wherein the movement of the body is determined from inertial forces detected by the inertial sensor, or from analysis of the image from the image capture unit, or from both inertial forces detected by the inertial sensor and analysis of the image from the image capture unit, wherein the gearing changes during interactivity with a virtual object of the computer program to impart a different response by the virtual object to the movement of the body during execution of actions to be applied by the computer program, wherein the changes in the gearing include different pre-determined gearing amounts between the movement of the body and the response of the virtual object during a single movement of the body, the single movement having a plurality of distinct pre-determined time periods, each of the different pre-determined gearing amounts being respectively mapped to each of the distinct pre-determined time periods of the single movement of the body.

32. The game controller of claim 31, wherein the pre-determined gearing amounts and the corresponding pre-determined time intervals are determined by user input to the computer program before the single movement.

33. The game controller of claim 31, wherein the pre-determined gearing amounts and the corresponding pre-determined time intervals are determined by the computer program before the single movement.

34. The game controller of claim 31, further comprising a diffuser assembled with the body proximate the light source, wherein the diffuser is configured to diffuse light from the light source, wherein the image capture unit is separate from the body.

35. The game controller of claim 34, wherein analyzing the image of the light source includes determining a centroid of a diffuse image of the light source that has been diffused by the diffuser and tracking the centroid.