Wireless game controllers

• US 8,870,655 B2
• Filed: 04/17/2006
• Issued: 10/28/2014
• Est. Priority Date: 08/24/2005
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Ikeda, Akio
• Primary Examiner(s): LIDDLE, JAY TRENT
• Application Number:
  US11/404,871
• Publication Number:
  US 20070050597A1
• Time in Patent Office: 3,116 Days
• Field of Search: None
• US Class Current: 463/39
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1031 using a wireless connection, e.g. Bluetooth, infrared connections
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera

Abstract

A game controller arrangement includes a first control unit generating first operation data including linear acceleration sensed within a first control unit body. A second control unit generates second operation data in accordance with a direction input operation performed by a player. One of the first control unit and the second control unit includes a transmission section for wirelessly transmitting the first operation data and the second operation data to a computer.

Claims

1. A game controller arrangement operable by at least one human player, the game controller arrangement comprising first and second control units, one of the first and second control units, in use, sending operating data obtained from the first control unit and the second control unit to a video game console providing video game play, the game controller arrangement comprising:

a first control unit structured to be held in the air by and operated by a first hand, said first control unit including a first control unit body having disposed therein a sensor comprising a linear acceleration sensing arrangement that detects linear acceleration or a gyro-sensor that detects angular rate of rotation;

a second control unit structured to be held in the air by and operated by a second hand, said second control unit including an imaging section that detects plural infrared markers and obtains marker coordinate related information therefrom, said second control unit further including at least one digit-operated control; and

a wireless connection that wirelessly connects the first control unit with the second control unit, wherein

the first control unit further includes a first operating data generator coupled to said sensor that provides first operating data sensed by said sensor, said first operating data in use controlling at least a first aspect of game play provided by said video game console;

the second control unit further includes a second operating data generator coupled to said imaging section that generates second operating data in response to the imaging section and position of the at least one digit-operated control, said second operating data in use controlling at least a second aspect of game play provided by said video game console; and

one of the first and second control units further includes a wireless transceiver for wirelessly transmitting the first operating data from the first control unit and the second operating data from the second control unit wirelessly to the video game console to thereby at least in part control said video game play.

2. The game controller arrangement according to claim 1, wherein

the imaging section includes an image pickup sensor that senses an image along a predetermined direction, and outputs, as the second operating data, data including marker image position coordinate data that is a result of subjecting an image sensed by the image pickup sensor to a predetermined calculation.

3. The game controller arrangement according to claim 2, wherein the second operating data generator further includes a coordinate information calculator calculating coordinate information indicating positional coordinates, in the image sensed by the image pickup sensor, of at least one marker image which is included in the sensed image and is used as an imaging target, when performing the predetermined calculation, and outputting said marker image positional coordinates as the second operating data.

4. The game controller arrangement according to claim 1,

wherein the sensor senses linear acceleration operating data, the imaging section provides marker image positional coordinate operating data, and the transceiver transmits to the video game player the linear acceleration operating data and the marker image positional coordinate operating data continually at intervals shorter than 1/60 second.

5. The game controller arrangement according to claim 1, wherein

the second control unit comprises a second control unit body, and the second control unit digit operated control includes a thumb-operable stick which has a tip projecting from the second control unit body and is inclinable relative to second control unit body, and outputs data obtained in accordance with an inclining direction of the thumb-operable stick for wireless transmission to the video game console.

6. The game controller arrangement according to claim 1, wherein the second control unit comprises a second control unit body and the second control unit digit-operated control includes an operation button which has operation portions representing at least four directions and which is able to be pushed by a thumb into the second control unit body by the operation portions, and outputs, as the second operating data for wireless transmission to the video game console, data corresponding to the operation portion at which the operation button is pushed.

7. The game controller arrangement according to claim 1, wherein the second control unit has a body and

the second operating data generator includes a sliding member which has a top surface exposed from the second control unit body and which is horizontally movable on the second control unit body, and outputs data obtained in accordance with a horizontal moving direction of the sliding member as the second operating data for wireless transmission to the video game console.

8. The game controller arrangement according to claim 1, wherein the second control unit has a body and

the second operating data generator includes a touch pad on an outer surface of the second control unit body and outputs, as the second operating data for wireless transmission to the video game console, data obtained in accordance with a position on the touch pad at which the touch pad is touched.

9. The game controller arrangement according to claim 1, wherein the second control unit has a body and

the second operating data generator includes at least four operation buttons which are able to be pushed into the second control unit body, and outputs data obtained in accordance with the pushed operation button as the second operating data for wireless transmission to the video game console.

10. A game system comprising the game controller arrangement according to claim 1, and wherein said video game console is wirelessly connected to the game controller arrangement and includes a computer for executing a game program to represent a virtual game world on a display screen, wherein

the video game console provides animated game play including the first aspect controlled by the first operating data from the first control unit and the second aspect controlled by the second operating data from the second control unit.

11. The game system according to claim 10, wherein

the video game console causes a player character appearing in the virtual game world to perform a first action in accordance with the first operating data and causes the player character appearing in the virtual game world to perform a second action in accordance with the second operating data.

12. For use with a video game playing system comprising (a) a video game console providing video game play and (b) a remote controller configured to be held in the air and operated by a first hand and including an image sensor that detects plural infrared markers disposed in the vicinity of a display screen and obtains marker image position coordinates therefrom and a three-axis linear acceleration sensor that detects linear acceleration to generate first data and wirelessly transmits said first data to the video game console, a further controller comprising:

a housing structured to be held in a second hand;

a thumbstick disposed on said housing, said thumbstick generating inclination data in response to inclination of said thumbstick by a thumb of said second hand relative to said housing;

at least one button disposed on said housing, said button generating button data in response to depression of said button by a finger of said second hand;

a further sensor disposed within said housing, said further sensor used to generate posture representing data related to posture of said housing; and

a wireless transmitter operatively coupled to said thumbstick, said at least one button and said further sensor, said wireless transmitter configured for sending said thumbstick inclination data, said button data and said posture representing data over the air through said remote controller to said video game console, said remote controller and further controller cooperating to, in use, control a first aspect of video game play provided by said video game console by operating said remote controller with the first hand and controlling an additional aspect of said video game play by operating said further controller with the second hand,

wherein said remote controller is configured to, in use, send said further controller'"'"'s thumbstick inclination data, button data and posture representing data, and to also send said detected linear acceleration and said marker image position coordinates, over the air to said video game console.

13. The video game playing system of claim 12 wherein said further controller is configured so that said remote controller can optionally connect to said further controller.

14. A video game accessory controller wherein at least a first aspect of video game play is, in use, controlled by said accessory controller and at least a second aspect of said video game play is, in use, controlled by another handheld controller, and said accessory controller is configured to communicate with a video game console through said another handheld controller, said video game accessory controller comprising:

a housing structured to be held in the air and operated by a single hand of a video game player;

a joystick disposed on and projecting from said housing, said joystick generating inclination data in response to manual inclination thereof relative to said housing by a digit of said single hand;

at least one button disposed on said housing, said button generating button data in response to depression thereof;

a sensor disposed within said housing, said sensor generating data relating to attitude of said housing; and

a wireless transceiver operatively coupled to said joystick, said at least one button and said sensor, said wireless transceiver sending said joystick inclination data, said button data and said sensor data over the air to another handheld controller held in the air and operated by a further hand for said another handheld controller to send to a video game console providing video game play.

15. The accessory controller of claim 14 wherein the sensor comprises an image sensor.

16. The accessory controller of claim 14 wherein wireless communication between said accessory controller and said another handheld controller is two-way.

17. For use with a video game console providing video game play and having a remote game controller for being held in the air and operated by a first hand, a further game controller for being held in the air and operated by a second hand, said further game controller comprising:

a housing dimensioned and structured to be held in the air and operated by the second hand, said housing comprising a tapered curved upper surface terminating in a forward surface and further comprising a lower surface having a concavity defined therein,

a joystick disposed on said housing upper surface, said joystick generating inclination data in response to detected inclination thereof relative to said upper surface by a digit of said second hand;

at least one button disposed on said housing forward surface, said button generating button data in response to depression thereof by a digit of said second hand;

a further sensor disposed within said housing, said further sensor generating further data related to the posture or attitude of said housing; and

a wireless communications device responsive to said joystick, said at least one button and said further sensor, said wireless communications device being configured to, in use, send said joystick inclination data, said button data and said further data wirelessly to said remote game controller for said remote game controller to forward to said video game console, operation of said remote game controller by said first hand, in use, controlling at least one aspect of game play provided by said video game console, operation of said further game controller by said second hand controlling, in use, at least one further aspect of said game play provided by said video game console.

18. The further controller of claim 17 wherein said remote game controller and said further game controller are configured for the same game player to hold in the air in different hands and operate simultaneously.

19. The further controller of claim 17 wherein said housing is dimensioned so that in use a plurality of fingers of said second hand can rest within said concavity while (a) at least a portion of the heel of the second hand is placed in contact with the tapered curved upper surface, (b) the thumb of said second hand can operate the joystick, and (c) the index finger of said second hand can operate the at least one button.

20. The further controller of claim 17 wherein said joystick comprises a thumbstick.

21. The further controller of claim 17 wherein said at least one button comprises plural buttons of different sizes and shapes disposed on said forward surface.

22. The further controller of claim 17 further comprising a cross-switch, an image sensor and a two-way transceiver provided on or in said housing.

23. The further controller of claim 17 wherein said remote game controller also wirelessly receives data from said further game controller.

24. The further controller of claim 17 wherein said wireless communications device comprises a radio transceiver.

25. A handheld remote controller structured to be held in, carried by and operated by a single hand of a video game player, said handheld remote controller comprising:

a housing shaped and structured so it can be held in the air by and manipulated by the game player'"'"'s single hand, said housing defining a surface;

an inclinable thumbstick projecting from said housing surface, said inclinable thumbstick outputting inclination data in accordance with the inclining direction of the inclinable thumbstick relative to the housing;

at least one button disposed on said housing, said button generating button depression data in response to depression thereof by an index finger of said single hand;

a three-axis linear acceleration sensor disposed within said housing, said three-axis linear acceleration sensor detecting linear acceleration of said housing and generating three axes of acceleration data related to posture of said housing; and

a wireless transceiver operatively coupled to said inclinable thumbstick, said at least one button and said acceleration sensor, said wireless transceiver sending at least said thumbstick inclination data, said button depression data and said three axes of acceleration data over the air for use by a video game console in generating video game play,

wherein, in use, at least a first aspect of said generated video game play can be controlled by said thumbstick inclination data and at least a second aspect of said generated video game play can be controlled by said linear acceleration data.

26. A handheld controller structured to be held in, carried by and operated by a single hand of a video game player, said handheld controller comprising:

a housing shaped and structured so the handheld controller can in use be held in, carried by and simultaneously manipulated by the game player'"'"'s single hand, said housing defining at least one surface;

an inclinable thumbstick projecting from said at least one surface of said housing, said inclinable thumbstick detecting inclination of the inclinable thumbstick relative to said at least one surface of said housing as controlled by the thumb of said single hand;

plural buttons disposed on said housing, said plural buttons generating button depression data in response to depression thereof by a digit of said single hand;

an inertial sensor disposed within said housing, said inertial sensor selected from the group consisting of a linear acceleration sensor and a gyrosensor, said inertial sensor detecting information related to posture of said housing; and

a wireless transceiver operatively coupled to said inclinable thumbstick, said plural buttons and said inertial sensor, said wireless transceiver sending said detected thumbstick inclination, said plural button depression data and said detected housing posture related information over the air for use by a video game console in generating video game play,

wherein, in use, at least a first aspect of said generated video game play can be controlled by said detected thumbstick inclination and at least a second aspect of said generated video game play can be controlled by said detected housing posture related information.

27. The controller of claim 26 wherein said inertial sensor comprises a three-axis linear accelerometer.

28. The controller of claim 26 wherein said inertial sensor comprises a gyro-sensor capable of directly detecting rotation or angular rate.

29. A game controller arrangement for use with a video game console and operable by the left and right hands of a user, the game controller arrangement comprising first and second control units, the game controller arrangement comprising:

a first control unit structured to be held in the air by and operated by a first hand of a user, said first control unit including;

an imaging section that detects plural infrared markers and obtains marker coordinate related information therefrom,

a linear accelerometer that detects linear acceleration, and

a wireless transmitter that wirelessly transmits data to the video game console; and

a second control unit having a housing structured to be held in the air by and operated by a second, different hand of said user, said second control unit including;

a sensor that generates game-related input by sensing stimuli external to said second control unit;

a joystick that generates inclination data in response to inclination thereof relative to said housing by a digit of said second hand; and

a wireless transmitter that wirelessly transmits output from the sensor and the digit-operated control to said first control unit.

30. The game controller arrangement of claim 29 wherein said second control unit sensor comprises an image sensor that senses coordinates of plural infrared markers.