Game operating device

• US 9,011,248 B2
• Filed: 03/24/2011
• Issued: 04/21/2015
• Est. Priority Date: 08/22/2005
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Ikeda, Akio, Kuroda, Ryoji, Urata, Masahiro, Ito, Kuniaki
• Primary Examiner(s): D'AGOSTINO, PAUL ANTHONY
• Application Number:
  US13/071,028
• Publication Number:
  US 20110172016A1
• Time in Patent Office: 1,489 Days
• US Class Current: 463/38
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/558 by assessing the players' skills or ranking

Abstract

A game operating device (controller) includes a longitudinal housing, and a holding portion held by hand to be wrapped by its palm it is formed in the housing. A direction switch is provided on an upper surface at a position where it can be operated by thumb of the hand holding the holding portion, and a start switch and a select switch are provided backward thereof. An X button 46 and a Y button are further arranged in line on the upper surface of the housing. An imaging information arithmetic unit is provided at a front end of the housing in a longitudinal direction in such a manner that an imaging device thereof is exposed from a front-end surface. A concave portion is formed on a lower surface at a position corresponding to the direction switch. The concave portion includes a valley and two inclined surfaces. An A button capable of being operated by index finger of the hand holding the holding portion is provided on the backward inclined surface. By processing an image signal obtained by imaging an infrared ray from LED modules by the imaging device, it is possible to obtain an operation signal varying according to a position and/or attitude of the controller.

Claims

1. A video game remote controller, comprising:

a housing including an upper control surface and a lower surface;

at least one control button disposed on the upper control surface;

at least one control button disposed on said housing lower surface;

an inertial sensor mounted within the housing that outputs a signal indicative of aspects of orientation or tilt of the housing;

an imaging module including;

a two dimensional image sensor mounted on or in the housing that generates frames of two dimensional image data representative of an area surrounding the housing, and

a processor that processes the frames of two dimensional image data and that determines positions of illuminated objects within the images that are emitting infrared light; and

a wireless transceiver operatively coupled to the inertial sensor and the imaging module that transmits information based on signals generated by the inertial sensor and the imaging module.

2. The controller of claim 1 wherein said housing includes a front portion and said image sensor is disposed at least in part on said housing front portion.

3. The controller of claim 1, wherein the image sensor senses infrared light.

4. The controller of claim 1, wherein the image sensor comprises a CMOS type image sensor.

5. The controller of claim 1, further comprising an infrared filter mounted on the housing, wherein the image sensor is mounted on the housing behind the infrared filter such that only infrared light passing through the filter is received by the image sensor.

6. The controller of claim 1, wherein the processor determines X and Y coordinates for an illuminated object appearing within each frame of image data that is emitting infrared light.

7. The controller of claim 6, wherein the processor determines X and Y coordinates of the center of gravity of an illuminated object appearing within each frame of image data that is emitting infrared light.

8. The controller of claim 6, wherein the imaging module creates a set of position data for each frame of two dimensional image data, and wherein each set of position data comprises X and Y coordinates for an illuminated object appearing in the frame of two dimensional image data that is emitting infrared light.

9. The controller of claim 8, wherein the wireless transceiver wirelessly transmits each set of position data.

10. The controller of claim 6, wherein the inertial sensor comprises a three axis accelerometer that senses linear acceleration in each of three mutually perpendicular axes, and wherein the signal output by the inertial sensor comprises three linear acceleration values corresponding to the three mutually perpendicular axes multiple times every second.

11. The controller of claim 10, wherein the wireless transmitter transmits X and Y coordinates for an illuminated object appearing within a frame of image data that is emitting infrared light, and the three acceleration values, multiple times every second.

12. The controller of claim 6, wherein the inertial sensor is a gyroscopic sensor, and wherein the signal output by the gyroscopic sensor comprises three values representing respective angular rotational speeds around three mutually perpendicular axes.

13. The controller of claim 12, wherein the wireless transmitter transmits X and Y coordinates for an illuminated object appearing within a frame of image data that is emitting infrared light, and the three angular rotational speed values, multiple times every second.

14. The controller of claim 1, wherein the inertial sensor is a gyroscopic sensor.

15. The controller of claim 14, wherein the signal output by the gyroscopic sensor comprises three values representing respective angular rotational speeds around three mutually perpendicular axes.

16. The controller of claim 15, wherein the wireless transmitter transmits the three angular rotational speed values multiple times every second.

17. The controller of claim 1, further comprising an output device, wherein the output device is controlled based on a signal received by the wireless transceiver.

18. The controller of claim 17, wherein the output device comprises a vibration module that causes the housing to vibrate based on a signal received by the wireless transceiver.

19. The controller of claim 17, wherein the output device comprises a speaker, and wherein the speaker outputs sounds based on a signal received by the wireless transceiver.

20. The controller of claim 17, wherein the output device comprises an array of indicator lights that are selectively illuminated based on a signal received by the wireless transceiver.

21. The controller of claim 5, wherein the processor processes the frames of two dimensional image data and determines positions of illuminated objects within the images that are emitting infrared light.

22. The controller of claim 5, wherein because of the infrared filter, the image sensor generates frames of two dimensional image data that only include features reflecting or emitting infrared light.

23. The controller of claim 22, wherein the processor processes the frames of two dimensional image data and determines positions of illuminated objects that are emitting infrared light.