Remotely controlled mobile device control system

• US 8,414,349 B2
• Filed: 06/01/2011
• Issued: 04/09/2013
• Est. Priority Date: 06/01/2011
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Boman, Michael Wesley, Gallacci, Gregory Allen
• Primary Examiner(s): HARPER, TRAMAR YONG
• Application Number:
  US13/150,383
• Publication Number:
  US 20120309261A1
• Time in Patent Office: 678 Days
• Field of Search: 446/268
• US Class Current: 446/268
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/424 involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/302 specially adapted for receiving control signals not targeted to a display device or game input means, e.g. vibrating driver's seat, scent dispenser
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 30/04 using wireless transmission

Abstract

A remotely controlled mobile device control system is disclosed wherein a remote controller of an existing game apparatus is selectively attachable to a remote controlled toy and used for controlling the movement of the remote controlled toy in conjunction with the game apparatus which is used as a central processing unit.

Claims

1. A remotely controlled mobile device control system comprising:

a computer game console;

a mobile device;

a remote controller in wireless communication with the computer game console, the remote controller affixed to the frame of the mobile device;

wherein

the remote controller includes a position and motion information acquisition unit configured to obtain and output information related to the current position, orientation and posture of the remote controller, the remote controller further including

a target acquisition unit configured to obtain and output information related to detecting objects in the vicinity of the controller;

wherein

the mobile device includes a transducer for receiving an audio input and converting the audio input to modulated control signals inputted to different servo motors of the mobile device, for controlling the motion of different sections of the mobile device, and wherein

the mobile device moves in response to the audio input, and the outputs of the position and motion information acquisition unit and the target acquisition unit.

2. The remotely controlled mobile device control system according to claim 1, wherein

the position and motion information acquisition unit includes at least one accelerometer sensor.

3. The remotely controlled mobile device control system according to claim 2, wherein

the accelerometer sensor comprises a gyro-sensor.

4. The remotely controlled mobile device control system according to claim 1, wherein

the target acquisition unit comprises an infrared camera, including an image pickup element and an infrared filter.

5. The remotely controlled mobile device control system according to claim 4, wherein

the infrared camera receives infrared radiation emitted by at least one infrared emitter positioned in the mobile device, said infrared radiation reflected from an object in the vicinity of the controller and reflected towards the infrared filter via a mirror positioned in the mobile device in the proximity of the infrared camera.

6. The remotely controlled mobile device control system according to claim 5, wherein

the mirror is a 360°

rotating mirror, or a series of fixed mirrors.

7. The remotely controlled mobile device control system according to claim 1, wherein

the transducer comprises an inductive pickup, which receives an audio signal from an audio output in the controller, said audio output being generated by a signal transmitted by the game console in response to an audio command of a user, said signal being received by the controller.

8. The remotely controlled mobile device control system according to claim 7, wherein

the inductive pickup produces different pulsed electric signals which are inputted to different servo motors controlling the motion of the different sections of the mobile device.

9. The remotely controlled mobile device control system according to claim 1, wherein

the mobile device comprises a robot toy.

10. The remotely controlled mobile device control system according to claim 9, wherein

the robot toy represents a game character of a game executed by the computer game console.

11. The remotely controlled mobile device control system according to claim 10, wherein

the robot toy representing a game character interacts with other robot toys representing other game characters, using the remotely controlled mobile device control system.

12. The remotely controlled mobile device control system according to claim 1, wherein

the computer game console is a Wii game console and the remote controller is a Wii remote controller.

13. A method for remotely controlling a mobile device having a remote controller, in wireless communication with a computer game console, affixed to the frame of the mobile device, the method comprising:

entering an audio input to a microphone in the computer game console, the audio input being wirelessly transmitted to the remote controller, and converting the received audio signal by the remote controller affixed to the mobile device to modulated control signals inputted to different servo motors of the mobile device, for controlling the motion of different sections of the mobile device, wherein

the remote controller includes position and motion information acquisition elements for obtaining and outputting information related to the current position, orientation and posture of the remote controller, the remote controller further including

target acquisition elements for obtaining and outputting information related to detecting objects in the vicinity of the controller, and

moving the mobile device in response to the audio input, and the outputs of the position and motion information acquisition elements and the target acquisition elements.

14. The method for remotely controlling a mobile device according to claim 13, wherein

the position and motion information acquisition elements include at least one accelerometer sensor.

15. The method for remotely controlling a mobile device according to claim 14, wherein

the accelerometer sensor comprises a gyro-sensor.

16. The method for remotely controlling a mobile device according to claim 13, wherein

the target acquisition elements comprise an infrared camera, including an image pickup element and an infrared filter.

17. The method for remotely controlling a mobile device according to claim 16, wherein

the infrared camera receives infrared radiation emitted by at least one infrared emitter positioned in the mobile device, said infrared radiation reflected from an object in the vicinity of the controller and reflected towards the infrared filter via a mirror positioned in the mobile device in the proximity of the infrared camera.

18. The method for remotely controlling a mobile device according to claim 17, wherein

the mirror is a 360°

rotating mirror, or a series of fixed mirrors.

19. The method for remotely controlling a mobile device according to claim 13, wherein

the received audio signal by the remote controller is converted to modulated control signals by a transducer comprising an inductive pickup, which receives an audio signal from an audio output in the controller, said audio output being generated by a signal transmitted by the game console in response to an audio command of a user, said signal being received by the controller.

20. The method for remotely controlling a mobile device according to claim 19, wherein

the inductive pickup produces different pulsed electric signals which are inputted to different servo motors controlling the motion of the different sections of the mobile device.

21. The method for remotely controlling a mobile device according to claim 13, wherein

the mobile device comprises a robot toy.

22. The method for remotely controlling a mobile device according to claim 21, wherein

the robot toy represents a game character of a game executed by the computer game console.

23. The method for remotely controlling a mobile device according to claim 22, wherein

the robot toy representing a game character interacts with other robot toys representing other game characters, using the remotely controlled mobile device control system.

24. The method for remotely controlling a mobile device according to claim 13, wherein

the computer game console is a Wii game console and the remote controller is a Wii remote controller.

25. A robot configured to receive a remote controller in an opening formed therein, the robot comprising:

one or more motors; and

a transducer for receiving an audio input and converting the audio input to modulated control signals inputted to said one or more motors of the robot, for controlling the motion of different sections of the robot, wherein

the remote controller is in wireless communication with a computer game console, wherein

the remote controller includes a position and motion information acquisition unit configured to obtain and output information related to the current position, orientation and posture of the remote controller, the remote controller further including

a target acquisition unit configured to obtain and output information related to detecting objects in the vicinity of the controller, and wherein

the robot moves in response to the audio input, and the outputs of the position and motion information acquisition unit and the target acquisition unit.