POINTING DEVICE SYSTEM AND METHOD

• US 20090203445A1
• Filed: 02/04/2009
• Published: 08/13/2009
• Est. Priority Date: 09/14/2005
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: DOHTA, Takuhiro, OHTA, Keizo
• Granted Patent: US 8,228,293 B2
• Time in Patent Office: Days
• US Class Current: 463/39
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/818 Fishing
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/66 for rendering three dimensional images
• CPC Class Codes: A63F 2300/8035 Virtual fishing

Abstract

Example systems and methods described herein relate to a remote control including an image sensor disposed on a front end portion thereof. First and second markers produced by a light source are detected at the image sensor. A first middle point is calculated based on the detected first and second markers and a second middle point is calculated based on the first middle point and a difference in direction between a reference direction and a direction from the first detected marker to the second detected marker. A position pointed to by the remote control is calculated based on a difference between a reference point and the second middle point. An image signal is generated for an image based at least in part on the pointed-to position.

Claims

1. A method of using a remote control comprising an image sensor disposed on a front end portion thereof, the method comprising:

detecting at the image sensor first and second markers produced by a light source;

calculating a first middle point based on the detected first and second markers;

calculating a second middle point based on the first middle point and a difference in direction between a reference direction and a direction from the first detected marker to the second detected marker;

calculating a position pointed to by the remote control based on a difference between a reference point and the second middle point; and

generating an image signal for an image based at least in part on the pointed-to position.

2. The method according to claim 1, wherein the light source comprises at least two spaced-apart light-emitting diodes.

3. The method according to claim 2, wherein the light-emitting diodes are spaced-apart in a substantially horizontal direction.

4. The method according to claim 1, further comprising:

transmitting signals indicative of the detected first and second markers from the remote control to a computer which performs the first middle point calculating, the second middle point calculating, the pointed-to position calculating and the image signal generating.

5. The method according to claim 4, wherein the transmitted signals are transmitted wirelessly.

6. The method according to claim 1, wherein the reference direction is based on first and second reference points and the reference point is a middle point between the first and second reference points.

7. The method according to claim 1, further comprising:

detecting the first and second reference points during a calibration process in which the first and second markers are detected at the image sensor when the remote control points in a reference pointing direction.

8. The method according to claim 1, further comprising:

storing, in a memory, data indicative of the first and second reference points.

9. The method according to claim 1, further comprising:

determining the reference direction based stored reference direction data.

10. The method according to claim 1, wherein the reference direction is substantially horizontal.

11. A method comprising using a remote control according to the method of claim 1 while playing a video game.

12. The method of claim 11, wherein the video game comprises a fishing game.

13. A computer readable medium storing computer readable instructions that, when executed, cause a processor to perform a method comprising:

receiving data indicative of first and second markers produced by a light source which are detected by an image sensor disposed on a front end portion of a remote control;

calculating a first middle point based on the detected first and second markers;

calculating a second middle point based on the first middle point and a difference in direction between a reference direction and a direction from the first detected marker to the second detected marker;

calculating a position pointed to by the remote control based on a difference between a reference point and the second middle point; and

generating an image signal for an image based at least in part on the pointed-to position.

14. The computer readable medium according to claim 13, wherein the reference direction is based on first and second reference points and the reference point is a middle point between the first and second reference points.

15. An apparatus comprising:

a processor; and

memory configured to store computer readable instructions that, when executed, cause the processor to perform a method comprising receiving data indicative of first and second markers produced by a light source which are detected by an image sensor disposed on a front end portion of a remote control;

calculating a first middle point based on the detected first and second markers;

calculating a second middle point based on the first middle point and a difference in direction between a reference direction and a direction from the first detected marker to the second detected marker;

calculating a position pointed to by the remote control based on a difference between a reference point and the second middle point; and

generating an image signal for an image based at least in part on the pointed-to position.

16. The apparatus according to claim 15, wherein the reference direction is based on first and second reference points and the reference point is a middle point between the first and second reference points.

17. The apparatus according to claim 15, wherein the reference direction is based on stored reference direction data.

18. A system comprising:

a remote control configured to be held by a hand and comprising an image sensor for detecting first and second markers produced by a light source arranged in the vicinity of a display screen; and

a processing system configured to calculate a first middle point based on the detected first and second markers, calculate a second middle point based on the first middle position and a difference in direction between a reference direction and a direction from the first detected marker to the second detected marker, calculate a position pointed to by the pointing device based on the difference between a reference point and the second middle point and generate image signals for an image displayed on the display screen based at least in part on the pointed-to position.

19. The system according to claim 18, wherein the reference direction is based on first and second reference points and the reference point is a middle point between the first and second reference points.

20. The system according to claim 18, wherein the remote further comprises a wireless transmitter for transmitting data indicative of the detected first and second markers.