Methods and apparatus for using illumination marks for spatial pointing

• US 10,022,621 B2
• Filed: 06/28/2017
• Issued: 07/17/2018
• Est. Priority Date: 05/08/2006
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Ashida, Kenichiro, Takamoto, Junji, Goto, Yoshitomo, Suetake, Fumiyoshi, Ikeda, Akio, Inoue, Susumu, Sugiyama, Shin, Ito, Kuniaki
• Primary Examiner(s): Shah, Milap
• Application Number:
  US15/635,463
• Publication Number:
  US 20170333784A1
• Time in Patent Office: 384 Days
• CPC Class Codes: A63F 13/20 Input arrangements for video game devices
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

An elongated member such as a bar includes spaced-apart infrared light illumination ports at opposite ends thereof. Exemplary spacing between the two spaced-apart light ports may be 20 centimeters or more. Each light port comprises an array of plural light sources. The plural light sources in each array may be directionally aimed to as to provide different illumination directions. The plural light sources in each array may emit different colors or frequencies of light. Example applications include targeting or marking capabilities for a video game or other system handheld pointing device.

Claims

1. A system, comprising:

a first infrared light emitting part and a second infrared light emitting part, the first and second infrared light emitting parts comprising;

a first plurality of infrared light emitters disposed within the first infrared light emitting part;

a second plurality of infrared light emitters disposed within the second infrared light emitting part, the first and second pluralities of infrared light emitters being arranged to transmit infrared light through an infrared-light transmissive housing portion;

an electrically-conductive wire connected to commonly activate the first and second pluralities of the infrared light emitters;

a portable device comprising;

an optical detector configured to detect infrared light emitted by the first and second pluralities of infrared light emitters; and

a transmitter operatively coupled to the optical detector and configured to transmit information based on the infrared light detected by the optical detector; and

an information processing device comprising;

at least one receiver configured to receive the transmitted information from the transmitter;

at least one memory configured to store computer executable instructions; and

at least one processor, which upon executing the instructions, is configured to (i) ascertain real-time continuous aspects of at least a position and an orientation of the portable device based on the transmitted information, and (ii) based on the real-time continuous aspects of at least the position and the orientation, operate at least one object being displayed on a display device operatively coupled to the information processing device,

wherein the first and second infrared light emitting parts are configured so that the optical detector can sense infrared light emitted by the first and second pluralities of infrared light emitters when the optical detector is substantially off axis with respect to a direction perpendicular to the infrared light-transmissive housing portion.

2. The system of claim 1, further comprising a printed circuit board, the printed circuit board having first and second ends with the first plurality of infrared light emitters disposed at the printed circuit board first end and the second plurality of infrared light emitters disposed at the printed circuit board second end.

3. The system of claim 1, wherein the information processing device is configured to turn the first and second plurality of infrared light emitters on and off at specified encodings.

4. The system of claim 1, wherein the first and second plurality of infrared light emitters are configured to radiate the infrared light at a frequency of 940 nanometers.

5. The system of claim 1, wherein each of the first and second pluralities of infrared light emitters comprises at least two discrete light emitters.

6. The system of claim 1, wherein the first plurality of light emitters is arrayed in the same orientation as the second plurality of light emitters.

7. The system of claim 1, wherein the first and second pluralities of infrared light emitters are directional.

8. The system of claim 1, further comprising an activation circuit coupled to the electrically-conductive wire, the activation circuit being structured to supply encoded information for selectively activating the first and second pluralities of infrared light emitters to emit encoded infrared signaling.

9. The system of claim 1, wherein the information processing device provides an output signal responsive to where the portable device is pointing relative to the first and second infrared light emitting parts.

10. The system of claim 1, wherein the processor determines, based on the infrared light the optical detector detects, an aspect of distance between the portable device and the first and second infrared light emitting parts.

11. The system of claim 1, wherein the processor determines, based on the infrared light the optical detector detects, an aspect of twist orientation of the portable device relative to the first and second infrared light emitting parts.

12. The system of claim 1, wherein the processor determines, based on the infrared light the optical detector detects, changes in pointing direction of the portable device relative to the first and second infrared light emitting parts.

13. The system of claim 1, wherein the first and second pluralities of infrared light emitters are angled in different directions.

14. The system of claim 1, wherein the first and second infrared light emitting parts are battery powered.

15. The system of claim 1, wherein the first and second infrared light emitting parts are physically attachable to a video display device.

16. The system of claim 1, wherein the first and second infrared light emitting parts are configured to radiate modulated infrared waves for reflection toward the optical detector.

17. The system of claim 1, wherein the first and second infrared light emitting parts are configured to radiate modulated infrared waves for reflection toward a device to be controlled by said modulated waves.

18. The system of claim 1, wherein the first and second infrared light emitting parts are configured to radiate modulated infrared waves for reflection toward a display to be controlled by said modulated waves.

19. A system, comprising:

a first infrared light emitting portion and a second infrared light emitting portion;

a first plurality of infrared light emitters disposed within the first infrared light emitting portion;

a second plurality of infrared light emitters disposed within the second infrared light emitting portion, the first and second pluralities of infrared light emitters being arranged to transmit infrared light through an infrared-light transmissive housing portion;

an electrical control connection connected to simultaneously power the first and second pluralities of infrared light emitters;

an optical detector configured to detect infrared light emitted by the first and second pluralities of infrared light emitters; and

a transmitter operatively coupled to the optical detector and configured to transmit information based on the infrared light detected by the optical detector; and

an information processing device comprising;

at least one receiver configured to receive the transmitted information from the transmitter;

at least one memory configured to store computer executable instructions; and

at least one processor, which upon executing the instructions, is configured to (i) ascertain real-time continuous aspects of at least an orientation of the optical detector based on the transmitted information, and (ii) based on the real-time continuous aspects of the orientation, manipulate a virtual object;

wherein the first and second infrared light emitting portions are configured so that the optical detector can sense infrared light emitted by the first and second pluralities of infrared light emitters when the optical detector is substantially off axis with respect to a forward direction of the infrared-light transmissive housing portion.

20. An information processing system, comprising:

a first infrared light emitting part and a second infrared light emitting part;

a first plurality of infrared light emitters disposed within the first infrared light emitting part;

a second plurality of infrared light emitters disposed within the second infrared light emitting part, the first and second pluralities of infrared light emitters being arranged to transmit infrared light through an infrared-light transmissive housing portion;

an electrical control connection connected to simultaneously power the first and second pluralities of infrared light emitters;

an optical detector configured to detect infrared light emitted by the first and second pluralities of infrared light emitters; and

a transmitter operatively coupled to the optical detector and configured to transmit information based on the infrared light detected by the optical detector,

wherein the first and second infrared light emitting parts being structurally configured to (i) enable a processor in an information processing device to ascertain real-time continuous aspects of at least a position and an orientation based on the transmitted information, and (ii) enable the processor to operate an object being displayed on a display device based on the real-time continuous aspects of at least the position and the orientation, and

wherein the first and second infrared light emitting parts are configured to permit the optical detector to sense the infrared light emitted by the first and second pluralities of the infrared light emitters when the optical detector is off axis with respect to a direction perpendicular to the infrared-light transmissive housing portion.