Methods and apparatus for using illumination marks for spatial pointing

• US 9,694,278 B2
• Filed: 06/13/2016
• Issued: 07/04/2017
• Est. Priority Date: 05/08/2006
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Ashida, Kenichiro, Takamoto, Junji, Goto, Yoshitomo, Suetake, Fumiyoshi, Inoue, Susumu, Ito, Kuniaki, Sugiyama, Shin, Ikeda, Akio
• Primary Examiner(s): Shah, Milap
• Application Number:
  US15/180,337
• Publication Number:
  US 20160361629A1
• Time in Patent Office: 386 Days
• CPC Class Codes: A63F 13/20 Input arrangements for video game devices
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

An elongated member such as a bar includes spaced-apart infrared light illumination ports at opposite ends thereof. Exemplary spacing between the two spaced-apart light ports may be 20 centimeters or more. Each light port comprises an array of plural light sources. The plural light sources in each array may be directionally aimed to as to provide different illumination directions. The plural light sources in each array may emit different colors or frequencies of light. Example applications include targeting or marking capabilities for a video game or other system handheld pointing device.

Claims

1. A system, comprising:

an infrared light emitting bar configured to transmit infrared light, the infrared light emitting bar comprising;

an elongated linear-shaped housing having first and second ends, at least a portion of said housing being infrared-light transmissive;

a first plurality of infrared light emitters disposed within the housing substantially at the housing first end;

a second plurality of infrared light emitters disposed within the housing substantially at the housing second end and spaced apart from the first plurality of infrared light emitters, the first and second pluralities of infrared light emitters being arranged to transmit infrared light through the infrared-light transmissive housing portion; and

an electrically-conductive wire entering the housing and connected to commonly activate the first and second pluralities of the infrared light emitters;

a handheld controller comprising;

an optical detector configured to detect infrared light emitted by the first and second pluralities of infrared light emitters; and

a wireless transmitter operatively coupled to the optical detector and configured to wirelessly transmit indications based on the infrared light detected by the optical detector; and

an information processing device comprising;

at least one wireless receiver configured to wirelessly receive the transmitted indications from the wireless transmitter;

at least one memory configured to store computer executable instructions; and

at least one processor, which upon executing the instructions, is configured to (i) ascertain real-time continuous aspects of at least a position and a pointing orientation of the optical detector relative to the light emitting bar based on the transmitted indications, and (ii) based on the real-time continuous aspects of at least the position and the pointing orientation, operate at least one object being displayed on a display device operatively coupled to the information processing device;

wherein the housing is configured so that the optical detector can sense infrared light emitted by the first and second pluralities of infrared light emitters when the optical detector is substantially off axis with respect to a direction perpendicular to the housing light-transmissive portion.

2. The system of claim 1, wherein the wire is configured to connect the bar to the information processing device and the information processing device is structured to supply power to the bar via the wire when the wire is connected thereto.

3. The system of claim 1, further including an elongated printed circuit board disposed within the housing, the printed circuit board having first and second ends with the first plurality of infrared light emitters disposed at the printed circuit board first end and the second plurality of infrared light emitters disposed at the printed circuit board second end.

4. The system of claim 1, wherein the information processing device is configured to turn the bar on and off at specified encodings.

5. The system of claim 1, wherein the bar is configured to radiate the infrared light at a frequency of 940 nanometers.

6. The system of claim 1, wherein the housing is dimensioned to space apart first and second infrared filtering windows by at least 20 centimeters.

7. The system of claim 1, wherein the housing comprises a rectangular trough defining a side that is at least partially open, the infrared-light transmissive housing portion being planar and disposed to cover open part(s) of the side of the trough.

8. The system of claim 1, wherein each of the first and second pluralities of light emitters comprises at least three discrete light emitters.

9. The system of claim 1, wherein the first plurality of light emitters is arrayed in the same orientation as the second plurality of light emitters.

10. The system of claim 1, wherein the light emitters are directional.

11. The system of claim 1, further including an activation circuit coupled to the electrically-conductive wire, the activation circuit being structured to supply encoded information for selectively activating said first and second pluralities of light emitters to emit encoded infrared signaling.

12. The system of claim 1, wherein the wireless transmitter reports coordinates.

13. The system of claim 1, wherein the information processing device provides an output signal responsive to where the handheld controller is pointing relative to the infrared light emitting bar.

14. The system of claim 1, wherein the processor determines, based on the infrared light the optical detector detects, an aspect of distance between the handheld controller and the infrared light emitting bar.

15. The system of claim 1, wherein the processor determines, based on the infrared light the optical detector detects, an aspect of twist orientation of the handheld controller relative to the infrared light emitting bar.

16. The system of claim 1, wherein the processor determines, based on the infrared light the optical detector detects, changes in pointing direction of the handheld controller relative to the infrared light emitting bar.

17. The system of claim 1, wherein the housing is configured to radiate modulated infrared waves into a room for reflection toward an infrared-controlled television or other device to be controlled by said modulated waves.

18. The system of claim 1, wherein the system is configured to control pointing position on displays of different sizes using the same infrared light emitting bar.

19. A system, comprising:

an infrared light emitting bar configured to transmit infrared light, the infrared light emitting bar comprising;

an elongated linear-shaped housing having first and second ends, at least a portion of said housing being infrared-light transmissive;

a first plurality of infrared light emitters disposed within the housing substantially at the housing first end;

a second plurality of infrared light emitters disposed within the housing substantially at the housing second end and spaced apart from the first plurality of infrared light emitters, the first and second pluralities of infrared light emitters being arranged to transmit infrared light through the infrared-light transmissive housing portion; and

an electrical control connection connected to simultaneously power the first and second point source arrays;

a handheld portable device, comprising;

an optical detector configured to detect infrared light emitted by the first and second pluralities of infrared light emitters; and

a wireless transmitter operatively coupled to the optical detector and configured to wirelessly transmit indications based on the infrared light detected by the optical detector; and

an information processing device comprising;

at least one wireless receiver configured to wirelessly receive the transmitted indications from the wireless transmitter;

at least one memory configured to store computer executable instructions; and

at least one processor, which upon executing the instructions, is configured to (i) ascertain real-time continuous aspects of at least an orientation of the optical detector relative to the light emitting bar based on the transmitted indications, and (ii) based on the real-time continuous aspects of the orientation, manipulate a virtual object;

wherein the housing is configured so that the optical detector can sense infrared light emitted by the first and second pluralities of infrared light emitters when the optical detector is substantially off axis with respect to a forward direction of the housing.

20. An infrared light emitting bar configured to transmit infrared light receivable by an optical detector, the infrared light emitting bar comprising:

an elongated linear-shaped housing having first and second ends, at least a portion of said housing being infrared-light transmissive;

a first plurality of infrared light emitters disposed within the housing substantially at the housing first end;

a second plurality of infrared light emitters disposed within the housing substantially at the housing second end and spaced apart from the first plurality of infrared light emitters, the first and second pluralities of infrared light emitters being arranged to transmit infrared light through the infrared-light transmissive housing portion; and

an electrical control connection connected to simultaneously power the first and second plurality of infrared light emitters,

wherein the infrared light emitting bar being structurally configured to (i) enable a processor in an information processing device to ascertain real-time continuous aspects of at least a position and a pointing orientation of the optical detector relative to the infrared light emitting bar based on the light emitted, and (ii) enable the processor to operate an object being displayed on a display device operatively coupled to the information processing device based on the realtime continuous aspects of at least the position and the pointing orientation of the optical detector, and

wherein the housing is configured to permit the optical detector to sense the infrared light emitted by the first and second pluralities of the infrared light emitters when the optical detector is off axis with respect to a direction perpendicular to the housing light-transmissive portion.