3D cursor or joystick device

• US 7,405,726 B2
• Filed: 05/31/2002
• Issued: 07/29/2008
• Est. Priority Date: 08/27/1999
• Status: Expired due to Fees

• Current Assignee: Maui Innovative Peripherals, Inc.
• Original Assignee: Maui Innovative Peripherals, Inc.
• Inventors: Pelosi, Michael J.
• Primary Examiner(s): Lefkowitz, Sumati
• Assistant Examiner(s): Kumar, Srilakshmi K
• Application Number:
  US10/160,657
• Publication Number:
  US 20020175897A1
• Time in Patent Office: 2,251 Days
• Field of Search: 345 6- 8, 345/207, 345156-184, 3561521-1523
• US Class Current: 345/158
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G01S 3/784 using a mosaic of detectors
• CPC Class Codes: G01S 5/163 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 9/08 for teaching control of aircraft, e.g. Link trainer

Abstract

A 3D cursor or joystick device and control method employs a complementary pair of emitter/detector units, one worn on a part of a user'"'"'s body (e.g., the head) and the other mounted in a stationary position on a display monitor facing the user. Each unit has an array of photovoltaic (PV) cells centered on a normal axis and an infrared diode for emitting a light beam on the normal axis. Each photodetectors array receives the infrared beam from the other unit and provides output signals representing the light intensities of the received beam on the PV cells. The PV cell response signals of the complementary units are used together to calculate the position and angular orientation of the user-worn unit relative to the stationary unit. The position and angle values are used by a software device driver installed on a computer to control 3D navigation functions of the associated application program on the computer. The system can be used for playing interctive 3D games, and also used for hands-free control in a wide range of other applications and environments, such as to control flight motions in a simulator or cockpit of an aircraft, or the command center of a naval vessel, spaceship, land vehicle, etc., for disabled persons to provide hands-free input to a computer, motorized wheelchair, prosthetic device, etc., and for controlling various functions in an industrial environment, such as guiding machine-assisted movement, or in CAD design, architectural, medical graphics, virtual reality, and other applications.

Claims

1. A 3D cursor or joystick device comprising:

a complementary pair of emitter/detector units, one of which is mounted on a movable component moved by the user in a 3D space and the other of which is mounted on a stationary component positioned at a reference position facing toward the 3D space in which the user moves the movable component, wherein each emitter/detector unit of the complementary pair has an emitter element for emitting a three-dimensionally distributed signal beam in a direction toward the other unit, and a detector element adjacent the emitter element so as to receive the signal beam from the other unit and provide an output signal representing measured characteristics of the signal beam received from the other unit,

wherein only the two output signals of the two detector elements, each detecting the signal beam from the emitter element of the other one of the complementary pair of emitter/detector units at opposite endpoints defining a single line between the two emitter/detector units, are used in combination together to calculate position and orientation angle values for the emitter/detector unit of the movable component relative to the emitter/detector unit of the stationary component.

2. A 3D cursor or joystick device according to claim 1, further comprising a processor module for receiving the output signals of the complementary pair of emitter/detector units and generating a device output of the calculated position and orientation angle of the movable component relative to the stationary component.

3. A 3D cursor or joystick device according to claim 2, wherein the processor module is coupled to a computer running a 3D application program and provides the device output to the computer to be used as a cursor or joystick control input to the 3D application program.

4. A 3D cursor or joystick device according to claim 1 which is used to control a 3D flight or navigation simulation program.

5. A 3D cursor or joystick device according to claim 1 which is used to control a 3D command and control application program.

6. A 3D cursor or joystick device according to claim 1 which is used for hands-free input to an assistive application program for a disabled person.

7. A 3D cursor or joystick device according to claim 1 which is used for controlling machine movement in an industrial environment.

8. A 3D cursor or joystick device according to claim 1 which is used for controlling user input to a CAD or 3D graphics application program.

9. A 3D cursor or joystick device according to claim 1 which is used for controlling user input to a virtual reality application program.

10. A 3D cursor or joystick device according to claim 1, wherein the movable component is attached to a part of the user'"'"'s body and controlled by moving that part of the body in the 3D space in front of the stationary component and without the requiring operation by the user'"'"'s hands.

11. A 3D cursor or joystick device according to claim 10, wherein the movable component is a headset mounted on the user'"'"'s head, and the stationary component is a monitor module mounted in proximity to a display monitor facing toward the user.

12. A 3D cursor or joystick device according to claim 1, wherein the emitter/detector units of the complementary pair are of the same construction and operate with the same characteristics.

13. A 3D cursor or joystick device according to claim 1, wherein each emitter/detector unit has at least one photodetector as the detector element comprising at least two planar photodetector cells and at least one light source having an axially symmetric light intensity distribution as the emitter element.

14. A 3D cursor or.joystickdevice according to claim 1, wherein each emitter element emits an axially symmetric light beam centered on the unit'"'"'s axis N in a direction toward the other unit, and each detector element is sensitive to light intensity and intensity differences of the light received, which are indicative of angle-of-incidence of and distance to of the emitter light source.

15. A 3D cursor or joystick device according to claim 1, wherein each emitter element emits a light beam in a direction toward the other unit, and each detector element is comprised of an array of photodetector cells that are arranged about the unit'"'"'s axis N and are inclined at an outward angle to the axis N facing in a direction toward the other unit, so that the position and angle of the source light beam of the other unit relative to the one unit can be calculated.

16. A 3D cursor or joystick control method comprising the steps of:

providing a peripheral device having a complementary pair of emitter/detector units, one of which is mounted on a movable component moved by the user in a 3D space and the other of which is mounted on a stationary component positioned at a reference position facing toward the 3D space in which the user moves the movable component, wherein each emitter/detector unit of the complementary pair has an emitter element for emitting a three-dimensionally distributed signal beam in a direction toward the other unit, and a detector element adjacent the emitter element for receiving the signal beam from the other unit and providing an output signal representing measured characteristics of the signal beam received from the other unit, and

obtaining respective output signals of the two detector elements each detecting the signal beam from the emitter element of the other one of the complementary pair of emitter/detector units at opposite endpoints defining a single line between the two emitter/detector units and using only the two output signals of the complementary pair of emitter/detector units in combination together to calculate position and orientation angle values of the emitter/detector unit of the movable component relative to the emitter/detector unit of the stationary component.

17. A 3D cursor or joystick control method according to claim 16 which is used to control a 3D flight or navigation simulation program.

18. A 3D cursor or joystick control method according to claim 16 which is used to control a 3D command and control application program.

19. A 3D cursor or joystick control method according to claim 16 which is used for hands-free input to an assistive application program for a disabled person.

20. A 3D cursor or joystick control method according to claim 16 which is used for controlling machine movement in an industrial environment.

21. A 3D cursor or joystick control method according to claim 16 which is used for controlling user input to a CAD or 3D graphics application program.

22. A 3D cursor or joystick control method according to claim 16 which is used for controlling user input to a virtual reality application program.

23. A 3D cursor or joystick control method according to claim 16, wherein each emitter element emits a light beam in a direction toward the other unit, and each detector element is sensitive to light intensity and intensity differences of the light received, which are indicative of angle-of-incidence of and distance to of the emitter light source.

24. A 3D cursor or joystick control method according to claim 16, wherein each emitter element emits a light beam in a direction toward the other unit, and each detector element is comprised of an array of photodetector cells that are arranged about the unit'"'"'s axis N and are inclined at an outward angle to the axis N facing in a direction toward the other unit, so that the position and angle of the source light beam of the other unit relative to the one unit can be calculated.