Wireless position sensing in three dimensions using ultrasound

• US 8,639,471 B2
• Filed: 01/22/2009
• Issued: 01/28/2014
• Est. Priority Date: 01/22/2008
• Status: Active Grant

• Current Assignee: Performance Designed Products LLC
• Original Assignee: Performance Designed Products LLC
• Inventors: Baxter, Richard, Lavache, Steven
• Primary Examiner(s): NGHIEM, MICHAEL P
• Application Number:
  US12/358,006
• Publication Number:
  US 20090187374A1
• Time in Patent Office: 1,832 Days
• Field of Search: 702/152, 702/158
• US Class Current: 702/152
• CPC Class Codes: G01S 11/16 using difference in transit time between electrical and acoustic signals
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 5/18 using ultrasonic, sonic, or infrasonic waves
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/043 using propagating acoustic waves

Abstract

According to various embodiments, the invention provides a method for establishing communication between a computer program in a computing system and a controller held in a hand of a user, comprising: capturing image data in a capture area in front of a display, the capturing configured to identify a two-dimensional location of the controller in the capture area; and capturing one-way sound communication between a location proximate to the display and a location at the controller, the sound communication being used to compute a third-dimensional location of the controller in the capture area.

Claims

1. A method for determining a position of a mobile controller relative to a fixed unit, wherein the mobile controller comprises an infrared (IR) light source and an ultrasonic transducer, and wherein the fixed unit comprises a camera and a first ultrasonic transducer, the method comprising the steps of:

using the camera to determine an angular location of the IR light source relative to the fixed unit;

determining a distance between the mobile controller and the fixed unit by measuring a time of flight of an ultrasonic transmission between the mobile controller and the fixed unit;

determining a three dimensional position of the mobile controller, relative to the fixed unit, by combining the angular location with the distance;

using the camera to track a path of the IR light source detected over time; and

using the tracked path to distinguish the IR light source from a background light source, when the IR light source and the background light source are detected close to each other, by comparing the tracked path with a extrapolated path of the IR light source.

2. A method according to claim 1, further comprising:

altering an illumination of the IR light source on receipt of a signal by the mobile controller from the fixed unit; and

distinguishing the IR light source from other IR light sources by detecting the altered illumination of the IR light source using the camera.

3. A method according to claim 1, wherein the fixed unit further comprises a second ultrasonic transducer. the method further comprising:

determining an approximate location for the mobile component by comparing the time of flight of ultrasound between the mobile controller and the first ultrasonic transducer and between the mobile controller the second ultrasonic transducer; and

determining which IR light source belongs to the mobile controller by comparing the approximate location to an image detected by the camera.

4. A method according to claim 1, further comprising:

averaging the time of flight of ultrasound between the mobile controller and fixed unit over two or more readings of the time of flight of ultrasound, for reducing an effect of errors on the determined distance.

5. A method according to claim 4, wherein the mobile controller further comprises an accelerometer, the method comprising:

determining a speed of the mobile controller using the accelerometer; and

reducing a number of readings used for averaging the time of flight of ultrasound when the controller is moving quickly.

6. A method according to claim 1, further comprising:

correcting an image detected by the camera to remove distortion caused by the camera.

7. A method according to claim 1, wherein the fixed unit further comprises means for sensing the angle of tilt of the camera, the method comprising:

detecting the angle of tilt of the camera from an upright position; and

correcting information determined from an image captured by the camera while at the angle of tilt.

8. A method according to claim 1, further comprising filtering a measured distance reading by:

comparing a measured distance reading to be tested to a last valid measured distance reading to determine an average speed; and

rejecting the measured distance reacting to be tested if the average speed is above a maximum allowable speed.

9. A method according to claim 1. further comprising filtering measured distance reading by:

calculating a tangential speed of the mobile controller by measuring a movement of the mobile controller with the camera and taking as a range of the mobile controller a last valid distance reading;

comparing a measured distance reading to be tested to the last valid measured distance reading to determine an average radial speed;

calculating an average speed by combining the tangential speed and the average radial speed; and

rejecting the measured distance reading to be tested if the average speed is above a maximum allowable speed.

10. A method according to claim 1, further comprising filtering a measured distance reading by:

comparing a measured distance reading to be tested to a last valid measured distance reading to determine a first average speed;

comparing the last valid measured distance reading to a penultimate valid measured distance reading to determine a second average speed;

comparing the first average speed to the second average speed to determine an average acceleration; and

rejecting the measured distance reading to be tested if the average acceleration is above a maximum allowable acceleration.

11. A position sensing apparatus comprising:

an ultrasonic transmitter;

an ultrasonic receiver;

an infrared transmitter;

a two-dimensional (2D) infrared receiver;

an image processing means for processing an image received by the 2D infrared receiver;

a timer;

a control means for coordinating functions of the 2D infrared receiver, the ultrasonic transmitter, and the timer; and

a trigger means for activating the timer,

wherein the apparatus comprises a mobile and a fixed component separate from one another,

wherein ultrasonic and infrared components are located adjacent to one another in a heterogeneous pair on each of the mobile and the fixed components,

wherein the apparatus is configured to transmit an ultrasonic pulse between the ultrasonic transmitter and ultrasonic receiver, and is configured to measure a time of flight of the ultrasonic pulse between the ultrasonic transmitter and receiver by;

starting the timer substantially simultaneously to transmission of the ultrasonic pulse,

stopping the timer when the ultrasonic pulse has been received by the ultrasonic receiver,

wherein in use the apparatus is further configured to determine a two-dimensional (2D) angular position of the infrared transmitter in relation to the 2D infrared receiver by processing the image received by the 2D infrared receiver, whereby an ultrasonic distance measurement from the time of flight of the ultrasonic pulse and an infrared angular measurement provide a three-dimensional (3D) position fix of the mobile component relative to the fixed component; and

wherein in use the apparatus is further configured to use the 2D infrared receiver to track, over time, a course of an infrared light source transmitted by the infrared transmitter to distinguish the infrared light source from a background light source, when the infrared light source and the background light source are detected close to each other, by comparing the tracked course with a extrapolated course of the IR light source.

12. The position sensing apparatus according to claim 11, further comprising a second infrared transmitter in a known spatial relationship to the infrared transmitter, wherein the image processing means is configured to distinguish the infrared transmitter and the second infrared transmitter from a background by searching for the known relationship between the infrared transmitter and the second infrared transmitter.

13. The position sensing apparatus according to claim 11, wherein the infrared transmitter is of a known size, wherein the image processing means is configured to calculate an approximate range for the infrared transmitter by measuring a detected size of the infrared transmitter, and wherein the apparatus is configured to compare the approximate range with the ultrasonic distance measurement to validate a received infrared source received by the 2D infrared receiver as being the infrared transmitter.