Touchless input method and apparatus

• US 6,130,663 A
• Filed: 07/31/1997
• Issued: 10/10/2000
• Est. Priority Date: 07/31/1997
• Status: Expired due to Fees

• Current Assignee: Nathan D. Null
• Original Assignee: Nathan D. Null
• Inventors: Null, Nathan D.
• Primary Examiner(s): Hofsass, Jeffery A.
• Assistant Examiner(s): TWEEL JR, JOHN ALEXANDER
• Application Number:
  US08/903,580
• Time in Patent Office: 1,167 Days
• Field of Search: 345/158, 345/156, 345/157, 345/177, 345/166, 345/173, 345/175, 178/18.09, 178/18.02, 178/18.04, 178/19.05
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0213 Arrangements providing an integrated pointing device in a keyboard, e.g. trackball, mini-joystick for pointing devices integrated in a laptop computer G06F1/169; joysticks G05G9/047; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0423 using sweeping light beams, e.g. using rotating or vibrating mirror

Abstract

Touchless activation of a controlled element, such as a graphic element of a computer display, is provided in any one or more of several dimensions of multi-dimensional coordinate system on the display, in response to the presence of a controlling object, such as a finger, in a predetermined field of free space separate from the element. The field is cyclically optically, angularly scanned in timed relationship with the cyclic generation and counting of timing signals. The scanning causes energy in the field that is reflected from the object to produce triggering signals during each cycle of the scan. The time each triggering signal is received is a function of the angle traversed by the scan from the start of the scan until an object is intercepted. These triggering signals are then used to interrupt the counting of the timing signals, whereby the counted values represent the angles. By triangulation, these angles are then converted into the coordinates of the object, and such coordinates are converted into control signals that are applied to the display to activate the graphic element or other controlled element. The system thus enables 3-D activation of the controlled element.

Claims

1. An apparatus for determining the position of an object in an area of free space adjacent to a plurality of reference points spaced along a reference line, comprising:

radiant energy detectors located at each of the reference points;

revolving scanning cylinders associated with each reference point, each of the cylinders including a slot extending therearound through which radiant passes for controlling the transmission of radiant energy to and from the radiant energy detectors along a scan line extending out from its associated reference point while such scan line is sweeping through an angle centered at its reference point from a starting position spaced from an object in the area to a position where it intercepts an object in the area,

the radiant energy detectors being capable of producing a signal associated with each reference point when its scan line intercepts the object, whereby the time elapsed between each of said starting positions and the production of its respective signal is proportional to the magnitude of the angle traversed by its scan line;

a converter capable of converting each signal into said magnitude of the angle traversed; and

a calculator capable of calculating the coordinates of the object in the area from said angles and the distance between the reference points.

2. The apparatus of claim 1,

wherein the slot in each cylinder is helical;

and

wherein a cover is interposed each cylinder and said area and has a straight slot disposed transversely of the helical slot in its respectively adjacent cylinder so that transmission of radiant energy between the detectors at each reference point and the object is allowed only along a line of sight when the detector and its associated helical slot and straight slot and the object are aligned.

3. The apparatus of claim 2,

wherein there are motors for rotating the cylinders so as to move the scan lines through their angles and to establish said lines of sight with an object in the area during each revolution of the cylinders.

4. The apparatus of claim 1,

wherein there are at least three reference points along said reference line with one of the reference points being a third point between first and second points;

wherein the scanning cylinders cause the scan lines associated with the first and second reference points to be scanned in a predetermined plane in x and y dimensions of a coordinate system and cause the scan line associated with the third reference point to be scanned in a plane transversely of said predetermined plane and in the z dimension of the coordinate system; and

wherein the calculator is capable of calculating the x, y and z coordinates of the object in the area.

5. The apparatus of claim 4 for use with a display having a controlled graphic symbol,

wherein there is a converter for converting the coordinates into signals for activating the graphic symbol of a display in x, y and z dimensions on the display in response to movements of the object in x, y and z dimensions in the area.

6. An electro-optical scanning mechanism, comprising:

an elongated housing having a cover provided with longitudinally extending upper slots spaced therealong,

cylinders rotatably mounted in the housing adjacent to the cover and having lower slots respectively adjacent to and in alignment with the upper slots during rotation of the cylinders,

radiant energy means in the cylinders enabling radiant energy to be transmitted through the upper and lower slots, where they are aligned, between the radiant energy means and the outside of the housing and to be blocked from such transmission where the slots are not aligned,

and means for rotating the cylinders so as to achieve such alignment at least once during each revolution whereupon the radiant energy means produces a signal, the time of which is an indication of the number of degrees of revolution of the cylinders from a predetermined start position to a position of alignment or misalignment of the slots and the radiant energy means.

7. The scanning mechanism of claim 6,

wherein the slot in the cylinder is helical so that the upper and lower slots are always in alignment where they overlap.

8. The scanning mechanism of claim 6,

wherein the slot in one of the cylinders is a straight slot whereby the upper and lower slots are aligned only once during each rotation of the cylinders.

9. The scanning mechanism of claim 6,

wherein there are three upper slots,

wherein there are at least three cylinders in axial alignment each adjacent to a slot in the cover,

wherein the lower slots in the outermost cylinders are helical so that the upper and lower slots are always in alignment where they overlap, and

wherein the slot in the middle cylinder is a straight slot whereby the upper and lower slots are aligned only once during each rotation of the cylinders.

10. The scanning mechanism of claim 6,

wherein the radiant energy means are detectors.

11. The scanning mechanism of claim 10, further including:

means for emitting radiant energy in a field adjacent to the housing and from which said energy is transmitted.

12. The scanning mechanism of claim 6, further including:

means for producing a signal upon completion of each revolution of the cylinders.

13. An apparatus for activating an element on a display in response to the presence of an object in a predetermined area spaced from the element, comprising:

means for cyclically generating a train of timing signals;

means for counting the signals generated;

means for cyclically scanning said area for the presence of an object and for producing a triggering signal in response to the reception of energy reflected from the object;

means for synchronizing the scanning and generating cycles so that they both start at the same time;

means responsive to the triggering signal for interrupting the counting of said timing signals so that the number of timing signals counted in a given cycle is a function of the time between the start of the scanning cycle and the receipt of the reflected energy from the object; and

means for activating the element of the display as a function of the number of timing signals counted.

14. An apparatus for controlling a graphic element on a display in response to movement of a user'"'"'s finger in free space along x, y and z dimensions of a first multi-dimensional coordinate system, wherein the graphic element is capable of being activated along x, y and z dimensions of a second multi-dimensional coordinate system of the display but which correspond to the x, y and z dimensions of the first system, comprising:

means for generating a plurality of trains of angle pulses respectively associated with said dimensions and a fourth train of cycle pulses;

means for counting the pulses in each of the trains and for respectively storing the counted pulses from each of said trains;

first, second and third infrared sensor means respectively located at spaced reference points along a reference line and capable of respectively generating first, second and third triggering signals when exposed to infrared energy;

infrared emitter means for generating a field of reflective energy in a predetermined plane that includes said reference line, whereby an object in the field is in a triangular relationship with any two of said sensors and whereby energy is reflected from such an object toward the sensors;

scanning means respectively associated with the sensor means for cyclically scanning the field through an angle in said plane whose apex is at its respective sensor means and for exposing its respective sensor means to the energy reflected from the object at predetermined intervals during each scanning cycle, each of said sensor means being capable of generating a triggering signal at each of said intervals so that the time delay between the start of each cycle and said exposure of each sensor means is a function of the angle between the reference line and a line of sight between the respective sensor means and the object;

means for transmitting said first, second and third triggering signals to the counting and storing means so as respectively to interrupt the counting of the first, second and third trains of pulses and to store the number of pulses counted during each cycle whereby the numbers of pulses stored are respectively functions of the number of degrees in said angles;

means for calculating the lengths of the sides of a triangle from the angle values stored in the counting and storing means;

means for generating an end count triggering signal responsive to the completion of each scanning cycle and for transmitting the end count signal to the counting and storing means in order to interrupt the counting of the pulses in the fourth train and for transmitting input signals to the calculating means representative of the scanning angles registered in each cycle;

means for developing control signals for controlling the graphic element of a display in response to said pulses stored in the counting and storing means from the signals representative of said lengths.

15. A method of controlling a graphic element in a multi-dimensional coordinate system on a display, comprising:

generating a train of timing pulses for each dimension in said coordinate system,

counting the pulses in each of said trains,

establishing a predetermined area of space separate from the display into which a controlling object may be placed and moved about,

developing triggering signals in response to energy reflected from an object in the area and representative of movements of the object in a multi-dimensional coordinate system in the area which corresponds to the coordinate system of the display,

interrupting the trains of timing pulses being counted in response to the triggering signals, the final count of pulses in each train being representative of the movement of the object in the area in corresponding dimensions of the coordinate system of the area, and

creating control signals in response to the final count of each train of pulses for controlling the graphic element of a display in selected dimensions of the coordinate system of the display.

16. The method of claim 15,

wherein there are a plurality of reference points along a reference line adjacent to the area,

wherein a triggering signal is developed when a line of sight at each reference point completes its scan from a starting time that is synchronized with the start of the generation of each train of timing pulses to the time it intersects with the object, and

wherein the trains of timing pulses being counted are interrupted by their respective triggering signals so that the final count of pulses in each train is representative of said intersecting times.

17. The method of claim 15,

wherein the developing involves cyclically scanning the field from a pair of reference points spaced along a reference line and said triggering signals are developed from reflections from the object at said reference points whereby the time of receipt of each signal during each cycle of the scan corresponds to the angle between a line of sight to the object and the reference line,

synchronizing the start of each scan with the start of counting the pulses, and

wherein the interrupting involves interrupting the counting of the pulses with the triggering signal whereby the number of pulses counted in each train corresponds to said angles.

18. The method of claim 17,

wherein the field is scanned in a predetermined dimension from said reference points, and

wherein the developing further involves cyclically scanning the field transversely of said predetermined dimension from a third reference point intermediate the pair of reference points.

19. An electro-optical scanning mechanism, comprising:

an elongated housing having a cover provided with longitudinally extending upper slots spaced therealong,

cylinders rotatably mounted in the housing adjacent to the cover and having lower slots respectively adjacent to and in alignment with the upper slots during rotation of the cylinders,

a radiant energy detector in each cylinder enabling radiant energy to be received through the upper and lower slots, where they are aligned, from the outside of the housing to the detector and to be blocked from such reception where the slots are not alignment,

and a rotational driver adapted to rotate the cylinders so as to achieve such alignment at least once during each revolution whereupon the radiant energy detector produces a signal upon receipt of radiant energy, the time of which is an indication of the number of degrees of revolution of the cylinders from a predetermined start position to a position of alignment or misalignment of the slots and the radiant energy detector.

20. An apparatus for activating an element on a display in response to the presence of an object in a predetermined area spaced from the element, comprising:

a generator adapted to cyclically generate a train of timing signals;

a counter operable to count the signals generated;

a scanner cyclically scanning said area for the presence of an object and produce a triggering signal in response to the reception of energy reflected from the object;

a timer synchronizing the scanning and generating cycles so that they both start at a predetermined time; and

a signal processor responsive to the triggering signal and interrupting the counting of said timing signals so that the number of timing signals counted in a given cycle is a function of the time between the start of the scanning cycle and the receipt of the reflected energy from the object and activating the element of the display as a function of the number of timing signals counted.

21. An apparatus for controlling a graphic element on a display in response to movement of a user'"'"'s finger or other passive object in free space along x, y and z dimensions of a first multi-dimensional coordinate system, wherein the graphic element is capable of being activated along x, y and z dimensions of a second multi-dimensional coordinate system of the display but which correspond to the x, y and z dimensions of the first system, comprising:

first generator generating a plurality of trains of angle pulses respectively associated with one of said dimensions and a fourth train of cycle pulses;

a counter and storage device counting the pulses in each of the train and respectively storing the counted pulses from each of said trains;

first, second and third infrared sensors respectively located at spaced reference points along a reference line and respectively generating first, second and third triggering signals when exposed to infrared energy;

infrared emitters generating a field of reflective energy in a predetermined plane that includes said reference line, whereby an object in the field is in a triangular relationship with any two of said sensors and whereby energy is reflected from such an object toward the sensors;

scanners respectively associated with each sensor cyclically scanning the field through an angle in said plane whose apex is at its respective sensor and exposing its respective sensor to the energy reflected from the object at predetermined intervals during each scanning cycle, each of said sensors generating a triggering signal at each of said intervals so that the time delay between the start of each cycle and said exposure of each sensor is a function of the angle between the reference line and a line of sight between the respective sensor means and the object;

a transmitter transmitting said first, second and third triggering signals to the counter and storage device, respectively interrupting the counting of the first, second and third trains of pulses, and storing the number of pulses counted during each cycle whereby the numbers of pulses stored are respectively functions of the number of degrees in said angles;

a calculator calculating the lengths of the sides of a triangle from the angle values stored in the counter and storage device;

a second generator generating an end count triggering signal responsive to the completion of each scanning cycle and transmitting the end count signal to the counter and storage device thereby interrupting the counting of the pulses in the fourth train and transmitting input signals to the calculator representative of the scanning angles registered in each cycle; and

a controller developing control signals that control the graphic element of a display in response to said pulses stored in the counter and storage device from the signals representative of said lengths.