Optical pseudo trackball controls the operation of an appliance or machine

• US 6,677,929 B2
• Filed: 03/21/2001
• Issued: 01/13/2004
• Est. Priority Date: 03/21/2001
• Status: Expired due to Term

• Current Assignee: Elan Microelectronics Corporation
• Original Assignee: Agilent Technologies, Inc.
• Inventors: Gordon, Gary B., Miller, Edward L
• Primary Examiner(s): Chang, Kent
• Assistant Examiner(s): SHENG, TOM V
• Application Number:
  US09/813,624
• Publication Number:
  US 20020135565A1
• Time in Patent Office: 1,028 Days
• Field of Search: 345/156, 345/158, 345/164, 345/165, 345/166, 345/167
• US Class Current: 345/156
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen

Abstract

An optical fingertip tracker, which may be a pseudo trackball, responds to the motion of the texture on one of the user'"'"'s digits pressed against an image input aperture to produce motion signals processed within an appliance to be controlled. The appliance may have a minimal GUI, such as an LCD display having only a modest number of low resolution pixel locations and/or preestablished characters or icons. An appliance control parameter is set or adjusted in response to translation of the fingertip along a particular axis. E.g., to enter a parameter value (volume) a changing bar graph can be displayed. The display might even be omitted; to set the tone control of an audio appliance it can be sufficient to simply adjust the tone until the result is as desired. A numeric display of control parameter digits may be desirable, as when moving the fingertip tunes a receiver. There can be several particular axes along which fingertip movement changes an associated appliance control parameter. Other appliances can include character recognition of input characters traced by the fingertip. A pressure sensitive switch coupled to the fingertip tracker can serve as a delimiting mechanism useful in ratification of interpreted results and in editing strings that have been input. Excursions is a loss-of-correlation signal can be detected and interpreted as tapping the image input aperture with the fingertip. Such “taps” and “double taps” can be defined, and have selected meanings associated therewith that may be used in conjunction with, or in place of, the pressure sensitive switch.

Claims

1. Input apparatus for controlling the operation of an appliance according to motion of the tip of and operator'"'"'s digit along a plurality of coordinate axes by (a) selecting an entry from within a displayed menu of choices and (b) adjusting the value of an appliance control parameter, the input apparatus comprising:

a housing containing the appliance;

an image input aperture in the housing and against which a portion of the tip of one of the operator'"'"'s digits may be placed;

a light source disposed proximate the image input aperture and that emits light which illuminates a portion of the tip of the digit placed against the image input aperture;

an image exit surface optically coupled to the image input aperture and from which reflected light that is an image of the tip of the operator'"'"'s digit may exit;

a motion transducer disposed proximate the image exit surface and that receives the image, from which the motion transducer creates pixelized representations comprising a newly sampled array, a previously sampled array and shifted versions of one of those arrays that are its nearest neighbor arrays, which one array and its nearest neighbor arrays are correlated with the non-shifted array to produce motion signals that correspond to motions in the directions of coordinate axes by the fingertip moving against the image input surface and that represent operator input to control the operation of the appliance;

an embedded system coupled to the motion signals and that directs the operation of the appliance in response to inputs made by an operator of the appliance;

the embedded system including a motion signal selector that examines corresponding instances of the first and second motion signals to determine if one thereof has a magnitude larger than the other by a selected amount, and if so, construes the motion signal with the larger magnitude as input made by the operator while also construing the other motion signal as having a magnitude of zero, and also examines the corresponding instances to determine if they have magnitudes that are of generally equal absolute value, and if so, construes the first and second motion signals as having magnitudes of zero while producing a third motion signal corresponding to motion of the tip of the digit along an axis inclined to the coordinate axes;

a display coupled to the embedded system and that displays indicia corresponding to a menu of choices available to the operator for affecting the operation of the appliance;

the embedded system treating one of the first and second construed motion signals as input made by the operator to select in the direction of the corresponding coordinate axis an entry in the menu by altering corresponding displayed indicia in accordance with that input, treating the other of the first and second construed motion signals as input made by the operator to select in the direction of the other coordinate axis another entry in the menu by altering corresponding displayed indicia in accordance with that input; and

the embedded system treating the third motion signal as input made by the operator adjust the value of an appliance control parameter associated with the selected entry in the menu.

2. Input apparatus as in claim 1 wherein the display includes indicia corresponding to the value of an appliance control parameter associated with the selected menu entry.

3. A method of setting the value of an appliance control parameter affecting the operation of an appliance, the method comprising the steps of:

placing the tip of an operator'"'"'s digit against an imaging surface;

moving the tip of the digit across the imaging surface in patterns corresponding to user input;

illuminating that portion of the digit that is against the imaging surface;

focusing light reflected from the illuminated portion of the digit as an image onto an array of photo detectors that are part of a motion transducer;

digitizing the output values of the photo detectors and storing the digital results as a reference array in a memory;

subsequent to storing the reference array, digitizing the output values of the photo detectors and storing the digital results as a sample array in a memory;

correlating the sample array with the reference array and also with nearest neighbor shifted versions of one of those arrays array to produce first and second motion signals having respective first and second values indicative of motion along respective axes by the tip of the digit as it moves across the imaging surface; and

setting the value of a first appliance control parameter in accordance with the value of the first motion signal and the value of a second appliance control parameter in accordance with the value of the second motion signal.

4. A method as in claim 3 further comprising the step of displaying an indication of the value to which the appliance control parameter is set by the setting step.

5. A method as in claim 3 further comprising the steps of recognizing the removal, brief and substantially motion-free replacement and subsequent removal of the digit against the imaging surface, and then in response that recognition, performing a selected appliance operation.

6. Input apparatus for controlling the operation of an appliance, the input apparatus comprising:

a housing containing the appliance;

absent from the appliance a keyboard for entry of separate keystrokes representing individual letters of the alphabet;

an image input aperture in the housing and against which a portion of the tip of one of the operator'"'"'s digits may be placed;

a light source disposed proximate the image input aperture and that emits light which illuminates a portion of the tip of the digit placed against the image input aperture;

an image exit surface optically coupled to the image input aperture and from which reflected light that is an image of the tip of the operator'"'"'s digit light may exit;

a motion transducer disposed proximate the image exit surface and that receives the image, from which the motion transducer creates pixelized representations comprising a newly sampled array, a previously sampled array and shifted versions of one of those arrays that are its nearest neighbor arrays, which one array and its nearest neighbor arrays are correlated with the non-shifted array to produce first and second motion signals that correspond to motions in the directions of orthogonal first and second coordinate axes by the tip of the digit moving against the image input aperture and that represent operator input to affect the operation of the appliance; and

an appliance control circuit coupled to the first and second motion signals, disposed internal to the appliance and that controls the operation of the appliance by altering the value of the first appliance control parameter in accordance with the first motion signal and by altering the value of the second appliance control parameter in accordance with the second motion signal, the altering being responsive to motion of the tip of the digit against the image input aperture.

7. Input apparatus as in claim 6 further comprising a lens assembly located within the image input aperture.

8. Input apparatus as in claim 7 wherein the lens assembly comprises a rod lens.

9. Input apparatus as in claim 7 wherein the lens assembly has a dome shape and a portion of which extends beyond an outer surface of the housing.

10. Input apparatus as in claim 9 wherein the dome shaped lens assembly has a diameter of about two to three millimeters.

11. Input apparatus as in claim 6 wherein the image input aperture holds a transparent surface that is generally flat and in about the same plane as an outer surface of the housing at the location thereof whereat the image input aperture is located.

12. Input apparatus as in claim 6 wherein the image exit surface comprises a mirror.

13. Input apparatus as in claim 6 wherein the image exit surface comprises a lens.

14. Input apparatus as in claim 6 further comprising indicia coupled to the appliance control circuit and indicating which appliance control parameter among a plurality thereof is changed in accordance with the motion of the fingertip against the image input aperture.

15. Input apparatus as in claim 14 further comprising a display coupled to the appliance control circuit and wherein the indicia comprises a menu element in a menu of choices, the menu element containing a legend associated with an appliance control parameter.

16. Input apparatus as in claim 14 wherein the indica comprises a visible annunciator disposed next to a permanently visible legend associated with an appliance control parameter.

17. Input apparatus as in claim 6 further comprising indicia coupled to the appliance control circuit and indicating the value of an appliance control parameter as it is altered in accordance with the motion of the tip of the digit against the image input surface.

18. Input apparatus as in claim 17 wherein the indica comprises a bar graph display.

19. Input apparatus as in claim 17 wherein the indicia comprises a digital display of a numeric value.

20. Input apparatus as in claim 17 wherein the alteration to the appliance control parameter is a trial alteration that does not affect the operation of the appliance until ratified by the operator.

21. Input apparatus as in claim 20 further comprising an electrical switching device actuated by pressure exerted against the image input aperture and electrically coupled to the appliance control circuit, and wherein ratification of a trial alteration in accomplished by actuating the electrical switching device.

22. Input apparatus as in claim 6 wherein the correlation of the arrays produces interpolated motion signals representing motion corresponding to less than the size of spatial features in the image.

23. Input apparatus as in claim 6 further comprising an electrical switching device actuated by pressure exerted against the image input aperture and electrically coupled to the appliance control circuit.

24. Input apparatus as in claim 23 wherein there are a plurality of appliance control parameters and the appliance control circuit construes actuation of the electrical switching device as a delimiter that separates the alteration of the value of one appliance control parameter from the alteration of the value of another appliance control parameter.

25. Input apparatus as in claim 6 further comprising a loss-of-correlation signal produced by the motion transducer in response to an absence of the operator'"'"'s digit from the image input aperture and coupled to the appliance control circuit, wherein there are a plurality of appliance control parameters and the appliance control circuit construes the presence of the loss-of correlation signal as a delimiter that separates the alteration of the value of one appliance control parameter from the alteration of the value of another appliance control parameter.

26. Input apparatus as in claim 6 further comprising a loss-of-correlation signal produced by the motion transducer in response to an absence of the operator'"'"'s digit from the image input aperture and coupled to the appliance control circuit, and wherein the appliance control circuit responds in a selected maimer to excursions in the loss-of-control-signal produced by the operator removing the digit from the image input aperture, briefly replacing it without substantial motions in the directions of the coordinate axes, followed by again removing the digit.

27. Input apparatus for controlling the operation of an appliance, the input apparatus comprising:

a housing containing the appliance;

absent from the appliance a keyboard for entry of separate keystrokes representing individual letters of the alphabet;

an image input aperture in the housing and against which a portion of the tip of one of the operator'"'"'s digits may be placed;

a light source disposed proximate the image input aperture and that emits light which illuminates a portion of the tip of the digit placed against the image input aperture;

an image exit surface optically coupled to the image input aperture and from which reflected light that is an image of the tip of the operator'"'"'s digit light may exit;

a motion transducer disposed proximate the image exit surface and that receives the image, from which the motion transducer creates pixelized representations comprising a newly sampled array, a previously sampled array and shifted versions of one of those arrays that are its nearest neighbor arrays, which one array and its nearest neighbor arrays are correlated with the non-shifted array to produce first and second motion signals that correspond to motions in the directions of orthogonal first and second coordinate axes by the tip of the digit moving against the image input aperture and that represent operator input to affect the operation of the appliance;

an appliance control circuit coupled to the first and second motion signals, disposed internal to the appliance and that controls the operation of the appliance by altering the value of a first appliance control parameter in accordance with the first motion signal and by altering the value of a second appliance control parameter in accordance with the second motion signal;

the appliance control circuit also comprising a third appliance control parameter, and further wherein motion of the tip of the digit along a path within a region inclined by a selected amount to one of the coordinate axes and of a selected width, is construed by the appliance control circuit as input from the operator to alter the value of a third appliance control parameter according to the tip of the digit'"'"'s motion along that path and to leave the values of the first and second appliance control parameters unchanged; and

the altering of the first, second and third appliance control parameters being responsive to motion of the tip of the digit against the image input aperture.

28. Input apparatus for controlling the operation of an appliance, the input apparatus comprising:

a housing containing the appliance;

absent from the appliance a keyboard for entry of separate keystrokes representing individual letters of the alphabet;

an image input aperture in the housing and against which a portion of the tip of one of the operator'"'"'s digits may be placed;

a light source disposed proximate the image input aperture and that emits light which illuminates a portion of the tip of the digit placed against the image input aperture;

an image exit surface optically coupled to the image input aperture and from which reflected light that is an image of the tip of the operator'"'"'s digit light may exit;

a motion transducer disposed proximate the image exit surface and that receives the image, from which the motion transducer creates pixelized representations comprising a newly sampled array, a previously sampled array and shifted versions of one of those arrays that are its nearest neighbor arrays, which one array and its nearest neighbor arrays are correlated with the non-shifted array to produce first and second motion signals that correspond to motions in the directions of orthogonal first and second coordinate axes by the tip of the digit moving against the image input aperture and that represent operator input to affect the operation of the appliance;

an appliance control circuit coupled to the first and second motion signals, disposed internal to the appliance and that controls the operation of the appliance by altering the value of a first appliance control parameter in accordance with the first motion signal and by altering the value of a second appliance control parameter in accordance with the second motion signal;

the appliance control circuit also comprising a third appliance control parameter, and further wherein when the first and second motion signals have the same signs and substantially the same absolute amount of motion, then the appliance control circuit construes the combination of the first and second motion signals as motion along the third axes and as operator input to alter the value of the third appliance control parameter in accordance with that motion; and

the altering of the first, second and third appliance control parameters being responsive to motion of the tip of the digit against the image input aperture.

29. Input apparatus for controlling the operation of an appliance, the input apparatus comprising:

a housing containing the appliance;

absent from the appliance a keyboard for entry of separate keystrokes representing individual letters of the alphabet;

an image input aperture in the housing and against which a portion of the tip of one of the operator'"'"'s digits may be placed;

a light source disposed proximate the image input aperture and that emits light which illuminates a portion of the tip of the digit placed against the image input aperture;

an image exit surface optically coupled to the image input aperture and from which reflected light that is an image of the tip of the operator'"'"'s digit light may exit;

a motion transducer disposed proximate the image exit surface and that receives the image, from which the motion transducer creates pixelized representations comprising a newly sampled array, a previously sampled array and shifted versions of one of those arrays that are its nearest neighbor arrays, which one array and its nearest neighbor arrays are correlated with the non-shifted array to produce first and second motion signals that correspond to motions in the directions of orthogonal first and second coordinate axes by the tip of the digit moving against the image input aperture and that represent operator input to affect the operation of the appliance;

an appliance control circuit coupled to the first and second motion signals, disposed internal to the appliance and that controls the operation of the appliance by altering the value of a first appliance control parameter in accordance with the first motion signal and by altering the value of a second appliance control parameter in accordance with the second motion signal;

the appliance control circuit also comprising a third appliance control parameter, and further wherein when the first and second motion signals have differing signs and substantially the same absolute amount of motion, then the appliance control circuit construes the combination of the first and second motion signals as motion along the third axes and as operator input to alter the value of the third appliance control parameter in accordance with that motion; and

the altering of the first, second and third appliance control parameters being responsive to motion of the tip of the digit against the image input aperture.

30. Input apparatus for controlling the operation of an appliance, the input apparatus comprising:

a housing containing the appliance;

absent from the appliance a keyboard for entry of separate keystrokes representing individual letters of the alphabet;

an image input aperture in the housing and against which a portion of the tip of one of the operator'"'"'s digits may be placed;

a light source disposed proximate the image input aperture and that emits light which illuminates a portion of the tip of the digit placed against the image input aperture;

an image exit surface optically coupled to the image input aperture and from which reflected light that is an image of the tip of the operator'"'"'s digit light may exit;

a motion transducer disposed proximate the image exit surface and that receives the image, from which the motion transducer creates pixelized representations comprising a newly sampled array, a previously sampled array and shifted versions of one of those arrays that are its nearest neighbor arrays, which one array and its nearest neighbor arrays are correlated with the non-shifted array to produce motion signals that correspond to motions in the directions of coordinate axes by the tip of the digit moving against the image input surface and that represent operator input to affect the operation of the appliance, the motion transducer further producing a loss-of-correlation signal in response to an absence of the operator'"'"'s digit from the image input aperture; and

an appliance control circuit, coupled to the loss-of-correlation signal and to the motion signals, disposed internal to the appliance and which controls the operation of the appliance by altering the value of at least two appliance control parameters in accordance with motion of the tip of the digit against the image input aperture, and further wherein the appliance control circuit construes the presence of the loss-of correlation signal as a delimiter that separates the alteration of the value of one appliance control parameter from the alteration of the value of another appliance control parameter.