Light-based touch screen

• US 8,339,379 B2
• Filed: 02/15/2009
• Issued: 12/25/2012
• Est. Priority Date: 04/29/2004
• Status: Active Grant

• Current Assignee: Neonode, Inc.
• Original Assignee: Neonode, Inc.
• Inventors: Goertz, Magnus, Eriksson, Thomas, Shain, Joseph
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): CHOWDHURY, AFROZA Y
• Application Number:
  US12/371,609
• Publication Number:
  US 20090189878A1
• Time in Patent Office: 1,409 Days
• Field of Search: 345/156, 345/173, 345/175
• US Class Current: 345/175
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

A light-based touch screen, including a housing for a display screen, a plurality of infra-red light emitting diodes (LEDs), fastened on the housing, for generating light beams, at least one LED selector, fastened on the housing and connected with the plurality of LEDs, for controllably selecting and deselecting one or more of the plurality of LEDs, a plurality of photodiode (PD) receivers, fastened on the housing, for measuring light intensity, at least one PD selector, fastened on the housing and connected with the plurality of PD receivers, for controllably selecting and deselecting one or more of the plurality of PD receivers, an optical assembly, fastened on the housing, for projecting light beams emitted by the plurality of LEDs in substantially parallel planes over the housing, and a controller, fastened on the housing and coupled with the plurality of PD receivers, (i) for controlling the at least one LED selector, (ii) for controlling the at least one PD selector, and (iii) for determining therefrom position and velocity of an object crossing at least one of the substantially parallel planes, based on output currents of the plurality of PD receivers.

Claims

1. A light-based touch surface for an electronic device, comprising:

a housing that exposes an upper surface of an encased component that enables user input to an electronic device;

a plurality of infra-red light emitting diodes (LEDs), situated inside said housing below the upper surface of the encased component, for generating light beams;

at least one LED selector, fastened on said housing and connected with said LEDs, for controllably selecting and deselecting one or more of said LEDs;

a plurality of photodiode (PD) receivers, situated inside said housing below the upper surface of the encased component, for generating output currents in accordance with received light beam intensities;

at least one PD selector, fastened on said housing and connected with said PD receivers, for controllably selecting and deselecting one or more of said PD receivers;

a first lens, fastened on said housing and in contact with the upper surface of the encased component, for projecting and distributing light beams generated by said LEDs above and across the upper surface at a plurality of heights above the upper surface;

a second lens, fastened on said housing and in contact with the upper surface of the encased component, for collecting and directing the light beams projected and distributed by said first lens onto said PD receivers; and

a controller, fastened on said housing and coupled with said at least one LED selector, with said at least one PD selector and with said PD receivers, (i) for controlling said at least one LED selector, (ii) for controlling said at least one PD selector, and (iii) for detecting position of an object by measuring light intensities at various heights above the upper surface of the encased component, based on the resulting output currents of said PD receivers.

2. The touch surface of claim 1 wherein the encased component is rectangular, wherein said LEDs are fastened along two adjacent edges of the encased component, and wherein said PD receivers are fastened along two other adjacent edges of the encased component.

3. The touch surface of claim 1 wherein the encased component is rectangular, and wherein each LED is fastened near a corner of said encased component.

4. The touch surface of claim 1 wherein said at least one LED selector generates a bit string for a shift register, and wherein each bit position of the shift register is mapped to a corresponding LED, whereby the bit at that position indicates whether to select or to deselect the corresponding LED.

5. The touch surface of claim 1 wherein said at least one PD selector generates a bit string for a shift register, and wherein each bit position of the shift register is mapped to a corresponding PD receiver, whereby the bit at that position indicates whether to select or to deselect the corresponding PD receiver.

6. The touch surface of claim 1 further comprising a multiplexer coupled with said PD receivers and with said controller, for selecting one PD output current from a group of PD output currents, based on control signals received from said controller.

7. The touch surface of claim 1 further comprising a resistance based current integrator for biasing and sampling the output currents entering said controller from said PD receivers.

8. The touch surface of claim 1 further comprising a transistor based current integrator for biasing and sampling the output currents entering said controller from said PD receivers.

9. The touch surface of claim 1 further comprising a transistor based filter and amplifier for sensing and amplifying the output currents entering said controller from said PD receivers.

10. The touch surface of claim 1 further comprising an operational amplifier based filter and amplifier for converting the PD receiver output currents to voltages, and for amplifying the voltages.

17. The touch surface of claim 1 wherein said controller determines the position of the object based on output currents that are lower than baseline output currents.

18. The touch surface of claim 1, wherein the encased component is a display, wherein said controller further determines a location of the object relative to the upper surface of the encased component based on the output currents, and wherein said controller generates an indication on the display corresponding to the determined location.

19. The touch surface of claim 1 wherein, when the object approaches the upper surface of the encased component by a user gesture, said controller further determines a velocity of the object in a direction perpendicular to the upper surface, based on a sequence of progressively decreasing output currents.

20. The touch surface of claim 19, wherein said controller generates a first user gesture input instruction in response to said controller determining a high velocity of the object in a direction perpendicular to the upper surface, and generates a second user gesture input instruction in response to said controller determining a low velocity of the object in a direction perpendicular to the upper surface.

21. The touch surface of claim 1 wherein said controller detects the position of the object based on output currents that are greater than baseline output currents.

22. The touch surface of claim 1 wherein, when the object approaches the upper surface, said controller determines a plurality of object positions over time based on a sequence of output currents of said PD receivers, wherein a first portion of the sequence comprises output currents that are greater than baseline output currents, and a second portion of the sequence comprises output currents that are lower than the baseline output currents.

23. The touch surface of claim 22, wherein said controller further determines a position and a velocity of the object in a direction perpendicular to the upper surface of the encased component, based on the determined plurality of object position.

24. The touch surface of claim 1, wherein said controller detects positions of two objects situated at different heights above the upper surface of the encased component, based on the output currents of said PD receivers.

31. The surface of claim 1 wherein the determined position of the object corresponds to a relative amount of current in at least one of the output currents, relative to a baseline amount of current.

32. The surface of claim 31 wherein the controller determines multiple positions of the object over time, and determines a velocity of the object therefrom.

33. The surface of claim 32 wherein the multiple determinations over time differ from each other in the relative amounts of current.

11. A light-based method for providing user input to an electronic device, comprising:

providing a user interface component encased in an electronic device and having an exposed upper surface;

controlling a plurality of light-emitting diodes (LEDs) situated inside the electronic device below the upper surface of the encased component, to select and deselect at least one of the LEDs, whereby a selected LED emits infra-red light beams into a first lens in contact with the upper surface, and whereby the first lens projects and distributes light beams emitted by the selected LED above and across the upper surface at a plurality of heights above the upper surface;

controlling a plurality of photodiode (PD) receivers situated inside the electronic device below the upper surface of the encased component, to select and deselect at least one of the PD receivers, whereby at least a portion of the light beams projected and distributed by the first lens are collected and directed onto a selected PD by a second lens in contact with the upper surface, and whereby the selected PD generates output currents in accordance with a light intensity of the light beams collected and directed by the second lens; and

determining position of an object by measuring light intensities at various heights above the upper surface of the encased component, based on the resulting output currents of the selected PD receiver.

12. The method of claim 11 wherein said controlling a plurality of LEDs comprises generating a bit string for a shift register, wherein each bit position of the shift register is mapped to a corresponding LED, whereby the bit at that position indicates whether to select or to deselect the corresponding LED.

13. The method of claim 11 wherein said controlling a plurality of PD receivers comprises generating a bit string for a shift register, wherein each bit position of the shift register is mapped to a corresponding PD receiver, whereby the bit at that position indicates whether to select or to deselect the corresponding PD receiver.

14. The method of claim 11 further comprising applying linear amplification to the output currents of the selected PD receiver prior to said determining.

15. The method of claim 11 further comprising compensating for ambient light by adding a plurality of PD output signals when an LED is turned on and subtracting therefrom a plurality of PD output signals when an LED is turned off.

16. The method of claim 11 further comprising sampling the output currents of the plurality of selected PD receiver prior to said determining, the sampling comprising:

turning off a transistor to begin current integration within a capacitor;

turning on a sample and hold circuit at a pre-designated amount of time after said turning off the transistor;

turning off the sample and hold circuit at a pre-designated amount of time after said turning on the sample and hold circuit;

measuring a charge in the capacitor; and

turning on the transistor to discharge the capacitor.

25. The method of claim 11 wherein said determining the position of the object is based on output currents that are lower than baseline output currents.

26. The method of claim 11 wherein said determining the position of the object is based on output currents that are greater than baseline output currents.

27. The method of claim 11 wherein said determining determines multiple positions of the object over time, based on a sequence of output currents of selected PD receivers, wherein a first portion of the sequence comprises output currents that are greater than baseline output currents, and a second portion of the sequence comprises output currents that are lower than the baseline output currents.

28. The method of claim 11 wherein said determining determines respective positions and respective velocities of two objects concurrently situated at different heights above the upper surface of the encased component, based on a sequence of output currents of selected PD receivers.

29. The method of claim 11, wherein the encased component is a display surface, wherein said controller further determines a position of the object relative to the upper surface of the encased component, and further comprising generating an indication on the display corresponding to the determined position of the object.

30. The method of claim 11, further comprising:

determining a velocity of the object in a direction perpendicular to the upper surface of the encased component based on a sequence of output currents of selected PD receivers;

generating a first user gesture input instruction in response to determination of a high velocity of the object in a direction perpendicular to the upper surface; and

generating a second user gesture input instruction in response to determination of a low velocity of the object in a direction perpendicular to the upper surface.

34. The method of claim 11 wherein the determined position of the object corresponds to a relative amount of current in at least one of the output currents, relative to a baseline amount of current.

35. The method of claim 34 wherein said determining determines multiple positions of the object over time, and determines a velocity of the object therefrom.

36. The method of claim 35 wherein the multiple determinations over time are based on differences in the relative amounts of current.

37. A light-based touch surface for an electronic device, comprising:

a housing that exposes an upper surface of an encased component that enables user input to an electronic device;

a plurality of infra-red light emitting diodes (LEDs), situated inside said housing alongside the encased component, for generating light beams;

at least one LED selector, fastened on said housing and connected with said LEDs, for controllably selecting and deselecting one or more of said LEDs;

a plurality of photodiode (PD) receivers, situated inside said housing alongside the encased component, for generating output currents in accordance with received light beam intensities;

at least one PD selector, fastened on said housing and connected with said PD receivers, for controllably selecting and deselecting one or more of said PD receivers;

a first lens fastened on said housing and in contact with the upper surface of the encased component, for projecting and distributing light beams generated by said LEDs above and across the upper surface at a plurality of heights above the upper surface;

a second lens fastened on said housing and in contact with the upper surface of the encased component, for collecting and directing the light beams projected and distributed by said first lens onto said PD receivers; and

a controller, fastened on said housing and coupled with said at least one LED selector, with said at least one PD selector and with said PD receivers, (i) for controlling said at least one LED selector, (ii) for controlling said at least one PD selector, and (iii) for detecting position of an object by measuring light intensities at various heights above the upper surface of the encased component, based on the resulting output currents of said PD receivers.

38. The surface of claim 37 wherein the determined position of the object corresponds to a relative amount of current in at least one of the output currents, relative to a baseline amount of current.

39. The surface of claim 38 wherein the controller determines multiple positions of the object over time, and determines a velocity of the object therefrom.