Methods for determining a touch location on a touch screen

• US 8,902,196 B2
• Filed: 03/22/2011
• Issued: 12/02/2014
• Est. Priority Date: 12/10/2002
• Status: Active Grant

• Current Assignee: Neonode, Inc.
• Original Assignee: Neonode, Inc.
• Inventors: Goertz, Magnus, Eriksson, Thomas, Shain, Joseph, Jansson, Anders, Kvist, Niklas, Pettersson, Robert, Sparf, Lars, Karlsson, John
• Primary Examiner(s): Tryder, Gregory J
• Assistant Examiner(s): CHOWDHURY, AFROZA Y
• Application Number:
  US13/053,226
• Publication Number:
  US 20110169780A1
• Time in Patent Office: 1,351 Days
• Field of Search: 345/173, 345/175
• US Class Current: 345/175
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method of determining a touch coordinate on a touch screen, including providing a display, a plurality of collimating lenses along two opposite edges of the display, the collimating lenses being arranged along the two edges so as to be shift-aligned relative to one another, a plurality of light pulse emitters that transmit light pulses through the collimating lenses of a first of the two edges over the display, and a plurality of light pulse receivers that receive the light pulses through the collimating lenses of the opposite of the two edges, and that output values representing the received light pulses, wherein light pulses emitted by each emitter are detected by at least two of the receivers, wherein each receiver detects light pulses emitted by at least two emitters, and wherein each receiver has expected values for emitter-receiver pairs when light pulses are not blocked, selecting receiver output values for emitter-receiver pairs that deviate significantly from corresponding receiver expected values, wherein the selected values indicate at least that light pulses transmitted by two emitters are blocked from reaching one receiver, or that light pulses transmitted by one emitter are blocked from reaching two receivers, associating a screen coordinate along a first screen axis with each selected receiver output, and calculating a touch coordinate by interpolating the associated screen coordinates according to the respective deviations between the selected receivers'"'"' output values and corresponding expected values.

Claims

1. A method of determining a touch coordinate on a touch screen, comprising:

providing (i) a display, (ii) a plurality of collimating lenses along two opposite edges of the display, (iii) a plurality of light pulse emitters, denoted E, that transmit light pulses through the collimating lenses of a first of the two edges and over the display, and (iv) a plurality of light pulse receivers, denoted R, that receive the light pulses through the collimating lenses of the opposite of the two edges, and that output values, denoted OUT(E, R), representing the light pulses received by receiver R from emitter E, wherein each emitter-receiver pair (E, R) has an expected receiver output value, denoted EXP(E, R), when light pulses are not blocked, and wherein the collimating lenses are arranged in a shift-aligned fashion such that (a) light pulses emitted by each emitter are detected by at least two of the receivers, and (b) each receiver detects light pulses emitted by at least two emitters;

selecting two or more emitter-receiver pairs (E₁, R₁), . . . , (E_n, R_n) for which their actual receiver output values, OUT(E₁, R₁), . . . , OUT(E_n, R_n), deviate significantly from their expected receiver output values EXP(E₁, R₁), . . . , EXP(E_n, R_n), because either (A) light pulses transmitted by each of two emitters are being blocked from reaching a common receiver, or (B) light pulses transmitted by a common emitter are being blocked from reaching each of two receivers;

associating respective screen coordinates, denoted X(E₁, R₁), . . . , X(E_n, R_n), along a first screen axis with the selected emitter-receiver pairs; and

calculating a touch coordinate, denoted XT, by interpolating the associated screen coordinates

XT=Σ

W_i*X(E_i, R_i)

with weights W_i according to the respective deviations, OUT(E_i, R_i)−

EXP (E_i, R_i), between the actual receiver output values and the expected receiver output values.

2. The method of claim 1, comprising further providing (v) a second plurality of collimating lenses along the other two opposite edges of the display, (vi) a second plurality of light pulse emitters, denoted EE, that transmit light pulses through the collimating lenses of a first of the other edges over the display, and (vii) a second plurality of light pulse receivers, denoted RR, that receive the light pulses through the collimating lenses of the opposite of the other edges, wherein the second collimating lenses are arranged in a shift-aligned fashion such that (a) light pulses emitted by each emitter EE are detected by at least two of the receivers RR, and (b) each receiver RR detects light pulses emitted by at least two emitters EE;

further selecting emitter-receiver pairs (RR, EE), for which their actual receiver output values significantly deviate from their expected receiver output values;

calculating another touch coordinate, denoted YT, along a second screen axis from the further selected emitter-receiver pairs; and

updating each screen coordinate X(E_i, R_i) according to the intersection of a line connecting the emitter-receiver pair (E_i, R_i) with the line at coordinate YT with respect to the second screen axis.

3. The method of claim 1 wherein said selecting emitter-receiver pairs comprises selecting three emitter-receiver pairs from two emitters and two receivers.

4. The method of claim 3 wherein said selecting emitter-receiver pairs comprises:

identifying an emitter-receiver pair, for which its actual receiver output value deviates from its expected value by more than the amounts by which actual receiver output values for other emitter-receiver pairs deviate from their expected receiver output values; and

further identifying an emitter-receiver pair adjacent on one side to the thus-identified emitter-receiver pair, and an emitter-receiver pair adjacent on another side to the thus-identified emitter-receiver pair, wherein adjacent emitter-receiver pairs are pairs that have a common emitter and adjacent receivers, or pairs that have a common receiver and adjacent emitters.

5. The method of claim 1 wherein said calculating further comprises:

providing a reference touch coordinate, denoted XRT; and

computing a temporally filtered touch coordinate, based on XT and XRT.

6. The method of claim 5 further comprising updating the reference touch coordinate XRT with either (i) the temporally filtered touch coordinate, or (ii) a combination of the temporally filtered touch coordinate and the reference touch coordinate.

7. A method of determining a touch coordinate on a touch screen, comprising:

providing (i) a display, (ii) a plurality of light pulse emitters, E₁, . . . , E_n, arranged such that each emitter, E, transmits light pulses, denoted E(θ

₁) and E(θ

₂), that are directed in complementary directions, θ

₁ and θ

₂, outward from an edge of the display and over the display, and (iii) a touch detector associated with the display, the touch detector being operable to identify two or more touch locations in response to a single touch on the display, each identified touch location corresponding to a light pulse E_i(θ

_j) that is partially blocked by the touch, and having (a) a normalized touch value between 0 and 1, denoted W(E_i(θ

_j)), according to the percentage of blockage of light pulse E_i(θ

_j)) by the touch, and (b) a respective screen coordinate, denoted X(E_i(θ

_j)); and

calculating a touch coordinate, denoted XT, comprising interpolating the screen coordinates of the identified touch locations according to the identified touch locations'"'"' normalized touch values,

XT=Σ

W(E_i(θ

_j))*X(E_i(θ

_j)).

8. The method of claim 7 further comprising:

selecting a first identified touch location whose normalized value is greater than the normalized values of other identified touch locations; and

further selecting identified touch locations that surround the first identified touch location, the surrounding touch locations having normalized touch values significantly greater than 0, wherein said interpolating comprises interpolating the screen coordinates of the selected and further selected ones of the identified touch locations.

9. The method of claim 7 wherein said calculating further comprises:

providing a reference touch coordinate, denoted XRT; and

computing a temporally filtered touch coordinate, based on XT and XRT.

10. The method of claim 9 further comprising updating the reference touch coordinate XRT with either (i) the temporally filtered touch coordinate, or (ii) a combination of the temporally filtered touch coordinate and the reference touch coordinate.

11. A method of pairing disambiguating unpaired x- and y- coordinate values detected by a touch screen system in response to two simultaneous touches, comprising:

providing (i) a display, (ii) a plurality of light pulse emitters that transmit light pulses over the display, and (iii) a plurality of light pulse receivers that receive the light pulses, and that output values representing the received light pulses wherein each receiver has expected values for emitter-receiver pairs when the light pulses are not blocked;

detecting two different x-coordinates corresponding to two simultaneous touches, based on significant deviations between actual receiver output values for receiver-emitter pairs and corresponding expected receiver output values;

separately detecting two different y-coordinates corresponding to the two simultaneous touches;

determining which one of the two x-coordinates is associated with a touch that is nearer to an edge of the display, based on the deviations corresponding to the x-coordinates; and

pairing the thus-determined x-coordinate with the y-coordinate that is closer to that one edge.

12. The method of claim 11 wherein said determining is based on a comparison of relative deviations.

13. The method of claim 11 wherein said determining is based on a comparison of absolute deviations.

14. The method of claim 11 wherein said determining is based on patterns of emitter-receiver pairs that indicate a touch for each coordinate.

15. A method of discriminating clockwise gestures from counter-clockwise gestures in a touch screen system, comprising:

providing (i) a display, (ii) a plurality of light pulse emitters that transmit light pulses over the display, and (iii) a plurality of light pulse receivers that receive the light pulses, and that output values representing the received light pulses, wherein each receiver has expected values for emitter-receiver pairs when the light pulses are not blocked;

performing a series of touch detections at times t₁, . . . , t_n, each touch detection at a given time t detecting two different x-coordinates, x₁(t) and x₂(t), corresponding to two touches, and separately detecting two different y-coordinates, y₁(t) and y₂(t), corresponding to the two touches, the touch detections being based on significant deviations between actual receiver output values for receiver-emitter pairs and corresponding expected receiver output values;

determining which of the two series of detected x-coordinates, (x₁(t₁), . . . , x₁(t_n)) and (x₂(t₁), . . . , x₂(t_n)), is associated with a touch approaching a display edge, by comparing the deviations corresponding to neighboring x-coordinates; and

discriminating a gesture as being clockwise or counter-clockwise by pairing the thus-determined series of the x-coordinates with that one of the series of detected y-coordinates, (y₁(t₁), . . . , (y₁(t_n) and (y₂(t₁), . . . , (y₂(t_n), that is also approaching that display edge.

16. The method of claim 15 wherein said determining is based on a comparison of relative deviations over time.

17. The method of claim 15 wherein said determining is based on a comparison of absolute deviations over time.

18. The method of claim 15 wherein said determining is based on patterns of emitter-receiver pairs that indicate a touch over time.