Optical touch screen using total internal reflection

• US 9,411,430 B2
• Filed: 08/31/2013
• Issued: 08/09/2016
• Est. Priority Date: 06/19/2008
• Status: Expired due to Fees

• Current Assignee: Neonode, Inc.
• Original Assignee: Neonode, Inc.
• Inventors: Elyan, Michael, Holmgren, Stefan, Sparf, Lars, Behdasht, Remo, Eriksson, Thomas, Shain, Joseph, Jansson, Anders, Pettersson, Robert, Karlsson, John
• Primary Examiner(s): Spar, Ilana
• Assistant Examiner(s): HERMANN, KIRK W
• Application Number:
  US14/016,076
• Publication Number:
  US 20140071094A1
• Time in Patent Office: 1,074 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0308 comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method for use by a touch screen in which light transmitted inside the screen is scattered by an object touching the screen from outside the screen, the method including activating emitter-receiver pairs for a plurality of emitters and receivers while an object is touching a screen from outside the screen, wherein light emitted by each emitter is transmitted inside the screen, wherein each emitter is associated with a limited number of receivers that detect significant light from such emitter while no object is touching the screen, and wherein the activated emitter-receiver pairs include pairs for which the receiver is not associated with the emitter in the pair, determining that receivers not associated with emitters detect significant light due to the object scattering the light emitted by the emitters, and deriving the location where the object is touching the screen from the determining.

Claims

1. A method for detecting locations of multiple objects simultaneously interacting with a screen, for use by a processor of a light-based touch screen system that comprises a light-transmissive layer above a screen, in which light transmitted inside the layer is confined to the layer by total internal reflection and is scattered inside the layer by an object touching the layer from outside the layer, the method comprising:

activating emitter-receiver pairs for a plurality of emitters and receivers while multiple objects are simultaneously touching the layer from outside the layer, wherein light emitted by each emitter is confined inside the layer, and wherein for each emitter-receiver pair a reference amount of light is detected at the receiver while no object is touching the screen;

identifying emitter-receiver pairs activated by said activating for which the receiver of the pair detects an amount of light less than the reference amount for the pair;

determining x-axis and y-axis touch coordinates based on said identifying; and

subsequent to said determining, and when and only when a plurality of x-axis and y-axis coordinates are thus determined, which do not suffice to disambiguate between alternative possibilities of locations at which the multiple objects are touching the layer;

selecting emitter-receiver pairs that are able to discriminate between the alternative possibilities of locations, based on light emitted by an emitter of the pair and scattered by one or more of the objects touching the layer causing the receiver of the pair to detect more than the reference amount of light for the pair;

further activating the emitter-receiver pairs determined by said determining; and

disambiguating the respective locations of the multiple objects touching the layer, comprising associating each x-axis coordinate with a respective y-axis coordinate, based on the amounts of light detected by the receivers for the further activated emitter-receiver pairs that are greater than the reference amounts for those further activated pairs.

2. The method of claim 1 wherein light confined inside the layer is absorbed by an object touching the layer from outside the layer, and wherein said identifying identifies emitter-receiver pairs for which the receiver of the pair detects less light than the reference amount of light for the pair due to absorption of light by one or more of the objects touching the layer.

3. The method of claim 1, wherein the layer is flexible and compressible.

4. The method of claim 1, wherein the light-based touch screen further comprises collimating lenses associated with each of the receivers, respectively, for directing light scattered from a point along the collimated path onto a respective receiver.

5. The method of claim 1, wherein the locations of the objects are calculated by assigning coordinates corresponding to each of the identified emitter-receiver pairs, and by calculating a weighted average of the assigned coordinates, wherein each coordinate'"'"'s weight in the average corresponds to a degree of reduction of light between the corresponding emitter and receiver.

6. A method for detecting locations of multiple objects simultaneously interacting with a screen, for use by a processor of a light-based touch screen system that comprises a light-transmissive layer above a screen, in which light transmitted inside the layer is confined to the layer by total internal reflection and is scattered by an object touching the layer from outside the layer, the method comprising:

activating emitter-receiver pairs for a plurality of emitters and receivers while multiple objects are simultaneously touching the layer from outside the layer, wherein light emitted by each emitter is confined inside the layer, wherein for each emitter-receiver pair a reference amount of light is detected at the receiver while no object is touching the layer, and wherein each emitter-receiver pair corresponds to a path crossing the screen;

identifying emitter-receiver pairs for which the amount of light detected by the receiver of the pair is less than the reference amount of light for the pair due to absorption of the confined light by one or more of the objects touching the layer;

further identifying x-axis and y-axis coordinates of path intersection locations for the paths corresponding to the identified emitter-receiver pairs; and

subsequent to said further identifying, and when and only when a plurality of x-axis and y-axis coordinates are thus identified, which do not suffice to disambiguate between alternative possibilities of locations at which the multiple objects are touching the layer;

determining emitter-receiver pairs for which the amount of light detected by the receiver of the pair would be greater than the reference amount of light for the pair due to scattering of the confined light by one or more of the objects, and whose corresponding paths pass over or nearly pass over the identified path intersection locations;

further activating at least some of the emitter-receiver pairs determined by said determining; and

disambiguating the respective locations of the multiple objects touching the layer, comprising associating each x-axis coordinate with a respective y-axis coordinate, based on the amounts of light detected by the receivers for the further activated emitter-receiver pairs that are greater than the reference amounts for those further activated pairs.

7. The method of claim 6, wherein the layer is flexible and compressible.

8. The method of claim 6, wherein the light-based touch screen further comprises collimating lenses associated with each of the receivers, respectively, for directing light scattered from a point along the collimated path onto a respective receiver.

9. The method of claim 6, wherein the locations of the objects are calculated by assigning coordinates corresponding to each of the identified emitter-receiver pairs, and by calculating a weighted average of the assigned coordinates, wherein each coordinate'"'"'s weight in the average corresponds to a degree of reduction of light between the corresponding emitter and receiver.

10. A method for detecting locations of multiple objects simultaneously interacting with a screen, for use by a processor of a light-based touch screen system that comprises a light-transmissive layer above a screen, in which light transmitted inside the layer is confined to the layer by total internal reflection and is scattered by an object touching the layer, the method comprising:

receiving amounts of light detected by a plurality of m+n light detectors while multiple objects are simultaneously touching a layer, the light being emitted by light emitters and confined inside the layer, whereby the light emitters correspond to a plurality of coordinates x₁, . . . , x_M, y₁, . . . , y_N and the light detectors also correspond to the plurality of coordinates x₁, . . . , x_M, y₁, . . . , y_N;

identifying amounts of light detected by K+L detectors, namely, those detectors corresponding to coordinates x₁, . . . , x_K, y₁, . . . , y_L, where 2≦

K≦

M and 2≦

L≦

N, the amounts of light being less than reference values detected while no objects touch the layer; and

subsequent to said identifying, and when and only when the coordinates of the K+L detectors do not suffice to disambiguate between alternative possibilities of locations at which the multiple objects are touching the layer;

further activating at least some of the 2KL (emitter, detector) pairs (x₁, y₁), . . . , (x₁, y_L), . . . , (x_K, y₁), . . . , (x_K, y_L), (y₁, x₁), . . . , (y₁, x_K), . . . , (y_L, x₁), . . . , (y_L, x_K) for which the amount of light detected by the detector of the pair should be greater than the reference amount of light for the pair due to scattering of the confined light by one or more of the objects; and

disambiguating the respective locations of the multiple objects touching the layer, comprising associating each coordinate x₁, . . . , x_K with a respective coordinate y₁, . . . , y_L, based on the amount of light detected by the detector of each further activated (emitter, detector) pair that is greater than the reference amount for that further activated pair.

11. The method of claim 10, wherein the layer is flexible and compressible.

12. The method of claim 10, wherein the light-based touch screen further comprises collimating lenses associated with each of the detectors, respectively, for directing light scattered from a point along the collimated path onto a respective detector.

13. The method of claim 10, wherein the locations of the objects are calculated by assigning coordinates corresponding to each of the identified (emitter, detector) pairs, and by calculating a weighted average of the assigned coordinates, wherein each coordinate'"'"'s weight in the average corresponds to a degree of reduction of light between the corresponding emitter and detector.