Stereo Optical Sensors for Resolving Multi-Touch in a Touch Detection System

• US 20110205189A1
• Filed: 09/29/2009
• Published: 08/25/2011
• Est. Priority Date: 10/02/2008
• Status: Abandoned Application

• Current Assignee: Next Holdings Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Next Holdings Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Newton, John David
• Application Number:
  US13/121,868
• Publication Number:
  US 20110205189A1
• Time in Patent Office: Days
• US Class Current: 345/175
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

An optical touch detection system including at least two stereo pairs of optical sensors, which are identify a set of potential points, and methods for determining which of the potential points are true touch points. The first pair of optical sensors is used to identify a first set of potential points and the second set of optical sensors is used to identify a second set of potential points. Potential point pairs are then compared as between the first and second sets of potential points, i.e., each potential point pair includes a potential point from the first set and a potential point from the second set. Each potential point pair is evaluated to determine the distance between its constituent potential points. The true touch points are identified by selecting the potential point pairs having the shortest distances between their constituent potential points. Using at least two pairs of optical sensors reduces the total number of potential point pairs that must be evaluated to determine the true touch points necessary computational analysis.

Claims

1. A touch detection system for resolving multitouch scenarios, the system comprising:

a touch area;

one or more optical emitters for emitting energy across the touch area;

a first pair of optical sensors positioned along at least one edge of the touch area;

a second pair of optical sensors positioned along at least one edge of the touch area; and

a computing system interfaced with the first and second pairs of optical sensors, the computer system configured to;

receive data signals indicating a first plurality of shadows detected by the first pair of optical sensors and a second plurality of shadows detected by the second pair of optical sensors, the first and second plurality of shadows caused by multiple true touch points,

triangulating the first plurality of shadows to determine a first set of potential points and triangulating the second plurality of shadows to determine a second set of potential points,

determining potential point pairs comprising combinations of the first set of potential points and the second set of potential points,

for each potential point pair, calculating the distance between its constituent potential points, and

determining that a plurality of the potential point pairs having the shortest distances between their constituent potential points are the true touch points.

2. The touch detection system as in claim 1, wherein the touch area is bounded on three sides by a bezel;

and

wherein the first and second pair of optical sensors are each positioned to image the bezel.

3. The touch detection system as in claim 2, wherein at least one of the optical emitters is positioned in close proximity to each optical sensor of the first and second pair of optical sensor;

and

wherein the bezel has a retroreflective surface for retroreflecting energy emitted by each optical emitter in the direction of the corresponding optical sensor.

4. The touch detection system as in claim 1, wherein each optical sensor of the first and second pair of optical sensors is housed in an assembly comprising at least one of the optical emitters.

5. The touch detection system as in claim 1, wherein the first pair of optical sensors comprises a first optical sensor and a second optical sensor;

wherein the second pair of optical sensors comprises a third optical sensor and a fourth optical sensor; and

wherein the first optical sensor and the third optical sensor are positioned adjacent to one another and the second optical sensor and the fourth optical sensor are positioned adjacent to one another.

6. The touch detection system as in claim 5, wherein the first optical sensor and the third optical sensor are housed in a single assembly.

7. The touch detection system as in claim 5, wherein the second optical sensor and the fourth optical sensor are housed in a single assembly.

8. The touch detection system as in claim 5, wherein the first optical sensor and the third optical sensor are positioned in a first corner of the touch area;

and

wherein the second optical sensor and the fourth optical sensor are positioned in a second corner of the touch area.

9. The touch detection system as in claim 1, wherein the first pair of optical sensors is separated by a first triangulation base line, and the second pair of optical sensors is separated by a second triangulation base line;

and

wherein each of the first triangulation base line and the second triangulation base line is relatively long.

10. The touch detection system as in claim 1, further comprising at least a third pair of optical sensors positioned along at least one edge of the touch area and interfaced with the computing device.

11. The touch detection system as in claim 1, wherein at least one optical sensor of the first pair of optical sensors and the second pair of optical sensors is a line scan sensor. and, an area image sensor, and a video camera.

12. The touch detection system as in claim 1, wherein at least one optical sensor of the first pair of optical sensors and the second pair of optical sensors is an area image sensor.

13. The touch detection system as in claim 12, wherein the area image sensor captures video data.

14. A method for resolving multitouch scenarios, the method comprising:

emitting energy across a touch area;

detecting a first plurality of shadows with a first pair of optical sensors that are positioned along at least one edge of the touch area;

detecting a second plurality of shadows with a second pair of optical sensors that are positioned along at least one edge of the touch area, wherein the first and second plurality of shadows are caused by multiple true touch points;

triangulating the first plurality of shadows to determine a first set of potential points and triangulating the second plurality of shadows to determine a second set of potential points;

determining potential point pairs comprising combinations of the first set of potential points and the second set of potential points;

calculating the distance between the constituent potential points for each potential point pair; and

determining that a plurality of the potential point pairs having the shortest distances between their constituent potential points are the true touch points.

15. The method as in claim 14, wherein triangulating the first plurality of shadows occurs simultaneously with triangulating the second plurality of shadows.

16. The method as in claim 14, wherein a potential point pair comprises one potential point from the first set of potential points and one potential point from the second set of potential points.

17. The method as in claim 14, further comprising adjusting the level of energy that is emitted across the touch area to thereby reduce the effect of a change in ambient light.

18. A computer-readable medium tangibly embodying program code operable for causing a processor to identify a true touch point from a plurality of potential points, the computer-readable medium comprising:

program code for receiving data signals indicating a first plurality of shadows detected by a first pair of optical sensors, wherein the first pair of optical sensors are positioned along at least one edge of a touch area;

program code for receiving data signals indicating a second plurality of shadows detected by a second pair of optical sensors, wherein the second pair of optical sensors are positioned along at least one edge of the touch area and the first and second plurality of shadows are caused by multiple true touch points;

program code for triangulating the first plurality of shadows to determine a first set of potential points and triangulating the second plurality of shadows to determine a second set of potential points;

program code for determining potential point pairs comprising combinations of the first set of potential points and the second set of potential points;

program code for calculating the distance between constituent potential points for each potential point pair; and

program code for determining that a plurality of the potential point pairs having the shortest distances between their constituent potential points are the true touch points.

19. A touch detection system for resolving multitouch scenarios, the system comprising:

a touch area;

a first pair of optical sensors positioned along at least one edge of the touch area;

a second pair of optical sensors positioned along at least one edge of the touch area; and

a computing system interfaced with the first and second pairs of optical sensors, the computer system configured to;

generating a first plurality of images of the touch area based on data signals received from the first pair of area optical sensors and generating a second plurality of images of the touch area based on data signals received from the second pair of optical sensors,

for each of the first plurality of images and the second plurality of images, determining relative positions of touch objects used to effect multiple true touch points,

triangulating the relative positions of the touch objects of the first plurality of images to determine a first set of potential points and triangulating the relative positions of the touch objects of the second plurality of images to determine a second set of potential points,

determining potential point pairs comprising combinations of the first set of potential points and the second set of potential points,

for each potential point pair, calculating the distance between its constituent potential points, and

determining that a plurality of the potential point pairs having the shortest distances between their constituent potential points are the true touch points.

20. The touch detection system as in claim 19, wherein each optical sensor of the first and second pair of optical sensors is housed in an assembly comprising at least one of the area image cameras.

21. The touch detection system as in claim 19, wherein the first pair of optical sensors is separated by a first triangulation base line, and the second pair of optical sensors is separated by a second triangulation base line;

and

wherein each of the first triangulation base line and the second triangulation base line is relatively long.

22. The touch detection system as in claim 19, wherein the first pair of optical sensors comprises a first area image camera and a second area image camera;

wherein the second pair of area image cameras comprises a third area image camera and a fourth area image camera; and

wherein the first area image camera and the third area image camera are positioned adjacent to one another and the second area image camera and the fourth area image camera are positioned adjacent to one another.

23. The touch detection system as in claim 22, wherein the first area image camera and the third area image camera are positioned in a first corner of the touch area;

and

wherein the second area image camera and the fourth area image camera are positioned in a second corner of the touch area.

24. The touch detection system as in claim 19, wherein the first plurality of images and the second plurality of images comprise video images of the touch area.