Fingertip detection for camera based multi-touch systems

• US 8,581,852 B2
• Filed: 11/15/2007
• Issued: 11/12/2013
• Est. Priority Date: 11/15/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Izadi, Shahram, Taylor, Stuart, Hodges, Stephen E.
• Primary Examiner(s): Liang, Regina
• Application Number:
  US11/940,822
• Publication Number:
  US 20090128499A1
• Time in Patent Office: 2,189 Days
• Field of Search: 345173-179, 178 1801- 1809
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

Touch detection systems and methods are described. The system comprises a light guiding sheet, a light source, a reflective layer and a detector. When a fingertip or other suitable object is pressed against the light guiding sheet, light which is undergoing total internal reflection within the sheet is scattered. The scattered light is reflected by the reflective layer and detected by the detector. In an embodiment, the light is infra-red light. The touch detection system may, in some embodiments, be placed on a display and the touch events used to control the display.

Claims

1. A touch detection system comprising:

a light guiding sheet having a touch surface and a rear surface;

a source arranged to couple light into an edge of the light guiding sheet, such that the light is totally internally reflected within a working area of the light guiding sheet;

a reflective layer in proximity to the rear surface of the light guiding sheet;

a display surface in proximity to the reflective layer;

a detector arranged in front of the touch surface of the light guiding sheet and opposite to the reflective layer, to detect light emitted by the source, scattered as a result of a touch event and reflected by the reflective layer; and

a computing-based device comprising;

a processor;

an interface to the display surface;

an interface to the detector; and

a memory arranged to store executable instructions to cause the processor to;

perform image analysis on a signal from the detector to identify a touch event, the image analysis comprising;

generating an area of interest inside the working area of the light guide sheet;

filtering the signal to remove all data outside the area of interest; and

converting the signal into a binary image using a threshold.

2. A touch detection system according to claim 1, wherein the source comprises an infra-red source.

3. A touch detection system according to claim 2, wherein the reflective layer reflects infra-red and is transparent to visible light.

4. A touch detection system according to claim 2, wherein the detector comprises an infra-red sensitive detector.

5. A touch detection system according to claim 1, wherein the display surface includes the reflective layer.

6. A touch detection system according to claim 1, wherein the display surface comprises one of a liquid crystal display, a whiteboard and a projector screen.

7. A touch detection system according to claim 1, wherein the memory is further arranged to store executable instructions to cause the processor to:

control an application based on the touch event.

8. A touch detection system according to claim 7, wherein the memory is further arranged to store executable instructions to cause the processor to:

output data to the display surface via the interface to the display surface, to cause the display surface to display a graphical user interface of the application.

9. A touch detection system according to claim 1, wherein the source comprises an array of sources.

10. A touch detection system according to claim 9, wherein in use the sources are illuminated sequentially.

11. A touch detection system according to claim 1, wherein in use the source is modulated.

12. A method of detecting touch events comprising:

projecting light into a light guiding sheet such that it undergoes total internal reflection;

detecting, by a detector arranged in front of a first surface of the light guiding sheet, light scattered by a touch event on the first surface of the light guiding sheet and reflected by a reflective layer in proximity to a second surface of the light guiding sheet;

generating a signal representative of the light detected;

performing image processing on the signal to identify a touch event, the image processing comprising;

generating an area of interest inside an area of the light guide sheet;

filtering the signal to remove all data outside the area of interest; and

converting the signal into a binary image using a threshold.

13. A method according to claim 12, further comprising:

controlling an application based on the touch event.

14. A method according to claim 13, further comprising:

displaying a graphical user interface for the application on a display surface in proximity to the reflective layer.

15. A touch sensitive user input device comprising:

a light guiding layer;

a source arranged to couple light into an edge of the light guiding layer;

a reflective layer in proximity to a first surface of the light guiding layer and arranged to reflect light scattered by a user touching a second surface of the light guiding layer;

a detector arranged in front of the second surface of the light guiding layer, the detector to detect light reflected by the reflective layer; and

a computing-based device comprising;

a processor and memory arranged to store executable instructions to cause the processor to;

generate a signal representative of the light detected; and

perform image processing on the signal to identify a touch event, the image processing comprising;

generating an area of interest inside an area of the light guiding layer;

filtering the signal to remove all data outside the area of interest; and

converting the signal into a binary image using a threshold.

16. A touch sensitive user input device according to claim 15, further comprising:

a display in proximity to the reflective layer,

and wherein the reflective layer is arranged to reflect at least one wavelength of light emitted by the source and to be transparent to at least one wavelength of light emitted by the display.