Multi-touch sensing through frustrated total internal reflection

• US 8,259,240 B2
• Filed: 03/26/2012
• Issued: 09/04/2012
• Est. Priority Date: 08/03/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Han, Jefferson Y.
• Primary Examiner(s): Healy, Brian
• Application Number:
  US13/430,484
• Publication Number:
  US 20120182266A1
• Time in Patent Office: 162 Days
• Field of Search: 349/12, 349/23, 349/60, 349/64, 349/112, 349/138, 349/158, 385/12, 385/13, 385/901, 250/221, 313/504, 345/175
• US Class Current: 349/12
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: Y10S 385/901 Illuminating or display apparatus

Abstract

High-resolution, scalable multi-touch sensing display systems and processes based on frustrated total internal reflection employ an optical waveguide that receives light, such as infrared light, that undergoes total internal reflection and an imaging sensor that detects light that escapes the optical waveguide caused by frustration of the total internal reflection due to contact by a user. The optical waveguide when fitted with a compliant surface overlay provides superior sensing performance, as well as other benefits and features. The systems and processes described provide true multi-touch (multi-input) and high-spatial and temporal resolution capability due to the continuous imaging of the frustrated total internal reflection that escapes the entire optical waveguide. Among other features and benefits, the systems and processes are scalable to large installations.

Claims

1. A multi-touch sensing system, comprising:

an optical waveguide having first and second sides;

a compliant layer directly coupled to the first side of the optical waveguide, the compliant layer and the optical waveguide having substantially similar indexes of refraction so that light of at least one wavelength received by the optical waveguide in a predetermined direction undergoes total internal reflection within the optical waveguide and the compliant layer;

a cladding layer directly coupled to the compliant layer and having an index of refraction sufficiently lower than the index of refraction of the compliant layer so that deformation of the cladding layer causes some of the light undergoing total internal reflection to scatter and to escape the compliant layer and the optical waveguide; and

an image sensor adapted to detect at least some of the light that escapes the compliant layer and the optical waveguide.

2. The multi-touch sensing system of claim 1, wherein the cladding layer has an associated light filter for filtering light of said at least one wavelength.

3. The multi-touch sensing system of claim 1, wherein the cladding layer is deformable by depressing a surface of the cladding layer by a finger of a user of the multi-touch sensing system.

4. The multi-touch sensing system of claim 1, wherein the image sensor is optically disposed to receive the light that escapes from the second side of the optical waveguide.

5. The multi-touch sensing system of claim 4, further comprising a band pass filter optically disposed between the second side of the optical waveguide and the image sensor for allowing substantially only the light of said at least one wavelength to pass from the optical waveguide to the image sensor.

6. The multi-touch sensing system of claim 1, further comprising a light source disposed directly against an edge of the optical waveguide for emitting light of said at least one wavelength and received by the optical waveguide in at least said predetermined direction.

7. The multi-touch sensing system of claim 1, wherein the optical waveguide is a compound component comprised of a non-compliant optical waveguide layer and a compliant optical waveguide layer disposed on the non-compliant optical waveguide layer, the compliant optical waveguide layer being disposed on the first side of the optical waveguide so that the compliant layer is coupled to the compliant optical waveguide layer of the optical waveguide.

8. The multi-touch sensing system of claim 1, further comprising a rear projector for projecting a video image towards the second side of the optical waveguide, and wherein the cladding layer, compliant layer and the optical waveguide are substantially transparent to visible light so that the displayed video image is viewable through the cladding layer, compliant layer and the optical waveguide.

9. The multi-touch sensing system of claim 8, further comprising a diffuser disposed on the cladding layer for diffusing the video image projected towards the second side of the optical waveguide.

10. The multi-touch sensing system of claim 8, wherein the compliant layer is adapted to diffuse the video image projected towards the second side of the optical waveguide.

11. A multi-touch sensing system, comprising:

a compliant optical waveguide having an index of refraction sufficient to cause light of at least one wavelength received in a predetermined direction to undergo total internal reflection within the compliant optical waveguide, the compliant optical waveguide having first and second sides;

a cladding layer directly coupled to the first side of the compliant optical waveguide and having an index of refraction sufficiently lower than the index of refraction of the compliant optical waveguide so that deformation of the cladding layer causes some of the light undergoing total internal reflection to scatter and to escape the compliant optical waveguide; and

an image sensor adapted to detect at least some of the light that escapes the compliant optical waveguide.

12. The multi-touch sensing system of claim 11, wherein the cladding layer has an associated light filter for filtering light of said at least one wavelength.

13. The multi-touch sensing system of claim 11, wherein the cladding layer is deformable by depressing a surface of the cladding layer by a finger of a user of the multi-touch sensing system.

14. The multi-touch sensing system of claim 11, wherein the image sensor is optically disposed to receive the light that escapes from the second side of the compliant optical waveguide.

15. The multi-touch sensing system of claim 14, further comprising a band pass filter optically disposed between the second side of the compliant optical waveguide and the image sensor for allowing substantially only the light of said at least one wavelength to pass from the compliant optical waveguide to the image sensor.

16. The multi-touch sensing system of claim 11, further comprising a light source disposed directly against an edge of the compliant optical waveguide for emitting light of said at least one wavelength and received by the compliant optical waveguide in at least said predetermined direction.

17. The multi-touch sensing system of claim 11, wherein the compliant optical waveguide is a compound component comprised of a non-compliant optical waveguide layer and a compliant optical waveguide layer disposed on the non-compliant optical waveguide layer, the compliant optical waveguide layer being disposed on the second side of the compliant optical waveguide so that the cladding layer is coupled to the compliant optical waveguide layer.

18. The multi-touch sensing system of claim 11, further comprising a rear projector for projecting a video image towards the second side of the compliant optical waveguide, and wherein the cladding layer and the compliant optical waveguide are substantially transparent to visible light so that the displayed video image is viewable through the cladding layer and the compliant optical waveguide.

19. The multi-touch sensing system of claim 18, further comprising a diffuser disposed on the cladding layer for diffusing the video image projected towards the second side of the compliant optical waveguide.

20. The multi-touch sensing system of claim 18, wherein the compliant optical waveguide is adapted to diffuse the video image projected towards the second side of the compliant optical waveguide.