Touch sensing with frustrated total internal reflection

• US 8,736,581 B2
• Filed: 04/09/2010
• Issued: 05/27/2014
• Est. Priority Date: 06/01/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Han, Jefferson Y., Kollin, Joel S., Slobodin, David Elliott
• Primary Examiner(s): Tryder, Gregory J
• Assistant Examiner(s): McLoone, Peter D
• Application Number:
  US12/757,937
• Publication Number:
  US 20100302210A1
• Time in Patent Office: 1,509 Days
• Field of Search: 345174-176, 178/18.09, 250/221
• US Class Current: 345/175
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A touch-screen device includes a radiation source, a waveguide configured to receive radiation emitted by the source and to cause some of the radiation to undergo total internal reflection within the waveguide, a pliable frustrating layer disposed relative to the waveguide to enable the frustrating layer to contact the waveguide when the frustrating layer is physically deformed, the frustrating layer being configured to cause frustration of the total internal reflection of the received radiation within the waveguide when the frustrating layer is physically deformed to contact the waveguide such that some of the received escapes from the waveguide at the contact point, an imaging sensor configured to detect some of the radiation that escapes from the waveguide, and a structure disposed relative to the frustrating layer, the structure configured to steer at least a portion of the radiation that escapes from the waveguide toward the imaging sensor.

Claims

1. A touch-screen device comprising:

a radiation source;

an optical waveguide configured to receive radiation emitted by the radiation source and to cause at least some of the received radiation to undergo total internal reflection within the optical waveguide;

a pliable frustrating layer disposed relative to the optical waveguide such that a small gap exists between the pliable frustrating layer and the optical waveguide so as to enable the pliable frustrating layer to contact the optical waveguide when the pliable frustrating layer is physically deformed, the pliable frustrating layer being configured to;

cause frustration of the total internal reflection of the received radiation within the optical waveguide at a contact point between the pliable frustrating layer and the optical waveguide when the pliable frustrating layer is physically deformed to contact the optical waveguide such that some of the received radiation undergoing total internal reflection within the optical waveguide escapes from the optical waveguide at the contact point via frustrated total internal reflectance;

a display device fixed to a bottom surface of the optical waveguide;

an imaging sensor configured to detect at least some of the radiation that escapes from the optical waveguide, the imaging sensor embedded in the display device;

a coupling layer configured to couple radiation out of the display device, the coupling layer in contact with a side of the display device, the side furthest from the optical waveguide;

a structure comprising a diffraction pattern, the structure disposed on a surface of the pliable frustrating layer that is furthest from the optical waveguide, the structure being configured to steer at least a portion of the radiation that escapes from the optical waveguide toward the imaging sensor; and

a cladding layer positioned on a surface of the pliable frustrating layer;

wherein portions of the cladding layer are located within one or more grooves defined by the structure;

wherein the optical waveguide is in optical contact with the display device;

wherein the structure comprises a reflective layer that is reflective to radiation that escapes from the optical waveguide; and

wherein the reflective layer transmits visible light.

2. The touch-screen device of claim 1 wherein the structure comprises a diffuser layer.

3. The touch-screen device of claim 1 wherein the diffraction pattern corresponds to a grating structure.

4. The touch-screen device of claim 3 wherein the grating structure includes at least one of a blazed grating profile, a square-wave profile, a 1-bit binary diffraction grating profile, a multiple-bit modulated binary profile, a sinusoidal profile, and a half-sinusoidal profile.

5. The touch-screen device of claim 1 wherein the diffraction pattern is aperiodic.

6. The touch-screen device of claim 1 wherein the radiation source is configured to emit infrared light.

7. The touch-screen device of claim 1 wherein the structure is configured to steer by diffraction at least a portion of the radiation that escapes from the optical waveguide toward the imaging sensor.

8. The touch-screen device of claim 1 wherein the structure is configured to steer by refraction at least a portion of the radiation that escapes from the optical waveguide toward the imaging sensor.

9. The touch-screen device of claim 8 wherein the structure comprises an array of prisms.

10. The touch-screen device of claim 1 wherein the structure is configured to steer by scattering at least a portion of the radiation that escapes from the optical waveguide toward the imaging sensor.

11. The touch-screen device of claim 1 wherein the structure is divided into substructures and each sub-structure is configured to steer radiation that escapes from the optical waveguide toward the imaging sensor.

12. The touch-screen device of claim 1 wherein the display device is a liquid crystal device.

13. The touch-screen device of claim 1 wherein the display device is a rear-projection light source.

14. The touch-screen device of claim 1 wherein the display device is a light emitting diode device.

15. The touch-screen device of claim 14 wherein the light emitting diode is an organic light emitting diode device.

16. The touch-screen device of claim 1 further comprising a plurality of imaging sensors, each imaging sensor being configured to detect at least some of the radiation that escapes from the optical waveguide.

17. The touch-screen device of claim 1 further comprising a projection screen layer, wherein the projection screen layer comprises a structure configured to diffuse at least a portion of light emitted from the display device.

18. The touch-screen device of claim 1 further comprising a projection screen layer and a structure configured to diffuse at least a portion of light emitted from the display device on to the projection screen layer.

19. A touch-screen device comprising:

a radiation source;

an optical waveguide configured to receive radiation emitted by the radiation source and to cause at least some of the received radiation to undergo total internal reflection within the optical waveguide;

a pliable frustrating layer disposed relative to the optical waveguide such that a small gap exists between the pliable frustrating layer and the optical waveguide so as to enable the pliable frustrating layer to contact the optical waveguide when the pliable frustrating layer is physically deformed, the pliable frustrating layer being configured to;

cause frustration of the total internal reflection of the received radiation within the optical waveguide at a contact point between the pliable frustrating layer and the optical waveguide when the pliable frustrating layer is physically deformed to contact the optical waveguide such that some of the received radiation undergoing total internal reflection within the optical waveguide escapes from the optical waveguide at the contact point via frustrated total internal reflectance;

an image generating layer fixed to a bottom surface of the optical waveguide;

an imaging sensor configured to detect at least some of the radiation that escapes from the optical waveguide, the imaging sensor embedded in the image generating layer;

a coupling layer configured to couple radiation out of the image generating layer, the coupling layer in contact with a side of the image generating layer, the side furthest from the optical waveguide;

a cladding layer positioned on a surface of the pliable frustrating layer;

a structure comprising a diffraction pattern, the structure disposed on a surface of the pliable frustrating layer that is furthest from the optical waveguide, the structure being configured to;

redirect at least a portion of the radiation that escapes from the optical waveguide back into the waveguide at an angle that enables the reflected radiation to undergo total internal reflection in the optical waveguide;

wherein portions of the cladding layer are located within one or more grooves defined by the structure;

wherein the optical waveguide is in optical contact with the image generating layer;

wherein the structure comprises a reflective layer that is reflective to radiation that escapes from the optical waveguide; and

wherein the reflective layer transmits visible light.

20. The touch-screen device of claim 19 wherein the bottom surface of the optical waveguide is opposite to a top surface of the optical waveguide, the image generating layer having a top surface facing the bottom surface of the optical waveguide and a bottom surface that is opposite from the top surface of the image generating layer and the image generating layer being configured to emit output images towards the optical waveguide and pliable frustrating layer and to be transmissive to radiation emitted by the radiation source.

21. The touch-screen device of claim 20 wherein the image generating layer comprises a liquid crystal device.

22. The touch-screen device of claim 20 wherein the image generating layer comprises a rear-projection light source.

23. The touch-screen device of claim 20 wherein the image generating layer comprises a light emitting diode.

24. The touch-screen device of claim 23 wherein the light emitting diode is an organic light emitting diode.

25. A touch-screen device comprising:

a radiation source;

an optical waveguide configured to receive radiation emitted by the radiation source and to cause at least some of the received radiation to undergo total internal reflection within the optical waveguide;

a pliable frustrating layer disposed relative to the optical waveguide such that a small gap exists between the pliable frustrating layer and the optical waveguide so as to enable the pliable frustrating layer to contact the optical waveguide when the pliable frustrating layer is physically deformed, the pliable frustrating layer being configured to;

cause frustration of the total internal reflection of the received radiation within the optical waveguide at a contact point between the pliable frustrating layer and the optical waveguide when the pliable frustrating layer is physically deformed to contact the optical waveguide such that some of the received radiation undergoing total internal reflection within the optical waveguide escapes from the optical waveguide at the contact point via frustrated total internal reflectance;

a display device fixed to a bottom surface of the optical waveguide;

a cladding layer positioned on a surface of the pliable frustrating layer;

an imaging sensor configured to detect at least some of the radiation that escapes from the optical waveguide, the imaging sensor embedded in the display device; and

a coupling layer configured to couple radiation out of the display device, the coupling layer in contact with a side of the display device, the side furthest from the optical waveguide;

wherein

the frustrating layer comprises a structure disposed on a surface of the pliable frustrating layer that is furthest from the optical waveguide, the structure configured to steer at least a portion of the radiation that escapes from the optical waveguide toward the imaging sensor;

wherein portions of the cladding layer are located within one or more grooves defined by the structure;

wherein the optical waveguide is in optical contact with the display device;

wherein the structure comprises a reflective layer that is reflective to radiation that escapes from the optical waveguide; and

wherein the reflective layer transmits visible light.

26. The touch-screen device of claim 25 wherein the structure comprises a diffraction pattern corresponding to a grating structure.

27. The touch-screen device of claim 26 wherein the grating structure includes at least one of a blazed grating profile, a square-wave profile, a 1-bit binary diffraction grating profile, a multiple-bit modulated binary profile, a sinusoidal profile, and a half-sinusoidal profile.

28. The touch-screen device of claim 25 wherein the structure comprises an aperiodic diffraction pattern.

29. The touch-screen device of claim 25 wherein the structure comprises a diffraction pattern in which planes of refractive index variation are aligned substantially parallel with a surface of the pliable frustrating layer on which the radiation is incident.

30. The touch-screen device of claim 25 wherein the radiation source is configured to emit infrared light.

31. The touch-screen device of claim 25 wherein the structure is configured to steer by diffraction at least a portion of the radiation that escapes from the optical waveguide toward the imaging sensor.

32. The touch-screen device of claim 25 wherein the display device is a liquid crystal device.

33. The touch-screen device of claim 25 wherein the display device is a rear-projection light source.

34. The touch-screen device of claim 25 wherein the display device is a light emitting diode device.

35. The touch-screen device of claim 34 wherein the light emitting diode is an organic light emitting diode device.

36. The touch-screen device of claim 25 further comprising a plurality of imaging sensors, each imaging sensor being configured to detect at least some of the radiation that escapes from the optical waveguide.

37. The touch-screen device of claim 25 wherein the structure is further configured to diffuse at least a portion of light emitted from the display device.

38. The touch-screen device of claim 25 wherein the structure comprises a volume diffusing structure or a surface diffusing structure.

39. The touch-screen device of claim 38 wherein the structure is further configured to diffuse at least a portion of light emitted from the display device to produce an image on the pliable frustrating layer.