Structure-augmented touch sensing with frustated total internal reflection

• US 8,624,853 B2
• Filed: 04/09/2010
• Issued: 01/07/2014
• Est. Priority Date: 06/01/2009
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Han, Jefferson Y., Kollin, Joel S., Slobodin, David Elliott
• Primary Examiner(s): Lao, Lun-Yi
• Assistant Examiner(s): McLoone, Peter D
• Application Number:
  US12/757,693
• Publication Number:
  US 20100302185A1
• Time in Patent Office: 1,369 Days
• Field of Search: 345/173, 345/175, 178/18.09
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A touch-screen device includes a radiation source, a pliable waveguide configured to receive radiation emitted by the radiation source and to cause some of the received radiation to undergo total internal reflection within the pliable waveguide, a frustrating layer disposed relative to the pliable waveguide so as to enable the frustrating layer to contact the pliable waveguide when the pliable waveguide is physically deformed, the frustrating layer being configured to cause frustration of the total internal reflection of the received radiation within the pliable waveguide at a contact point between the frustrating layer and the pliable waveguide when the pliable waveguide is physically deformed to contact the frustrating layer such that some of the received radiation undergoing total internal reflection within the pliable waveguide escapes from the pliable waveguide at the contact point, and an imaging sensor configured to detect some of the radiation that escapes from the optical waveguide.

Claims

1. A touch-screen device comprising:

a radiation source;

a pliable waveguide configured to receive radiation emitted by the radiation source and to cause at least some of the received radiation to undergo total internal reflection within the pliable waveguide;

a frustrating layer disposed relative to the pliable waveguide such that a small gap exists between the frustrating layer and the pliable waveguide so as to enable the frustrating layer to contact the pliable waveguide when the pliable waveguide is physically deformed, the frustrating layer being configured to;

cause frustration of the total internal reflection of the received radiation within the pliable waveguide at a contact point between the frustrating layer and the pliable waveguide when the pliable waveguide is physically deformed to contact the frustrating layer such that some of the received radiation undergoing total internal reflection within the pliable waveguide escapes via frustrated total internal reflection from the pliable waveguide at the contact point and proceeds through the frustrating layer;

a display device fixed to a bottom surface of the frustrating layer comprising;

an imaging sensor embedded in the display device, the imaging sensor configured to detect at least some of the radiation that escapes from the pliable waveguide and proceeds through the frustrating layer; and

a structure configured to steer at least a portion of the radiation that escapes from the pliable waveguide toward the imaging sensor and proceeds through the frustrating layer;

a coupling layer in contact with a side of the display device, the side being furthest from the frustrating layer, and wherein the coupling layer is configured to couple radiation out of the display device; and

a cladding layer positioned on a surface of the pliable waveguide;

wherein the frustrating layer is in optical contact with the display device; and

wherein portions of the cladding layer are located within one or more grooves defined by the structure.

2. The touch-screen device of claim 1 wherein the structure comprises a light diffusing surface.

3. The touch-screen device of claim 1 wherein the structure comprises a volume diffusing structure integral to the frustrating layer.

4. The touch-screen device of claim 1 wherein the structure comprises a diffraction pattern corresponding to a grating structure.

5. The touch-screen device of claim 4 wherein the grating structure includes at least one of a blazed grating profile, a square-wave profile, a 1-bit binary diffraction grating profile, a multiple-bit modulated binary profile, a sinusoidal profile and a half-sinusoidal profile.

6. The touch-screen device of claim 1 wherein the structure comprises an aperiodic diffraction pattern.

7. The touch-screen device of claim 1 wherein the structure comprises a diffraction pattern in which planes of refractive index variation are aligned substantially parallel with a surface of the frustrating layer on which the radiation is incident.

8. The touch-screen device of claim 1 wherein the structure is on a surface of the frustrating layer that is nearest to the pliable waveguide.

9. The touch-screen device of claim 1 wherein the structure is on a surface of the frustrating layer that is furthest from the pliable waveguide.

10. The touch-screen device of claim 1 wherein the structure is configured to steer by diffraction at least a portion of the radiation that escapes from the pliable waveguide toward the imaging sensor.

11. The touch-screen device of claim 1 wherein the structure is configured to steer by refraction at least a portion of the radiation that escapes from the pliable waveguide toward the imaging sensor.

12. The touch-screen device of claim 11 wherein the structure comprises an array of prisms.

13. The touch-screen device of claim 1 wherein the structure is divided into sub-structures and each sub-structure is configured to steer radiation that escapes from the pliable waveguide toward the imaging sensor.

14. The touch-screen device of claim 1 further comprising a pliable frustrating layer disposed relative to the pliable waveguide so as to enable the pliable frustrating layer to contact the pliable waveguide when the pliable frustrating layer is physically deformed, the pliable frustrating layer being configured to:

cause frustration of the total internal reflection of the received radiation within the pliable waveguide at a contact point between the pliable frustrating layer and the pliable waveguide when the pliable frustrating layer is physically deformed to contact the pliable waveguide such that some of the received radiation undergoing total internal reflection within the pliable waveguide escapes from the pliable waveguide at the contact point between the pliable frustrating layer and the pliable waveguide.

15. The touch-screen device of claim 14 wherein the frustrating layer is disposed on a first side of the pliable waveguide and the pliable frustrating layer is disposed on a second opposite side of the pliable waveguide.

16. The touch-screen device of claim 14 wherein the pliable frustrating layer comprises a structure configured to steer at least a portion of the radiation that escapes from the pliable waveguide toward the imaging sensor.

17. The touch-screen device of claim 1 wherein the frustrating layer is fixed to the display device.

18. The touch-screen device of claim 1 wherein the coupling layer is in optical contact with the side of the display device that is furthest from the frustrating layer.

19. The touch-screen device of claim 1 wherein the display device is a liquid crystal device.

20. The touch-screen device of claim 1 wherein the display device is an organic light emitting diode (OLED) device.

21. The touch-screen device of claim 1 wherein the structure comprises a polarizer or substrate of the display device.

22. The touch-screen device of claim 1 wherein the structure comprises a light diffusing structure.

23. The touch-screen device of claim 22 wherein the light diffusing structure comprises a volumetric diffusive layer.

24. The touch-screen device of claim 23 wherein the light diffusing structure comprises a surface diffusive layer.

25. The touch-screen device of claim 1 further comprising a screen projection layer adjacent to the frustrating layer.

26. The touch-screen device of claim 1 wherein the frustrating layer comprises a screen projection layer.

27. The touch-screen device of claim 1 further comprising a cladding layer on the structure.

28. A touch-screen device comprising:

a radiation source;

a pliable waveguide configured to receive radiation emitted by the radiation source and to cause at least some of the received radiation to undergo total internal reflection within the pliable waveguide;

a frustrating layer disposed relative to the pliable waveguide such that a small gap exists between the frustrating layer and the pliable waveguide so as to enable a top surface of the frustrating layer to contact the pliable waveguide when the pliable waveguide is physically deformed, the frustrating layer being configured to;

cause frustration of the total internal reflection of the received radiation within the pliable waveguide at a contact point between the top surface of the frustrating layer and the pliable waveguide when the pliable waveguide is physically deformed to contact the top surface of the frustrating layer such that some of the received radiation undergoing total internal reflection within the pliable waveguide escapes via frustrated total internal reflection from the pliable waveguide at the contact point and proceeds through the frustrating layer;

an image generating layer fixed to a bottom surface of the frustrating layer that is opposite to the top surface of the frustrating layer, the image generating layer having a top surface facing the bottom surface of the frustrating layer and a bottom surface that is opposite from the top surface of the image generating layer and the image generating layer being configured to emit output images towards the frustrating layer and the pliable waveguide and to be transmissive to radiation emitted by the radiation source;

an imaging sensor embedded in the image generating layer and configured to detect at least some of the radiation that escapes from the pliable waveguide and proceeds through the frustrating layer;

a light-steering structure disposed adjacent to the bottom surface of the image generating layer, the light-steering structure being configured to steer at least a portion of the radiation that escapes from the pliable waveguide and proceeds through the frustrating layer toward the imaging sensor;

a coupling layer in contact with a side of the image generating layer, the side being furthest from the frustrating layer, and wherein the coupling layer is configured to couple radiation out of the image generating layer; and

a cladding layer positioned on a surface of the pliable waveguide;

wherein the frustrating layer is in optical contact with the image generating layer; and

wherein portions of the cladding layer are located within one or more grooves defined by the light-steering structure.

29. The touch-screen device of claim 28 wherein the light-steering structure is in optical contact with the bottom surface of the image generating layer.

30. The touch-screen device of claim 28 wherein the light-steering structure is fixed to the bottom surface of the image generating layer.

31. The touch-screen device of claim 28 wherein the top surface of the image generating layer is in optical contact with the bottom surface of the frustrating layer.

32. The touch-screen device of claim 28 wherein the top surface of the image generating layer is fixed to the bottom surface of the frustrating layer.

33. The touch-screen device of claim 28 wherein the image generating layer comprises a liquid crystal device.

34. The touch-screen device of claim 28 wherein the image generating layer comprises a light emitting diode device.

35. The touch-screen device of claim 34 wherein the light emitting diode device comprises an organic light emitting diode device.

36. The touch-screen device of claim 28 wherein the light-steering structure comprises a light diffusing structure.

37. The touch-screen device of claim 36 wherein the light diffusing structure comprises a surface diffusive layer.

38. The touch-screen device of claim 36 wherein the light diffusing structure comprises a volumetric diffusive layer.

39. The touch-screen device of claim 28 wherein the light-steering structure comprises a diffraction pattern corresponding to a grating structure.

40. The touch-screen device of claim 28 wherein the light-steering structure comprises an aperiodic diffraction pattern.

41. The touch-screen device of claim 28 wherein the light-steering structure comprises a diffraction pattern in which planes of refractive index variation are aligned substantially parallel with a surface of the frustrating layer on which the radiation is incident.

42. The touch-screen device of claim 28 wherein the light-steering structure is configured to steer by diffraction at least a portion of the radiation that escapes from the pliable waveguide toward the imaging sensor.

43. The touch-screen device of claim 28 wherein the light-steering structure is configured to steer by refraction at least a portion of the radiation that escapes from the pliable waveguide toward the imaging sensor.

44. The touch-screen device of claim 28 further comprising a cladding layer on a surface of the light-steering structure.

45. The touch-screen device of claim 28 further comprising a plurality of imaging sensors, each imaging sensor being configured to detect at least some of the radiation that escapes from the pliable waveguide.