Touch sensing using shadow and reflective modes

• US 8,368,663 B2
• Filed: 12/07/2011
• Issued: 02/05/2013
• Est. Priority Date: 11/27/2006
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Izadi, Shahram, Hodges, Stephen, Butler, David Alexander, Rrustemi, Alban
• Primary Examiner(s): Lao, Lun-Yi
• Assistant Examiner(s): Hegarty, Kelly B
• Application Number:
  US13/313,700
• Publication Number:
  US 20120075256A1
• Time in Patent Office: 426 Days
• Field of Search: 345156-158, 345/173, 345/175, 345/176, 345/211, 715/702, 715/740, 178 1801- 1904, 434322-364, 315149-150, 382/106, 382/107, 382/108, 382/154, 382/224, 713300-320, 713323-340
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen

Abstract

A touch panel is described which uses at least one infrared source and an array of infrared sensors to detect objects which are in contact with, or close to, the touchable surface of the panel. The panel may be operated in both reflective and shadow modes, in arbitrary per-pixel combinations which change over time. For example, if the level of ambient infrared is detected and if that level exceeds a threshold, shadow mode is used for detection of touch events over some or all of the display. If the threshold is not exceeded, reflective mode is used to detect touch events. The touch panel includes an infrared source and an array of infrared sensors.

Claims

1. A method of operating a touch panel system for detecting one or more objects in proximity with a touchable surface of a touch panel, the method comprising:

scanning at least a portion of the touch panel to measure a level of ambient infrared radiation using at least one infrared sensor;

switching to a shadow mode of operation if the level of ambient infrared radiation exceeds a first threshold;

detecting a first shape of an object adjacent the touch panel while in the shadow mode of operation;

switching to a reflective mode of operation if the level of ambient infrared radiation does not exceed both the first threshold and a second threshold, wherein the switching between the shadow mode and the reflective mode changes an angle of illumination of the object adjacent to the touch panel;

detecting a second shape of the object while in the reflective mode of operation;

analyzing the detected first and second shapes; and

determining a three-dimensional shape and thickness of the object based at least in part on the changes in the angle of illumination analysis of the first and second shapes.

2. The method of claim 1, further comprising:

determining that a battery level is below a predetermined limit while the level of ambient infrared radiation exceeds the second threshold and not the first threshold; and

switching to the shadow mode of operation after the battery level drops below the predetermined limit.

3. The method of claim 2, further comprising switching to the reflective mode of operation after the battery level rises above the predetermined limit.

4. The method according to claim 2, wherein the first threshold is higher than the second threshold.

5. The method according to claim 2, wherein the touch panel system further comprises a plurality of infrared sources configured to illuminate the one or more objects with infrared radiation through the touchable surface, the method further comprising, in the reflective mode of operation:

scanning the touch panel; and

on detection of a touch event at an infrared sensor, illuminating infrared sources of the plurality of infrared sources that are in proximity to the infrared sensor.

6. The method according to claim 2, further comprising, in the reflective mode of operation:

illuminating the touchable surface with infrared radiation of a first wavelength;

detecting infrared radiation reflected from the object at the first wavelength; and

repeating the illuminating and detecting steps at a second wavelength.

7. The method according to claim 1, further comprising, periodically recalibrating the touch panel system based on the scanning at least the portion of the touch panel.

8. The method according to claim 1, wherein the touch panel system further comprises a plurality of groups of infrared sources configured to illuminate the one or more objects with infrared radiation through the touchable surface, the method further comprising, in the reflective mode of operation:

switching at least two of the groups of infrared sources on and off sequentially, wherein the switching between the at least two of the groups of infrared sources changes the angle of illumination of the object;

detecting a third shape of the object when one of the groups of infrared sources is switched on;

detecting a fourth shape of the object when another of the groups of infrared sources is switched on;

analyzing the detected third and fourth shapes; and

determining a three-dimensional shape of the object based at least in part on the analysis of the third and fourth shapes.

9. The method according to claim 1, wherein the touch panel system further comprises at least one infrared source that is configured to move in position, wherein movement of the at least one infrared source changes the angle of illumination of the object, the method further comprising, in the reflective mode of operation:

detecting a third shape of the object with the at least one infrared source in a first position;

moving the at least one infrared source from the first position to a second position;

detecting a fourth shape of the object with the at least one infrared source in the second position;

analyzing the detected third and fourth shapes; and

determining a three-dimensional shape of the object based at least in part on the analysis of the third and fourth shapes.

10. A touch panel system to detect one or more objects in proximity with a touchable surface of the touch panel system, the touch panel system comprising:

a control element to;

scan at least a portion of the touch panel to measure a level of ambient infrared radiation;

switch to a shadow mode of operation if the level of ambient infrared radiation exceeds a first threshold;

detect a first shape of an object adjacent the touch panel while in the shadow mode of operation;

switch to a reflective mode of operation if the level of ambient infrared radiation does not exceed both the first threshold and a second threshold, wherein the switching between the shadow mode and the reflective mode changes an angle of illumination of the object;

detect a second shape of the object while in the reflective mode of operation;

analyze the detected first and second shapes; and

determine a three-dimensional shape of the object based at least in part on the analysis of the first and second shapes;

taken together with the other elements of the claim.

11. The touch panel system according to claim 10, wherein the control element comprises:

a processor; and

a memory to store executable instructions configured to cause the processor to monitor signals from the infrared sensors and switch between the reflective mode of operation and the shadow mode of operation for at least a portion of the touch panel based on the monitored signals.

12. The touch panel system according to claim 11, further comprising an array of infrared sources, wherein the memory is further configured to stored executable instructions configured to cause the processor, in the reflective mode of operation, to:

scan the touch panel; and

on detection of a touch event at an infrared sensor, illuminate infrared sources of the array of infrared sources that are in proximity to the infrared sensor.

13. The touch panel system according to claim 11, further comprising:

a red light emitting diode (LED) placed behind the infrared sensors;

a green LED placed behind the infrared sensors;

a blue LED placed behind the infrared sensors; and

an infrared LED placed behind the infrared sensors.

14. The touch panel system according to claim 13, further comprising:

a red color filter placed above the infrared sensors; and

a blue color filter placed above the infrared sensors.

15. The touch panel system according to claim 14, further comprising a plurality of pixel electrodes placed adjacent the infrared sensors.

16. The touch panel system according to claim 15, further comprising an Infrared-transmitting polymer black matrix polymer filter located above the infrared sensors.

17. The touch panel system according to claim 10, wherein the control element is further configured to:

determine that a battery level is below a predetermined limit while the level of ambient infrared radiation exceeds the second threshold and not the first threshold;

switch to the shadow mode of operation after the battery level drops below the predetermined limit; and

switch to the reflective mode of operation after the battery level rises above the predetermined limit.

18. A method of operating a touch panel system for detecting an object in proximity with a touchable surface of the touch panel system, the method comprising:

detecting a level of ambient infrared light over a portion of the touchable surface;

selecting between a first mode of operation and a second mode of operation for a region of a touch panel according to the level of ambient infrared light, wherein the first mode comprises detecting the object by detecting infrared radiation reflected from the object and wherein the second mode comprises detecting the object by detecting ambient infrared radiation;

switching to the second mode of operation after the level of ambient infrared radiation surpasses a threshold;

detecting a first shape of the object while in the second mode of operation;

switching to the first mode of operation after the level of ambient infrared radiation drops below the threshold, wherein the switching between the first mode and the second mode changes an angle of illumination of the object adjacent the touch panel;

detecting a second shape of the object while in the first mode of operation;

analyzing the detected first and second shapes; and

determining a three-dimensional shape of the object based at least in part on the analysis of the first and second shapes.

19. The method according to claim 18, wherein the touch panel system further comprises a plurality of groups of infrared sources configured to illuminate the object with infrared radiation through the touchable surface, the method further comprising, in the first mode of operation:

switching at least two of the groups of infrared sources on and off sequentially, wherein the switching between the at least two of the groups of infrared sources changes the angle of illumination of the object;

detecting a third shape of the object when one of the groups of infrared sources is switched on;

detecting a fourth shape of the object when another of the groups of infrared sources is switched on;

analyzing the detected third and fourth shapes; and

determining a three-dimensional shape of the object based at least in part on the analysis of the third and fourth shapes.

20. The method according to claim 18, wherein the touch panel system further comprises at least one infrared source that is configured to move in position, wherein movement of the at least one infrared source changes the angle of illumination of the object, the method further comprising, in the first mode of operation:

detecting a third shape of the object with the at least one infrared source in a first position;

moving the at least one infrared source from the first position to a second position;

detecting a fourth shape of the object with the at least one infrared source in the second position;

analyzing the detected third and fourth shapes; and

determining a three-dimensional shape of the object based at least in part on the analysis of the third and fourth shapes.