Infrared sensor integrated in a touch panel

• US 8,780,088 B2
• Filed: 04/01/2013
• Issued: 07/15/2014
• Est. Priority Date: 11/27/2006
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Boer, Willem den, Bathiche, Steven N., Hodges, Stephen Edward, Izadi, Shahram
• Primary Examiner(s): Lao, Lun-Yi
• Assistant Examiner(s): Hegarty, Kelly B
• Application Number:
  US13/854,745
• Publication Number:
  US 20130215086A1
• Time in Patent Office: 470 Days
• Field of Search: 345/173, 345/175, 345/207, 345/211, 178/18.09
• US Class Current: 345/175
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06V 40/1318 using electro-optical elements or layers, e.g. electroluminescent sensing

Abstract

An infrared source is configured to illuminate the underside of one or more objects on or above a touchable surface of a touch panel. Infrared light reflected from the underside of the object(s) is detected by an infrared sensor integrated in the touch panel below the touchable surface.

Claims

1. A touch panel system comprising:

a touchable surface;

a backlight including visible light sources and at least one infrared source, wherein the at least one infrared source is configured to direct infrared radiation through the touchable surface for illuminating objects that are in contact with or adjacent to the touchable surface with infrared radiation;

a touch panel display configured to illuminate pixels for visibly displaying an image, the touch panel display comprising;

a matrix circuit including pixel circuit elements; and

infrared sensors that are integrated in the matrix circuit with the pixel circuit elements and distributed parallel to the touchable surface, wherein;

the infrared sensors are configured to detect reflected infrared radiation incident on the infrared sensors,

infrared radiation directed by the at least one infrared source through the touchable surface is not detected by the infrared sensors, and

the infrared sensors are shielded from visible light emitted by the visible light sources and visible light radiated by the pixels via filters located between the touchable surface and each of the infrared sensors; and

a computing device coupled to the touch panel display for processing reflected infrared radiation detected by the infrared sensors, wherein the computing device is configured to;

cause a multi-player game to be displayed by the touch panel display,

process reflected infrared radiation detected by the infrared sensors that is directed through the touchable surface by different physical game pieces which are in contact with the touchable surface and which are associated with different players of the multi-player game,

identify and distinguish between the different physical game pieces,

detect locations of the different physical game pieces, and

alter display of the multi-player game based on the locations of the different physical game pieces.

2. The touch panel system of claim 1, wherein:

the reflected infrared radiation detected by the infrared sensors is processed to identify and distinguish between the different physical game pieces by shape.

3. The touch panel system of claim 1, wherein:

the computing device identifies and distinguishes the different physical game pieces based on symbols or codes imprinted on the different physical game pieces.

4. The touch panel system of claim 1, wherein the touch panel display is a liquid crystal display.

5. The touch panel system of claim 4, wherein the liquid crystal display comprises one of an active matrix backplane, an active matrix frontplane, a passive matrix backplane, and a passive matrix frontplane.

6. The touch panel system of claim 1, wherein the touch panel display is an organic light emitting diode display.

7. The touch panel system of claim 6, wherein the at least one infrared source is an organic light emitting diode.

8. The touch panel system of claim 6, wherein the infrared sensors comprise organic photosensors.

9. The touch panel system of claim 1, wherein the infrared sensors comprise thin film transistors.

10. The touch panel system of claim 1, wherein the infrared sensors comprise photodiodes.

11. A touch panel display comprising:

a touchable surface;

a plurality of pixels for visibly displaying an image on the touchable surface;

a color backlight comprising a plurality of color light sources for emitting visible light;

at least one infrared source configured to direct infrared radiation through the touchable surface for illuminating one or more objects that are in contact with or adjacent to the touchable surface with infrared radiation;

a backplane including pixel circuit elements;

infrared sensors that are integrated in the backplane with the pixel circuit elements and distributed parallel to the touchable surface, wherein;

the infrared sensors are configured to detect reflected infrared radiation incident on the infrared sensors,

infrared radiation directed by the at least one infrared source through the touchable surface is not detected by the infrared sensors, and

the infrared sensors are shielded from visible light emitted by the color light sources and visible light radiated by the pixels via filters located between the touchable surface and each of the infrared sensors; and

a computing device for processing reflected infrared radiation detected by the infrared sensors, wherein the computing device is configured to;

cause a game to be displayed on the touchable surface,

process reflected infrared radiation detected by the infrared sensors that is directed through the touchable surface by different physical game pieces which are in contact with the touchable surface,

identify the different physical game pieces based on symbols or codes imprinted on the different physical game pieces, and

alter display of the game on the touchable surface.

12. The touch panel display of claim 11, wherein the touchable surface is implemented by a liquid crystal display.

13. The touch panel display of claim 11, wherein the touchable surface is implemented by an organic light emitting diode display.

14. The touch panel display of claim 13, wherein the infrared sensors comprise organic photosensors.

15. The touch panel display of claim 11, wherein the infrared sensors comprise thin film transistors.

16. The touch panel display of claim 11, wherein the infrared sensors comprise photodiodes.

17. The touch panel display of claim 11, wherein the computing device causes a video clip to be displayed on the touchable surface in response to positioning a physical game piece at a certain location on the touchable surface.

18. A method performed in a touch panel system, the method comprising:

emitting visible light from a backlight of the touch panel system;

visibly displaying a game on a touchable surface of a touch panel display by illuminating pixels of the touch panel display;

directing infrared radiation from at least one infrared source integrated in the touch panel system through the touchable surface for illuminating different physical game pieces that are in contact with the touchable surface with infrared radiation;

detecting reflected infrared radiation incident on infrared sensors which are integrated in the touch panel display with pixel circuit elements and distributed parallel to the touchable surface, wherein;

infrared radiation directed by the at least one infrared source through the touchable surface is not detected by the infrared sensors, and

the infrared sensors are shielded from visible light emitted by the backlight and visible light radiated by the pixels via filters located between the touchable surface and each of the infrared sensors; and

processing reflected infrared radiation that is directed through the touchable surface by the different physical game pieces and detected by the infrared sensors to;

identify the different physical game pieces based on symbols or codes imprinted on the different physical game pieces, and

alter display of the game on the touchable surface of the touch panel display.

19. The method of claim 18, wherein:

the different physical game pieces are associated with different players of a multi-player game.

20. The method of claim 18, wherein a video clip is displayed on the touchable surface in response to positioning a physical game piece at a certain location on the touchable surface.