Single camera display device detection

• US 8,674,965 B2
• Filed: 11/18/2010
• Issued: 03/18/2014
• Est. Priority Date: 11/18/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Large, Timothy, Travis, Adrian
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): LAM, NELSON C
• Application Number:
  US12/949,529
• Publication Number:
  US 20120127127A1
• Time in Patent Office: 1,216 Days
• Field of Search: 345173-179
• US Class Current: 345/175
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

Various embodiments related to determining a distance of an object from a surface of an interactive display device are disclosed herein. For example, one disclosed embodiment provides a method comprising, directing infrared (IR) light to the object above the surface which is reflected by the object back to the interactive display device, and refracting IR light reflected from the object into two rays travelling in different directions based on a polarization state of the reflected IR light. The method further comprises switching a polarization state of an LCD device to allow one of the two refracted rays to pass through the LCD device, and receiving, at a detector, the one of the two refracted ray that passes through the LCD device. Further, the method comprises estimating a distance of the object from the surface based on triangulation.

Claims

1. A method for determining a distance of an object from a surface of an interactive display device with a liquid crystal display (LCD) device, the method comprising:

directing infrared (IR) light to the object above the surface of the interactive display device, the IR light being reflected by the object back to the interactive display device;

refracting IR light reflected from the object into two rays travelling in two different directions based on a polarization state of the reflected IR light;

switching a polarization state of the LCD device to allow a first of the two refracted rays to pass through the LCD device;

receiving, at a detector, the first of the two refracted rays that passes through the LCD device;

switching the polarization state of the LCD device to allow a second of the two refracted rays to pass through the LCD device;

receiving, at the detector, the second of the two refracted rays that passes through the LCD device; and

estimating the distance of the object from the surface of the interactive display device based on triangulation.

2. The method of claim 1, wherein the IR light reflected from the object is refracted into the two rays travelling in two different directions by a birefringent prism.

3. The method of claim 2, wherein the birefringent prism includes a sawtooth-shaped region which is filled with a liquid crystal material, the sawtooth-shaped region having a height equivalent to a multiple of a wavelength of the reflected IR light divided by a birefringence of the birefringent prism.

4. The method of claim 2, wherein a direction of travel of the first of the two refracted rays remains unchanged by the birefringent prism and a direction of travel of the second of the two refracted rays is changed by the birefringent prism.

5. The method of claim 1, wherein the LCD device includes an LCD and a polarizer, and switching the polarization state of the LCD includes applying a voltage to the LCD such that the LCD rotates a polarization of a ray passing through the LCD.

6. The method of claim 1, wherein the detector is a camera, and an image generated from the second of the two refracted rays is shifted from an image generated from the first of the two refracted rays based on a difference in direction of travel between the two refracted rays.

7. An interactive display device with a computing system, comprising:

a display subsystem of the computing system configured to display an image on a surface of the interactive display device with which a user interacts;

a vision subsystem of the computing system configured to detect an object above the surface of the interactive display device;

an optical system, comprising;

an infrared (IR) light source which directs IR light toward the object;

a birefringent prism configured to split an incoming ray of IR light reflected from the object into two rays of light travelling in two different directions based on a polarization state of the incoming ray of IR light;

a liquid crystal display (LCD) device including an LCD and a polarizer;

a wedge-shaped light guide; and

a detector coupled to an end of the wedge-shaped light guide; and

a computer-readable device comprising instructions executable by the computing system to switch a polarization state of the LCD so that IR light in one polarization state passes through the LCD while IR light in another polarization state is absorbed by the LCD, and to estimate a distance of the object from the surface of the interactive display device based on triangulation.

8. The interactive display device of claim 7, wherein the wedge-shaped light guide focuses an image generated from IR light passing through the LCD device on the detector, the detector coupled to a wide end of the wedge-shaped light guide.

9. The interactive display device of claim 7, wherein the birefringent prism splits the incoming ray of IR light into an ordinary ray and an extraordinary ray, and a direction of travel of the ordinary ray is unchanged and a direction of travel of the extraordinary ray is shifted from that of the ordinary ray.

10. The interactive display device of claim 9, wherein triangulation is carried out by the computing system based on a shift in an image generated by the detector for the extraordinary ray from an image generated by the detector for the ordinary ray.

11. The interactive display device of claim 7, wherein the birefringent prism includes a sawtooth-shaped region filled with a liquid crystal material, the sawtooth-shaped region having a peak-to-valley height equivalent to a multiple of one wavelength of the incoming ray of IR light divided by a birefringence of the birefringent prism, the incoming ray of IR light being the ray of IR light reflected from the object above the surface of the interactive display device.

12. The interactive display device of claim 7, further comprising a switchable diffuser made of polymer dispersed liquid crystal, and the computer-readable device further comprising instructions for switching the switchable diffuser between a diffuse state and a non-diffuse state.

13. The interactive display device of claim 12, wherein, in the diffuse state, the display subsystem is active to display the image on the surface of the interactive display device and, in the non-diffuse state, the vision subsystem is active to detect a location of an object on or above the surface of the interactive display device.

14. The interactive display device of claim 12, wherein the display subsystem comprises a display backlight configured to illuminate the LCD device by directing visible light toward the LCD device, and the computer-readable device further comprises instructions for switching the display backlight on during the diffuse state of the switchable diffuser and turning the display backlight off during the non-diffuse state of the switchable diffuser.

15. An interactive display device, comprising:

an infrared light source positioned to emit light away from a surface of the interactive display device and toward an object positioned above the surface of the interactive display device;

a birefringent prism which includes a sawtooth-shaped region that is filled with liquid crystal, the birefringent prism configured to cause an incoming ray of light reflected from the object above the surface of the interactive display device to be refracted into two rays travelling in different directions based on a polarization state of the incoming ray of light reflected from the object;

a liquid crystal display (LCD) device positioned below the birefringent prism, the LCD device including an LCD and a polarizer;

a wedge-shaped light guide positioned below the LCD device;

a camera positioned at a wide end of the wedge-shaped light guide so that the camera receives refracted rays of light from the birefringent prism; and

a computer-readable device comprising instructions executable by a computing device to switch a polarization state of the LCD so that light in one polarization state passes through the LCD while light in another polarization state is absorbed by the LCD, and to estimate a distance of the object from the surface of the interactive display device based on triangulation.

16. The interactive display device of claim 15, wherein the birefringent prism splits the incoming ray of light into an ordinary ray and an extraordinary ray, and a direction of travel of the ordinary ray is unchanged and a direction of travel of the extraordinary ray is shifted from that of the ordinary ray.

17. The interactive display device of claim 16, wherein an image generated by the camera from the extraordinary ray is shifted from an image generated by the camera from the ordinary ray based on a shift of the extraordinary ray from the ordinary ray.

18. The interactive display device of claim 15, further comprising a switchable diffuser positioned above the birefringent prism configured to switch between a non-diffuse state through which IR light passes and a diffuse state through which visible light passes.

19. The interactive display device of claim 18, further comprising a display backlight positioned below the wedge-shaped light guide configured to illuminate the LCD device by directing visible light toward the LCD device, and wherein the computer-readable device further comprises instructions for switching the display backlight on during the diffuse state of the switchable diffuser and turning the display backlight off during the non-diffuse state of the switchable diffuser.

20. The interactive display device of claim 19, wherein the computer-readable device further comprises instructions for opening a shutter of the camera during the non-diffuse state when the backlight is off and closing the shutter of the camera during the diffuse state when the backlight is on.