Input method for surface of interactive display

• US 8,519,952 B2
• Filed: 02/23/2011
• Issued: 08/27/2013
• Est. Priority Date: 08/31/2005
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Yee, Dawson
• Primary Examiner(s): Amadiz, Rodney
• Application Number:
  US13/032,877
• Publication Number:
  US 20110181551A1
• Time in Patent Office: 916 Days
• Field of Search: 345 11- 13, 345156-184
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

An interactive display system configured for detecting an object or user input provided with an object. The system includes a display surface on which graphic images are displayed, one or more scanning light sources configured for scanning the interactive display surface, and a light detector configured for detecting light reflected from an object that is adjacent to or in contact with the interactive display surface. A computing system storing machine instructions is in communication with the scanning light source and the light detector. When executed, the machine instructions cause the computing system to illuminate the interactive display surface with the scanning light source, to detect light with the light detector that is reflected from an object after illumination with the light source, and to generate an output signal based on the detected light that has been reflected from an object on or adjacent to the interactive display surface.

Claims

1. A method for detecting an object or user input provided with an object using a scanning light source, comprising the steps of:

illuminating an interactive display surface with at least one scanning light source, wherein the interactive display surface has an external surface and an internal surface, wherein the at least one scanning light source is configured to emit light of a predetermined wavelength and scan interactive display surface with the light of the predetermined wavelength, so that the entire interactive display surface is fully scanned over time, and wherein illuminating the interactive display surface includes the at least one scanning light source emitting the light through a photosensitive light surface toward the interactive display surface; and

detecting light of the predetermined wavelength that is reflected from an object that is on or proximate the external surface of the interactive display surface, the light that is reflected being detected as the at least one scanning light source is illuminating the object with the light of the predetermined wavelength, and wherein the photosensitive light surface acts as a detector for the predetermined wavelength reflected from the object.

2. The method recited in claim 1, wherein each of the at least one scanning light source is configured to emit light radiation of the predetermined wavelength in the infra-red spectrum.

3. The method recited in claim 1, wherein the photosensitive light surface is adjacent the internal surface of the interactive display surface.

4. The method recited in claim 1, wherein the photosensitive light surface is the only light detector used in detecting light of the predetermined wavelength.

5. The method recited in claim 1, further comprising:

combining an output from detecting light of the predetermined wavelength in regions corresponding to each of the at least one scanning light source, such that a composite output is provided for the entire interactive display surface.

6. The method recited in claim 1, wherein illuminating the interactive display surface comprises using at least one scanning light source having a spatially small-sized cross-sectional beam concentrated in a small area rather than over a wide area.

7. The method recited in claim 1, wherein illuminating the interactive display surface comprises a detector configured to detect light of the predetermined wavelength that is reflected from the object.

8. The method recited in claim 1, wherein at least one scanning light source comprises a raster scanning emitter light source with a collimated beam diameter.

9. At least one computer-readable storage device having stored thereon computer executable instructions that, when executed by one or more processors associated with an interactive display table, cause the interactive display table to detect an object or user input provided with an object using a scanning light source by performing at least:

illuminating an interactive display surface with at least one scanning light source, wherein the interactive display surface has an external surface and an internal surface, wherein the at least one scanning light source is configured to emit light of a predetermined wavelength and scan interactive display surface with the light of the predetermined wavelength, so that the entire interactive display surface is fully scanned over time, and wherein illuminating the interactive display surface includes the at least one scanning light source emitting the light through a photosensitive light surface toward the interactive display surface; and

detecting light of the predetermined wavelength that is reflected from an object that is on or proximate the external surface of the interactive display surface, the light that is reflected being detected as the at least one scanning light source is illuminating the object with the light of the predetermined wavelength, and wherein the photosensitive light surface acts as a detector for the predetermined wavelength reflected from the object.

10. The at least one computer-readable storage device recited in claim 9, wherein each of the at least one scanning light source is configured to emit light radiation of the predetermined wavelength in the infra-red spectrum.

11. The at least one computer-readable storage device recited in claim 9, wherein the photosensitive light surface is adjacent the internal surface of the interactive display surface.

12. The at least one computer-readable storage device recited in claim 9, wherein the photosensitive light surface is the only light detector used in detecting light of the predetermined wavelength.

13. The at least one computer-readable storage device recited in claim 9, wherein the interactive display table is further caused to perform:

combining an output from detecting light of the predetermined wavelength in regions corresponding to each of the at least one scanning light source, such that a composite output is provided for the entire interactive display surface.

14. The at least one computer-readable storage device recited in claim 9, wherein illuminating the interactive display surface comprises using at least one scanning light source having a spatially small-sized cross-sectional beam concentrated in a small area rather than over a wide area.

15. The at least one computer-readable storage device recited in claim 9, wherein illuminating the interactive display surface comprises a detector configured to detect light of the predetermined wavelength that is reflected from the object.

16. The at least one computer-readable storage device recited in claim 9, wherein at least one scanning light source comprises a raster scanning emitter light source with a collimated beam diameter.

17. An interactive display table for detecting an object on or adjacent to a user interface surface, comprising:

an interactive display surface having an internal surface and an external surface;

at least one scanning light source, each of the at least one scanning light source being configured for emitting light of a predetermined wavelength to thereby scan the interactive display surface with the light of the predetermined wavelength, so that the entire interactive display surface is fully scanned at least over time; and

at least one photosensitive light surface arranged to receive light emitted from the at least one scanning light source as directed to the interactive display surface, and to detect light reflected back from the interactive display surface and/or an object on or near the interactive display surface, the at least one photosensitive light surface comprising a detector for the predetermined wavelength of reflected light.

18. The interactive display table recited in claim 17, wherein the at least one photosensitive light surface is adjacent the internal surface of the interactive display surface.

19. The interactive display table of claim 17, wherein the at least one photosensitive layer is a photo transistor array.

20. The interactive display table of claim 17, further comprising a computing system configured to receive an output from the detector and detect each of:

a type of specific object that is adjacent to or in contact with the interactive display surface based on a characteristic of the object determined from light reflected by the object;

a size of the specific object;

a shape of the specific object;

a trajectory of the specific object over time;

an orientation of the specific object; and

a characteristic associated with the specific object based upon parameters of the light reflected from the specific object.