COMPUTER VISION-BASED MULTI-TOUCH SENSING USING INFRARED LASERS

• US 20090278799A1
• Filed: 05/12/2008
• Published: 11/12/2009
• Est. Priority Date: 05/12/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wilson, Andrew David
• Granted Patent: US 8,952,894 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

The claimed subject matter provides a system and/or a method that facilitates detecting a plurality of inputs simultaneously. A laser component can be coupled to a line generating (LG) optic that can create a laser line from an infrared (IR) laser spot, wherein the laser component and line generating (LG) optic emit a plane of IR light. A camera device can capture a portion of imagery within an area covered by the plane of light. The camera device can be coupled to an IR-pass filter that can block visible light and pass IR light in order to detect a break in the emitted plane of IR light. An image processing component can ascertain a location of the break within the area covered by the emitted plane of IR light.

Claims

1. A system that facilitates detecting input, comprising:

a laser component coupled to a line generating (LG) optic that creates a laser line from an infrared (IR) laser spot, the laser component and line generating (LG) optic emit a plane of IR light;

a camera device that captures a portion of imagery within an area covered by the plane of light;

the camera device is coupled to an IR-pass filter that blocks visible light and passes IR light in order to detect a break in the emitted plane of IR light; and

an image processing component that ascertains a location of the break within the area covered by the emitted plane of IR light.

2. The system of claim 1, the image processing component calculates at least one of a size of the break or a shape of the break based at least in part upon the detected break captured by the camera device.

3. The system of claim 1, the image processing component maps the location of the break of the plane of IR light to a corresponding location on a display.

4. The system of claim 3, the display is at least one of a monitor, a television, a liquid crystal display (LCD), a plasma, a rear-projection display, a front-projection display, a cathode ray tube (CRT) monitor, a flat-panel, a display for a computing device, a portable digital assistance (PDA) screen, a laptop display, a computer monitor, a smartphone display, a cellular device screen, a mobile communication device display, or a portable gaming device display.

5. The system of claim 1, the laser component and the LG optic transmit the plane of IR light substantially parallel to a substantially flat surface.

6. The system of claim 5, the substantially flat surface relates to at least one of a display, a desk, a table, a wall, a television, a laptop, a floor, a ceiling, a section of the ground, a section of concrete, a piece of wood, a chalkboard, a projection screen, a motor vehicle windshield, a motor vehicle window, a motor vehicle dashboard, a substantially flat surface associated with a device, a substantially flat surface related to a vehicle, or a tray on an airplane.

7. The system of claim 5, further comprising a plurality of laser components with at least one LG optic coupled thereto, the plurality of laser components are oriented to emit a plane of IR light covering an area of the substantially flat surface.

8. The system of claim 1, the image processing component tracks the detected break in the plane of IR light in real time.

9. The system of claim 1, the image processing component receives a captured image from the break in the plane of IR light and employs an image processing technique to re-create the shape and the size of the break on a corresponding location on a display, the corresponding location on the display is a mapped coordinate representative of the location for the detected break.

10. The system of claim 1, the break in the plane of IR light is a reflection from an object that absorbs a portion of the plane of IR light, the break is caused by at least one of a touch event, a gesture, a motion, or an object.

11. The system of claim 1, further comprising an infrared (IR) modulation component that compensates for a portion of IR light that is not generated by at least one of the laser component or the LG optic.

12. The system of claim 11, the IR modulation component controls the laser a sequence of an “

OFF”

command and an “

ON”

command while the camera device captures the following;

a first collection of IR light including the portion of IR light not generated by the laser component during the “

OFF”

command; and

a second collection of IR light including the plane of IR light and a portion of IR light not generated by the laser component during the “

ON”

command.

13. The system of claim 12, the IR modulation component identifies the portion of IR light not generated by the laser component by subtracting the second collection of IR light and the first collection of IR light, the portion of IR light not generated by the laser component is filtered out from the camera device.

14. The system of claim 1, further comprising an application framework that leverages the ascertained location of the break in the plane of IR light for at least one of a data input or data interaction.

15. The system of claim 14, the application framework includes at least one of a portion of software, a portion of hardware, or a combination of a portion of software and a portion of hardware, wherein the application framework receives a portion of data related to a detected break in the plane of IR light in order to enable data interaction.

16. The system of claim 15, the application framework utilizes surface computing techniques with a touch-sensitive screen in which touch detection is provided by the captured break in the plane of IR light.

17. A computer-implemented method that facilitates enabling multiple touch interactions with a display, comprising:

generating a plane of laser light with at least one of the following characteristics;

a brightness level for the plane of laser light that is visible to a user;

or the plane of laser light is generated within an environment having a darkness level that allows the laser light to be visible to a user;

receiving a portion of data related to a detection of at least one break in the plane of emitted laser light;

calculating a location of the break in the plane of emitted laser light;

ascertaining at least one of a size of the break in the plane of emitted laser light or a shape of the break in the plane of laser light; and

mapping the location, the size, and the shape of the break in the plane of emitted laser light to the display.

18. The method of claim 17, further comprising:

emitting the plane of laser light substantially parallel to a surface; and

tracking the at least one break in the plane of laser light in real time.

19. The method of claim 18, further comprising:

receiving the mapped location, size, and shape of the break in the plane of emitted laser light with an application framework; and

utilizing the application framework to interact with data based upon the data input detected by the break in the plane of emitted laser light, the application framework employs at least one surface computing technique.

20. A computer-implemented system that facilitates, comprising:

means for emitting a plane of IR light substantially parallel to a surface;

means for tracking at least one break in the plane of IR light in real time

means for receiving a portion of data related to a detection of the at least one break in the plane of emitted infrared (IR) light;

means for calculating a location of the break in the plane of emitted IR light;

means for ascertaining at least one of a size of the break in the plane of emitted IR light or a shape of the break in the plane of IR light;

means for mapping the location, the size, and the shape of the break in the plane of emitted IR light to a display;

means for eliminating a portion of IR light not generated by the means for emitting the plane of IR light;

means for utilizing the break in the plane of IR light to interact with a portion of data; and

means for employing a surface computing technique in connection with the portion of data related to the detection of the at least one break in the plane of IR light.