Compact Interactive Tabletop With Projection-Vision

• US 20100066675A1
• Filed: 09/04/2009
• Published: 03/18/2010
• Est. Priority Date: 02/28/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wilson, Andrew D., Bathiche, Steven
• Granted Patent: US 7,970,211 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G03B 21/008 using micromirror devices
• CPC Class Codes: G03B 29/00 Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects combinations with flash apparatus G03B15/03
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

The subject application relates to a system(s) and/or methodology that facilitate vision-based projection of any image (still or moving) onto any surface. In particular, a front-projected computer vision-based interactive surface system is provided which uses a new commercially available projection technology to obtain a compact, self-contained form factor. The subject configuration addresses installation, calibration, and portability issues that are primary concerns in most vision-based table systems. The subject application also relates to determining whether an object is touching or hovering over an interactive surface based on an analysis of a shadow image.

Claims

1. A method that facilitates determining whether a finger is touching or hovering over an interactive surface in connection with a projection-vision system comprising:

observing a finger shadow as the finger shadow appears on an interactive surface;

computing at least one shadow image; and

determining whether the at least one finger is touching or hovering over the surface based on an analysis of the shadow image.

2. The method of claim 1 further comprises triggering content to appear on the surface when at least one of a touch or hovering is determined.

3. The method of claim 1 further comprises interacting with content on the surface via touching the surface.

4. The method of claim 1 further comprises determining whether the finger is touching or hovering over the interactive surface based on when the finger and the finger shadow are matched to yield one image.

5. A method implemented on a projection-vision system, the method comprising:

sensing an object over an interactive surface;

projecting a shadow of the object on the interactive surface; and

detecting whether the object is touching or hovering over the interactive surface by examining a change in an appearance of a shadow image.

6. The method of claim 5, further comprising detecting the object is touching the interactive surface based at least in part on the object and the shadow of the object is binarized to yield one image.

7. The method of claim 5, further comprising calculating a height of the object over the interactive surface when the object and the shadow of the object are matched to yield one image.

8. The method of claim 6, further comprising using the height as a hover signal for a cursor control or a 3D cursor control.

9. The method of claim 5, further comprises determining the object is touching or hovering over the interactive surface to open a button control panel or a window, such as when a finger is determined to hover or touch a designated area of the interactive surface.

10. The method of claim 5, further comprises determining the object is touching or hovering over the interactive surface, a hovering finger triggers a button panel to appear and a finger touch presses the button panel.

11. The method of claim 5, further comprising detecting the object is not touching the interactive surface based at least in part on the object and the shadow of the object yield two images.

12. A projection-vision system that facilitates determining whether an object is touching or hovering over an interactive surface, the system comprising:

a projector;

a camera mounted to the projector to create the interactive surface;

a image component to determine whether an object is touching or hovering over the interactive surface by;

tracking whether the object is touching or hovering over the interactive surface;

computing a shadow of the object appearing on the interactive surface; and

determining whether the object is touching or hovering over the interactive surface based on an analysis of a shadow image.

13. The system of claim 12, further comprising:

an infrared illuminant mounted to the projector and to the camera; and

the interactive surface to receive projections from the infrared illuminant, wherein the illuminant is positioned off axis from the camera so that objects above the interactive surface generate shadows to indicate a height.

14. The system of claim 13, wherein the height comprises being used as a hover signal for a cursor control or a 3D cursor control.

15. The system of claim 12, further comprising a shadow analysis component to compute a shadow of the object appearing on the interactive surface.

16. The system of claim 12, further comprising a shadow analysis component to compute a shadow image of at least one finger on the projection surface to determine whether the finger is touching or hovering over the surface.

17. The system of claim 12, further comprising a shadow analysis component that binarizes the input image to yield at least one shadow image.

18. The system of claim 12, further comprises determining the object is touching or hovering over the interactive surface to open a button control panel or a window such as when a finger is determined to hover or touch a designated area of the interactive surface.

19. The system of claim 12, further comprises determining the object is touching or hovering over the interactive surface, a hovering finger triggers a button panel to appear and a finger touch presses the button panel.

20. The system of claim 12, further comprising detecting the object is not touching the interactive surface based at least in part on the object and the shadow of the object yield two images.