Compact interactive tabletop with projection-vision

• US 7,970,211 B2
• Filed: 09/04/2009
• Issued: 06/28/2011
• Est. Priority Date: 02/28/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Bathiche, Steven N, Wilson, Andrew David
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US12/554,827
• Publication Number:
  US 20100066675A1
• Time in Patent Office: 662 Days
• Field of Search: 382/100, 382/151, 382/190, 382/199, 382/286, 382/293, 382/294, 382/295, 382/296, 345/156, 345/157, 345/158, 348/744
• US Class Current: 382/190
• CPC Class Codes: G03B 21/008 using micromirror devices
• CPC Class Codes: G03B 29/00 Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects combinations with flash apparatus G03B15/03
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

The subject application relates to a system(s) and/or methodology that facilitate vision-based projection of any image (still or moving) onto any surface. In particular, a front-projected computer vision-based interactive surface system is provided which uses a new commercially available projection technology to obtain a compact, self-contained form factor. The subject configuration addresses installation, calibration, and portability issues that are primary concerns in most vision-based table systems. The subject application also relates to determining whether an object is touching or hovering over an interactive surface based on an analysis of a shadow image.

Claims

1. A method comprising:

observing, by a projection-vision system implemented by one or more processors configured with executable instructions, a finger shadow by a projection-vision system, as the finger shadow appears on an interactive surface;

computing at least one shadow image by the projection-vision system based on the observing the finger shadow; and

determining, by the projection-vision system, whether the at least one finger is touching or hovering over the interactive surface based on an analysis of the at least one shadow image.

2. The method of claim 1 further comprising triggering content to appear on the interactive surface when at least one of a touch or hovering is determined.

3. The method of claim 1 further comprising interacting with content on the interactive surface via touching the interactive surface.

4. The method of claim 1 further comprising determining whether the at least one finger is touching or hovering over the interactive surface based on when the at least one finger and the finger shadow are matched to yield one image.

5. A method comprising:

sensing, by a projection-vision system implemented by one or more processors configured with executable instructions, an object over an interactive surface;

projecting, by the projection-vision system, a shadow of the object on the interactive surface based on the sensing the object; and

detecting, by the projection-vision system, whether the object is touching or hovering over the interactive surface by examining a change in an appearance of a shadow image.

6. The method of claim 5, further comprising detecting the object is touching the interactive surface based at least in part on the object and the shadow of the object are binarized to yield one image.

7. The method of claim 5, further comprising calculating a height of the object over the interactive surface when the object and the shadow of the object are matched to yield one image.

8. The method of claim 7, further comprising using the height as a hover signal for a cursor control or a 3D cursor control.

9. The method of claim 5, wherein the object is a finger further comprising determining the finger is touching or hovering over the interactive surface to open a button control panel or a window, wherein:

the finger is determined to hover, or

the finger is to touch a designated area of the interactive surface.

10. The method of claim 5, wherein the object is a finger, further comprising determining the finger is touching or hovering over the interactive surface, wherein:

a hovering finger triggers a button panel to appear, and

a finger touch presses the button panel.

11. The method of claim 5, further comprising detecting the object is not touching the interactive surface based at least in part on the object and the shadow of the object yielding two images.

12. A projection-vision system comprising:

a projector;

a camera mounted to the projector to create the interactive surface;

one or more processors in communication with the camera;

an image component implemented by the one or more processors to determine whether an object is touching or hovering over an interactive surface by;

tracking whether the object is touching or hovering over the interactive surface;

computing a shadow of the object appearing on the interactive surface; and

determining whether the object is touching or hovering over the interactive surface based on an analysis of a shadow image.

13. The system of claim 12, further comprising:

an infrared illuminant mounted to the projector and to the camera; and

the interactive surface to receive projections from the infrared illuminant, wherein the infrared illuminant is positioned off axis from the camera so that objects above the interactive surface generate shadows to indicate a height.

14. The system of claim 13, wherein the height comprises being used as a hover signal for a cursor control or a 3D cursor control.

15. The system of claim 12, further comprising a shadow analysis component to compute the shadow of the object appearing on the interactive surface.

16. The system of claim 12, further comprising a shadow analysis component to compute a shadow image of at least one finger on a projection surface to determine whether the finger is touching or hovering over the projection surface.

17. The system of claim 12, further comprising a shadow analysis component that binarizes an input image to yield at least one shadow image.

18. The system of claim 12, wherein the object is a finger, further comprising determining whether the finger is touching or hovering over the interactive surface to open a button control panel or a window, wherein:

the finger is determined to hover, or

the finger is to touch a designated area of the interactive surface.

19. The system of claim 12, wherein the object is a finger, further comprising determining the finger is touching or hovering over the interactive surface, wherein:

a hovering finger triggers a button panel to appear, and

a finger touch presses the button panel.

20. The system of claim 12, wherein the object is a finger, further comprising detecting the finger is not touching the interactive surface based at least in part on the object and the shadow of the object yielding two images.