Compact interactive tabletop with projection-vision

• US 7,599,561 B2
• Filed: 02/28/2006
• Issued: 10/06/2009
• Est. Priority Date: 02/28/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wilson, Andrew D., Bathiche, Steven
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US11/363,750
• Publication Number:
  US 20070201863A1
• Time in Patent Office: 1,316 Days
• Field of Search: 382/100, 382/151, 382/199, 382/286, 382/294, 382/295, 382/296, 382/293, 382/276, 396/429
• US Class Current: 382/199
• CPC Class Codes: G03B 21/008 using micromirror devices
• CPC Class Codes: G03B 29/00 Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects combinations with flash apparatus G03B15/03
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

The subject application relates to a system(s) and/or methodology that facilitate vision-based projection of any image (still or moving) onto any surface. In particular, a front-projected computer vision-based interactive surface system is provided which uses a new commercially available projection technology to obtain a compact, self-contained form factor. The subject configuration addresses installation, calibration, and portability issues that are primary concerns in most vision-based table systems.

Claims

1. A projection-vision system that facilitates sensing and projecting objects as images, comprising:

a projection surface on which at least one visual coded image is presented; and

an object sensing component, executed by a processor and stored in memory, that detects that the visual coded image is present on the projection surface by;

computing an edge intensity and edge orientation for each pixel in the at least one visual coded image;

using the edge intensity and edge orientation to determine code values for each pixel; and

obtaining a candidate instance of the code by checking the code values against a table of codes, and if a match exists, the match is the candidate instance of the code.

2. The system of claim 1, wherein using the edge intensity to determine code values for each pixel comprises:

establishing a rotated local coordinate system utilizing the edge orientation for each pixel with a high edge intensity;

reading each pixel value in a rectified image in the rotated local coordinate system, each pixel value in the rectified image corresponds to each bit in a code; and

determining a code value by thresholding each pixel based on a minimum and maximum pixel value read.

3. The system of claim 1, the visual coded image comprises a bar code.

4. The system of claim 1, further comprising an object tracking component, executed by the processor and stored in memory, that tracks at least one page on the projection surface in part by detecting at least two pairs of strong edge parallel lines that are perpendicular to each other.

5. The system of claim 4, the object tracking component recognizes overlapping pages.

6. The system of claim 4, further comprising a camera-projection component, comprising a projector with at least one camera and an illuminant, wherein the illuminant and the at least one camera are rigidly mounted to the projector.

7. The system of claim 1, farther comprising a shadow analysis component, executed by the processor and stored in memory, that computes shadow images of at least one finger on the projection surface to determine whether the finger is touching or hovering over the projection surface.

8. The system of claim 7, the shadow analysis component binarizes the input image to yield at least one shadow image.

9. The system of claim 1, further comprising a rank component that ranks each candidate instance of the code according to some criteria such that a top ranked candidate is taken as a valid code instance and any remaining candidates that overlap are eliminated.

10. The system of claim 1, further comprising one or more remote display surfaces to display content from the projection surface.

11. The system of claim 1, the visual coded image comprises a game piece.

12. The system of claim 1, the object sensing component employs a Sobel filter to compute the edge intensity and the edge orientation for every pixel in the at least one visual coded image.

13. The system of claim 4, the object tracking component employs a Hough transform to detect the at least two pairs of strong edge parallel lines that are perpendicular to each other.

14. The system of claim 6, the camera projection component captures the detected visual coded image and projects the visual coded image back onto the projection surface as a visual object.

15. The system of claim 6, the camera projection component projects at least one image onto the at least one page.

16. The system of claim 6, the camera projection component is positioned off to the side of the projection surface.

17. The system of claim 6, the camera projection component projects the at least one image onto at least one of a real or a virtual page on the projection surface in real time.

18. The system of claim 6, the camera projection component projects a movie in real time.

19. The system of claim 6 is self-contained and portable.

20. The system of claim 7, the shadow analysis component triggers content to appear on the surface when at least one of a touch or hovering is determined.