Providing an Interactive Experience Using a 3D Depth Camera and a 3D Projector
First Claim
1. A method for providing an interactive experience to a user using an interaction system, comprising:
- capturing a depth image of a physical object placed on, or in proximity to, a surface;
capturing a video image of the physical object;
generating a 3D virtual object which is a counterpart of the physical object based on the depth image and the video image; and
projecting, using a 3D projector, the 3D virtual object on, or in proximity to, the surface.
2 Assignments
0 Petitions
Accused Products
Abstract
An interaction system is described which uses a depth camera to capture a depth image of a physical object placed on, or in vicinity to, an interactive surface. The interaction system also uses a video camera to capture a video image of the physical object. The interaction system can then generate a 3D virtual object based on the depth image and video image. The interaction system then uses a 3D projector to project the 3D virtual object back onto the interactive surface, e.g., in a mirrored relationship to the physical object. A user may then capture and manipulate the 3D virtual object in any manner. Further, the user may construct a composite model based on smaller component 3D virtual objects. The interaction system uses a projective texturing technique to present a realistic-looking 3D virtual object on a surface having any geometry.
-
Citations
20 Claims
-
1. A method for providing an interactive experience to a user using an interaction system, comprising:
-
capturing a depth image of a physical object placed on, or in proximity to, a surface; capturing a video image of the physical object; generating a 3D virtual object which is a counterpart of the physical object based on the depth image and the video image; and projecting, using a 3D projector, the 3D virtual object on, or in proximity to, the surface. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. An interaction system, comprising:
-
an illumination source for projecting radiation onto a surface; a depth camera for receiving radiation, emitted by the illumination source, which illuminates at least one physical object on, or in proximity to, the surface, to capture a depth image; a video camera for capturing a video image of said at least one physical object; a virtual scene generation module for generating at least one 3D virtual object based on the depth image and the video image; and a stereoscopic projector for projecting said at least one 3D virtual object on, or in proximity to, the surface. - View Dependent Claims (17, 18)
-
-
19. A computer readable storage medium for storing computer readable instructions, the computer readable instructions providing a virtual scene generation module when executed by one or more processing devices, the computer readable instructions comprising:
-
logic configured to receive a depth image of a physical object placed on, or in proximity to, a surface; logic configured to receive a video image of the physical object; and logic configured to apply a texture, obtained from the video image, to a geometrical shape identified in the depth image, to provide a 3D virtual object in a form of a perspective-adjusted image, the perspective-adjusted image being projected, by a 3D projector, to a location on, or in proximity to, the surface. - View Dependent Claims (20)
-
Specification