System and method for interactive markerless paper documents in 3D space with mobile cameras and projectors
First Claim
Patent Images
1. A system, comprising:
- a camera system configured to detect three-dimensional orientation information for an identified surface onto which an image is to be projected, the three-dimensional orientation information comprising information about an angle of the identified surface, an orientation of the identified surface and a shape of the identified surface;
at least one projector configured to project the image onto the identified surface, and to adjust the image to be projected within the identified surface and oriented in accordance with the information about the angle of the identified surface, the orientation of the identified surface and the shape of the identified surface,wherein the identified surface comprises a marker-less surface, andwherein the camera system is configured to detect the identified surface by creating a depth image based on images received from the camera, analyzing the depth image for weakly connected components to isolate potential surfaces, determining inner points of one of said potential surfaces, mapping the inner points to outer points of the one of said potential surfaces to define a surface, the outer points being determined based on preset attributes for a desired surface, and tracking the defined surface as the identified surface.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods directed to fine-grained interaction with ordinary markerless paper documents and projectors at flexible poses in 3D space. Systems and methods allow for the projection of images onto non-flat variable surfaces by utilizing depth detection techniques in order to project an image or video properly onto a variable surface.
-
Citations
20 Claims
-
1. A system, comprising:
-
a camera system configured to detect three-dimensional orientation information for an identified surface onto which an image is to be projected, the three-dimensional orientation information comprising information about an angle of the identified surface, an orientation of the identified surface and a shape of the identified surface; at least one projector configured to project the image onto the identified surface, and to adjust the image to be projected within the identified surface and oriented in accordance with the information about the angle of the identified surface, the orientation of the identified surface and the shape of the identified surface, wherein the identified surface comprises a marker-less surface, and wherein the camera system is configured to detect the identified surface by creating a depth image based on images received from the camera, analyzing the depth image for weakly connected components to isolate potential surfaces, determining inner points of one of said potential surfaces, mapping the inner points to outer points of the one of said potential surfaces to define a surface, the outer points being determined based on preset attributes for a desired surface, and tracking the defined surface as the identified surface. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method, comprising:
-
identifying a surface; utilizing a camera system to receive three-dimensional orientation information for the identified surface onto which an image is to be projected, the three dimensional orientation information comprising information about an angle of the identified surface, an orientation of the identified surface and a shape of the identified surface; and projecting the image onto the identified surface and adjusting the image to fit within the identified surface and oriented in accordance with the information about the angle of the identified surface, the orientation of the identified surface and the shape of the identified surface, wherein the identified surface comprises a marker-less surface, and wherein, in utilizing the camera system, the camera system detects the identified surface by creating a depth image based on images received from the camera, analyzing the depth image for weakly connected components to isolate potential surfaces, determining inner points of one of said potential surfaces, mapping the inner points to outer points of the one of said potential surfaces to define a surface, the outer points being determined based on preset attributes for a desired surface, and tracking the defined surface as the identified surface. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A camera-projector unit, comprising:
-
a camera system configured to track an identified surface in real time and receive three dimensional orientation information, the three dimensional orientation information comprising information about an angle of the identified surface, an orientation of the identified surface onto which an image is to be projected, a shape of the identified surface and a depth of the identified surface; a projector configured to project the image onto the identified surface and adjust the image to be projected within the identified surface and oriented in accordance with the information about the angle of the identified surface, the orientation of the identified surface, the shape of the identified surface and the depth of the identified surface; wherein the camera system detects changes to the surface in real time, and wherein the image is adjusted according to said changes in real time, and wherein the identified surface comprises a marker-less surface, and wherein the identified surface is determined by a process comprising; creating a depth image based on images received from the camera; analyzing the depth image for weakly connected components to isolate potential surfaces; determining inner points of one of said potential surfaces; mapping the inner points to outer points of the one of said potential surfaces to define a surface, the outer points determined based on preset attributes for a desired surface; and tracking the defined surface as the identified surface. - View Dependent Claims (17, 18, 19, 20)
-
Specification