Real-Time Geometry Aware Projection and Fast Re-Calibration
First Claim
1. A computer program product comprising at least one computer-readable medium storing one or more sequences of instructions, wherein execution of the one or more sequences of instructions by one or more processors causes the one or more processors to execute a computer-implemented method for calibrating a projector system comprising a camera and a projector, each being directed toward a display surface, the computer-implemented method comprising:
- obtaining a correspondence that maps a set of projector pixels to a set of the camera pixels via a set of display surface points; and
responsive to the projector being at a different pose;
projecting a set of feature points onto the display surface using the projector, the set of feature points having known projector pixel locations;
capturing at least a portion of the set of feature points using the camera;
detecting a set of detected feature points from the set of feature points;
correlating projector pixels to camera pixels using at least some of the set of detected feature points;
mapping the correlated projector pixels to display surface points from the set of display surface points using the correspondence; and
using the mapped correspondence to obtain a new projection matrix for the projector at the difference pose.
2 Assignments
0 Petitions
Accused Products
Abstract
Aspects of the present invention include systems and methods for recalibrating projector-camera systems. In embodiments, systems and methods are able to recalibrate automatically the projector with arbitrary intrinsic and pose, as well as render for arbitrarily desired viewing point. In contrast to previous methods, the methods disclosed herein use the observing camera and the projector to form a stereo pair. Structured light is used to perform pixel-level fine reconstruction of the display surface. In embodiments, the geometric warping is implemented as a direct texture mapping problem. As a result, re-calibration of the projector movement is performed by simply computing the new projection matrix and setting it as a camera matrix. For re-calibrating the new view point, the texture mapping is modified according to the new camera matrix.
57 Citations
20 Claims
-
1. A computer program product comprising at least one computer-readable medium storing one or more sequences of instructions, wherein execution of the one or more sequences of instructions by one or more processors causes the one or more processors to execute a computer-implemented method for calibrating a projector system comprising a camera and a projector, each being directed toward a display surface, the computer-implemented method comprising:
-
obtaining a correspondence that maps a set of projector pixels to a set of the camera pixels via a set of display surface points; and responsive to the projector being at a different pose; projecting a set of feature points onto the display surface using the projector, the set of feature points having known projector pixel locations; capturing at least a portion of the set of feature points using the camera; detecting a set of detected feature points from the set of feature points; correlating projector pixels to camera pixels using at least some of the set of detected feature points; mapping the correlated projector pixels to display surface points from the set of display surface points using the correspondence; and using the mapped correspondence to obtain a new projection matrix for the projector at the difference pose. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer program product comprising at least one computer-readable medium storing one or more sequences of instructions, wherein execution of the one or more sequences of instructions by one or more processors causes the one or more processors to execute a computer-implemented method for calibrating a projector system comprising a camera and a projector, each being directed toward a display surface, the computer-implemented method comprising:
-
obtaining a correspondence that maps a set of projector pixels to a set of the camera pixels via a set of display surface points; and responsive to having a view location at a position that is different than a position for the camera; obtaining a new camera projection matrix for the view location; and using the correspondence to compute a new light projection matrix to alter an image projected by the projector. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A computer system for recalibrating a projector system comprising a projector and a camera, the system comprising:
-
one or more processors; and one or more computer readable media in communication with the one or more processors, the computer readable medium having stored thereon a set of instructions executable by the one or more processors, set of instructions comprising; obtaining a correspondence that maps a set of projector pixels to a set of the camera pixels via a set of display surface points; and responsive to a change of pose of either the projector or a view location from which an image projected from the projector is viewed by a viewer, using the correspondence to calculate a new projection matrix. - View Dependent Claims (19, 20)
-
Specification