AUTOMATIC REGISTRATION OF MULTI-PROJECTOR DOME IMAGES

• US 20130070094A1
• Filed: 09/20/2012
• Published: 03/21/2013
• Est. Priority Date: 09/20/2011
• Status: Abandoned Application

• Current Assignee: Regents of the University of California (University of California)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: MAJUMDER, ADITI, SAJADI, BEHZAD
• Application Number:
  US13/623,805
• Publication Number:
  US 20130070094A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: G03B 37/04 with cameras or projectors providing touching or overlapping fields of view
• CPC Class Codes: H04N 9/3147 Multi-projection systems displays in general H04N9/12; video walls G06F3/1446, G09G2300/026
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

Automatic registration of projectors and their images on a curved surface may be performed using non-linear optimization techniques. A camera may capture images on the curved surface. The camera may be un-calibrated. The camera parameters may be estimated using a non-linear optimization of data in the images of the curved surface. The images may be from multiple projectors. In some embodiments, registration may be view independent.

Claims

1. A method of registering images on a curved surface, comprising:

capturing a display of images projected from multiple projectors on to the curved surface with a camera;

estimating camera parameters of the camera using a non-linear optimization of data in the images of the curved surface captured by the camera; and

registering the display of images on the curved surface using the estimated camera parameters.

2. The method of claim 1, wherein the curved surface is a dome.

3. The method of claim 1, wherein the camera is un-calibrated.

4. The method of claim 3, wherein the camera parameters estimated are intrinsic and extrinsic camera parameters.

5. The method of claim 1, wherein the display of images are segmented images, wherein adjacent images partially overlap.

6. The method of claim 1, wherein the images are used as a relationship of projector coordinates with display surface coordinates.

7. The method of claim 6, wherein the relationship is represented using a set of rational Bezier patches.

8. A system, comprising:

a camera;

a plurality of projectors coupled to the camera; and

a controller coupled to the camera configured to;

control the plurality of projectors to display overlapping segmented images onto a curved surface,

receive information captured by the camera of the displayed segmented images,

estimate camera parameters of the camera using the received information, and

reconstruct the camera parameters based on the received information.

9. The system of claim 8, wherein the camera parameters are intrinsic and extrinsic camera properties.

10. The system of claim 8, wherein the received information is processed under a non-linear optimization.

11. The system of claim 8, wherein the curved surface is a partial hemisphere.

12. The system of claim 8, wherein a registration of the segmented images is configured as view dependent.

13. The system of claim 8, wherein the segmented images are registered in the curved surface.

14. The system of claim 8, wherein the segmented images are registered for any arbitrary viewpoint.

15. A computer readable storage medium including a computer readable code configured to:

capture a display of images projected from multiple projectors on to a curved surface with a camera;

define a coordinate system of the curved surface using a fiducial constraint;

determine display to projector correspondences of the curved surface based on estimated camera parameters of the camera;

backproject a blob onto the curved surface using the estimated camera parameters; and

finding an intersection of the backprojected blob with the coordinate system of the curved surface.

16. The computer readable storage medium of claim 15, comprising performing a view independent registration of the captured display of images on the curved surface.

17. The computer readable storage medium of claim 16, wherein the registration is configured for view from different perspectives.

18. The computer readable storage medium of claim 15, wherein the camera parameters estimated are intrinsic and extrinsic camera parameters.

19. The computer readable storage medium of claim 15, wherein the non-linear optimization uses Bezier patches.

20. The computer readable storage medium of claim 18, wherein the Bezier patches include using a non-linear least squares fitting.