Method for globally aligning multiple projected images

• US 6,755,537 B1
• Filed: 03/21/2003
• Issued: 06/29/2004
• Est. Priority Date: 03/21/2003
• Status: Active Grant

• Current Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Inventors: Beardsley, Paul A., Raskar, Ramesh, van Baar, Jeroen
• Primary Examiner(s): Adams, Russell
• Assistant Examiner(s): Koval, Melissa J
• Application Number:
  US10/393,686
• Time in Patent Office: 466 Days
• Field of Search: 353/69, 353/70, 353/94, 353/121, 353/122, 349/5, 349/7, 349/9, 348/383, 348/744, 348/745
• US Class Current: 353/94
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor
• CPC Class Codes: H04N 9/3147 Multi-projection systems displays in general H04N9/12; video walls G06F3/1446, G09G2300/026
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A method forms a cluster from a set of projectors. Each projector in the set includes a projector sub-system in a fixed physical relationship to a camera sub-system, and a communication sub-system for sending and receiving messages. A calibrate message is received in the projectors via the communications sub-system. A ready message is broadcast by the projectors using the communications sub-system. A structured pattern is projected sequentially by each of the projectors on a display surface using the projector sub-system. An input image of the structured pattern is acquired sequentially by each of the projectors using the camera sub-system. The projectors are globally aligned with each other and the display surface according to the input images.

Claims

1. A method for forming a cluster from a set of projectors, each projector in the set including a projector sub-system in a fixed physical relationship to a camera sub-system, and a communication sub-system for sending and receiving messages, comprising:

receiving a calibrate message in each projector using the communications sub-system;

broadcasting a ready message from each projector using the communications sub-system in response to the calibrate message;

projecting sequentially in each projector a structured pattern on a display surface using the projector sub-system;

acquiring sequentially in each projector an input image of the structured pattern using the camera sub-system; and

aligning globally the projectors with each other and the display surface according to the input images.

2. The method of claim 1 further comprising:

placing the projectors so that a union of the structured light patterns and the input images form a polygon.

3. The method of claim 1 wherein for a particular structured pattern a subset of the projectors acquire the image.

4. The method of claim 1 wherein the aligning is performed concurrently in the set of projectors.

5. The method of claim 1 wherein the structured pattern is a checkerboard pattern.

6. The method of claim 1 further comprising:

locating a largest rectangle inside the polygon; and

compositing a single perceived display image from a plurality output images in the largest rectangle according to the global alignment.

7. The method of claim 1 wherein the set of projectors is heterogeneous.

8. The method of claim 7 wherein the projectors have different display characteristics.

9. The method of claim 8 wherein the different display characteristics include intensity, aspect ratio and pixel resolution.

10. The method of claim 1 wherein the display surface has a quadric order.

11. The method of claim 1 further comprising:

determining a plurality of homographies, each homography for transferring the structured pattern from one projector into the input image of another projector.

12. The method of claim 11 further comprising:

assigning a confidence value to each homography.

13. The method of claim 12 wherein the confidence value is related to a percentage of overlap between the structured image of the one projector and the input image of the other projector on the display surface.

14. The method of claim 13 wherein the confidence value is a ratio of a number of features of the structured pattern of the one projector acquired in the input image of the other projector to a total number of features in the pattern of the one projector.

15. The method of claim 6 further comprising:

aligning the single perceived display image with a horizontal axes and a vertical axes of the display surface.

16. The method of claim 12 further comprising:

determining a global homography for transferring an output image from the one projector to a global reference frame.