System and method for displaying images

• US 20070291184A1
• Filed: 06/16/2006
• Published: 12/20/2007
• Est. Priority Date: 06/16/2006
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Harville, Michael, Culbertson, W. Bruce, Gelb, Daniel G., Sobel, Irwin, Fitzhugh, Andrew E., Tanguay, Donald O.
• Application Number:
  US11/455,148
• Publication Number:
  US 20070291184A1
• Time in Patent Office: Days
• US Class Current: 348/745
• CPC Class Codes: G06T 3/08 Projecting images onto non-planar surfaces, e.g. geodetic screens
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: H04N 9/3147 Multi-projection systems displays in general H04N9/12; video walls G06F3/1446, G09G2300/026
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A method of displaying images includes performing geometric processing and photometric processing on a plurality of image frames, thereby generating a plurality of processed image frames, projecting the plurality of processed image frames on a non-planar display surface with at least one projector, wherein the geometric processing includes applying a first plurality of meshes to the plurality of image frames, wherein the first plurality of meshes defines 2D mappings between the display surface and the at least one projector.

Claims

1. A method of displaying images, comprising:

performing geometric processing and photometric processing on a plurality of image frames, thereby generating a plurality of processed image frames;

projecting the plurality of processed image frames on a non-planar display surface with at least one projector; and

wherein the geometric processing includes applying a first plurality of meshes to the plurality of image frames, wherein the first plurality of meshes defines 2D mappings between the display surface and the at least one projector.

2. The method of claim 1, wherein the non-planar display surface is a non-planar developable display surface.

3. The method of claim 1, wherein the first plurality of meshes is generated based on a second plurality of meshes configured to map a first domain associated with the display surface to a second domain associated with a camera configured to capture an image of the display surface, and a third plurality of meshes configured to map the second domain to at least one third domain associated with the at least one projector.

4. The method of claim 3, wherein the first plurality of meshes, second plurality of meshes, and third plurality of meshes are generated based on Delaunay triangulation.

5. The method of claim 3, wherein the display surface includes a plurality of fiducial marks in a predetermined arrangement, and wherein the second plurality of meshes is generated based on at least one captured image of the fiducial marks.

6. The method of claim 5, wherein all or substantially all of the fiducial marks are positioned outside of a display area on the display surface where images are displayed.

7. The method of claim 6, wherein the fiducial marks are configured as first and second fiducial marker strips, and wherein the first fiducial marker strip is positioned above a top border of the display area and the second fiducial marker strip is positioned below a bottom border of the display area.

8. The method of claim 1, wherein the photometric processing comprises:

applying at least one blend map to the plurality of image frames, wherein the at least one blend map includes a plurality of attenuation factors corresponding to regions of overlap of images projected by the at least one projector.

9. The method of claim 8, wherein at least one of the attenuation factors is determined based on a product of a plurality of distances between a first pixel location of an image frame and a plurality of edges of the image frame.

10. The method of claim 1, wherein the photometric processing comprises:

applying at least one scale map to the plurality of image frames, wherein the at least one scale map is determined based on applying at least one blend map to at least one white level measurement map and based on at least one white level target map that is determined by applying a smoothing function to the at least one white level measurement map.

11. The method of claim 1, wherein the photometric processing comprises:

applying at least one offset map to the plurality of image frames, wherein the at least one offset map is determined based on at least one black level measurement map, and based on at least one black level target map that is determined by applying a smoothing function to the at least one black level measurement map.

12. The method of claim 1, wherein the photometric processing comprises:

applying at least one inverse tone reproduction function to the plurality of image frames.

13. A display system, comprising:

a processing system for performing geometric processing and photometric processing on a plurality of image frames, thereby generating a plurality of processed image frames;

a plurality of projectors configured to project the plurality of processed image frames onto a non-planar display surface; and

wherein the geometric processing comprises applying to the image frames a first plurality of meshes that defines 2D mappings between the display surface and the plurality of projectors, the first plurality of meshes determined based on a predetermined arrangement of fiducial marks on the display surface, and wherein the photometric processing comprises applying at least one blend map, at least one scale map, at least one offset map, and at least one inverse tone reproduction function to the plurality of image frames.

14. The display system of claim 13, wherein the non-planar display surface is a non-planar developable display surface.

15. The display system of claim 13, wherein the first plurality of meshes is generated based on a second plurality of meshes configured to map a first domain associated with the display surface to a second domain associated with a camera configured to capture an image of the display surface, and a third plurality of meshes configured to map the second domain to a plurality of third domains associated with the plurality of projectors.

16. The display system of claim 13, wherein the fiducial marks are positioned outside of an image display area of the display surface.

17. The display system of claim 16, wherein the fiducial marks are configured as a plurality of fiducial marker strips positioned adjacent to borders of the image display area.

18. The display system of claim 13, wherein the at least one scale map is determined based on applying the at least one blend map to at least one white level measurement map and based on at least one white level target map that is determined by applying a smoothing function to the at least one white level measurement map.

19. The display system of claim 13, wherein the at least one offset map is determined based on at least one black level measurement map, and based on at least one black level target map that is determined by applying a smoothing function to the at least one black level measurement map.

20. A method of displaying images, comprising:

providing a non-planar developable display surface with a plurality of fiducial marks positioned along first and second edges of the display surface;

geometrically processing a plurality of image frames, thereby generating a plurality of processed image frames, wherein the geometric processing includes applying to the image frames a plurality of meshes that defines mappings between the display surface and the at least one projector, the plurality of meshes determined based on the plurality of fiducial marks; and

projecting the plurality of processed image frames onto the display surface with the at least one projector.