Projection of overlapping sub-frames onto a surface

• US 7,443,364 B2
• Filed: 03/15/2005
• Issued: 10/28/2008
• Est. Priority Date: 03/15/2005
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Allen, William J., Chang, Nelson Liang An, Damera-Venkata, Niranjan
• Primary Examiner(s): Patel; Nitin
• Application Number:
  US11/080,583
• Publication Number:
  US 20060209057A1
• Time in Patent Office: 1,323 Days
• Field of Search: 345 30- 40, 345/63, 345/1.1, 345/1.2, 345/1.3, 348778-780, 348800-803, 353 85- 94, 349/8, 349/73, 349/74, 349/77, 349/78, 349/61
• US Class Current: 345/31
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 3/007 Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels
• CPC Class Codes: G09G 5/391 Resolution modifying circuits, e.g. variable screen formats

Abstract

A method of displaying an image with a display system includes receiving image data for the image. The method includes generating a first sub-frame and a second sub-frame corresponding to the image data based on a geometric relationship between a hypothetical reference projector and each of a first and a second projector. The method includes projecting the first sub-frame with the first projector onto a target surface. The method includes projecting the second sub-frame with the second projector onto the target surface, wherein the first and the second sub-frames at least partially overlap on the target surface.

Claims

1. A method of displaying an image with a display system, the method comprising:

receiving image data for the image;

generating a first sub-frame and a second sub-frame corresponding to the image data based on a geometric relationship between a hypothetical reference projector and each of a first and a second projector, wherein the hypothetical reference projector is used in an image formation model to represent a projector positioned at any arbitrary location with respect to the first and second projectors;

projecting the first sub-frame with the first projector onto a target surface; and

projecting the second sub-frame with the second projector onto the target surface, wherein the first and the second sub-frames at least partially overlap on the target surface.

2. The method of claim 1, wherein the first and the second sub-frames are generated by geometrically transforming and down-sampling the image data.

3. The method of claim 1, wherein the first and the second sub-frames are generated by geometrically transforming, filtering, and down-sampling the image data.

4. The method of claim 1, wherein the first and the second sub-frames are generated based on maximization of a probability that a simulated image is the same as the image data.

5. The method of claim 4, wherein the simulated image is defined as a summation of up-sampled, filtered, and geometrically transformed sub-frames.

6. The method of claim 5, wherein the geometric transformation of the sub-frames is represented by an operator that geometrically transforms the sub-frames based on relative positions of the projectors with respect to the hypothetical reference projector.

7. The method of claim 4, wherein a difference between the image data and the simulated image is represented by Gaussian noise.

8. The method of claim 4, wherein the first and the second sub-frames are generated with an iterative algorithm that computes an error during each iteration, the method further comprising:

updating values of the first and the second sub-frames during each iteration based on the computed error.

9. The method of claim 8, wherein the error is calculated based on a difference between the image data and the simulated image.

10. The method of claim 9, wherein the updated values are calculated based on a Laplacian of the simulated image.

11. The method of claim 10, and further comprising:

down-sampling, filtering, and geometrically transforming the error before using the error to update the values of the first and the second sub-frames.

12. The method of claim 1, wherein projection of the sub-frames onto the target surface produces an image that has a three-dimensional appearance.

13. A system for displaying an image, the system comprising:

a buffer adapted to receive image data for the image;

a sub-frame generator configured to define first and second sub-frames corresponding to the image data;

a first projection device adapted to project the first sub-frame onto a target surface;

a second projection device adapted to project the second sub-frame onto the target surface, such that the second sub-frame at least partially overlaps the first sub-frame; and

wherein the first and the second sub-frames are defined by the sub-frame generator based on a geometric relationship between a hypothetical reference projection device and each of the first and the second projection devices.

14. The system of claim 13, wherein the first and the second sub-frames are defined by geometrically transforming and down-sampling the image data.

15. The system of claim 13, wherein the first and the second sub-frames are defined by geometrically transforming, filtering, and down-sampling the image data.

16. The system of claim 13, wherein the first and the second sub-frames are defined based on maximization of a probability that a hypothetical image matches the image data.

17. The system of claim 16, wherein the hypothetical image is defined as a summation of up-sampled, filtered, and geometrically transformed sub-frames.

18. The system of claim 17, wherein the geometric transformation of the sub-frames is represented by an operator that geometrically transforms the sub-frames based on relative positions of the projection devices with respect to the hypothetical reference projection device.

19. The system of claim 16, wherein a difference between the image data and the hypothetical image is defined as Gaussian noise.

20. The system of claim 16, wherein the first and the second sub-frames are generated with an iterative algorithm that computes an error during each iteration, and wherein the error is used to update values of the first and the second sub-frames during each iteration.

21. The system of claim 20, wherein the error is calculated based on a difference between the image data and the hypothetical image.

22. The system of claim 21, wherein the updated values are calculated based on a Laplacian of the hypothetical image.

23. The system of claim 22, wherein the error is down-sampled, filtered, and geometrically transformed before being used to update the values of the first and the second sub-frames.

24. The system of claim 13, wherein projection of the sub-frames onto the target surface produces an image that has a three-dimensional appearance.

25. A system for generating low-resolution sub-frames for simultaneous projection onto a viewing surface at spatially offset positions to generate the appearance of a high-resolution image, the system comprising:

means for receiving a first high-resolution image;

means for generating a first plurality of low-resolution sub-frames based on the first high-resolution image; and

means for iteratively updating the first plurality of sub-frames based on an error calculated at each iteration, the error based on a difference between the first high-resolution image and a simulated high-resolution image, and wherein the error is down-sampled, filtered, and geometrically transformed before being used to update the first plurality of sub-frames.

26. The system of claim 25, wherein the simulated high-resolution image is defined as a summation of up-sampled, filtered, and geometrically transformed sub-frames.

27. The system of claim 26, wherein the geometric transformation of the sub-frames is represented by an operator that geometrically transforms the sub-frames based on relative positions of projector units with respect to a reference projection unit.

28. The system of claim 25, wherein a difference between the first high-resolution image and the simulated high-resolution image is defined to be Gaussian noise.

29. The system of claim 25, wherein the first plurality of sub-frames are updated based on a Laplacian of the simulated high-resolution image.

30. A computer-readable medium having computer-executable instructions for performing a method of generating low-resolution sub-frames for simultaneous projection onto a viewing surface at spatially offset positions to generate the appearance of a high-resolution image, comprising:

receiving a first high-resolution image;

generating a first plurality of low-resolution sub-frames based on the first high-resolution image; and

iteratively updating the first plurality of sub-frames based on an error calculated at each iteration, the error based on a difference between the first high-resolution image and a simulated high-resolution image, and wherein the error is down-sampled, filtered, and geometrically transformed before being used to update the first plurality of sub-frames.

31. The computer-readable medium of claim 30, wherein the simulated high-resolution image is defined as a summation of up-sampled, filtered, and geometrically transformed sub-frames.

32. The computer-readable medium of claim 31, wherein the geometric transformation of the sub-frames is represented by an operator that geometrically transforms the sub-frames based on relative positions of projectors with respect to a reference projector.

33. The computer-readable medium of claim 30, wherein a difference between the first high resolution image and the simulated high-resolution image is defined to be zero mean white Gaussian noise.

34. The computer-readable medium of claim 30, wherein the first plurality of sub-frames are updated based on a Laplacian of the simulated high-resolution image.