SYSTEM AND METHOD FOR GENERATING CORRESPONDENCE MAPPINGS USING INFRARED PATTERNS

• US 20090015791A1
• Filed: 07/12/2007
• Published: 01/15/2009
• Est. Priority Date: 07/12/2007
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Chang, Nelson Liang An, Damera-Venkata, Niranjan, Widdowson, Simon
• Granted Patent: US 9,052,575 B2
• Time in Patent Office: Days
• US Class Current: 353/6
• CPC Class Codes: G03B 21/00 Projectors or projection-type viewers; Accessories therefor devices for changing pictures G03B23/00
• CPC Class Codes: G03B 21/005 Projectors using an electronic spatial light modulator but not peculiar thereto
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/006 Inverse problem, transformation from projection-space into object-space, e.g. transform methods, back-projection, algebraic methods
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G06T 3/08 Projecting images onto non-planar surfaces, e.g. geodetic screens
• CPC Class Codes: G06T 3/10 Selection of transformation methods according to the characteristics of the input images
• CPC Class Codes: G06V 10/62 relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking

Abstract

A method performed by a display system is provided. The method includes projecting a first infrared pattern from a first projection plane of a first projector into a scene, capturing the first infrared pattern from the scene in a capture plane of at least one image capture device, and determining a first correspondence mapping between the first projector and the image capture device from at least the first infrared pattern in the first projection plane and the first infrared pattern in the capture plane.

Claims

1. A method performed by a display system, the method comprising:

projecting a first infrared pattern from a first projection plane of a first projector into a scene;

capturing the first infrared pattern from the scene in a capture plane of at least one image capture device; and

determining a first correspondence mapping between the first projector and the image capture device from at least the first infrared pattern in the first projection plane and the first infrared pattern in the capture plane.

2. The method of claim 1 further comprising:

projecting visual content onto the scene for display by a human observer with the first projector; and

projecting the first infrared pattern while projecting the visual content.

3. The method of claim 1 further comprising:

projecting a second infrared pattern from a second projection plane of a second projector into the scene;

capturing the second infrared pattern from the scene in the capture plane of the image capture device; and

determining a second correspondence mapping between the second projector and the image capture device from at least the second infrared pattern in the second projection plane and the second infrared pattern in the capture plane.

4. The method of claim 3 further comprising:

projecting the first infrared pattern onto a region of the scene at a first time; and

projecting the second infrared pattern onto at least a portion of the region at a second time that is subsequent to the first time.

5. The method of claim 3 further comprising:

remapping the first and the second correspondence mappings to a reference coordinate system.

6. The method of claim 1 further comprising:

generating a frame for display onto the scene by the first projector with the first correspondence mapping.

7. The method of claim 1 wherein the first infrared pattern is substantially visually imperceptible to a viewer when displayed in the scene.

8. The method of claim 1 wherein the first infrared pattern includes a space-time code.

9. An image display system comprising:

a processing system;

a first projector with a first projection plane;

at least one image capture device with a capture plane;

wherein the first projector is configured to project a first pattern into a scene with first infrared light, wherein the image capture device is configured to capture the first pattern from the scene, and wherein the processing system is configured to determine a first correspondence mapping between the first projector and the image capture device from at least the first pattern in the first projection plane and the first pattern in the capture plane.

10. The image display system of claim 9 wherein the processing system is configured to provide a first frame with the first pattern to the first projector.

11. The image display system of claim 9 wherein the projector includes a color wheel with a region configured to transmit the first infrared light.

12. The image display system of claim 9 wherein the projector includes a color wheel with a plurality of blanking regions that are configured to transmit the first infrared light.

13. The image display system of claim 9 wherein the projector includes a controllable infrared blocking filter.

14. The image display system of claim 9 wherein the image capture device includes an infrared filter that is configured to transmit the first infrared light from the scene.

15. The image display system of claim 9 wherein the projector is configured to project visual content into the scene for display by a human observer with first projector while projecting the first pattern with the infrared light.

16. The image display system of claim 9 further comprising:

a second projector with a second projection plane;

wherein the second projector is configured to project a second pattern into the scene with second infrared light, wherein the image capture device is configured to capture the second pattern from the scene, and wherein the processing system is configured to determine a second correspondence mapping between the second projector and the image capture device from at least the second pattern in the second projection plane and the second pattern in the capture plane.

17. A program product comprising:

a program executable by a processing system for causing an image display system to;

project a first infrared pattern from a first projection plane of a first projector onto a display surface;

capture the first infrared pattern from the display surface in a capture plane of at least one image capture device; and

determine a first correspondence mapping between the first projector and the image capture device from at least the first infrared pattern in the first projection plane and the first infrared pattern in the capture plane; and

a medium for storing the program.

18. The program product of claim 17 wherein the program is executable by the processing system for causing the processing system to:

project a second infrared pattern from a second projection plane of a second projector onto the display surface;

capture the second infrared pattern from the display surface in the capture plane of the image capture device; and

determine a second correspondence mapping between the second projector and the image capture device from at least the second infrared pattern in the second projection plane and the second infrared pattern in the capture plane.

19. The program product of claim 17 wherein the first infrared pattern is substantially visually imperceptible to a viewer when displayed on the display surface.

20. The program product of claim 17 wherein the first infrared pattern includes a space-time code.