Multiple-surface display projector with interactive input capability

• US 6,431,711 B1
• Filed: 02/08/2001
• Issued: 08/13/2002
• Est. Priority Date: 12/06/2000
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Pinhanez, Claudio S.
• Primary Examiner(s): Adams, Russell
• Assistant Examiner(s): SEVER, ANDREW T
• Application Number:
  US09/779,212
• Publication Number:
  US 20020105623A1
• Time in Patent Office: 551 Days
• Field of Search: 353/28, 353/69, 353/11, 353/42, 353/44, 353/45, 353/50, 353/51, 353/62, 353/70, 352/69, 352/70
• US Class Current: 353/69
• CPC Class Codes: G03B 21/28 Reflectors in projection beam in illumination beam G03B21/2066
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor
• CPC Class Codes: H04N 9/3147 Multi-projection systems displays in general H04N9/12; video walls G06F3/1446, G09G2300/026
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

The present invention projects an image onto any surface in a room and distorts the image before projection so that a projected version of the image will not be distorted. The surface could be planar or non-planar. The present invention also allows for a projected image to be displayed at multiple locations along a surface or multiple surfaces. This allows a projected image to move from one location on a surface to another location on this or another surface, while the projected image remains undistorted through the move. Moreover, the present invention allows interaction between people and a projector. Interactive input, such as from mice, may be used with the versions of the present invention. Importantly, versions of the present invention can determine if an object is near an interactive item (such as a hyperlink) on the projected image. If so, the present invention can activate the interactive item. This allows a person to interact with a projected image.

Claims

1. A multiple-surface display projector comprising:

a multiple-surface display controller adapted to distort an undistorted image into a distorted image;

a video projector coupled to the multiple-surface display controller and adapted to project the distorted image; and

a redirection device positioned to redirect the projected and distorted image onto a destination area of a destination surface.

2. The multiple-surface display projector of claim 1, wherein the redirection device comprises a mirror, wherein the mirror is adapted to move about multiple degrees of freedom, the mirror positioned to receive the projected image from the video projector and to reflect the projected image onto the destination area.

3. The multiple-surface display projector of claim 2, wherein the redirection device comprises a pan/tilt head that itself comprises the mirror and a pan/tilt mechanism, the pan/tilt mechanism adapted to move the mirror to a specific location about the multiple degrees of freedom, the specific location selected whereby the mirror reflects the distorted image onto the destination area.

4. The multiple-surface display projector of claim 3, wherein the pan/tilt mechanism is adapted to move the mirror relative to multiple axes.

5. The multiple-surface display projector of claim 4, wherein the pan/tilt mechanism is adapted to move the mirror to a specific pan location and a specific tilt location.

6. The multiple-surface display projector of claim 1, wherein:

the multiple-surface display controller comprises a means for distorting the undistorted image into the distorted image;

the video projector comprises a means for projecting the distorted image; and

the redirection device comprises a means for redirecting the projected and distorted image onto a destination surface.

7. The multiple-surface display projector of claim 1, further comprising a camera positioned to receive a camera image that comprises an image reflected from the destination area.

8. The multiple-surface display projector of claim 7, wherein the multiple-surface display controller undistorts the camera image to create an undistorted camera image and wherein the multiple-surface display controller compares the undistorted image with the undistorted camera image to determine if there is an object on the camera image.

9. The multiple-surface display projector of claim 8, wherein the multiple-surface display controller determines if the object is near an interactive item and, if so, activates the interactive item.

10. The multiple-surface display projector of claim 9, wherein the object is an obstruction, an area of light from a laser pointer or a specific object.

11. The multiple-surface display projector of claim 1, wherein the multiple-surface display controller further comprises zoom and focus information, and wherein the multiple-surface display controller communicates the zoom and focus information to the video projector.

12. The multiple-surface display projector of claim 1, further comprising a distortion controller adapted to distort the undistorted image into the distorted image.

13. The multiple-surface display projector of claim 12, wherein the distortion controller comprises a video adapter and where the multiple-surface display controller sets parameters of a correction surface in the video adapter and places the undistorted image as a texture on the correction surface.

14. The multiple-surface display projector of claim 13, wherein the parameters of the correction surface are RX, RY, RZ, lens, scale, TX, and TY.

15. A method to project a substantially distortionless image on any of a multiple of surfaces and for providing interaction with the substantially distortionless image, the method comprising:

distorting an undistorted image to create a distorted image, the step of distorting performed so that a projected image of the distorted image will be substantially undistorted when projected onto a destination area on a destination surface;

projecting the distorted image; and

redirecting projected light to a predetermined position selected to illuminate the destination area with the projected and distorted image.

16. The method of claim 15, wherein the predetermined position comprises a pan location and a tilt location of a mirror.

17. The method of claim 15, wherein the projected and distorted image at the destination area is a displayed image, and where the method further comprises the steps of:

receiving a camera image that comprises a reflected version of the displayed image;

determining if there is an object; and

if there is an object, performing the steps of;

determining a location of the object; and

determining if the object is within a predetermined distance from an interactive item.

18. The method of claim 17, wherein the step of determining if there is an object comprises the step of undistorting the camera image by mapping the camera image to an original plane and surface area.

19. The method of claim 18, wherein the step of determining if there is an object comprises the step of comparing the undistorted image and the image that results from undistorting the camera image.

20. The method of claim 15, wherein the step of distorting comprises the step of mapping the undistorted image to a correction surface.

21. The method of claim 15, wherein the step of projecting further comprises the step of adjusting zoom and focus.

22. A system to project a substantially distortionless image on any of a multiple of surfaces and for providing interaction with the substantially distortionless image, the system comprising:

a computer system comprising;

a memory that stores computer-readable code; and

a processor operatively coupled to the memory, the processor configured to implement the computer-readable code, the computer-readable code configured to;

distort an undistorted image to create a distorted image, the distortion performed so that a projected image of the distorted image will be substantially undistorted when projected onto a destination area on a destination surface;

output the distorted image to a projector suitable for projecting video; and

cause a redirection device to redirect projected light to a predetermined position selected to illuminate the destination area with the projected and distorted image.

23. The system of claim 22, further comprising:

the redirection device that comprises a mirror and that is coupled to computer, wherein the mirror is adapted to move about multiple degrees of freedom, the mirror positioned to receive the projected image from the video projector and to reflect the projected image onto the destination area; and

a video projector placed to project images onto the mirror and coupled to the computer.

24. The system of claim 23, wherein the computer-readable code is further configured to communicate a pan location and a tilt location to the redirection device.

25. The system of claim 22, further comprising a camera positioned to receive a camera image that comprises an image reflected from the destination area, wherein the camera is coupled to the computer system.

26. The system of claim 25, wherein the computer-readable code is further configured to undistort the camera image to create an undistorted camera image and to compare the undistorted image with the undistorted camera image to determine if there is an object on the camera image.

27. The system of claim 26, wherein the computer-readable code is further configured to determine if the object is near an interactive item and, if so, to activate the interactive item.

28. The system of claim 27, wherein the object is an obstruction, an area of light from a laser pointer or a specific object.

29. An article of manufacture comprising:

a computer readable medium having computer readable code means embodied thereon, the computer readable program code means comprising;

a step to distort an undistorted image to create a distorted image, the distortion performed so that a projected image of the distorted image will be substantially undistorted when projected onto a destination area on a destination surface;

a step to output the distorted image to a projector suitable for projecting video; and

a step to cause a redirection device to redirect projected light to a predetermined position selected to illuminate the destination area with the projected and distorted image.

30. The article of manufacture of claim 29, wherein the computer-readable code means further comprises a step to communicate a pan location and a tilt location to the redirection device.

31. The article of manufacture of claim 29, wherein the computer-readable code means further comprises a step to undistort the camera image to create an undistorted camera image and a step to compare the undistorted image with the undistorted camera image to determine if there is an object on the camera image.

32. The article of manufacture of claim 31, wherein the computer-readable code means further comprises a step to determine if the object is near an interactive item and, if so, to activate the interactive item.

33. The article of manufacture of claim 32, wherein the object is an obstruction, an area of light from a laser pointer or a specific object.