Image projector with reflected light tracking

• US 8,282,222 B2
• Filed: 10/10/2008
• Issued: 10/09/2012
• Est. Priority Date: 10/10/2007
• Status: Active Grant

• Current Assignee: Gerard Dirk Smits
• Original Assignee: Gerard Dirk Smits
• Inventors: Smits, Gerard Dirk
• Primary Examiner(s): Ko, Tony
• Assistant Examiner(s): Reilly-Diakun, Jori S
• Application Number:
  US12/249,899
• Publication Number:
  US 20090096994A1
• Time in Patent Office: 1,460 Days
• Field of Search: 353/30, 353/122, 353/37, 353/50, 353 85- 87, 353/98
• US Class Current: 353/85
• CPC Class Codes: G01B 11/14 for measuring distance or clearance between spaced objects or spaced apertures G01B11/26 takes precedence; rangefinders G01C3/00
• CPC Class Codes: G02B 26/101 with both horizontal and vertical deflecting means, e.g. raster or XY scanners colour television using laser beams scanning a display screen H04N9/3129
• CPC Class Codes: G03B 21/147 Optical correction of image distortions, e.g. keystone
• CPC Class Codes: H04N 9/3129 scanning a light beam on the display screen scanning a light beam on a screen in displays other than projection devices G09G3/02; scanning systems in general G02B26/10; projectors using laser light sources in general H04N9/3161
• CPC Class Codes: H04N 9/3155 for controlling the light source light source control per se H05B35/00 – H05B47/00; control of an illumination source for displays in general G09G3/3406
• CPC Class Codes: H04N 9/3164 using multiple light sources
• CPC Class Codes: H04N 9/3173 wherein the projection device is specially adapted for enhanced portability
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

An image projection device for displaying an image onto a remote surface. The image projection device employs a scanner to project image beams of visible light and tracer beams of light onto a remote surface to form a display of the image. The device also employs a light detector to sense at least the reflections of light from the tracer beam pulses incident on the remote surface. The device employs the sensed tracer beam light pulses to predict the trajectory of subsequent image beam light pulses and tracer beam light pulses that form a display of the image on the remote surface in a pseudo random pattern. The trajectory of the projected image beam light pulses can be predicted so that the image is displayed from a point of view that can be selected by, or automatically adjusted for, a viewer of the displayed image.

Claims

1. A device for scanned image projection, comprising:

a light projection device that is arranged to generate an image on a projection screen by projecting a light beam on the projection surface;

a tracer beam generator that is arranged to project a tracer beam on the projection surface;

a location detector that is arranged to detect the location of a spot formed by the light beam on the projection surface by detecting a reflection of the tracer beam, such that the detected location includes a set of coordinates that define the location of the spot relative to the projection screen, and wherein the location detector is further arranged to provide location information based on the detected location; and

a processor that is configured to predict a subsequent position of the light beam on the projection surface by determining a scanline trajectory of the light beam on the projection surface based, at least in part, on the location information; and

further configured to control the light projection device to generate the image by controlling an intensity of each color component of the light beam based on the predicted subsequent position.

2. The device of claim 1, wherein

the processor is configured to estimate the next position of the light beam on the projection surface by predicting a trajectory predicted by the processor based, at least in part, on the location of the light beam on the projection surface, and

the processor is further configured to adjust the intensity of each color component of the light beam based on an adjustable point of view.

3. The device of claim 1, wherein

the location detector is further arranged to detect pixels on the projection surface, such that a detection of a pixel hit occurs if a predetermined amount of energy is detected at a location on the projection surface, such that the detection of the pixel hit is asynchronous.

4. The device of claim 1, wherein

the location information includes timing information, the detected location of the spot formed by the light beam on the projection surface, and a plurality of previous positions of the light beam on the projection surface.

7. The device of claim 1, wherein the tracer beam generator is arranged to generate the tracer beams as a sequence of electromagnetic radiation pulses not visible to human observers.

8. The device of claim 1, wherein the tracer beam generator is arranged to generate the tracer beams as a sequence of infrared pulses.

10. The device of claim 1, wherein

the light projection device includes a scanner that is arranged to move the projected light beam;

and wherein the processor is further arranged to determine whether the scanner is moving the projected light beam properly, to disable the light beam if the scanner is determined to be not operating properly, and to disable the projected light beam if an object is detected between the scanner and the projection surface.

11. The device of claim 1, wherein

the location detector includes a camera, the camera is arranged to detect a reflected image from the projection surface, the processor is further configured to determine a difference between a known image and the reflected image to detect another image superimposed on the known image, and wherein the processor is configured to control the projected light to augment the known image with said another image.

13. The device of claim 1, wherein

the location information includes flight time of the tracer beam to the projection surface and back to the location detector, and wherein the processor is further configured to control the light projection device to adjust the projected image for a difference in flight times of the tracer beam caused by the projection surface being tilted and/or by the projection surface having surface irregularities.

14. The device of claim 1 wherein

the processor is further configured to determine whether a visual artifact is present in the image, and to control the projected light to correct the visual artifact if the visual artifact is present.

15. The device of claim 1 wherein

the processor is further configured to control the color and intensity at each location on the projection surface as a result of several spots traversing a location on the projection surface with overlapping spots relative to the projection surface and separated briefly in time.

16. The device of claim 1 wherein the processor is arranged to control the intensity of each color component of the projected light such that the plurality of spots form a plurality of arcs sweeping across the projection surface such that the order and direction of each arc in the plurality of arcs is independent of the order and direction of each other arc in the plurality of arcs.

17. The device of claim 1 wherein the processor is further arranged to dynamically scale a resolution of the image based on at least one of:

view angle, distance, or field of view.

18. The device of claim 1 wherein the light projection device includes a beam combiner and a scanner.

19. The device of claim 18, wherein

the processor is further configured to determine whether the scanner is moving the projected light beam properly, to disable the projection of the projected light beam if the scanner is determined to be not operating properly, and to disable the projection of the projected light beam if an object is detected between the scanner and the projection surface.

20. The device of claim 18, wherein

the projection surface is a screen having screen boundaries, and wherein the light projection device is arranged to project the projected light within the screen boundaries.

21. The device of claim 18, wherein:

the light projection device further includes a light source driver that is arranged to modulate component light beams based on the control of component light beams by the processor, and

wherein the device further comprises a plurality of laser light-emitting diode light sources that is arranged to generate the component light beams.

22. The device of claim 18, wherein the scanner is arranged to project the projected image such that the projected image is about 180 degrees wide or greater.

23. The device of claim 22, wherein the scanner is arranged to project the image such that the projection image is 360 degrees to completely surround a viewer.

5. A device for scanned image projection, comprising:

a light projection device that is arranged to project a light beam by projecting light on a projection surface to form a plurality of spots on the projection surface;

a location detector that is arranged to detect a location of a spot formed by the light beam on the projection surface, and to provide location information based on the detected location; and

a processor that is configured to predict a subsequent position of the light beam on the projection surface based, at least in part, on the location information; and

further configured to control the intensity of each color component of the light beam based on the predicted subsequent position, wherein the processor that is configured to control an intensity of each color component of the projected light such that a predetermined image is rendered on the projection surface, including controlling the intensity of each color component of the projected light such that a serial order of the plurality of spots is determined based on a sweep path of the projected light, wherein the sweep path of the projected light is not predetermined.

6. The device of claim 5, further comprising:

a tracer beam generator that is arranged to project a tracer beam on the projection surface, wherein the location detector is arranged to detect the location of the spot formed by the light beam on the projection surface by detecting a reflection of the tracer beam.

9. A device for scanned image projection, comprising:

a light projection device that is arranged to project a light beam by projecting light on a projection surface to form a plurality of spots on the projection surface;

a location detector that is arranged to detect a location of a spot formed by the light beam on the projection surface, and to provide location information based on the detected location; and

a processor that is configured to predict a subsequent position of the light beam on the projection surface based, at least in part, on the location information; and

further configured to control the intensity of each color component of the light beam based on the predicted subsequent position, wherein the processor is configured to control an intensity of each color component of the projected light such that a predetermined image is rendered on the projection surface, including controlling the intensity of each color component of the projected light such that a serial order of the plurality of spots is determined based on a sweep path of the projected light, wherein the sweep path of the projected light is a pseudo-random trajectory.

12. The device of claim 9, further comprising:

a tracer beam generator that is arranged to project a tracer beam on the projection surface, wherein the location detector is arranged to detect the location of the spot formed by the light beam on the projection surface by detecting a reflection of the tracer beam.

24. A method for scanned image projection, comprising:

generating an image on a projection screen by projecting a light beam on the projection surface;

projecting a tracer beam on the projection surface;

detecting a location of the light beam on the projection surface by detecting a reflection of the tracer beam;

receiving location information that includes a set of coordinates that define the location of the spot relative to the projection screen;

predicting a subsequent position of the light beam on the projection surface by determining a scanline trajectory of the light beam on the projection surface based, at least in part, on the location information; and

controlling the generation of the image by controlling an intensity of each color component of the light beam based on the predicted subsequent position.

25. The method of claim 24, further comprising:

providing the location information based on the detected location.

26. The method of claim 24, wherein controlling an intensity of each color component of the light beam is accomplished such that the image is rendered on the projection surface, and such that a serial order of the plurality of spots is determined based on a sweep path of the light beam, wherein the sweep path of the projected light is a pseudo-random trajectory.

27. The method of claim 24, further comprising:

rendering the predetermined image subject to the controlling of the intensity of each color component of the light beam in a relatively rapid succession of a plurality of scans such that a sweep path of each of the plurality of scans is in a pseudo-random direction.

29. The method of claim 24, wherein

generating the image includes rendering a predetermined image in a relatively rapid succession of a plurality of scans such that a sweep path of each of the plurality of scans is in a pseudo-random direction.

30. The method of claim 29, wherein

each of the plurality of scans is rendered by projecting the light beam on the projection surface subject to the control of the intensity of each color component of the light beam.

31. The method of claim 30, further comprising:

providing the location information based on the detected location.

28. An article of manufacture including a processor-readable medium having processor-executable code encoded therein, which when executed by one or more processors, enables actions for scanned image projection, comprising:

receiving location information that is based on a detected location of a spot formed by a light beam on a projection surface, wherein the detected location includes a set of coordinates that define the location of the spot relative to the projection screen;

predicting a subsequent position of the light beam on the projection surface by determining a scanline trajectory of the light beam on the projection surface based, at least in part, on the location information; and

controlling generation of an image on the projection screen by controlling an intensity of each color component of the light beam based on the predicted subsequent position.