Generation and modulation of non-visible structured light for augmented reality projection system

• US 9,134,593 B1
• Filed: 12/23/2010
• Issued: 09/15/2015
• Est. Priority Date: 12/23/2010
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Worley, William Spencer III, Weatherford, William Thomas, Coley, Christopher, Crump, Edward Dietz
• Primary Examiner(s): Chowdhury, Sultan
• Assistant Examiner(s): Owens, Danell L
• Application Number:
  US12/977,760
• Time in Patent Office: 1,727 Days
• Field of Search: 353/31, 353/84
• US Class Current: 1/1
• CPC Class Codes: G01B 11/25 by projecting a pattern, e.g. one or more lines, moiré fringes on the object G01B11/255 takes precedence ; image analysis for depth or shape recovery G06T7/50
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G03B 21/147 Optical correction of image distortions, e.g. keystone
• CPC Class Codes: G03B 21/206 Control of light source other than position or intensity
• CPC Class Codes: G03B 21/26 Projecting separately subsidiary matter simultaneously with main image
• CPC Class Codes: G03B 33/08 Sequential recording or projection G03B33/02, G03B33/04, G03B33/06 take precedence
• CPC Class Codes: H04N 9/3111 for displaying the colours sequentially, e.g. by using sequentially activated light sources sequential projection in colour photography G03B33/08
• CPC Class Codes: H04N 9/3147 Multi-projection systems displays in general H04N9/12; video walls G06F3/1446, G09G2300/026
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A display system having a modulated light source is configured to include one or more non-visible wavelengths as part of the display sequence. In one implementation a color wheel, configured to modulate the wavelengths emitted by a projector, includes an infrared (IR) segment, allowing for projection of an IR image. The wavelength modulated non-visible light may be spatially modulated to generate a structured light pattern, for signaling, to synchronization with other devices, and so forth.

Claims

1. An image projection system comprising:

a light source configured to generate light having a plurality of wavelengths both visible and non-visible;

a color wheel optically coupled to the light source and configured to selectively pass a pre-determined range of wavelengths from the light source, the color wheel comprising;

a plurality of visible light segments, each being configured to pass a pre-determined range of visible wavelengths;

one or more non-visible light segments, each being configured to pass a pre-determined range of non-visible wavelengths;

an imaging modulator configured to generate an image from the light passed by the color wheel and to generate at least a portion of a structured light pattern while the one or more non-visible light segments of the color wheel are passing the pre-determined range of non-visible wavelengths;

a camera configured to detect the non-visible light and gather structured light data indicative of the structured light pattern projected onto a physical scene; and

a computing device configured to;

determine a topology of the physical scene by analyzing distortion in the structured light data; and

based on the analyzed distortion in the structured light data, cause adjustment of at least one of a frequency, a duration, or a sequencing of the non-visible wavelengths passed by the one or more non-visible light segments of the color wheel.

2. The system of claim 1, further comprising:

a color wheel motor coupled to the color wheel and configured to rotate the color wheel; and

a controller coupled to and configured to synchronize the color wheel motor and the imaging modulator.

3. The system of claim 2, wherein the controller is further configured to generate a synchronization signal indicating a state of the color wheel.

4. The system of claim 3, wherein the camera is configured to accept the synchronization signal indicating the state of the color wheel.

5. The system of claim 1, wherein the visible wavelengths extend from about 390 nanometers to about 750 nanometers.

6. The system of claim 1, wherein the non-visible wavelengths are less than about 390 nanometers or greater than about 750 nanometers.

7. The system of claim 1, wherein the imaging modulator comprises a digital micromirror device.

8. A system comprising:

a projector comprising;

a wavelength modulated light source configured to generate light having a particular pre-determined range of wavelengths both visible and non-visible; and

one or more imaging modulators configured to generate visible and non-visible images from the light generated by the wavelength modulated light source;

wherein the projector is configured to project the visible and non-visible images onto a physical scene in an environment;

a camera configured to capture the non-visible images projected onto the physical scene to characterize a topology of the physical scene; and

wherein the wavelength modulated light source is further configured to adjust a range of wavelengths of the non-visible light based at least in part on the non-visible images captured by the camera.

9. The system of claim 8, wherein the wavelength modulated light source generates non-visible wavelengths at a pre-determined periodic interval.

10. The system of claim 8, wherein the wavelength modulated light source generates non-visible wavelengths upon receipt of a signal from a controller.

11. The system of claim 8, wherein the wavelength modulated light source is further configured to alternate between a pre-determined wavelength modulation pattern of visible and non-visible wavelengths.

12. The system of claim 8, wherein the one or more imaging modulators comprise a digital micromirror device.

13. The system of claim 8, wherein the one or more imaging modulators comprise a liquid crystal.

14. The system of claim 8, wherein the wavelength modulated light source comprises one or more lasers.

15. The system of claim 8, wherein the wavelength modulated light source comprises a solid state light source.

16. The system of claim 15, wherein the solid state light source comprises a light emitting diode.

17. The system of claim 8, wherein the wavelength modulated light source comprises a lamp coupled to a color wheel, the color wheel comprising:

one or more visible light segments, each being configured to pass a pre-determined range of visible wavelengths; and

one or more non-visible light segments, each being configured to pass a pre-determined range of non-visible wavelengths.

18. The system of claim 8, wherein the wavelength modulated light source comprises a lamp coupled to a wavelength modulator, the wavelength modulator configured to:

pass a pre-determined range of visible wavelengths at a first time; and

pass a pre-determined range of non-visible wavelengths at a second time.

19. The system of claim 18, wherein the wavelength modulator comprises a liquid crystal device.

20. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:

modulating one or more light sources to produce light having a pre-determined range of non-visible wavelengths;

generating a structured light pattern with the non-visible wavelengths;

projecting the structured light pattern onto a physical scene;

modulating the one or more light sources to produce a pre-determined range of visible wavelengths;

generating a visible light image with the visible wavelengths;

projecting the visible light image onto the physical scene;

capturing an image of the structured light pattern projected into the physical scene;

analyzing the captured image to identify distortion in the structured light pattern to determine characteristics of a topology of the physical scene;

generating an adjusted structural light pattern based at least in part on the determined characteristics of the topology of the physical scene; and

projecting the adjusting structural light pattern onto the physical scene.

21. The one or more non-transitory computer-readable storage media of claim 20, wherein the generating images comprises controlling one or more imaging modulators.

22. The one or more non-transitory computer-readable storage media of claim 20, further comprising synchronizing the generation of the structured light pattern with the capturing of the image.

23. The one or more non-transitory computer-readable storage media of claim 20, wherein the modulating the light source comprises controlling a color wheel motor.

24. The one or more non-transitory computer-readable storage media of claim 20, wherein the modulating the light source comprises controlling activation of one or more solid state light sources.

25. The one or more non-transitory computer-readable storage media of claim 20, further comprising receiving a wavelength modulation synchronization signal.

26. The one or more non-transitory computer-readable storage media of claim 20, further comprising:

synchronizing a plurality of projectors such that each projector is configured to generate the structured light pattern with the non-visible wavelengths at different times, using different pre-determined ranges of non-visible wavelengths, or both.