Color scannerless range imaging system using an electromechanical grating

• US 6,507,706 B1
• Filed: 07/27/2001
• Issued: 01/14/2003
• Est. Priority Date: 07/27/2001
• Status: Expired due to Term

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Eastman Kodak Company
• Inventors: Kowarz, Marek, Gabello, Louis R., Ray, Lawrence A., Brazas, John C., Repich, Kenneth J.
• Primary Examiner(s): PERKEY, WILLIAM B
• Application Number:
  US09/916,995
• Publication Number:
  US 20030021599A1
• Time in Patent Office: 536 Days
• Field of Search: 396/106, 356/5--, 348/135, 250/559.38
• US Class Current: 396/106
• CPC Class Codes: G01S 17/36 with phase comparison between the received signal and the contemporaneously transmitted signal
• CPC Class Codes: G01S 17/89 for mapping or imaging

Abstract

A scannerless range imaging system includes an illumination system and an electromechanical light modulator. The illumination system illuminates objects in the scene with modulated illumination of a predetermined modulation frequency, and the modulated illumination reflected from objects in the scene incorporates a phase delay corresponding to the distance of the objects from the range imaging system. The electromechanical light modulator, which is positioned in an optical path of the reflected illumination, operates at a reference frequency that corresponds to the predetermined modulation frequency and accordingly modulates the modulated illumination reflected from the object, thereby generating a phase image from the interference between the reference frequency and the reflected modulated illumination. The system further includes an optical system that deflects the reflected illumination to the electromechanical light modulator and redirects the phase image generated by the electromechanical light modulator to an image capture section. A color image may be captured by moving the optical system out of the optical path such that reflected illumination from the object will pass directly to the image capture section without contacting the electromechanical light modulator.

Claims

1. A scannerless range imaging system for capturing range information of a scene, said system comprising;

an illumination system for controllably illuminating the scene with modulated illumination of a predetermined modulation frequency, whereby modulated illumination reflected from an object in the scene incorporates a phase delay corresponding to a distance of the object from the range imaging system;

an electromechanical light modulator positioned in an optical path of the modulated illumination reflected from the object, wherein the electromechanical light modulator operates at a reference frequency that corresponds to the predetermined modulation frequency and accordingly modulates the modulated illumination reflected from the object, thereby generating a phase image from the interference between the reference frequency and the modulated illumination reflected from the object; and

an image capture section positioned in the optical path of the modulated illumination reflected from the object for capturing the phase image, whereby the range information is derived from the phase image.

2. The range imaging system as claimed in claim 1 wherein the electromechanical light modulator includes modulating elements having reflective surfaces, said system further including an optical system interposed in the optical path and comprised of a mirror element that deflects the reflected illumination upon the reflective surfaces of the electromechanical light modulator and redirects the phase image generated by the reflective surfaces to the image capture section.

3. The range imaging system as claimed in claim 2 wherein the optical system is movable out of the optical path such that reflected illumination from the object will pass directly to the image capture section without contacting the electromechanical light modulator.

4. The range imaging system as claimed in claim 3 wherein the image capture section captures at least one phase image used to derive a range image and another image of reflected unmodulated illumination corresponding to color in the scene when the optical system is moved out of the optical path.

5. The range imaging system as claimed in claim 1 wherein the electromechanical light modulator is an electromechanical grating.

6. The range imaging system as claimed in claim 1 wherein the image capture section includes a photosensitive film for capturing the phase image.

7. The range imaging system as claimed in claim 1 wherein the image capture section includes an electronic image sensor for capturing the phase image.

8. The range imaging system as claimed in claim 1 wherein the image capture section captures a plurality of phase images corresponding to the reflected modulated illumination, wherein each phase image incorporates the effect of the predetermined modulation frequency together with a phase offset unique for each image.

9. The range imaging system as claimed in claim 8 wherein each unique phase offset θ

is given by θ

_i=2π

i/3;

i=0,1,2.

10. The range imaging system as claimed in claim 8 wherein the image capture section further comprises means for storing the phase images as a bundle of associated images.

11. The range imaging system as claimed in claim 1 wherein the illumination system includes either a laser illuminator or an array of light emitting diodes for producing the modulated illumination.

12. The range imaging system as claimed in claim 1 wherein the predetermined modulation frequency is in the infra-red spectrum.

13. A color scannerless range imaging system for capturing both color and range information of a scene, said system comprising;

an illumination system for controllably illuminating objects in the scene with modulated illumination of a predetermined modulation frequency, whereby modulated illumination reflected from an object in the scene incorporates a phase delay corresponding to a distance of the object from the range imaging system;

a modulation section including (a) an electromechanical light modulator positioned in an optical path of the modulated illumination reflected from the object, wherein the electromechanical light modulator operates at a reference frequency that corresponds to the predetermined modulation frequency and accordingly modulates the modulated illumination reflected from the object, thereby generating a phase image from the interference between the reference frequency and the modulated illumination reflected from the object, wherein said phase images are used to derive the range information, and (b) an optical system located in the optical path to transmit the reflected modulated illumination to the image capture section via the electromechanical grating when a phase image is to be captured;

an image capture section positioned in the optical path of the modulated illumination reflected from the object for capturing a plurality of images thereof, including (a) at least one phase image corresponding to the reflected modulated illumination and (b) at least one other image of reflected unmodulated illumination corresponding to color in the scene; and

a controller for activating the modulation section when a phase image is to be captured and inactivating the modulation section when a color image is to be captured.

14. The range imaging system as claimed in claim 13 wherein the electromechanical light modulator includes modulating elements having reflective surfaces, said optical system further includes a mirror element having facets that deflect the reflected modulated illumination upon the reflective surfaces of the electromechanical light modulator and redirect the phase image generated by the reflective surfaces of the electromechanical light modulator to the image capture section.

15. The range imaging system as claimed in claim 14 wherein the controller inactivates the modulation section by moving the optical system out of the optical path such that the reflected unmodulated illumination corresponding to color in the scene will pass directly to the image capture section without contacting the electromechanical light modulator.

16. The range imaging system as claimed in claim 13 wherein the electromechanical light modulator is an electromechanical grating.

17. The range imaging system as claimed in claim 13 wherein the image capture section includes a photosensitive film for capturing the phase image.

18. The range imaging system as claimed in claim 13 wherein the image capture section includes an electronic image sensor for capturing the phase image and the color image.

19. The range imaging system as claimed in claim 13 wherein the image capture section captures a plurality of phase images corresponding to the reflected modulated illumination, wherein each phase image incorporates the effect of the predetermined modulation frequency together with a phase offset unique for each image.

20. The range imaging system as claimed in claim 19 wherein each unique phase offset θ

is given by θ

_i=2π

i/3;

i=0,1,2.

21. The range imaging system as claimed in claim 19 wherein the image capture section further comprises means for storing the phase images and the color image as a bundle of associated images.

22. The range imaging system as claimed in claim 13 wherein the illumination system includes either a laser illuminator or an array of light emitting diodes for producing the modulated illumination.

23. The range imaging system as claimed in claim 13 wherein the predetermined modulation frequency is in the infra-red spectrum.

24. The range imaging system as claimed in claim 13 wherein the illumination system also emits unmodulated illumination and the reflected illumination includes unmodulated illumination originating with the illumination system and reflected from objects in the scene.

25. The range imaging system as claimed in claim 13 wherein the reflected illumination includes unmodulated illumination from ambient illumination reflected from objects in the scene.