Single lens range imaging method and apparatus

• US 5,703,677 A
• Filed: 11/14/1995
• Issued: 12/30/1997
• Est. Priority Date: 11/14/1995
• Status: Expired due to Fees

• Current Assignee: Trustees Of The University Of Pennsylvania (University of Pennsylvania)
• Original Assignee: Trustees Of The University Of Pennsylvania (University of Pennsylvania)
• Inventors: Farid, Hany, Simoncelli, Eero
• Primary Examiner(s): Buczinski, Stephen C.
• Application Number:
  US08/557,527
• Time in Patent Office: 777 Days
• Field of Search: 356/4.04, 356/4.06, 356/4.01, 382/106, 250/201.7, 396/89, 364/458
• US Class Current: 356/4.04
• CPC Class Codes: G02B 26/02 for controlling the intensity of light G02B26/004 takes precedence
• CPC Class Codes: G02B 7/28 Systems for automatic generation of focusing signals

Abstract

A single lens range sensor comprises a camera 27 having a pair of plano-convex lenses 28a and 28b, an optical mask 30, an imaging sensor 32, a digitizer 34 and a computer 36. The optical mask 30 may be implemented with a liquid crystal array having spatially varying opacity which can be switched (e.g., by the computer 36) between masks derived from a differentiable mask function and its derivative. Alternatively, the mask 30 may be composed of two printed masks which are mechanically switched to obtain two images based on the differentiable mask function and its derivative. The imaging sensor 32 may be implemented with a CCD array. The invention avoids the correspondence problems of the two camera and moving camera approaches, and is simple to calibrate.

Claims

1. A single lens range sensor for determining range information, comprising:

(a) a lens;

(b) an optical sensor constructed and arranged to sense optical energy travelling from a visual scene through said lens;

(c) at least one optical mask for alternately providing first and second mask functions for masking said sensor to prevent a portion of said optical energy from reaching said sensor, said mask functions being based on at least a differentiable function and a derivative of said differentiable function; and

(d) range determination means for forming an aperture derivative image of an object in said visual scene, and for determining the range of said object on the basis of at least said aperture derivative image.

2. A single lens range sensor as recited in claim 1, wherein said range sensor comprises a CCD array.

3. A single lens range sensor as recited in claim 1, wherein said optical mask comprises a liquid crystal array having spatially varying opacity which is switchable between said differentiable mask function and its derivative.

4. A single lens range sensor as recited in claim 1, wherein said optical mask comprises two printed masks which are mechanically switchable to provide said differentiable mask function and its derivative.

5. A single lens range sensor as recited in claim 1, wherein said optical mask comprises two printed masks, wherein said masks have an opacity represented by the equations:

space="preserve" listing-type="equation">M.sub.0 =(α

G(x,y)+β

G.sub.x (x,y))

space="preserve" listing-type="equation">M.sub.π

=(α

G(x,y)-β

G.sub.x (x,y))

where α and

β

are scaling constants, G(x,y) is a differentiable function and G_x (x,y) is the derivative of G(x,y).

6. A single lens range sensor as recited in claim 1, where said optical mask is composed of a single printed mask defined by the equation

7. A single lens range sensor as recited in claim 1, wherein said lens comprises two plano-convex lenses and said mask is disposed between said two lenses.

8. A method for determining the range of a point or patch in an image, said range being indicative of the distance between said point or patch and a second, known location, comprising the steps of obtaining a spatial derivative image using a first mask and obtaining an aperture derivative image using a second mask, and then combining the spatial derivative and aperture derivative images to obtain information indicative of said range.

9. A method for determining a range map of an image comprising the steps of:

(a) obtaining first and second intensity images (I1 and I2) with first and second optical masks (M₀ and M.sub.π

), respectively;

(b) obtaining a sum image (I) by computing a sum of said first and second intensity images, and obtaining a difference image (I_v) by computing a difference between said first and second intensity images;

(c) computing a first derivative image (I_x) by convolving said sum image with a first convolution filter (D(x,y)), and computing a second derivative image (I_v '"'"') by convolving said difference image with a second convolution filter (L(x,y));

(d) computing squared values (I_x²) based on said first derivative image and computing product values (I_x I_v '"'"') based on said first derivative image and said second derivative image;

(e) computing a first blur image based on I_x² and computing a second blur image based on I_x I_v '"'"'; and

(f) computing the range map by dividing I_x I_v '"'"' by I_x².

10. A method for determining a range map of an image as recited in claim 9, wherein said first and second optical masks M₀ and M.sub.π

are characterized by the equations;

space="preserve" listing-type="equation">M.sub.0 =(α

G(x,y)+β

G.sub.x (x,y))

space="preserve" listing-type="equation">M.sub.π

=(α

G(x,y)-β

G.sub.x (x,y))

where α and

β

are scaling constants, G(x,y) is a differentiable function and G_x (x,y) is the derivative of G(x,y).