Camera with rotating optical displacement unit

• US 6,616,347 B1
• Filed: 09/29/2000
• Issued: 09/09/2003
• Est. Priority Date: 09/29/2000
• Status: Expired due to Fees

• Current Assignee: Optinav
• Original Assignee: Optinav
• Inventors: Dougherty, Robert
• Primary Examiner(s): MAHONEY, CHRISTOPHER E
• Application Number:
  US09/677,223
• Time in Patent Office: 1,075 Days
• Field of Search: 396/89, 396/107, 396/111, 396/351, 396/342, 396/71, 396/432, 396/544, 356/3.15, 356/3.13
• US Class Current: 396/351
• CPC Class Codes: G03B 3/00 Focusing arrangements of general interest for cameras, projectors or printers

Abstract

Ranges of objects are determined using a camera equipped with a rotating optical axis displacement unit (ODU). The ODU receives light about an offset line of sight, and displaces it to a substantially parallel camera line of sight. The displaced light is focussed onto an image sensor. Images of a scene are captures as the ODU rotates. Range information is calculated from the apparent motion of objects in the captured images.

Claims

1. A camera system comprising

a) a camera having a camera line of sight, an image sensor and a means for capturing images formed on the image sensor;

b) a focussing system for focussing light to form an image on the image sensor;

c) an optical displacement unit (ODU) that receives light from an offset line of sight that is different from the camera line of sight and directs the light into the camera along or parallel to the camera line of sight, the ODU being rotatable about a rotation axis that is the same as or parallel to the camera line of sight but different than the offset line of sight, wherein all elements of the focussing system, except for optional elements for increasing field of view, are located between the ODU and the image sensor, and wherein the ODU is not attached to the camera.

2. A method for determining the range of an object, comprising

a) bringing a scene containing the object within the field of view of a camera system including (1) a camera having a camera line of sight, an image sensor, a means for capturing images formed on the image sensor, (2) a focussing system for focussing light to form an image of the scene on the image sensor and (3) an optical displacement unit (ODU) that receives light from an offset line of sight that is different from the camera line of sight and directs the light into the camera along the camera line of sight, the ODU being rotatable about a rotation axis that is the same as or substantially parallel to the camera line of sight but different than the offset line of sight, so as to form an image of the scene on the image sensor;

b) capturing said image of the scene to produce a first frame;

c) rotating the optical displacement unit about the rotation axis to a different position while maintaining the orientation of the image sensor substantially constant with respect to said object, so as to effect an apparent motion of the image on the image sensor;

d) capturing another image to produce a subsequent frame;

e) determining the position of an image corresponding to at least one point on said object on the first frame and at least one subsequent frame; and

f) calculating the range of the object from the positions of the image corresponding to said at least one point on said object on said first frame and at least one subsequent frame.

3. The method of claim 2, wherein the offset line of sight is parallel to the camera line of sight.

4. The method of claim 3 wherein the rotation axis is the same as the camera line of sight.

5. The method of claim 4 wherein the image sensor is a CCD.

6. The method of claim 4 wherein the ODU rotates through a constant angle between each frame, images move in circles on the image sensor as the ODU rotates, and ranges are calculated by determining the instantaneous velocity of an imaged point.

7. The method of claim 2 wherein ranges are calculated by defining a given distance D_g and evaluating the frames for objects whose motion matches that expected for an object at distance D_g.

8. The method of claim 7 wherein the frames are evaluated by forming a shifted image corresponding to each frame by applying to each frame a radius vector r_vi having a magnitude corresponding to the radius of a circle the corresponds to the expected movement on the image sensor of an image of an object at distance D_g, and a direction for each frame corresponding to the direction from the offset line of sight to the camera line of sight, forming a composite image from the shifted images, identifying pixels in the composite image in which objects are in focus, and assigning a distance of D_g to objects imaged on the identified pixels.

9. The method of claim 8 wherein pixels in the composite image in which objects are in focus are identified by applying a focus metric.

10. The method of claim 8 wherein pixels in the composite image in which objects are in focus are identified in a reverse mapping method in which each pixel in the composite image is associated with a pixel in each of the frames by applying a vector −

r_vi, and the brightness values of the associated pixels in the frames are compared.

11. The method of claim 2 wherein transverse coordinates of said object are also calculated to determine a three-dimensional map of the object.

12. The method of claim 2, wherein steps steps c) and d) are repeated one or more times to produce additional subsequent frames and wherein step f) is performed by

g) identifying a given distance;

h) shifting each of said first and subsequent frames to produce a corresponding number of shifted images, such that objects at said given distance appear at substantially the same pixel locations in each of said shifted images;

i) summing said shifted images to form a composite image in which objects at said given distance appear to be in focus; and

j) identifying pixels in said composite image having objects in focus, and assigning said given distance to objects imaged on said pixels in said composite image.

13. A camera system comprising

a) a camera having a camera line of sight, an image sensor and a means for capturing images formed on the image sensor;

b) a focussing system for focussing light to form an image on the image sensor; and

c) an optical displacement unit (ODU) that (1) is physically detached from the camera and (2) receives light from an offset line of eight that is different from the camera line of sight and directs the light into the camera along or parallel to the camera line of sight, the ODU being rotatable about a rotation axis that is the same as or parallel to the camera line of sight but different than the offset line of sight.

14. A method for determining the range of an object, comprising

a) bringing a scene containing the object within the field of view of a camera system of claim 13, so as to form an image of the scene on the image sensor;

b) capturing said image of the scene to produce a first frame;

c) rotating the optical displacement unit about the rotation axis to a different position while maintaining the orientation of the image sensor substantially constant with respect to said object, so as to effect an apparent motion of the image on the image sensor;

d) capturing another image to produce a subsequent frame;

e) determining the position of an image corresponding to at least one point on said object on the first frame and at least one subsequent frame; and

f) calculating the range of the object from the positions of the image corresponding to said at least one point on said object on said first frame and at least one subsequent frame.

15. A method for determining the range of an object, comprising

a) bringing a scene containing the object within the field of view of a camera system including (1) a camera having a camera line of sight, an image sensor, a means for capturing images formed on the image sensor, (2) a focussing system for focussing light to form an image of the scene on the image sensor and (3) an optical displacement unit (ODU) that receives light from an offset line of sight that is different from the camera line of sight and directs the light into the camera along the camera line of sight, so as to form an image of the scene on the image sensor;

b) capturing said image of the scene to produce a first frame;

c) rotating the optical displacement unit about a rotation axis that is the same as or parallel to the camera line of sight so as to effect an apparent motion of the object in a plane;

d) capturing another image to produce a subsequent frame;

e) determining the position of an image corresponding to at least one point on said object on the first frame and at least one subsequent frame; and

f) calculating the range of the object from the positions of the image corresponding to said at least one point on said object on said first frame and at least one subsequent frame.