Single-sensor system for extracting depth information from image blur

• US 10,291,894 B2
• Filed: 09/23/2016
• Issued: 05/14/2019
• Est. Priority Date: 01/02/2013
• Status: Active Grant

• Current Assignee: California Institute of Technology
• Original Assignee: California Institute of Technology
• Inventors: Gharib, Morteza, Jeon, David
• Primary Examiner(s): Nawaz, Talha M
• Application Number:
  US15/275,321
• Publication Number:
  US 20170013245A1
• Time in Patent Office: 963 Days
• Field of Search: None
• CPC Class Codes: G02B 3/0056 arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses G02B3/0043 takes precedence; miniaturised objectives for electronic devices employing wafer level optics G02B13/0085
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/571 from focus
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/211 using temporal multiplexing
• CPC Class Codes: H04N 13/236 using varifocal lenses or mirrors
• CPC Class Codes: H04N 13/246 Calibration of cameras
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps

Abstract

Hardware and software methodology are described for three-dimensional imaging in connection with a single sensor. A plurality of images is captured at different degrees of focus without focus change of an objective lens between such images. Depth information is extracted by comparing image blur between the images captured on the single sensor.

Claims

1. A three-dimensional imaging system comprising:

a single image sensor;

an array of micro-lenses positioned to allow the single image sensor to capture images having blur of different degrees without moving an objective lens of the imaging system to change the focus of the objective lens, wherein each of the capture images is captured along a common optical axis; and

a computer processor connected with the image sensor, wherein the processor is adapted to match elements from the captured images and determine depth position for elements of the images by comparing differences in blurring for the elements.

2. The system of claim 1, wherein portions of the sensor are uncovered by the array.

3. The system of claim 1, wherein the array includes micro-lenses of at least two focal lengths.

4. The system of claim 1, further comprising a single objective lens assembly.