Imaging systems with depth detection

• US 10,609,361 B2
• Filed: 06/29/2018
• Issued: 03/31/2020
• Est. Priority Date: 06/29/2018
• Status: Active Grant

• Current Assignee: Semiconductor Components Industries LLC (ON Semiconductor Corporation)
• Original Assignee: Semiconductor Components Industries LLC (ON Semiconductor Corporation)
• Inventors: Mlinar, Marko, Boettiger, Ulrich
• Primary Examiner(s): Elahi, Shan E
• Application Number:
  US16/023,077
• Publication Number:
  US 20200007853A1
• Time in Patent Office: 641 Days
• Field of Search: 348139
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 7/521 from laser ranging, e.g. using interferometry; from the projection of structured light
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/12 with one sensor only
• CPC Class Codes: H04N 25/131 including elements passing infrared wavelengths
• CPC Class Codes: H04N 25/135 based on four or more different wavelength filter elements

Abstract

An imaging system may include an image sensor, a lens, and layers with reflective properties, such as an infrared cut-off filter, between the lens and the image sensor. The lens may focus light from an object in a scene onto the image sensor. Some of the light directed onto the image sensor may form a first image on the image sensor. Other portions of the light directed onto the image sensor may reflect off of the image sensor and back towards the layers with reflective properties. These layers may reflect the light back onto the image sensor, forming a second image that is shifted relative to the first image. Depth mapping circuitry may compare the first and second images to determine the distance between the imaging system and the object in the scene.

Claims

1. An imaging system comprising:

a lens;

an image sensor comprising an array of pixels that generate image data;

an at least partially reflective intermediate layer interposed between the lens and the image sensor;

an infrared cut-off filter interposed between the intermediate layer and the lens, wherein light from an object passes through the lens, the infrared cut-off filter, and the intermediate layer to reach the image sensor, wherein a first portion of the light is captured by the array of pixels to generate a primary image, and wherein a second portion of the light reflects off of the image sensor towards the intermediate layer, reflects off of the intermediate layer back toward the image sensor, and is captured by the array of pixels to generate a secondary image that is different than the primary image; and

depth mapping circuitry that detects the primary image and the secondary image and that compares the primary image to the secondary image to determine a distance between the imaging system and the object, wherein the first and second portions of the light are visible light.

2. The imaging system defined in claim 1, wherein the imaging system has a depth of field, wherein the object is outside of the depth of field of the imaging system, and wherein the primary image is a first blur spot of a first size.

3. The imaging system defined in claim 2, wherein the secondary image is a second blur spot of a second size that is greater than the first size, and wherein the depth mapping circuitry determines the distance between the imaging system and the object based on the first size of the first blur spot and the second size of the second blur spot.

4. The imaging system defined in claim 1, wherein the depth mapping circuitry applies autocorrelation detection operations to the image data to detect the primary image and the secondary image and to determine the distance between the imaging system and the object.

5. The imaging system defined in claim 1, wherein the depth mapping circuitry applies spectral analysis to the image data to detect the primary image and the secondary image and to determine the distance between the imaging system and the object.

6. The imaging system defined in claim 1, further comprising:

processing circuitry that applies a filter to the image data to remove the secondary image from the image data after the depth mapping circuitry determines the distance between the imaging system and the object.

7. The imaging system defined in claim 6, wherein the processing circuitry displays the image data to a user after the secondary image has been removed.

8. The imaging system defined in claim 1, wherein a gap separates the intermediate layer and the image sensor, and wherein a width of the gap is adjustable.

9. An imaging system comprising:

a lens;

an image sensor that captures an image of a scene;

reflective layers interposed between the lens and the image sensor; and

depth processing circuitry that determines depth information for the scene based on light that reflects off of the reflective layers and onto the image sensor, wherein the image sensor comprises a color filter layer having visible light color filters and infrared color filters and wherein the light that reflects off of the reflective layers and onto the image sensor passes through the infrared color filters and is blocked by the visible light color filters.

10. The imaging system defined in claim 9, further comprising:

a light source that illuminates the scene, wherein the light that reflects off of the reflective layers and onto the image sensor is generated by the light source and is reflected off of an object in the scene that is illuminated by the light source.

11. The imaging system defined in claim 10, wherein the light source is a light source selected from the group consisting of:

a scanning collimated light source and a pulsed light source.

12. The imaging system defined in claim 9, wherein the image sensor captures a primary image of an object in the scene from a primary light ray that is incident upon the image sensor, wherein a portion of the primary light ray reflects off of the image sensor as a secondary light ray, and wherein the secondary light ray is the light that reflects off of the reflective layers and onto the image sensor, wherein the image sensor captures a secondary image of the object in the scene from the light that reflects off of the reflective layers and onto the image sensor, and wherein the depth processing circuitry determines the depth information for the scene by determining a distance between the imaging system and the object based on the primary image and the secondary image.

13. A method of operating an imaging system comprising an image sensor, a reflective layer, and a depth determination engine, the method comprising:

with the image sensor, capturing image data for a scene, wherein the image data includes primary image data generated in response to light directly incident upon the image sensor and secondary image data generated in response to light that reflected off of the image sensor, off of the reflective layer, and back onto the image sensor;

with the depth determination engine, determining depth information for the scene by comparing the primary image data to the secondary image data; and

with the depth determination engine, performing autocorrelation operations on the image data to identify the primary image data and the secondary image data and determine the depth information.

14. The method defined in claim 13, further comprising:

with the depth determination engine, performing spectral analysis operations on the image data to identify the primary image data and the secondary image data and determine the depth information.

15. The method defined in claim 13, further comprising:

filtering the image data to remove the secondary image data while retaining the primary image data; and

displaying the filtered image data to a user.

16. The method defined in claim 13, further comprising:

providing the depth information for the scene to a machine vision processor.