Systems and methods for detecting obstructions within the field-of-view of an image sensor

• US 9,245,333 B1
• Filed: 12/10/2014
• Issued: 01/26/2016
• Est. Priority Date: 12/10/2014
• Status: Active Grant

• Current Assignee: Semiconductor Components Industries LLC (ON Semiconductor Corporation)
• Original Assignee: Semiconductor Components Industries LLC (ON Semiconductor Corporation)
• Inventors: Beck, Jeffery, McCord, Charles
• Primary Examiner(s): Edwards, Jerrah
• Assistant Examiner(s): Smith-Stewart, Demetra
• Application Number:
  US14/566,434
• Time in Patent Office: 412 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60Q 1/0023 the element being a sensor, e.g. distance sensor, camera
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/146 Abnormalities, e.g. fail-safe
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

An imaging system may include an image sensor and a transparent protective layer formed within the field-of-view of the image sensor. The imaging system may include a light source that emits light in a predetermined pattern. The imaging system may include circuitry that may detect a reflected version of the predetermined pattern of light in image data captured by image sensor. In response, the imaging system may determine an obstruction is present within the field-of-view of the image sensor. The obstruction may be located on the transparent protective layer and may be within 10 centimeters of the image sensor. The light source and image sensor may be located in the interior of a vehicle and oriented to face the exterior of the vehicle. The imaging system may use the image data captured by the image sensor to perform vehicle assist functions for the vehicle.

Claims

1. A method of operating an automotive imaging system having an image sensor, a light source, and processing circuitry, the method comprising:

with the image sensor, capturing image data over a field-of-view of the image sensor;

with the processing circuitry, performing a vehicle assist function using the captured image data;

with the light source, emitting light in a predetermined pattern, wherein emitting light in the predetermined pattern comprises emitting light of a first color for a first time period and emitting light of a second color that is different than the first color for a second time period subsequent to the first time period;

with the processing circuitry, determining whether the captured image data includes a portion of image data generated in response to a reflected version of the predetermined pattern of emitted light; and

with the processing circuitry, identifying that there is an obstruction present in the field-of-view of the image sensor in response to determining that the captured image data includes the portion of image data generated in response to the reflected version of the predetermined pattern of emitted light.

2. The method defined in claim 1, further comprising:

with the processing circuitry, determining a location and a size of the obstruction within the captured image data.

3. The method defined in claim 2, further comprising:

with the processing circuitry, comparing the determined size of the obstruction to a predetermined threshold size; and

in response to determining that the size of the obstruction is less than the predetermined threshold size, continuing to perform the vehicle assist function using the captured image data.

4. The method defined in claim 2, wherein the field-of-view has a periphery, the method further comprising:

with the processing circuitry, determining whether the location of the obstruction is at the periphery of the field-of-view; and

in response to determining that the location of the near-field obstruction is at the periphery of the field-of-view, continuing to perform the vehicle assist function using the captured image data.

5. The method defined in claim 2, further comprising:

with the processing circuitry, notifying a user of the vehicle that the obstruction is present in the field-of-view of the image sensor in response to determining the location and size of the obstruction.

6. The method defined in claim 1, wherein identifying that there is an obstruction present in the field-of-view of the image sensor comprises:

identifying that there is an obstruction present within 10 centimeters of the image sensor.

7. The method defined in claim 1, further comprising:

disabling the vehicle assist function in response to identifying that there is an obstruction present in the field-of-view of the image sensor.

8. The method defined in claim 1, further comprising:

altering the vehicle assist function in response to identifying that there is an obstruction present in the field-of-view of the image sensor.

9. The method defined in claim 1, wherein performing the vehicle assist function comprises performing a vehicle safety system function selected from the group consisting of:

a parking assistance function, a cruise control function, an auto-braking function, a collision avoidance function, a pedestrian detection function, and a lane keeping function.

10. An imaging system, comprising:

an image sensor configured to capture image data in response to light received over a field-of-view of the image sensor;

a transparent protective layer formed within the field-of-view of the image sensor;

a light source configured to emit light in a predetermined pattern;

processing circuitry configured to detect portions of the image data captured by the image sensor in response to the light emitted by the light source in the predetermined pattern and configured to identify an obstruction on the transparent protective layer in response to detecting the portions of the image data; and

a host subsystem configured to perform a vehicle assist function for the vehicle using the captured image data, wherein the vehicle assist function comprises a vehicle safety system function selected from the group consisting of;

a parking assistance function, a cruise control function, an auto-braking function, a collision avoidance function, a pedestrian detection function, and a lane keeping function.

11. The imaging system defined in claim 10, wherein the transparent protective layer comprises glass.

12. The imaging system defined in claim 10, wherein the transparent protective layer is formed within 10 centimeters from the image sensor.

13. The imaging system defined in claim 10, wherein the transparent protective layer comprises a windshield for a vehicle.

14. The imaging system defined in claim 13, wherein the predetermined pattern comprises a predetermined temporal and chromatic pattern.

15. A system, comprising:

a vehicle with an interior and an exterior;

a central processing unit;

memory;

input-output circuitry;

an imaging device configured to capture image data, wherein the imaging device is mounted at the interior of the vehicle and oriented to face the exterior of the vehicle, wherein the imaging device comprises a single image sensor that captures image data;

a host subsystem configured to perform vehicle assist functions for the vehicle using the captured image data, wherein the vehicle assist functions comprise a vehicle safety system function selected from the group consisting of;

a parking assistance function, a cruise control function, an auto-braking function, a collision avoidance function, a pedestrian detection function, and a lane keeping function;

a transparent protective layer separating the imaging device from the exterior of the vehicle; and

a light source mounted at the interior of the vehicle, wherein the light source is configured to emit a predetermined pattern of light and wherein the central processing unit is configured to detect a near-field obstruction of the single image sensor by identifying reflections of the predetermined pattern of light in the captured image data.

16. The system defined in claim 15, wherein the near-field obstruction comprises a physical object within a field-of-view of the imaging device, wherein the physical object is located on the exterior of the vehicle, and wherein the physical object is located within 10 centimeters of the imaging device.