SYSTEMS AND METHODS FOR DETECTING OBSTRUCTIONS IN A CAMERA FIELD OF VIEW

• US 20160031372A1
• Filed: 10/12/2015
• Published: 02/04/2016
• Est. Priority Date: 11/23/2005
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Inventors: Stein, Gideon, Hadassi, Ofer
• Granted Patent: US 10,011,226 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60Q 1/0023 the element being a sensor, e.g. distance sensor, camera
• CPC Class Codes: B60Q 1/1423 Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
• CPC Class Codes: B60Q 1/20 Fog lights
• CPC Class Codes: B60Q 2300/146 Abnormalities, e.g. fail-safe
• CPC Class Codes: B60Q 2300/312 Adverse weather
• CPC Class Codes: B60Q 2300/314 Ambient light
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60S 1/023 including defroster or demisting means
• CPC Class Codes: B60S 1/04 Wipers or the like, e.g. scrapers
• CPC Class Codes: B60S 1/0822 characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A system mounted on a vehicle for detecting an obstruction on a surface of a window of the vehicle, a primary camera is mounted inside the vehicle behind the window. The primary camera is configured to acquire images of the environment through the window. A secondary camera is focused on an external surface of the window, and operates to image the obstruction. A portion of the window, i.e. window region is subtended respectively by the field of view of the primary camera and the field of view of the secondary camera. A processor processes respective sequences of image data from both the primary camera and the secondary camera.

Claims

1. A system mountable on a vehicle, the system comprising:

a primary camera configured to acquire a plurality of primary images of the environment through the window;

a secondary camera adapted to focus on at least a portion of a surface of the window to acquire a secondary image of an obstruction when present on the surface, wherein a region of the window is subtended by respective fields of view of the primary camera and the secondary camera;

a light source adapted to illuminate the window with a puke of light, wherein the secondary camera is operated synchronously with the light source; and

a processor adapted to process the secondary image to detect the obstruction in the secondary image.

2. The system of claim 1, wherein the processor is configured to activate a low visibility mode of the primary camera when the obstruction is detected in the secondary image.

3. The system of claim 1, wherein the processor is adapted to perform edge detection of the obstruction.

4. The system of claim 1, wherein information is extracted from at least one of the primary images to selectably either enhance a classification of the obstruction or eliminate false identification of the obstruction.

6. The system of claim 1, further comprising:

an activation mechanism operatively attached to the processor, wherein the activation mechanism is operable to cause cleaning fluid to be sprayed on the window and windshield wipers to be activated when the processor identifies the obstruction as including dirt on an external surface of the window while the external surface is dry.

7. The system of claim 1, further comprising:

an activation mechanism operatively attached to the processor, the activation mechanism activating windshield wipers when the processor identifies the obstruction on an external surface of the window.

8. The system of claim 1, wherein the processor is adapted to initiate a task to remove the obstruction.

9. The system of claim 8, wherein the task is selected from the group of tasks consisting of:

notification of the driver of the vehicle, disabling the system, activating wipers with or without cleaning fluid, activating defogging, and turning on fog lights.

10. The system of claim 1, wherein the secondary camera is adapted to also focus on at least a portion of an internal surface of the window and wherein the processor identifies the obstruction when present on the at least a portion of the internal surface.

11. The system of claim 1, wherein the secondary camera is further adapted to perform a task selected from the group of applications consisting of:

ambient light sensing, and gain control sensing.

5. The system of calm 1, wherein the obstruction causes a measurable deterioration of image quality in the primary images.

12. A method performable by a system mountable inside a vehicle, the system including a primary camera and a secondary camera both connectible to a processor, the method comprising the steps of:

enabling acquiring through a window from the primary camera a primary image of the environment;

wherein the secondary camera is focused on a surface of the window to provide a secondary image of the surface, wherein a region of the window is subtended by respective fields of view of the primary camera and the secondary camera;

illuminating the window with a pulsing light source, wherein the secondary camera is operated synchronously with the pulsing light source; and

processing the secondary image for an obstruction if present on the surface.

13. The method of claim 12, wherein the processing is responsive to the illuminating.

14. The method of claim 12, wherein the processing includes edge detection of the obstruction.

15. The method of claim 12, wherein the processing of the secondary image uses information extracted from the primary image to selectably either enhance identifying the obstruction or eliminating false identification of an obstruction.

16. The method, according to claim 12, further comprising the step of:

upon determining a level of ambient light, setting a mode of the system to selectably either day mode, dusk mode or night mode.

17. The method, according to claim 16, when determining the level of ambient light as being of dusk mode or night mode, turning on the headlights.

18. The method of claim 12, further comprising the step of:

initiating at least one task to remove the obstruction.

19. The method of claim 16, wherein the at least one task is selected from the group of tasks consisting of:

notification of the driver of the vehicle, disabling the system, activating windshield wipers, spraying fluid on windshield and activating defogging of a window.

20. The method of claim 12, further comprising the step of:

enabling activating a low visibility mode of the primary camera when the obstruction is detected in the secondary image.