SYSTEMS AND METHODS FOR DETECTING OBSTRUCTIONS IN A CAMERA FIELD OF VIEW

• US 20070115357A1
• Filed: 11/23/2006
• Published: 05/24/2007
• Est. Priority Date: 11/23/2005
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: Mobileye Technologies Limited (Intel Corporation)
• Inventors: Stein, Gideon, Hadassi, Ofer
• Granted Patent: US 8,553,088 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60Q 1/0023 the element being a sensor, e.g. distance sensor, camera
• CPC Class Codes: B60Q 1/1423 Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
• CPC Class Codes: B60Q 1/20 Fog lights
• CPC Class Codes: B60Q 2300/146 Abnormalities, e.g. fail-safe
• CPC Class Codes: B60Q 2300/312 Adverse weather
• CPC Class Codes: B60Q 2300/314 Ambient light
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60S 1/023 including defroster or demisting means
• CPC Class Codes: B60S 1/04 Wipers or the like, e.g. scrapers
• CPC Class Codes: B60S 1/0822 characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A system mounted on a vehicle for detecting an obstruction on a surface of a window of the vehicle, a primary camera is mounted inside the vehicle behind the window. The primary camera is configured to acquire images of the environment through the window. A secondary camera is focused on an external surface of the window, and operates to image the obstruction. A portion of the window, i.e. window region is subtended respectively by the field of view of the primary camera and the field of view of the secondary camera. A processor processes respective sequences of image data from both the primary camera and the secondary camera.

Claims

1. A system mounted on a vehicle for classifying at least one obstruction on a surface of a window of the vehicle, the system comprising:

(a) a secondary camera mounted inside the vehicle, said secondary camera focusing on at least a portion of the surface of the window; and

(b) a processor which processes a plurality of secondary images acquired by said secondary camera, and identifies the at least one obstruction when present on the surface;

wherein the surface of the window can be selectably either the external surface of the window or the internal surface of the window.

2. The system of claim 1, further comprising a primary camera mounted inside the vehicle, the primary camera configured to acquire a plurality of primary images of the environment through the window, wherein a region of the window is subtended by respective fields of view of said secondary camera and said primary camera, wherein said processor processes respectively at least one of said primary images and at least one of the secondary images.

3. The system of claim 2, wherein said processor processes at least one of said primary images and wherein said processing of said at least one secondary image uses information extracted from said at least one primary image to selectably either enhance identifying said at least one obstruction or eliminating false identification of an obstruction.

4. The system of claim 2, wherein said at least one obstruction causes a deterioration of quality in said at least one primary image, and wherein said processor determines said deterioration of image quality in at least one of said primary images, wherein said deterioration is caused by said at least one obstruction.

5. The system of claim 1, further comprising:

(c) an activation mechanism operatively attached to said processor, said activation mechanism causing cleaning fluid to be sprayed on the window and windshield wipers to be activated when said processor identifies the at least one obstruction as including dirt on the window while the surface is dry

6. The system of claim 1, further comprising:

(c) an activation mechanism operatively attached to said processor, said activation mechanism activating windshield wipers when said processor identifies the at least one obstruction as including dirt and moisture on the window.

7. The system of claim 1, when said processor identifies the at least one obstruction, said processor initiates a task to remove said at least one obstruction.

8. The system of claim 7, wherein said task is selected from the group of tasks consisting of:

notification of the driver of the vehicle, disabling the system, activating wipers with or without cleaning fluid and activating defogging, turning on fog lights.

9. The system of claim 1, wherein said secondary camera is also focusing on at least a portion of the internal surface of the window and wherein said processor identifies the at least one obstruction when present on said at least a portion of the internal surface.

10. The system of claim 1, wherein said secondary camera performs tasks for said primary camera selected from the group of applications consisting of:

ambient light sensing, gain control sensing.

11. The system of claim 2, further comprising a pulsing light source, said light source capable of illuminating said region whereas said secondary camera is synchronized with the timing of activating said light source and images said region.

12. In a system mounted on a vehicle, the vehicle including a window, a method comprising the steps of:

(a) providing a secondary camera mounted inside the vehicle focusing on a surface of the window, said camera providing at least one secondary image of said surface; and

(b) processing said at least one secondary image thereby identifying at least one obstruction when present on said surface.

13. The method of claim 12, wherein said processing includes edge detection of said at least one obstruction.

14. The method of claim 12, further comprising the steps of:

(c) providing a primary camera mounted inside the vehicle, the primary camera configured to acquire a plurality of primary images of the environment through the window, wherein a region of the window is subtended by respective fields of view of said secondary camera and said primary camera;

(d) processing said at least one primary image thereby detecting at least one obstruction when present on said surface, said at least one obstruction causing a deterioration of quality in said at least one primary image; and

(e) determining deterioration of image quality in at least one of said primary images, wherein said deterioration is caused by said at least one obstruction.

15. The method of claim 14, wherein said identifying at least one obstruction is also performed by processing of said at least one primary image, wherein said processing of said at least one secondary image uses information extracted from said at least one primary image to selectably either enhance identifying said at least one obstruction or eliminating false identification of an obstruction.

16. The method, according to claim 12, further comprising a step of:

(c) upon determining a level of ambient light, setting a mode of the system to selectably either day mode, dusk mode or night mode.

17. The method, according to claim 16, when determining said level of ambient light as being of dusk mode or night mode, turning on the headlights.

18. The method of claim 12, wherein said at least one obstruction is selected from the group consisting of:

rain, dirt, mud, snow, frost, cracks, smoke, dust, condensation, smeared insects and bird droppings.

19. The method of claim 12, further comprising the step of:

(c) initiating at least one task to remove said at least one obstruction.

20. The method of claim 19, wherein said at least one task is selected from the group of tasks consisting of:

notification of the driver of the vehicle, disabling the system, activating windshield wipers, spraying fluid on windshield and activating defogging of a window.

21. The method of claim 12, wherein said processing of said at least one primary image includes at least one other vehicular vision processing step selected from the group consisting of:

detecting lane markings in a road, detecting pedestrians, detecting vehicles, detecting obstacles, detecting road signs, lane keeping, headway keeping and headlights control; and

wherein said at least one other vehicular vision processing step is turned off.

22. The method of claim 12, wherein said identifying of said at least one obstruction includes classifying said at least one obstruction, using a Support Vector Machine technique.

23. The method of claim 22, wherein said identifying of said at least one obstruction includes classifying use SVM with Radial Basis Function kernel techniques.

24. The method of claim 12, wherein said secondary camera images a region of said window, further comprising the step of:

illuminating said window with a pulsing light source, wherein said secondary camera is operated synchronously with said light source, and said secondary camera images said surface of the window.