Method for detecting rain on a windscreen

• US 7,860,275 B2
• Filed: 05/21/2007
• Issued: 12/28/2010
• Est. Priority Date: 05/22/2006
• Status: Active Grant

• Current Assignee: Valeo Vision (Valeo SE)
• Original Assignee: Valeo Vision (Valeo SE)
• Inventors: Bensrhair, Abdelaziz, Challita, Georges, Lelevé, Joël, Rebut, Julien
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US11/751,160
• Publication Number:
  US 20070267993A1
• Time in Patent Office: 1,317 Days
• Field of Search: 382/103, 382/104, 382/106, 382/107, 382/168, 382/172, 382/181, 382192-194, 382/199, 382/232, 382/240, 382/255, 382/274, 382/276, 382/286, 382/305, 382/312, 250/208.1, 250/227.25, 356/239.8
• US Class Current: 382/104
• CPC Class Codes: B60S 1/0822 characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: G01N 21/958 Inspecting transparent materials or objects, e.g. windscreens for conveyed flat sheet or rod G01N21/896
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30248 Vehicle exterior or interior
• CPC Class Codes: G06T 7/44 using image operators, e.g. filters, edge density metrics or local histograms
• CPC Class Codes: G06V 10/46 Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features colour feature extraction G06V10/56
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

A method for detecting raindrops on a windscreen, which uses a camera, which is fitted inside the vehicle opposite the windscreen and which is focused at infinite. The method comprises steps of acquiring images by a camera through the windscreen, camera preferably focused at infinite, retrieving the contours of the spots present on the acquired images, and realizing the histogram of the widths of contours of the spots.

Claims

1. A method comprising the steps of:

detecting

raindrops on a windscreen, using a camera, which is fitted inside the vehicle opposite the windscreen and which is focused at infinite;

thresholding, beyond a given minimum threshold, of the widths of contours of the spots, more particularly in order to confirm the possible presence of spots likely to correspond to droplets on the windscreen; and

reconstructing the droplets based on the thresholded widths of contour.

2. The method according to claim 1, wherein it uses the camera, which is also used to detect vehicles and roadside edges to make the vehicle headlamps switch from one mode of lighting to another.

3. The method according to claim 1, wherein said method further comprises the step of:

characterizing the reconstructed spots, including at least one of the following measurements;

measure of variation of the greyscale in the spots, measure of blur of said spots, measure of shape of said spots, count of the number of spots.

4. The method according to claim 1, wherein at least one of the steps are implemented within the framework of a hierarchical approach.

5. The method according to claim 1, wherein said method further comprises the step of:

participating in automatic triggering or automatic modification of a functionality of the vehicle, more particularly actuation of the windscreen wipers, once the droplets of water have been detected on the windscreen.

6. The method according to claim 1 and further comprises the means of storing information, wherein said means memorizes one or more programs, the execution of which authorizes implementation of said method.

7. The method according to claim 1 and further comprises a computer readable medium comprising means of storing information, comprising one or more sequences of executable instructions by a microprocessor executing sequences of instructions authorizing implementation of said method.

8. The method according to claim 1, wherein it uses the camera, which is also used to detect vehicles to make the vehicle headlamps switch from one mode of lighting to another.

9. The method according to claim 1, wherein it uses the camera, which is also used to detect roadside edges to make the vehicle headlamps switch from one mode of lighting to another.

10. The method according to claim 1 and further comprises a computer readable medium comprising means of storing information, comprising one or more sequences of executable instructions by a computer executing sequences of instructions authorizing implementation of said method.

11. The method according to claim 1 and further comprises a computer readable medium comprising means of storing information, comprising one or more sequences of executable instructions by a microprocessor and computer executing sequences of instructions authorizing implementation of said method.

12. A method for detecting raindrops on a windscreen, which comprises the steps of:

a stage (a) of acquiring images by a camera through the windscreen, camera preferably focused at infinite;

a stage (b) of retrieving contours of the spots present on the acquired images;

a stage (c) of realizing a histogram of the widths of said contours of the spots;

a stage (d) thresholding, beyond a given minimum threshold, of the widths of contours of the spots, more particularly in order to confirm the possible presence of spots likely to correspond to droplets on the windscreen; and

a stage (e) of reconstructing the droplets based on the thresholded widths of contour.

13. A device for detecting raindrops on a windscreen, which comprises:

means for acquiring images by a camera through the windscreen, said camera being focused at infinite;

means for retrieving contours of the spots present on the acquired images;

means for realizing the histogram of the widths of contours of the spots;

means for thresholding, beyond a given minimum threshold, of the widths of contours of the spots, in order to identify the possible presence of spots likely to correspond to droplets on the windscreen;

means of reconstructing/characterizing the spots based on the thresholded widths of contour, including at least one means for measuring one of the following parameters;

measure of variation of the greyscale in the spots, measure of blur of said spots, measure of shape of said spots, or count of said spots;

means of automatic triggering or automatic modification of a functionality of the vehicle, including at least an actuation of the windscreen wipers.

14. The device according to claim 13, wherein the camera is shared with at least one other device equipping said vehicle.

15. A vehicle rain sensing system for sensing rain on a windshield comprising of:

a camera for capturing an image of raindrops and generating information in response thereto;

a processor for processing said information and generating contour information of said raindrops; and

a control for energizing at least one windshield wiper in response to said contour information;

wherein said processor thresholds beyond a given minimum threshold, of the widths of contours of the spots, more particularly in order to confirm the possible presence of spots likely to correspond to droplets on the windscreen and reconstructs the droplets based on the thresholded widths of contour.

16. The vehicle rain sensing system as claimed in claim 15 wherein said camera is set at infinite focus.

17. The vehicle rain sensing system as claimed in claim 15 in response wherein said processor thereto generates a histogram in response to said raindrops.

18. The vehicle rain sensing system as claimed in claim 17 wherein said histogram is a histogram of widths of raindrops.

19. The vehicle rain sensing system as claimed in claim 15 wherein said camera is adapted to capture images situated away from said windshield.

20. The vehicle rain sensing system as claimed in claim 19 wherein said camera is located in a passenger compartment of said vehicle.