Rain detection apparatus and method

• US 8,180,099 B2
• Filed: 01/14/2005
• Issued: 05/15/2012
• Est. Priority Date: 07/16/2002
• Status: Active Grant

• Current Assignee: TRW Limited (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Original Assignee: TRW Limited (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Inventors: Heenan, Adam John, Hazelden, Roger John, Thompson, Martin John, Buchanan, Alastair James
• Primary Examiner(s): TUCKER, WESLEY J
• Application Number:
  US11/035,677
• Publication Number:
  US 20050206511A1
• Time in Patent Office: 2,678 Days
• Field of Search: 382/100, 345/158, 340/604, 340/461, 250/208.1, 318/444
• US Class Current: 382/100
• CPC Class Codes: B60S 1/0822 characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: B60S 1/485 including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
• CPC Class Codes: B60S 1/603 the operation of at least a part of the cleaning means being controlled by electric means
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

A rain detection apparatus and method, comprising a camera adapted to view a surface and a processor adapted to capture at least one image from the camera, in which the processor is further adapted to generate at least one signal indicative of the presence of rain on the surface from information contained in the at least one captured image and to, optionally drive surface cleaning apparatus in response thereto, in which the apparatus is adapted to capture images focused at a plurality of distances; in which the processor includes edge detection means adapted to detect edges visible in the at least one captured image and difference means adapted to calculate the difference between the number of edges visible between differing images; and in which the edge detection means is further adapted to disregard edges close to areas of light larger than the largest raindrop that is desired or expected to be detected. The apparatus and method optionally includes a backlight, which the difference in numbers of edges between frames with and without the backlight illuminated being used to distinguish between background features and rain on the surface. The surface may be a vehicle windscreen, windshield or the cover or lens of a vehicle lamp, in which case the cleaning apparatus may be one or more wipers or washers.

Claims

1. A rain detection apparatus comprising:

a camera that is configured to view a surface and to generate a plurality of images thereof focused at a plurality of distances therefrom, each of the images containing a number of visible edges; and

a processor that captures the plurality of images from the camera and generates at least one signal that is indicative of a presence of rain on the surface from information contained in the plurality of captured images, wherein

the processor includes an edge detection means that detects edges that are visible in the plurality of captured images,

the processor includes a difference means that calculates a difference between the number of edges visible between differing images, and

the processor generates the at least one signal in response to the calculated difference between the number of edges visible between differing images.

2. The apparatus defined in claim 1 wherein the edge detection means disregards edges close to areas of light that are larger than a largest raindrop that is desired or expected to be detected.

3. The apparatus defined in claim 1 further including a backlight that is configured to illuminate the surface.

4. The apparatus defined in claim 3 wherein the backlight is configured to illuminate the surface with a given range of frequencies, and wherein the apparatus further includes an optical bandpass filter which preferentially allows the given range of frequencies to pass.

5. The apparatus defined in claim 3 wherein the difference means calculates a difference between the number of edges visible in captured images with and without the backlight illuminated.

6. The apparatus defined in claim 1 wherein the edge detection means is provided by convolving the image with a filter.

7. The apparatus defined in claim 6 wherein the filter includes a Sobel-like mask.

8. The apparatus defined in claim 7 wherein the mask includes a central peak and two troughs spaced on either side of the central peak in convolution space.

9. The apparatus defined in claim 1 wherein the camera is configured to be focused at a plurality of distances.

10. The apparatus defined in claim 9 wherein the camera is provided with a multi-focal lens to focus at a plurality of distances.

11. The apparatus defined in claim 1 configured to sense a location of other vehicles or of lane markings on a road in which the vehicle to which the system is fitted is situated.

12. The apparatus defined in claim 1 wherein the difference means subtracts a number of edges due to specular reflection of the backlight on the surface from a number of edges detected.

13. The apparatus defined in claim 1 wherein the surface is selected from a group including a vehicle window and a cover of a vehicle headlight.

14. An apparatus according to claim 1 configured to control a cleaning apparatus for a vehicle window.

15. A rain detection apparatus comprising:

a camera that is configured to view a surface and to generate a plurality of images thereof focused at a plurality of distances therefrom, each of the images containing a number of visible edges; and

a processor that captures the plurality of images from the camera and generates at least one signal that is indicative of a presence of rain on the surface from information contained in the plurality of captured images, wherein

the processor includes an edge detection means that detects edges that are visible in the plurality of captured images and a difference means that calculates the difference between the number of edges visible between differing images, and

the processor generates the at least one signal in response to the calculated difference between the number of edges visible between differing images.

16. The apparatus defined in claim 15 wherein the edge detection disregards edges close to areas of light that are larger than a largest raindrop that is expected to be detected.

17. The apparatus defined in claim 15 further including a backlight configured to illuminate the surface.

18. The apparatus defined in claim 17 wherein the backlight is configured to illuminate the surface with a given range of frequencies, and wherein the apparatus includes an optical bandpass filter which preferentially allows the given range of frequencies to pass.

19. The apparatus defined in claim 15 wherein the difference means calculates a difference between the numbers of edges visible in captured images with and without the backlight illuminated.

20. The apparatus defined in claim 15 wherein the edge detection means is provided by convolving the image with a filter.

21. The apparatus defined in claim 20 wherein the filter includes a Sobel-like mask.

22. The apparatus defined in claim 21 wherein the mask includes a central peak and two troughs spaced on either side of the central peak in convolution space.

23. The apparatus defined in claim 15 wherein the camera is configured to be focused at a plurality of distances.

24. The apparatus defined in claim 23 wherein the camera is provided with a multi-focal lens to focus at a plurality of distances.

25. The apparatus defined in claim 15 configured to sense a location of other vehicles on a road in which the vehicle to which the system is fitted is situated.

26. The apparatus defined in claim 15 wherein the difference means subtracts a number of edges due to specular reflection of the backlight on the surface from a number of edges detected.

27. The apparatus defined in claim 15 wherein the surface is a selected from a group including a vehicle window and a cover of a vehicle headlight.

28. An apparatus according to claim 15 configured to control a cleaning apparatus for a vehicle window.