DRIVING ASSISTANCE SYSTEM AND RAINDROP DETECTION METHOD THEREOF

• US 20140028849A1
• Filed: 03/08/2012
• Published: 01/30/2014
• Est. Priority Date: 04/13/2011
• Status: Active Application

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Hayakawa, Yasuhisa, TSUCHIYA, Chikao
• Application Number:
  US14/111,409
• Publication Number:
  US 20140028849A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A driving assistance system 1 is installed in a moving object and includes; image-capturing means 10 to capture a surrounding image I including a portion of the moving object, first edge line storing means 22 to store a first edge line E1 detected from a first surrounding image I captured in normal conditions by the image-capturing means 10, and calculating means 23 to calculate a matching degree between the first edge line E1 and a second edge line E2 detected from a second surrounding image I currently captured by the image-capturing means 10. A raindrop judging means 24 judges that a raindrop is attached to the lens unit of the image-capturing means 10 in response to a decrease in the matching degree between the first edge line E1 and the second edge line E2.

Claims

1-13. -13. (canceled)

14. A driving assistance system to provide various kinds of information to a driver of a moving object from an image-capturing result of surroundings of the moving object, comprising:

image-capturing unit installed on the moving object and configured to capture a surrounding image including a portion of the moving object;

first edge line storing unit configured to store a first edge line detected from a first surrounding image captured in advance by the image-capturing unit;

edge detecting unit configured to detect a second edge line from a second surrounding image currently captured by the image-capturing unit;

calculating unit configured to calculate a matching degree between the first edge line stored in the first edge line storing unit and the second edge line detected by the edge detecting unit; and

raindrop judging unit configured to judge that a raindrop is attached to a lens unit of the image-capturing unit, in response to a decrease in the matching degree between the first edge line and the second edge line, wherein

the calculating unit calculates a deviation degree between the first edge line stored in the first edge line storing unit and the second edge line detected by the edge detecting unit, and

when the deviation degree is equal to or larger than a predetermined value, the raindrop judging unit determines that the matching degree has decreased and judges that the raindrop is attached to the lens unit of the image-capturing unit.

15. The driving assistance system according to claim 14, further comprising detection sensitivity lowering unit configured to lower sensitivity of detection of another moving object from the second surrounding image currently captured by the image-capturing unit, when the raindrop judging unit judges that a raindrop is attached to the lens unit of the image-capturing unit.

16. The driving assistance system according to claim 14, further comprising raindrop detection sensitivity lowering unit configured to lower sensitivity of raindrop detection from the second surrounding image currently captured by the image-capturing unit, when the raindrop judging unit judges that a raindrop is attached to the lens unit of the image-capturing unit,

17. The driving assistance system according to claim 16, wherein

when the raindrop judging unit judges that a raindrop is attached to the lens unit of the image-capturing unit, the raindrop detection sensitivity lowering unit lowers the sensitivity of raindrop detection in a part of the second surrounding image currently captured by the image-capturing unit, the part judged as having the raindrop attached thereto.

18. The driving assistance system according to claim 14, wherein

when the deviation degree calculated by the calculating unit stays equal to or smaller than a prescribed value over a predetermined period of time, the first edge line storing unit stores, as the first edge line, the second edge line detected by the edge detecting unit within the predetermined period of time.

19. The driving assistance system according to claim 14, wherein

the first edge line storing unit stores, as the first edge line, the second edge line detected by the edge detection unit at a prescribed period of time before the current time.

20. The driving assistance system according to claim 14, wherein

the image-capturing unit is installed with an optical axis thereof directed obliquely downward from a horizontal direction.

21. The driving assistance system according to claim 14, wherein

the calculating unit calculates the deviation degree by determining how many pixels a special point on the second edge line detected by the edge detecting unit is shifted from a point on the first edge line stored by the first edge line storing unit, the point on the first edge line corresponding to the special point.

22. The driving assistance system according to claim 21, wherein

the calculating unit:

determines how many pixels each of all the special points on the second edge line detected by the edge detecting unit are shifted from the point on the first edge line stored by the first edge Sine storing unit, the point on the first edge line corresponding, to the special point; and

calculates, as the deviation degree, a sum of the determined numbers of pixels for all the points.

23. The driving assistance system according to claim 14, wherein

the calculating unit calculates the deviation degree on the basis of a difference between a luminance gradient direction of a special point on the second edge line detected by the edge detecting unit, and a luminance gradient direction of a point on the first edge line stored by the first edge line storing unit, the point on the first edge line corresponding to the special point.

24. The driving assistance system according to claim 23, wherein

the calculating unit:

calculates an angle formed by a luminance gradient direction of each of all the special points on the second edge line detected by the edge detecting unit, and a luminance gradient direction of the point on the first edge line stored by the first edge line storing unit, the point on the first edge line corresponding to the special point; and

calculates, as the deviation degree, a sum of the calculated angles for all the points.

25. A raindrop detection method for a driving assistance system capable of providing various kinds of information to a driver of a moving object from an image-capturing result of surroundings of the moving object, the method comprising:

an image-capturing step, of capturing a surrounding image including a portion of the moving object, performed by an image-capturing unit installed on the moving object;

an edge detecting step of detecting an edge line for the portion of the moving object in the image captured in the image-capturing step;

a calculating step of calculating a matching degree between a previously-stored edge line detected from a first surrounding image captured in advance in the image-capturing step, and the edge line detected from a second surrounding image currently captured; and

a raindrop judging step of judging, in response to a decrease in the matching degree between the previously-stored edge line and the edge line detected from the second surrounding image, that a raindrop is attached to a lens unit of the image-capturing unit, wherein

the calculating step includes calculating a deviation degree between the previously-stored edge line stored in advance as a reference for the portion of the moving object targeted for image capturing in the image-capturing step, and the edge line detected from the second surrounding image, and

the raindrop judging step includes determining that the matching degree has decreased and judging that a raindrop is attached to the lens unit of the image-capturing unit, when the deviation degree is equal to or larger than a predetermined value.

26. A raindrop detection method for a driving assistance system capable of providing various kinds of information to a driver of a moving object from an image-capturing result of surroundings of the moving object, the method comprising:

an image-capturing step, of capturing a surrounding image including a portion of the moving object, performed by an image-capturing unit installed on the moving object;

an edge detecting step of detecting an edge fine for the portion of the moving object in the image captured in the image-capturing step;

a calculating step of calculating a matching degree between a previously-stored edge line detected from a first surrounding image captured in advance in the image-capturing step, and the edge line detected from a second surrounding image currently captured; and

a raindrop judging step of judging, in response to a decrease in the matching degree between the previously-stored edge line and the edge line detected from the second surrounding image, that a raindrop is attached to a lens unit of the image-capturing unit,

wherein

the calculating step includes calculating a deviation degree between the previously-stored edge line in an image captured in the past in the image-capturing step and the edge line detected from the second surrounding image, and

the raindrop judging step includes determining that the matching degree is decreased and judging that a raindrop is attached to the lens unit of the image-capturing unit, when the deviation degree is equal to or larger than a predetermined value.

27. A driving assistance system to provide various kinds of information to a driver of a moving object from an image-capturing result of surroundings of the moving object, comprising:

image-capturing means for capturing a surrounding image including a portion of the moving object;

first edge line storing means for storing a first edge line detected from a first surrounding image captured in advance by the image-capturing means;

edge detecting means for detecting a second edge line from a second surrounding image currently captured by the image-capturing means;

calculating means for calculating a matching degree between the first edge line stored in the first edge line storing means and the second edge line detected by the edge detecting means; and

raindrop judging means for judging that a raindrop is attached to a lens unit of the image-capturing means, in response to a decrease in the matching degree between the first edge line and the second edge line, wherein

the calculating means calculates a deviation degree between the first edge line stored in the first edge line storing means and the second edge line detected by the edge detecting means, and

when the deviation degree is equal to or larger than a predetermined value, the raindrop judging means determines that the matching degree has decreased and judges that the raindrop is attached to the lens unit of the image-capturing means.