Method and apparatus for recognizing directional structures on a window pane of a vehicle

• US 9,616,851 B2
• Filed: 05/15/2012
• Issued: 04/11/2017
• Est. Priority Date: 06/17/2011
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Halimeh, Jad, Huelsen, Michael, Schmid, Roland, Uhler, Werner, Frederiksen, Annette, Simon, Stephan
• Primary Examiner(s): Goradia, Shefali
• Application Number:
  US14/127,069
• Publication Number:
  US 20140321701A1
• Time in Patent Office: 1,792 Days
• Field of Search: None
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: B60S 1/0874 characterized by the position of the sensor on the windshield
• CPC Class Codes: B60S 2001/3844 equipped with means to indicate wear or usage of blade
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions

Abstract

A method for recognizing directional structures on a window pane of a vehicle is described. The method includes carrying out an assessment of image points of an image of the window pane, which image points are disposed along an evaluation path, a course of the evaluation path being dependent on an expected orientation of the directional structures on the window pane. The method further includes recognizing a directional structure based on the assessment.

Claims

1. A method for automatically determining a wear condition of a vehicle component by recognizing directional structures on a window pane of a vehicle, comprising:

carrying out an assessment of image points of an image of at least a portion of the window pane, which image points are disposed along an evaluation path, a course of the evaluation path being dependent on an expected orientation of the directional structures on the window pane;

carrying out a determination of whether an image point disposed along the evaluation path constitutes a light diffraction effect in a region of the window pane represented by the image point;

recognizing a directional structure based on the assessment and the determination;

based at least on the determining, classifying a wear condition of the vehicle component; and

based at least on the classifying, alerting a user of the wear condition.

2. The method as recited in claim 1, wherein the carrying out the assessment step includes determining whether an image point disposed along the evaluation path constitutes a contamination of a region of the window pane represented by the image point.

3. The method as recited in claim 1, further comprising:

carrying out a further assessment of image points of the image of the window pane, which image points are disposed along a further path, a course of the further path being approximately perpendicular to the course of the evaluation path, wherein, in the recognizing step, the directional structure is determined based on the assessment and the further assessment.

4. The method as recited in claim 3, wherein the course of the evaluation path is dependent on a wiping trajectory of a wiping edge of a wiping device for wiping the window pane.

5. The method as recited in claim 4, further comprising:

ascertaining a condition of the wiping edge based on an item of information relating to the directional structure.

6. The method as recited in claim 5, further comprising:

carrying out a subsequent assessment of image points of a subsequent image of the window pane, which image points are disposed along the evaluation path, and

recognizing a subsequent directional structure based on the subsequent assessment, and wherein, in the ascertaining step, the condition of the wiping edge is ascertained further based on an item of information relating to the subsequent directional structure.

7. The method as recited in claim 1, in the carrying out of the assessment, taking into consideration at least one of:

i) slit diffraction effects and ii) refraction effects.

8. The method as recited in claim 1, wherein the directional structures are one of:

i) scratches, ii) smears, iii) classified as scratches, or iv) classified as smears.

9. The method as recited in claim 1, further comprising:

determining at least one of;

i) an extent of the directional structures, ii) a thickness of the directional structures iii) an orientation of the directional structures, iv) the spacing of the directional structures from one another, and v) differences of the directional structures from one another.

10. The method as recited in claim 1, further comprising:

analyzing the image points of the image of the window pane to recognize fogging on an inside of the window pane.

11. The method as recited in claim 1, wherein the directional structures are smears.

12. The method as recited in claim 11, wherein the smears are water smears.

13. The method as recited in claim 1, wherein the directional structures are scratches.

14. An apparatus for automatically determining a wear condition of a vehicle component by recognizing directional structures on a window pane of a vehicle, comprising:

an image capture device to capture an image of the window pane;

an implementation device which receives the image of the window pane from the image capture device and carries out an assessment of image points of the image of the window pane, which image points are disposed along an evaluation path, a course of the evaluation path being dependent on an expected orientation of the directional structures on the window pane, and carry out a determination of whether an image point disposed along the evaluation path constitutes a light diffraction effect in a region of the window pane represented by the image point;

a recognition device recognize a directional structure based on the assessment and determine the wear condition of the vehicle component based on the assessment; and

an alert device to alert a user of the wear condition.

15. A non-transitory computer readable medium storing program code to automatically determine a wear condition of a vehicle component by recognizing directional structures on a window pane of a vehicle, the program code, when executed by an information system, causing the information system to perform the following steps:

receiving an image of at least a portion of the window pane from an image capture device;

carrying out an assessment of image points of the received image of at least a portion of the window pane, which image points are disposed along an evaluation path, a course of the evaluation path being dependent on an expected orientation of the directional structures on the window pane;

carrying out a determination of whether an image point disposed along the evaluation path constitutes a light diffraction effect in a region of the window pane represented by the image point;

recognizing a directional structure based on assessment;

based at least on the assessment, determining the wear condition of the vehicle component; and

based at least on the determining, alerting a user of the wear condition.