Method for identifying soiling on a transparent screen

• US 8,274,562 B2
• Filed: 02/21/2006
• Issued: 09/25/2012
• Est. Priority Date: 07/27/2005
• Status: Expired due to Fees

• Current Assignee: ADC GmbH (TE Connectivity Ltd. (United Kingdom))
• Original Assignee: ADC GmbH (TE Connectivity Ltd. (United Kingdom))
• Inventors: Walter, Michael, Zobel, Matthias
• Primary Examiner(s): Chen, Wing
• Assistant Examiner(s): Thieu, Benjamin M
• Application Number:
  US11/989,349
• Publication Number:
  US 20090046148A1
• Time in Patent Office: 2,408 Days
• Field of Search: 348113-118, 348148-149, 348/122, 382/104
• US Class Current: 348/148
• CPC Class Codes: B60S 1/0822 characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: G01N 2021/8887 based on image processing techniques
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

A camera for identifying soiling on a protective screen, such as a vehicle windscreen, is focused on a scene through the protective screen and can be used to identify soiling and for other applications, e.g. to identify driving lanes and/or objects in the scene. Soiling is identified merely by evaluating successively recorded image frames, and artificial reference frames or reference objects are not required. A prerequisite is that the relative speed v_rel between the camera and at least one recorded object in the scene is not equal to zero and its trajectory in the image is predicted. By comparing the relevant image frame sections, possible soiling on subregions of the protective screen is identified.

Claims

1. A method to identify soiling on a protective screen of a motor vehicle, wherein a camera is arranged in the motor vehicle to monitor, through the protective screen, a surrounding environment outside of the motor vehicle, and the camera is focused on a scene in the surrounding environment through the protective screen,

characterized in that

a relative velocity v_rel between the camera and at least one recorded object in the surrounding environment recorded by the camera is not equal to zero,

a trajectory of the at least one recorded object with v_rel not equal to zero is predicted, and

a degree of correspondence of the recorded object and/or several similar objects as recorded in different image regions respectively imaged by the camera through different partial areas of the protective screen is analyzed and a conclusion is derived therefrom about soiling on the screen based on determining a difference of a degree of soiling respectively on the different partial areas of the protective screen.

2. A method according to claim 1, characterized in that

measuring windows are set along the predicted trajectory,

the recorded object is detected in more than one measuring window in images recorded in a chronologically offset manner and/or

several similar objects, being roadway markings, along the predicted trajectory are detected in more than one measuring window.

3. A method according to claim 2, characterized in that in case of a linear movement of the camera, with a linear movement of the vehicle, the measuring windows are set along straight lines, which proceed radially from a vanishing point of a respective camera image.

4. A method according to claim 1, characterized in that in a measuring window respective values of

an image contrast and/or

an image brightness or its standard deviation and/or

gray tone differences are determined, and soiling is identified, if a difference of the values in corresponding measuring windows is greater than a given threshold value.

5. A method according to claim 4, characterized in that in case of a linear movement of the camera, with a linear movement of the vehicle, the measuring windows are set along straight lines, which proceed radially from a vanishing point of a respective camera image.

6. A method according to claim 1, characterized in that the trajectories of the recorded objects, which are static objects, are predicted on the basis of

a) characteristics of the surrounding environment and/or

b) an instantaneous camera movement of the camera and/or

c) a mounting position of the camera

and the measuring windows are arranged along at least one of the trajectories.

7. A method of identifying soiling on a protective screen of a motor vehicle using a camera arranged in the vehicle, comprising steps:

a) directing and focusing a field of view of said camera through said protective screen so as to acquire successive image frames of a surrounding environment outside of said motor vehicle with said camera;

b) selecting at least one selected object that is present in said surrounding environment, and that is imaged respectively as at least one object image in said successive image frames, and that has a non-zero relative velocity relative to said camera such that said at least one object image is moving in said field of view and is imaged successively through different sub-regions of said protective screen in said successive image frames;

c) predicting a respective trajectory of a motion of said at least one object image in said field of view;

d) specifying plural image regions, corresponding to said sub-regions of said protective screen, respectively along said trajectory in said field of view among said successive image frames such that said at least one object image respectively appears successively in said plural image regions successively among said successive image frames;

e) detecting respective values of at least one image parameter of said at least one object image successively in said plural image regions successively among said successive image frames; and

f) comparing said respective values in said plural image regions successively among said successive image frames, and determining a variation of a degree of soiling of said different sub-regions of said protective screen from said comparing.

8. The method according to claim 7, wherein said field of view of said camera is focused only on said surrounding environment and is not focused on said protective screen.

9. The method according to claim 7, wherein said at least one image parameter comprises at least one of:

an image contrast, image gray tone variations, an average value of image brightness, and a standard deviation of image brightness.

10. A method of identifying soiling on a protective screen of a motor vehicle using a camera arranged in the vehicle, comprising steps:

a) acquiring with said camera, through said protective screen, successive image frames of a surrounding environment outside of said motor vehicle;

b) selecting at least one object of said surrounding environment, wherein each said object exhibits motion among said successive image frames;

c) predicting a respective trajectory of said motion of each said object among said successive image frames;

d) detecting respective values of at least one image parameter of each said object respectively at successive positions of said object along said trajectory through successive different sub-regions of said protective screen respectively in said successive image frames; and

e) evaluating a variation of said values, and determining different degrees of soiling of said different sub-regions of said protective screen from a result of said evaluating.

11. The method according to claim 10, wherein, for said acquiring of said image frames, said step a) comprises focusing said camera on said surrounding environment and not on said protective screen.

12. The method according to claim 10, wherein said at least one image parameter comprises at least one of:

an image contrast, image gray tone variations, an average value of image brightness, and a standard deviation of image brightness.

13. The method according to claim 10, further comprising comparing said different degrees of soiling to a threshold, and determining that an unacceptable degree of soiling exists when at least one of said different degrees of soiling exceeds said threshold.

14. The method according to claim 10, further comprising establishing measuring windows along said trajectory in a field of view of said camera, wherein said successive positions respectively fall into successive ones of said measuring windows, wherein said successive measuring windows correspond to said different sub-regions of said protective screen, and wherein said detecting is carried out successively in said successive measuring windows.

15. The method according to claim 14, wherein said measuring windows are established along straight radial lines extending radially outwardly from a vanishing point of said field of view of said camera.

16. The method according to claim 10, wherein said respective trajectory for each said object is established along a straight radial line extending radially outwardly from a vanishing point of each one of said image frames.

17. The method according to claim 10, wherein said object is a static object that does not move in said surrounding environment, said vehicle is moving in said surrounding environment, and said trajectory of said static object is predicted based on at least one of:

characteristics of said surrounding environment, an instantaneous camera motion of said camera, and a mounting position of said camera on said motor vehicle.

18. The method according to claim 10, wherein said at least one object comprises successive similar objects being roadway markings in said surrounding environment.

19. The method according to claim 10, wherein said protective screen is a windshield of said motor vehicle.

20. The method according to claim 10, further in combination with using said camera to monitor said surrounding environment, comprising obtaining from said successive image frames additional information, in addition to said selecting, said predicting and said detecting of said steps b), c) and d), and using said additional information in an additional application in said motor vehicle.