Method and device for assisting a driver while driving a vehicle by detecting weather-related visibility limitations

• US 9,128,813 B2
• Filed: 04/05/2011
• Issued: 09/08/2015
• Est. Priority Date: 04/16/2010
• Status: Active Grant

• Current Assignee: Conti Temic Microelectronic GmbH (Continental AG)
• Original Assignee: Conti Temic Microelectronic GmbH (Continental AG)
• Inventors: Almedia, Carlos, Randler, Martin, Bauer, Jochen
• Primary Examiner(s): Algahaim, Helal A
• Assistant Examiner(s): MOTT, GENNA M
• Application Number:
  US13/640,516
• Publication Number:
  US 20130103257A1
• Time in Patent Office: 1,617 Days
• Field of Search: 701/36, 701/45, 701/48, 701/49, 701/1, 340601-604
• US Class Current: 1/1
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 1/20 Fog lights
• CPC Class Codes: B60Q 1/303 Rear fog lamps
• CPC Class Codes: B60Q 2300/312 Adverse weather
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

The invention relates to a method for assisting a driver in driving a vehicle by detecting weather-related visibility limitations, wherein image data of the surroundings of the vehicle and of the windshield are generated by a camera that is directed toward the windshield.

Claims

1. A method for assisting a driver in driving a vehicle by detecting weather-related visibility limitations, wherein image data of the surroundings of the vehicle and of a windshield of the vehicle are generated by a camera that is directed toward the windshield, including:

generating at least one image by the camera which includes a bifocal optical element so that the camera is focused on the windshield in a first image region and focused on the surroundings of the vehicle in a second image region;

detecting wetting of at least one of the inner and/or outer surface of the windshield with moisture and condensate, the image data of the first image region of the at least one image are evaluated by an image processing system and, in the event of a detection of wetting, a first evaluation signal that indicates wetting of the inner and/or outer surface of the windshield with moisture and/or condensate is generated;

detecting a visibility limitation, due to fog and/or wetting of the inner and/or outer surface of the windshield with moisture and/or condensate, the image data of the second image region of the at least one image are evaluated by the image processing system and, in the event of a detection of visibility limitation, a second evaluation signal that indicates the visibility limitation is generated; and

1) activating, by a control device, a windshield wiper of the vehicle to wipe the windshield in response to the first evaluation signal and the second evaluation signal both being generated, and then activate a windshield heater of the vehicle in response to the first evaluation signal and the second evaluation signal both still being generated after the wiper wipes the windshield,

2) activating, by the control device, a fog lamp of the vehicle and/or a driver warning device of the vehicle in response to only the second evaluation signal being generated.

2. The method according to claim 1, wherein the image data of the surroundings of the vehicle acquired by the camera are supplied to a further image processing system.

3. The method according to claim 1, wherein the image of the surroundings of the vehicle is acquired with a focal length that is adjusted to infinity.

4. The method according to claim 1, wherein the image data of the at least one image of the surroundings of the vehicle are evaluated by the image processing system on the basis of a contrast quality of the image data in order to generate a second evaluation signal that indicates the visibility limitation.

5. A method for assisting a driver in driving a vehicle by detecting weather-related visibility limitations, including:

generating, by a camera directed toward a windshield of the vehicle, image data of the surroundings of the vehicle,

generating, by a rain sensor, a first evaluation signal if at least one of the inner and outer surface of the windshield is wetted with moisture and/or condensate, for a detection of a visibility limitation, due to fog and/or wetting of the inner and/or outer surface of the windshield with moisture and/or condensate, the camera is focused on the surroundings of the vehicle and at least one image is generated, wherein the image data of the at least one image of the surroundings of the vehicle are evaluated by an image processing system in order to generate a second evaluation signal that indicates the visibility limitation;

1) activating, by a control device, a windshield wiper of the vehicle to wipe the windshield in response to the first evaluation signal and the second evaluation signal both being generated, and then activate a windshield heater of the vehicle in response to the first evaluation signal and the second evaluation signal both still being generated after the wiper wipes the windshield;

2) activating, by the control device, a fog lamp of the vehicle and/or a driver warning device of the vehicle in response to only the second evaluation signal being generated.

6. The method according to claim 5, wherein the rain sensor is an optoelectronic sensor.

7. The method according to claim 5, wherein the image data of the surroundings of the vehicle acquired by the camera are supplied to a further image processing system.

8. The method according to claim 5, wherein the image of the surroundings of the vehicle is acquired with a focal length that is adjusted to infinity.

9. The method according to claim 5, wherein the image data of the at least one image of the surroundings of the vehicle are evaluated by the image processing system on the basis of the contrast quality of the image data in order to generate a second evaluation signal that indicates the visibility limitation.

10. A device for assisting a driver in driving a vehicle by detecting weather-related visibility limitations, including:

a camera directed toward a windshield of the vehicle for generating an image data of the surroundings of the vehicle and of the windshield, the camera comprises a bifocal optical element so that the camera is focused on the windshield in a first image region and focused on the surroundings of the vehicle in a second image region; and

a control device that activates the camera in such a manner that at least one image of the windshield and of the surroundings of the vehicle is generated, wherein the image data of the first image region of the at least one image are evaluated by an image processing system in order to generate a first evaluation signal that indicates wetting of at least one of the inner and outer surface of the windshield with moisture and/or condensate and wherein the image data of the second image region of the at least one image are evaluated by the image processing system in order to generate a second evaluation signal that indicates the visibility limitation;

the control device is configured to;

1) activate a windshield wiper of the vehicle to wipe the windshield in response to the first evaluation signal and the second evaluation signal both being generated, and then activate a windshield heater of the vehicle in response to the first evaluation signal and the second evaluation signal both still being generated after the wiper wipes the windshield,

2) activate a fog lamp of the vehicle and/or a driver warning device of the vehicle in response to only the second evaluation signal being generated.

11. A device for assisting a driver in driving a vehicle by detecting weather-related visibility limitations, including:

a camera that is directed toward a windshield, the camera generating image data of the surroundings of the vehicle;

a rain sensor, by which a first evaluation signal is generated if at least one of the inner and outer surface of the windshield is wetted with moisture and/or condensate; and

a control device that activates the camera in such a manner that at least one image is generated in order to detect a visibility limitation, due to fog and/or wetting of the inner and/or outer surface of the windshield with moisture and/or condensate, wherein the image data of the at least one image of the surroundings of the vehicle are evaluated by an image processing system in order to generate a second evaluation signal that indicates the visibility limitation;

the control device is configured to;

1) activate a windshield wiper of the vehicle to wipe the windshield in response to the first evaluation signal and the second evaluation signal both being generated, and then activate a windshield heater of the vehicle in response to the first evaluation signal and the second evaluation signal both still being generated after the wiper wipes the windshield,

2) activate a fog lamp of the vehicle and/or a driver warning device of the vehicle in response to only the second evaluation signal being generated.

12. The device according to claim 11, wherein the rain sensor is an optoelectronic sensor.