Driving Assistance System and Driving Assistance Method

• US 20180370433A1
• Filed: 02/28/2018
• Published: 12/27/2018
• Est. Priority Date: 06/27/2017
• Status: Active Grant

• Current Assignee: Mindtronic AI Co.,Ltd., Shanghai XPT Technology Limited
• Original Assignee: Intelligence & Partner Limited, Shanghai XPT Technology Limited
• Inventors: Huang, Mu-Jen, Tai, Ya-Li, Jiang, Yu-Sian
• Granted Patent: US 10,583,781 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 2300/108 using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A driving assistance system includes a database configured to store numbers of preset criteria concerning various driving conditions, a sensor, configured to sense environmental data surrounding a vehicle; a thermal image capturing device, configured to capture a thermal images surrounding the vehicle; a display device; and a processor, coupled to the sensor, the thermal image capturing device and the display device. The processor compares the environmental data against the preset criteria to determine the driving condition of the vehicle. The display device automatically display thermal images to inform and provide precautions to the driver if the driving condition indicates that the driver'"'"'s vision is adversely affected.

Claims

1. A driving assistance system in a subject vehicle, comprising:

a database, configured to store a plurality of preset criteria concerning a plurality of driving conditions;

a sensor, configured to collect environmental data surrounding the subject vehicle;

a thermal image capturing device, configured to capture thermal images surrounding the subject vehicle;

a display device; and

a processor, coupled to the sensor, the thermal image capturing device and the display device, configured to determine a driving condition of the subject vehicle by comparing the environment data against the preset criteria;

wherein if the result indicates that the driver'"'"'s vision is adversely affected because of the driving condition, the display device automatically display the thermal images to inform the driver as to the surrounding circumstance.

2. The driving assistance system of claim 1, wherein one of the driving conditions is when a vehicle in the opposite direction is approaching toward the subject vehicle and the illumination from the headlights adversely affects the driver in the subject vehicle.

3. The driving assistance system of claim 2, wherein the driving condition is concluded by reference to a glaring area on a visible light image collected by the sensor;

particularly, if either the size of the glaring area, the pixel amount of the glaring area, or the size ratio of the glaring area and the entire visible light image meets the preset criteria, the processor concludes the driving condition.

4. The driving assistance system of claim 2, wherein the driving condition is concluded by reference to an intensity of ambient light;

particularly, the processor concludes the driving condition if the intensity of ambient light is greater than a preset criterion.

5. The driving assistance system of claim 1, wherein one of the driving conditions is when the weather is misty and the vision from the subject vehicle is adversely affected.

6. The driving assistance system of claim 5, wherein the driving condition is concluded by reference to a foggy area on a visible light image collected by the sensor;

particularly, the processor concludes the driving condition if a degree of blurriness of an object on the visible light image meets the preset criteria.

7. The driving assistance system of claim 5, wherein the driving condition is concluded by reference to a foggy area on a visible light image collected by the sensor;

particularly, the processor concludes the driving condition if a brightness difference between an object and its neighboring scene reaches the preset criteria.

8. The driving assistance system of claim 5, wherein the driving condition is concluded by temperature and humidity degrees collected by the sensor;

particularly, the processor concludes the driving conditions if the temperature and humidity degrees meet the preset criteria.

9. The driving assistance system of claim 1, wherein one of the driving conditions is when the subject vehicle is driving in the dark where the driver on the subject vehicle may not be able to see things clearly, and the processor concludes the driving condition by reference to an intensity of ambient light;

wherein another one of the driving condition is when the weather is smoggy, and the processor concludes the driving condition by detecting the particulate matter concentration.

10. The driving assistance system of claim 1, wherein the processor further superposes a visible light image obtained from the sensor with the relevant thermal image to produce an image that emphasizing the position of objects, such as a pedestrian, an animal, or a moving vehicle, to inform the driver on the subject vehicle to pay more attention to.

12. The driving assistance method of claim 10, wherein one of the driving conditions is when a vehicle in the opposite direction is approaching toward the subject vehicle and the illumination from the headlights adversely affects the driver in the subject vehicle.

15. The driving assistance method of claim 10, wherein one of the driving conditions is when the weather is misty and the vision from the subject vehicle is adversely affected.

16. The driving assistance method of claim 15, further comprising identifying a foggy area on a collected visible light image, and determining the driving condition if the degree of blurriness of an object on the visible light image meets the preset criteria.

17. The driving assistance method of claim 15, further comprising identifying a foggy area on a collected visible light image, and determining the driving condition if a brightness difference between an object and its neighboring scene reaches the preset criteria.

18. The driving assistance method of claim 15, further comprising collecting temperature and humidity degrees, and determining the driving conditions if the temperature and humidity degrees meet the preset criteria.

11. A driving assistance method to assist a driver in a subject vehicle, comprising:

presetting a plurality of criteria to indicate a plurality of driving conditions in a database;

collecting environmental data and thermal images surrounding the subject vehicle;

determining one of the driving condition of the subject vehicle by comparing the collected environmental data against the preset criteria; and

automatically displaying the thermal images on a display if it is determining that the driving condition adversely affect the driver'"'"'s vision from the subject vehicle.

13. The driving assistance method of claim 11, further comprising identifying a glaring area on a collected visible light image, and determining the driving condition if either the size of the glaring area, the pixel amount of the glaring area, or the size ratio of the glaring area and the entire visible light image meets the preset criteria.

14. The driving assistance method of claim 11, further comprising sensing an intensity of ambient light and determining the driving condition if the intensity of ambient light meets the preset criteria.

19. The driving assistance method of claim 11, wherein one of the driving conditions is when the subject vehicle is driving in the dark where the driver on the subject vehicle may not be able to see things clearly, and the determination is made by reference to an intensity of ambient light;

wherein another of the driving conditions is when the weather is smoggy, and the driving condition is determined by detecting the particulate matter concentration.

20. The driving assistance method of claim 11, further comprising superposing a visible light image with the relevant thermal image to produce an image that emphasizing the position of objects, such as a pedestrian, an animal, or a moving vehicle, to inform the driver on the subject vehicle to pay more attention to.