Driver assistance system for monitoring driving safety and corresponding method for detecting and evaluating a vehicle movement

• US 8,605,948 B2
• Filed: 10/13/2008
• Issued: 12/10/2013
• Est. Priority Date: 12/06/2007
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Mathony, Hans-Joerg, Kassner, Uwe
• Primary Examiner(s): Fitzpatrick, Atiba O
• Application Number:
  US12/734,766
• Publication Number:
  US 20100316255A1
• Time in Patent Office: 1,884 Days
• Field of Search: 382100-107, 340907-911, 340933-940, 348113-120
• US Class Current: 382/104
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G08G 1/096716 where the received information does not generate an automatic action on the vehicle control
• CPC Class Codes: G08G 1/09675 where a selection from the received information takes place in the vehicle
• CPC Class Codes: G08G 1/096783 where the origin of the information is a roadside individual element

Abstract

A driver assistance system for monitoring driving safety has a mobile electronic unit including a video sensor, a computer unit for image data processing, and an acoustic output unit, which detects the immediate surroundings of the vehicle from the data of the video sensor and outputs a warning or information via an output unit when the computer unit detects a dangerous situation. The mobile electronic unit detects noises within the vehicle or from the outside via an acoustic input unit, and incorporates the information in the assessment of driving safety.

Claims

1. A driver assistance system configured as a mobile electronic unit for monitoring driving safety of a vehicle, comprising:

a video sensor;

an acoustic input unit configured to detect acoustic signals, wherein the acoustic signals are detected in a learning mode;

a computer unit configured detect a hazardous driving situation for the vehicle, wherein the computer unit is configured to perform the following as part of the detection of the hazardous driving situation;

(a) image data processing to analyze the surroundings of the vehicle from data output by the video sensor, and (b) acoustic data processing to analyze acoustic signals detected by the acoustic input unit; and

an output unit configured to output at least one of a warning and instruction when the computer unit detects a hazardous driving situation for the vehicle;

wherein the acoustic signals include at least one of a turn indicator noise, an acoustic warning signal from the vehicle, and an acoustic instruction signal from the vehicle.

18. The driver assistance system as recited in claim 1, wherein the system is located in the vehicle.

2. A driver assistance system configured as a mobile electronic unit for monitoring driving safety of a vehicle, comprising:

a video sensor;

an acoustic input unit configured to detect acoustic signals, wherein the acoustic signals are detected in a learning mode;

a computer unit configured detect a hazardous driving situation for the vehicle, wherein the computer unit is configured to perform the following as part of the detection of the hazardous driving situation;

(a) image data processing to analyze the surroundings of the vehicle from data output by the video sensor, and (b) acoustic data processing to analyze acoustic signals detected by the acoustic input unit; and

an output unit configured to output at least one of a warning and instruction when the computer unit detects a hazardous driving situation for the vehicle;

wherein the acoustic signals include at least one of a turn indicator noise, an engine noise, an acoustic warning signal from the vehicle, an acoustic instruction signal from the vehicle, a sound of a horn from the vehicle, and a sound of a horn from an adjacent vehicle, and

wherein the acoustic signals include a turn indicator noise, an engine noise, an acoustic warning signal from the vehicle, and an acoustic instruction signal from the vehicle.

3. The driver assistance system as recited in claim 2, wherein the mobile electronic unit is configured to:

(a) detect at least one of traffic signs and traffic participants, and (b) acoustically output spoken information regarding the detected at least one of traffic signs and traffic participants.

4. The driver assistance system as recited in claim 2, wherein the mobile electronic unit is configured to detect vehicle speed from the data of the video sensor.

5. The driver assistance system as recited in claim 2, wherein the output unit includes a visual output unit configured to display the at least one of the warning and instruction.

6. The driver assistance system as recited in claim 5, wherein the output unit further includes an acoustic output unit.

7. The driver assistance system as recited in claim 2, further comprising:

a navigation unit configured to provide current navigation information including the position of the vehicle and the road on which the vehicle is traveling, wherein the current navigation information is assessed by the computer unit in comparison to a reference road environment to determine a deviation from the reference road environment.

8. The driver assistance system as recited in claim 7, wherein the computer unit classifies a hazardous driving situation for the vehicle in one of multiple hazard categories, and wherein multiple operating modes are provided, and wherein in one of the operating modes the at least one of the warning and instruction is output only for a high-risk-potential hazard category.

9. The driver assistance system as recited in claim 7, wherein the computer unit is configured to summarize multiple determined deviations in statistical form.

10. The driver assistance system as recited in claim 4, wherein the system is further configured to detect an infrared laser radiation from the data of the video sensor.

11. The driver assistance system located in a vehicle for automatic detection and evaluation of a vehicle movement, comprising:

a video recorder configured to record video data;

means for recognizing preselected high-contrast objects in the immediate surroundings of the vehicle;

means for comparing a detected vehicle movement with a previously calculated vehicle movement calculated based on the assumption of a constant and linear movement of the vehicle, wherein a difference between the detected movement and the previously calculated movement is determined;

means for detecting acoustic signals from at least one of the immediate surroundings of the vehicle and the interior of the vehicle;

means for filtering and recognizing preselected noises from the detected acoustic signals;

means for evaluating the determined difference between the detected movement and the previously calculated movement; and

means for gating a result of the evaluation of the determined difference with the recognized preselected noises, and determining, based on the gating, a type of evaluation event.

12. A method for automatic detection and evaluation of a vehicle movement, comprising:

recording, using a video sensor, video data from a moving vehicle;

detecting preselected high-contrast objects in the immediate surroundings of the vehicle from the recorded video data;

comparing a detected vehicle movement with a previously calculated vehicle movement calculated based on the assumption of a constant and linear movement of the vehicle, wherein a difference between the detected movement and the previously calculated movement is determined;

detecting acoustic signals from at least one of the immediate surroundings of the vehicle and the interior of the vehicle;

filtering and recognizing preselected noises from the detected acoustic signals;

evaluating the determined difference between the detected movement and the previously calculated movement;

gating a result of the evaluation of the determined difference with the recognized preselected noises; and

determining, based on the gating, a type of evaluation event.

13. The method as recited in claim 12, further comprising:

determining, using navigation data, current navigation information including a current position of the vehicle and the road on which the vehicle is traveling;

comparing the current navigation information with a reference road environment to determine a deviation from the reference road environment; and

gating the determined deviation with the recognized preselected noises.

14. The method as recited in claim 12, further comprising:

detecting the current distance and the rate of approach of the vehicle to at least one other vehicle; and

gating the current distance and the rate of approach with the recognized preselected noises.

15. The method as recited in claim 12, further comprising:

comparing the detected high-contrast objects with stored representations of road signs; and

gating the result of the comparison with the recognized preselected noises.

16. The method as recited in claim 12, further comprising:

calculating the speed of the vehicle from speed of the detected high-contrast objects relative to the vehicle; and

determining a distance of the vehicle from the high-contrast objects using a nonlinear distortion of the objects used for the video sensor.

17. The driver assistance system located in a vehicle for automatic detection and evaluation of a vehicle movement, comprising:

a video recorder configured to record video data;

a recognizing arrangement for recognizing preselected high-contrast objects in the immediate surroundings of the vehicle;

a comparing arrangement for comparing a detected vehicle movement with a previously calculated vehicle movement calculated based on the assumption of a constant and linear movement of the vehicle, wherein a difference between the detected movement and the previously calculated movement is determined;

a detecting arrangement for detecting acoustic signals from at least one of the immediate surroundings of the vehicle and the interior of the vehicle;

a filtering arrangement for filtering and recognizing preselected noises from the detected acoustic signals;

an evaluating arrangement for evaluating the determined difference between the detected movement and the previously calculated movement; and

a gating arrangement for gating a result of the evaluation of the determined difference with the recognized preselected noises, and determining, based on the gating, a type of evaluation event.

19. A driver assistance system configured as a mobile electronic unit for monitoring driving safety of a vehicle, comprising:

a video sensor;

an acoustic input unit configured to detect acoustic signals, wherein the acoustic signals are detected in a learning mode;

a computer unit configured detect a hazardous driving situation for the vehicle, wherein the computer unit is configured to perform the following as part of the detection of the hazardous driving situation;

(a) image data processing to analyze the surroundings of the vehicle from data output by the video sensor, and (b) acoustic data processing to analyze acoustic signals detected by the acoustic input unit; and

an output unit configured to output at least one of a warning and instruction when the computer unit detects a hazardous driving situation for the vehicle;

wherein the acoustic signals include at least one of a turn indicator noise, an engine noise, an acoustic warning signal from the vehicle, and an acoustic instruction signal from the vehicle, and

wherein the acoustic signals include a turn indicator noise, an engine noise, an acoustic warning signal from the vehicle, and an acoustic instruction signal from the vehicle.

20. The driver assistance system as recited in claim 19, wherein the mobile electronic unit is configured to:

(a) detect at least one of traffic signs and traffic participants, and (b) acoustically output spoken information regarding the detected at least one of traffic signs and traffic participants.

21. The driver assistance system as recited in claim 19, wherein the mobile electronic unit is configured to detect vehicle speed from the data of the video sensor.

22. The driver assistance system as recited in claim 19, wherein the output unit includes a visual output unit configured to display the at least one of the warning and instruction.

23. The driver assistance system as recited in claim 22, wherein the output unit further includes an acoustic output unit.

24. The driver assistance system as recited in claim 19, further comprising:

a navigation unit configured to provide current navigation information including the position of the vehicle and the road on which the vehicle is traveling, wherein the current navigation information is assessed by the computer unit in comparison to a reference road environment to determine a deviation from the reference road environment.

25. The driver assistance system as recited in claim 24, wherein the computer unit classifies a hazardous driving situation for the vehicle in one of multiple hazard categories, and wherein multiple operating modes are provided, and wherein in one of the operating modes the at least one of the warning and instruction is output only for a high-risk-potential hazard category.

26. The driver assistance system as recited in claim 24, wherein the computer unit is configured to summarize multiple determined deviations in statistical form.

27. The driver assistance system as recited in claim 21, wherein the system is further configured to detect an infrared laser radiation from the data of the video sensor.