Intelligent driver assist system based on multimodal sensor fusion
First Claim
Patent Images
1. A method of providing driver assistance for performing a driving action, comprising:
- obtaining video information adjacent to a vehicle;
obtaining audio information adjacent to the vehicle; and
generating, via a decision making processor executing one or more decision algorithms, a driver assist indication based on a combination of the video information and the audio information, the generating comprising;
comparing the video information to a video threshold corresponding to video information for which performing the driving action is acceptable;
comparing the audio information to an audio threshold corresponding to audio information for which performing the driving action is acceptable; and
generating the driver assist indication with a positive value or a negative value based on a result of the comparing.
0 Assignments
0 Petitions
Accused Products
Abstract
An apparatus and method of providing driver assistance for performing a driving action include obtaining video information adjacent to a vehicle, obtaining audio information adjacent to the vehicle, optionally obtaining movement-related information, and generating a driver assist indication based on a combination of the video information and the audio information, and, optionally, the movement-related information.
18 Citations
18 Claims
-
1. A method of providing driver assistance for performing a driving action, comprising:
-
obtaining video information adjacent to a vehicle; obtaining audio information adjacent to the vehicle; and generating, via a decision making processor executing one or more decision algorithms, a driver assist indication based on a combination of the video information and the audio information, the generating comprising; comparing the video information to a video threshold corresponding to video information for which performing the driving action is acceptable; comparing the audio information to an audio threshold corresponding to audio information for which performing the driving action is acceptable; and generating the driver assist indication with a positive value or a negative value based on a result of the comparing. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer program product comprising:
a non-transitory computer-readable medium having control logic stored therein, the control logic comprising; at least one instruction for causing a computer to obtain video information adjacent to a vehicle; at least one instruction for causing the computer to obtain audio information adjacent to the vehicle; and at least one instruction for causing the computer to generate a driver assist indication based on a combination of the video information and the audio information, wherein the at least one instruction for causing the computer to generate a driver assist indication is further for causing the computer to; compare the video information to a video threshold corresponding to video information for which performing a driving action is acceptable; compare the audio information to an audio threshold corresponding to audio information for which performing the driving action is acceptable; and generate the driver assist indication with a positive value or a negative value based on a result of each comparison. - View Dependent Claims (10)
-
11. An apparatus to provide driver assistance for performing a driving action, comprising:
-
a video processor configured to obtain video information adjacent to a vehicle; an audio processor configured to obtain audio information adjacent to the vehicle; and a decision making processor to generate a driver assist indication based on a combination of the video information and the audio information, the decision making processor being configured to; compare the video information to a video threshold corresponding to video information for which performing the driving action is acceptable; compare the audio information to an audio threshold corresponding to audio information for which performing the driving action is acceptable; and generate the driver assist indication with a positive value or a negative value based on a result of each comparison. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18)
-
Specification