Vehicular collision mitigation system

• US 10,497,262 B2
• Filed: 11/20/2017
• Issued: 12/03/2019
• Est. Priority Date: 02/04/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Salomonsson, Ove J., Van Dan Elzen, Christopher L.
• Primary Examiner(s): Dunn, Alex C
• Application Number:
  US15/817,612
• Publication Number:
  US 20180157921A1
• Time in Patent Office: 743 Days
• CPC Class Codes: B60Q 1/08 automatically
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/80 characterised by the intended use of the viewing arrangement
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60T 7/22 initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle , or by means of contactless obstacle detectors mounted on the vehicle
• CPC Class Codes: F02D 41/042 for stopping the engine
• CPC Class Codes: F02D 41/065 at hot start or restart F02D41/067 takes precedence
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/096725 where the received information generates an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096766 : where the system is characterised by the origin of the information transmission
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

A collision mitigation system for a vehicle includes a plurality of cameras, a radar sensor and/or lidar sensor, and a control that may process data captured by the cameras, radar sensor and/or lidar sensor. When the vehicle is moving and responsive at least in part to a determination that the vehicle is approaching an object present forwardly of the vehicle, the control is operable to control application by an automatic emergency braking system of a vehicle brake of the vehicle to mitigate collision with the object. Responsive to determination that a following vehicle is following the vehicle and when the determined following vehicle is within a threshold distance from the vehicle and is approaching the vehicle above a threshold rate of approach, the control adjusts automatic emergency braking of the vehicle to mitigate collision at the rear of the vehicle by the determined following vehicle.

Claims

1. A vehicular collision mitigation system, said vehicular collision mitigation system comprising:

a plurality of cameras disposed at a vehicle equipped with said vehicular collision mitigation system, wherein said cameras have respective fields of view exterior of the equipped vehicle;

wherein at least one of said cameras comprises a forward viewing camera disposed at a front portion of the equipped vehicle so as to view at least forward of the equipped vehicle;

wherein said forward viewing camera comprises a photosensor array having rows and columns of photosensor elements and comprising at least 1 million photosensor elements;

wherein at least one of said cameras comprises a rearward viewing camera disposed at a rear portion of the equipped vehicle so as to view at least rearward of the equipped vehicle;

wherein said rearward viewing camera comprises a photosensor array having rows and columns of photosensor elements and comprising at least 1 million photosensor elements;

at least one selected from the group consisting of (i) a radar sensor disposed at the equipped vehicle so as to sense at least forward of the equipped vehicle and (ii) a lidar sensor disposed at the equipped vehicle so as to sense at least forward of the equipped vehicle;

a control disposed at the equipped vehicle, said control comprising an image processor operable to process image data captured by said plurality of cameras disposed at the equipped vehicle;

said control operable to process at least one selected from the group consisting of (i) radar data captured by said radar sensor disposed at the equipped vehicle and (ii) lidar data captured by said lidar sensor disposed at the equipped vehicle;

wherein, responsive at least in part to processing at said control of image data captured by said forward viewing camera and to processing at said control of at least one selected from the group consisting of (i) radar data captured by said radar sensor disposed at the equipped vehicle and (ii) lidar data captured by said lidar sensor disposed at the equipped vehicle, an automatic emergency braking system of the equipped vehicle is controlled;

wherein, when the equipped vehicle is moving and responsive at least in part to a determination, via at least one selected from the group consisting of (i) image processing by said image processor of image data captured by said forward viewing camera and (ii) processing at said control of at least one selected from the group consisting of captured radar data and captured lidar data, that the equipped vehicle is approaching an object present forwardly of the equipped vehicle, said control controls application by said automatic emergency braking system of a vehicle brake of the equipped vehicle to mitigate collision with the object; and

wherein, responsive to determination, at least in part via image processing by said image processor of image data captured by said rearward viewing camera, that a following vehicle is following the equipped vehicle and when the determined following vehicle is within a threshold distance from the equipped vehicle and is approaching the equipped vehicle above a threshold rate of approach, said control adjusts automatic emergency braking of the equipped vehicle to mitigate collision at the rear of the equipped vehicle by the determined following vehicle.

2. The vehicular collision mitigation system of claim 1, wherein, when the equipped vehicle is moving and responsive at least in part to determination that the moving equipped vehicle is approaching the object determined present forwardly of the equipped vehicle and when the determined following vehicle is beyond a threshold distance from the equipped vehicle and is approaching the equipped vehicle below a threshold rate of approach, said control controls application of the vehicle brake by said automatic emergency braking system of the equipped vehicle at a first degree of braking.

3. The vehicular collision mitigation system of claim 2, wherein, when the equipped vehicle is moving and responsive at least in part to determination that the moving equipped vehicle is approaching the object determined present forwardly of the equipped vehicle and responsive at least in part to determination of the determined following vehicle being within a threshold distance from the equipped vehicle and approaching the equipped vehicle above a threshold rate of approach, said control controls application of the vehicle brake by said automatic emergency braking system of the equipped vehicle at a second degree of braking.

4. The vehicular collision mitigation system of claim 3, wherein the second degree of braking is less than the first degree of braking.

5. The vehicular collision mitigation system of claim 4, wherein said control determines the second degree of braking based on at least one selected from the group consisting of (i) distance of the determined following vehicle from the equipped vehicle and (ii) rate of approach of the determined following vehicle to the equipped vehicle.

6. The vehicular collision mitigation system of claim 1, wherein, in order to mitigate collision by the equipped vehicle with the object determined present forwardly of the equipped vehicle and in order to mitigate collision by the determined following vehicle with the equipped vehicle, said control determines a degree of braking of the equipped vehicle responsive to a comparison of (i) rate of approach and distance of the equipped vehicle to the object determined present forwardly of the equipped vehicle and (ii) rate of approach and distance of the determined following vehicle to the equipped vehicle.

7. The vehicular collision mitigation system of claim 1, wherein, responsive to determination that the moving equipped vehicle is approaching the object determined to be present forwardly of the equipped vehicle and responsive to rate of approach and distance of the equipped vehicle to the object determined present forwardly of the equipped vehicle, said vehicular collision mitigation system generates an alert to a driver of the equipped vehicle.

8. The vehicular collision mitigation system of claim 1, wherein, responsive to determination that the following vehicle is following the equipped vehicle and responsive to rate of approach and distance of the determined following vehicle to the equipped vehicle, said vehicular collision mitigation system generates an alert to a driver of the equipped vehicle.

9. The vehicular collision mitigation system of claim 1, wherein, when the equipped vehicle is moving and said automatic emergency braking system of the equipped vehicle is braking the equipped vehicle, and responsive at least in part to determination that the determined following vehicle is within a threshold distance from the equipped vehicle and is approaching the equipped vehicle above a threshold rate of approach, said control reduces application of the vehicle brake to mitigate a rear collision by the determined following vehicle with the equipped vehicle.

10. The vehicular collision mitigation system of claim 1, wherein, when the equipped vehicle is moving and said automatic emergency braking system of the equipped vehicle is braking the equipped vehicle, said control determines a degree of application of the vehicle brake to mitigate collision by the equipped vehicle with the object determined present forwardly of the equipped vehicle and to mitigate collision by the determined following vehicle with the equipped vehicle.

11. The vehicular collision mitigation system of claim 1, wherein, when the equipped vehicle is moving and responsive at least in part to determination that the moving equipped vehicle is approaching the object determined present forwardly of the equipped vehicle, said automatic emergency braking system of the equipped vehicle is operable to apply maximum braking of the equipped vehicle when there is no vehicle determined to be following the equipped vehicle within a threshold distance from the equipped vehicle.

12. The vehicular collision mitigation system of claim 1, wherein said forward viewing camera is disposed behind a windshield of the equipped vehicle so as to view at least forwardly of the equipped vehicle through the windshield, and wherein said image processor processes image data captured by said forward viewing camera for at least one selected from the group consisting of (i) a headlamp control system of the equipped vehicle and (ii) a lane departure warning system of the equipped vehicle.

13. The vehicular collision mitigation system of claim 1, wherein said image processor processes image data captured by said rearward viewing camera for at least one selected from the group consisting of (i) a rear backup system of the equipped vehicle and (ii) a surround view system of the equipped vehicle.

14. The vehicular collision mitigation system of claim 1, wherein, responsive to a vehicle system of the equipped vehicle, said control determines when the equipped vehicle is stopped, and wherein said vehicle system comprises one selected from the group consisting of (i) a speed sensor of the equipped vehicle and (ii) a braking system of the equipped vehicle.

15. The vehicular collision mitigation system of claim 14, wherein the object present forwardly of the equipped vehicle comprises a vehicle.

16. A vehicular collision mitigation system, said vehicular collision mitigation system comprising:

a plurality of cameras disposed at a vehicle equipped with said vehicular collision mitigation system, wherein said cameras have respective fields of view exterior of the equipped vehicle;

wherein at least one of said cameras comprises a forward viewing camera disposed behind a windshield of the equipped vehicle so as to view at least forwardly of the equipped vehicle through the windshield;

wherein said forward viewing camera comprises a photosensor array having rows and columns of photosensor elements and comprising at least 1 million photosensor elements;

wherein at least one of said cameras comprises a rearward viewing camera disposed at a rear portion of the equipped vehicle so as to view at least rearward of the equipped vehicle;

wherein said rearward viewing camera comprises a photosensor array having rows and columns of photosensor elements and comprising at least 1 million photosensor elements;

at least one radar sensor disposed at the equipped vehicle so as to sense at least forward of the equipped vehicle;

a control disposed at the equipped vehicle, said control comprising an image processor operable to process image data captured by said plurality of cameras;

said control operable to process radar data captured by said at least one radar sensor;

wherein, responsive at least in part to processing at said control of image data captured by said forward viewing camera and to processing at said control of radar data captured by said at least one radar sensor, an automatic emergency braking system of the equipped vehicle is controlled;

wherein, when the equipped vehicle is moving and responsive at least in part to a determination, via at least one selected from the group consisting of (i) image processing by said image processor of image data captured by said forward viewing camera and (ii) processing at said control of radar data captured by said at least one radar sensor, that the equipped vehicle is approaching an object present forwardly of the equipped vehicle, said control is operable to control application by said automatic emergency braking system of a vehicle brake of the equipped vehicle to mitigate collision with the object;

wherein, responsive to determination, at least in part via image processing by said image processor of image data captured by said rearward viewing camera, that a following vehicle is following the equipped vehicle and when the determined following vehicle is within a threshold distance from the equipped vehicle and is approaching the equipped vehicle above a threshold rate of approach, said control adjusts automatic emergency braking of the equipped vehicle to mitigate collision at the rear of the equipped vehicle by the determined following vehicle;

wherein, when the equipped vehicle is moving and responsive at least in part to determination that the moving equipped vehicle is approaching the object determined present forwardly of the equipped vehicle and when the determined following vehicle is beyond a threshold distance from the equipped vehicle and is approaching the equipped vehicle below a threshold rate of approach, said control controls application of the vehicle brake by said automatic emergency braking system of the equipped vehicle at a first degree of braking;

wherein, when the equipped vehicle is moving and responsive at least in part to determination that the moving equipped vehicle is approaching the object determined present forwardly of the equipped vehicle and responsive at least in part to determination of the determined following vehicle being within a threshold distance from the equipped vehicle and approaching the equipped vehicle above a threshold rate of approach, said control controls application of the vehicle brake by said automatic emergency braking system of the equipped vehicle at a second degree of braking;

wherein the second degree of braking is less than the first degree of braking; and

wherein said control determines the second degree of braking based at least on distance of the determined following vehicle from the equipped vehicle and rate of approach of the determined following vehicle to the equipped vehicle.

17. The vehicular collision mitigation system of claim 16, wherein said image processor processes image data captured by said rearward viewing camera for a rear backup system of the equipped vehicle.

18. The vehicular collision mitigation system of claim 17, wherein said image processor processes image data captured by said forward viewing camera for a headlamp control system of the equipped vehicle.

19. The vehicular collision mitigation system of claim 17, wherein at least one lidar sensor is disposed at the equipped vehicle so as to sense at least forward of the equipped vehicle, and wherein said control is operable to process lidar data captured by said at least one lidar sensor, and wherein responsive at least in part to processing at said control of image data captured by said forward viewing camera and to processing at said control of at least one selected from the group consisting of (i) radar data captured by said at least one radar sensor and (ii) lidar data captured by said at least one lidar sensor, said automatic emergency braking system of the equipped vehicle is controlled.

20. The vehicular collision mitigation system of claim 17, wherein said image processor processes image data captured by said forward viewing camera for a lane departure warning system of the equipped vehicle, and wherein said image processor processes image data captured by said rearward viewing camera for a surround view system of the equipped vehicle.

21. A vehicular collision mitigation system, said vehicular collision mitigation system comprising:

a plurality of cameras disposed at a vehicle equipped with said vehicular collision mitigation system, wherein said cameras have respective fields of view exterior of the equipped vehicle;

wherein at least one of said cameras comprises a forward viewing camera disposed behind a windshield of the equipped vehicle so as to view at least forwardly of the equipped vehicle through the windshield;

wherein said forward viewing camera comprises a photosensor array having rows and columns of photosensor elements and comprising at least 1 million photosensor elements;

wherein at least one of said cameras comprises a rearward viewing camera disposed at a rear portion of the equipped vehicle so as to view at least rearward of the equipped vehicle;

wherein said rearward viewing camera comprises a photosensor array having rows and columns of photosensor elements and comprising at least 1 million photosensor elements;

at least one radar sensor disposed at the equipped vehicle so as to sense at least forward of the equipped vehicle;

a control disposed at the equipped vehicle, said control comprising an image processor operable to process image data captured by said plurality of cameras;

said control operable to process radar data captured by said at least one radar sensor;

wherein, responsive at least in part to processing at said control of image data captured by said forward viewing camera and to processing at said control of radar data captured by said at least one radar sensor, an automatic emergency braking system of the equipped vehicle is controlled;

wherein, when the equipped vehicle is moving and responsive at least in part to a determination, via at least one selected from the group consisting of (i) image processing by said image processor of image data captured by said forward viewing camera and (ii) processing at said control of radar data captured by said at least one radar sensor, that the equipped vehicle is approaching an object present forwardly of the equipped vehicle, said control is operable to control application by said automatic emergency braking system of a vehicle brake of the equipped vehicle to mitigate collision with the object;

wherein the object present forwardly of the equipped vehicle comprises a vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by said rearward viewing camera, said control determines that a following vehicle is following the equipped vehicle and that the determined following vehicle is within a threshold distance from the equipped vehicle and is approaching the equipped vehicle above a threshold rate of approach; and

wherein, in order to mitigate collision by the equipped vehicle with the object determined present forwardly of the equipped vehicle and in order to mitigate collision by the determined following vehicle with the equipped vehicle, said control determines a degree of braking of the equipped vehicle responsive to a comparison of (i) rate of approach and distance of the equipped vehicle to the object determined present forwardly of the equipped vehicle and (ii) rate of approach and distance of the determined following vehicle to the equipped vehicle.

22. The vehicular collision mitigation system of claim 21, wherein said image processor processes image data captured by said rearward viewing camera for a rear backup system of the equipped vehicle.

23. The vehicular collision mitigation system of claim 21, wherein said image processor processes image data captured by said forward viewing camera for a headlamp control system of the equipped vehicle.

24. The vehicular collision mitigation system of claim 21, wherein at least one lidar sensor is disposed at the equipped vehicle so as to sense at least forward of the equipped vehicle, and wherein said control is operable to process lidar data captured by said at least one lidar sensor, and wherein responsive at least in part to processing at said control of image data captured by said forward viewing camera and to processing at said control of at least one selected from the group consisting of (i) radar data captured by said at least one radar sensor and (ii) lidar data captured by said at least one lidar sensor, said automatic emergency braking system of the equipped vehicle is controlled.

25. The vehicular collision mitigation system of claim 21, wherein said image processor processes image data captured by said forward viewing camera for a lane departure warning system of the equipped vehicle, and wherein said image processor processes image data captured by said rearward viewing camera for a surround view system of the equipped vehicle.

26. The vehicular collision mitigation system of claim 21, wherein, when the equipped vehicle is moving and responsive at least in part to determination that the moving equipped vehicle is approaching the object determined present forwardly of the equipped vehicle and when the determined following vehicle is beyond a threshold distance from the equipped vehicle and is approaching the equipped vehicle below a threshold rate of approach, said control controls application of the vehicle brake by said automatic emergency braking system of the equipped vehicle at a first degree of braking.

27. The vehicular collision mitigation system of claim 26, wherein, when the equipped vehicle is moving and responsive at least in part to determination that the moving equipped vehicle is approaching the object determined present forwardly of the equipped vehicle and responsive at least in part to determination of the determined following vehicle being within a threshold distance from the equipped vehicle and approaching the equipped vehicle above a threshold rate of approach, said control controls application of the vehicle brake by said automatic emergency braking system of the equipped vehicle at a second degree of braking, and wherein the second degree of braking is less than the first degree of braking.

28. The vehicular collision mitigation system of claim 27, wherein said control determines the second degree of braking based on at least one selected from the group consisting of (i) distance of the determined following vehicle from the equipped vehicle and (ii) rate of approach of the determined following vehicle to the equipped vehicle.