COLLISION AVOIDANCE SYSTEM FOR VEHICLE

• US 20180043888A1
• Filed: 10/25/2017
• Published: 02/15/2018
• Est. Priority Date: 04/10/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Wolf, Johannes
• Granted Patent: US 10,207,705 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/8026 in addition to a rear-view mirror system
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60T 2201/024 Collision mitigation systems
• CPC Class Codes: B60T 7/22 initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle , or by means of contactless obstacle detectors mounted on the vehicle
• CPC Class Codes: B60T 8/17 Using electrical or electronic regulation means to control braking detecting or indicating faulty operation B60T8/885
• CPC Class Codes: B60W 10/04 including control of propulsion units
• CPC Class Codes: B60W 10/18 including control of braking systems
• CPC Class Codes: B60W 10/184 with wheel brakes
• CPC Class Codes: B60W 10/20 including control of steering systems
• CPC Class Codes: B60W 10/30 including control of auxiliary equipment, e.g. air-conditioning compressors or oil pumps
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2420/408 Radar; Laser, e.g. lidar
• CPC Class Codes: B60W 2554/00 Input parameters relating to objects
• CPC Class Codes: B60W 2554/80 Spatial relation or speed relative to objects
• CPC Class Codes: B60W 2554/802 Longitudinal distance
• CPC Class Codes: B60W 2554/804 Relative longitudinal speed
• CPC Class Codes: B60W 2556/65 : Data transmitted between vehicles
• CPC Class Codes: B60W 2710/18 : Braking system
• CPC Class Codes: B60W 2710/20 : Steering systems
• CPC Class Codes: B60W 2710/30 : Auxiliary equipments
• CPC Class Codes: B60W 30/08 : Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
• CPC Class Codes: B60W 30/085 : Taking automatic action to adjust vehicle attitude in preparation for collision, e.g. braking for nose dropping
• CPC Class Codes: B60W 30/09 : Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: B60W 30/0953 : the prediction being responsive to vehicle dynamic parameters
• CPC Class Codes: B60W 50/14 : Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B62D 15/0265 : Automatic obstacle avoidance by steering
• CPC Class Codes: B62D 6/002 : computing target steering angles for front or rear wheels B62D7/159 takes precedence
• CPC Class Codes: G05D 1/0214 : in accordance with safety or protection criteria, e.g. avoiding hazardous areas monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/16 : Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A collision avoidance system includes a plurality of cameras disposed at a vehicle, and an electronic control unit that includes an image processor operable to process image data captured by the cameras. A plurality of other sensors sense at least one of rearward and sideward of the equipped vehicle and capture sensor data. The collision avoidance system may determine imminence of collision with the equipped vehicle by another vehicle present exterior the equipped vehicle responsive at least in part to (a) image processing by the image processor of image data captured by a forward-viewing camera, a rearward-viewing camera, a driver side-viewing camera and/or a passenger side-viewing camera, and (b) radar data sensed by the plurality of other sensors, lidar data sensed by at least one lidar sensor of said plurality of other sensors and/or information transmitted to or from the equipped vehicle via a car2car (v2v) communication system.

Claims

1. A collision avoidance system suitable for use in a vehicle, said collision avoidance system comprising:

a plurality of cameras disposed at a vehicle equipped with said collision avoidance system, each having a field of view exterior of the equipped vehicle;

said cameras comprising a forward-viewing camera disposed at the equipped vehicle, said forward-viewing camera having a field of view at least forward of the equipped vehicle;

wherein the field of view of said forward-viewing camera at least encompasses (i) a traffic lane the equipped vehicle is travelling along and (ii) at least one traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

said cameras comprising a rearward-viewing camera disposed at the equipped vehicle, said rearward-viewing camera having a field of view rearward of the equipped vehicle;

wherein the field of view of said rearward-viewing camera encompasses (i) the traffic lane the equipped vehicle is travelling along and (ii) at least one traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

said cameras comprising a driver side-viewing camera disposed at a driver side of the equipped vehicle, said driver side-viewing camera having a field of view at least sideward of the equipped vehicle;

said cameras comprising a passenger side-viewing camera disposed at a passenger side of the equipped vehicle, said passenger side-viewing camera having a field of view at least sideward of the equipped vehicle;

an electronic control unit;

wherein said electronic control unit receives image data captured by said cameras;

wherein said electronic control unit comprises an image processor operable to process image data captured by said cameras;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said forward-viewing camera, said collision avoidance system detects vehicles present ahead of the equipped vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said forward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in the traffic lane the equipped vehicle is travelling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by said forward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by said rearward-viewing camera, said collision avoidance system detects vehicles present rearward of the equipped vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by said rearward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in the traffic lane the equipped vehicle is travelling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said rearward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

a plurality of other sensors disposed at the equipped vehicle;

wherein said plurality of other sensors comprises at least one sensor that senses at least one of rearward and sideward of the equipped vehicle;

wherein said plurality of other sensors capture sensor data; and

wherein said collision avoidance system is operable to determine imminence of collision with the equipped vehicle by another vehicle present exterior the equipped vehicle;

wherein imminence of collision with the equipped vehicle by the other vehicle present exterior the equipped vehicle is determined (a) responsive at least in part to at least one of (i) image processing by said image processor of image data captured by said forward-viewing camera, (ii) image processing by said image processor of image data captured by said rearward-viewing camera, (iii) image processing by said image processor of image data captured by said driver side-viewing camera and (iv) image processing by said image processor of image data captured by said passenger side-viewing camera and (b) responsive at least in part to at least one of (i) radar data sensed by at least one radar sensor of said plurality of other sensors, (ii) lidar data sensed by at least one lidar sensor of said plurality of other sensors and (iii) information transmitted to or from the equipped vehicle via a car2car (v2v) communication system.

2. The collision avoidance system of claim 1, wherein said collision avoidance system determines a detected vehicle present in the traffic lane the equipped vehicle is travelling along is an immediately following other vehicle responsive at least in part to at least one of (a) image processing by said image processor of image data captured by said rearward-viewing camera and (b) radar data sensed by at least one radar sensor of said plurality of other sensors.

3. The collision avoidance system of claim 2, wherein, responsive to the determination that impact is imminent, a driver of the equipped vehicle is alerted.

4. The collision avoidance system of claim 2, wherein the immediately following other vehicle is tailgating the equipped vehicle.

5. The collision avoidance system of claim 4, wherein said collision avoidance system determines speed difference between the equipped vehicle and the tailgating other vehicle and determines distance from the equipped vehicle to the tailgating other vehicle and based on such determinations, determines that impact is imminent.

6. The collision avoidance system of claim 5, wherein, responsive to the determination that impact is imminent, pre-impact measures are undertaken.

7. The collision avoidance system of claim 5, wherein, responsive to the determination that impact is imminent, pre-impact measures are undertaken, said pre-impact measures comprising at least one of (i) seat belt pre-tensioning and (ii) adjusting a vehicle seat.

8. The collision avoidance system of claim 5, wherein, responsive to the determination that impact is imminent, said collision avoidance system controls the equipped vehicle to accelerate in order to at least one of (i) lower impact speed and (ii) give the tailgating other vehicle additional space for slowing/stopping.

9. The collision avoidance system of claim 4, wherein said collision avoidance system, responsive at least in part to the determination that impact is imminent, controls a steering system of the equipped vehicle to move the equipped vehicle to another lane.

10. The collision avoidance system of claim 1, wherein, responsive at least in part to information transmitted to or from the equipped vehicle via a car2car (v2v) communication system, a braking system of the equipped vehicle is controlled.

11. The collision avoidance system of claim 10, wherein, responsive at least in part to information transmitted to or from the equipped vehicle via the car2car (v2v) communication system, a steering system of the equipped vehicle is controlled.

12. The collision avoidance system of claim 1, wherein said collision avoidance system determines (i) difference between the speed of the other vehicle present exterior the equipped vehicle and the speed of the equipped vehicle and (ii) distance between the other vehicle present exterior the equipped vehicle and the equipped vehicle, and wherein, responsive at least in part to difference between the speed of the other vehicle present exterior the equipped vehicle and the speed of the equipped vehicle being such that a collision is imminent, said collision avoidance system prepares the equipped vehicle for collision.

13. The collision avoidance system of claim 12, wherein said collision avoidance system prepares the equipped vehicle for collision by pre-tensioning a seat belt of the equipped vehicle.

14. The collision avoidance system of claim 12, wherein said collision avoidance system prepares the equipped vehicle for collision by adjusting a seat of the equipped vehicle.

15. The collision avoidance system of claim 12, wherein said collision avoidance system is operable to wirelessly communicate via a car2car (v2v) communication system to the other vehicle present exterior the equipped vehicle a request to control a vehicle system of the other vehicle.

16. The collision avoidance system of claim 15, wherein the vehicle system of the other vehicle present exterior the equipped vehicle comprises a brake system of the other vehicle.

17. The collision avoidance system of claim 1, wherein said collision avoidance system is operable to communicate via a car2car (v2v) communication system with the other vehicle present exterior the equipped vehicle to determine a collision avoidance path for at least the equipped vehicle.

18. The collision avoidance system of claim 1, wherein said collision avoidance system is operable, responsive at least in part to a communication wirelessly communicated to the equipped vehicle via a car2car (v2v) communication system, to at least one of (a) control a braking system of the equipped vehicle, (b) control a steering system of the equipped vehicle and (c) control an acceleration system of the equipped vehicle.

19. The collision avoidance system of claim 18, wherein said forward-viewing camera is a component of an adaptive cruise control system of the equipped vehicle.

20. The collision avoidance system of claim 1, wherein, responsive at least in part to determination by said collision avoidance system of imminence of collision with the equipped vehicle by the other vehicle present exterior the equipped vehicle, said collision avoidance system determines an evasive path for the equipped vehicle to avoid collision with the other vehicle.

21. The collision avoidance system of claim 20, wherein said collision avoidance system controls a steering system of the equipped vehicle to move the equipped vehicle along the determined evasive path.

22. The collision avoidance system of claim 21, wherein said collision avoidance system controls the steering system of the equipped vehicle to move the equipped vehicle into a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along.

23. The collision avoidance system of claim 1, wherein, responsive at least in part to information transmitted to or from the equipped vehicle via a car2car (v2v) communication system, and responsive at least in part to at least one of (i) image processing by said image processor of image data captured by said forward-viewing camera and (ii) image processing by said image processor of image data captured by said rearward-viewing camera, said collision avoidance system is operable to determine imminence of collision with the equipped vehicle by the other vehicle present exterior the equipped vehicle.

24. The collision avoidance system of claim 1, wherein, responsive at least in part to at least one of (i) radar data sensed by at least one radar sensor of said plurality of other sensors and (ii) lidar data sensed by at least one lidar sensor of said plurality of other sensors, said collision avoidance system is operable to determine imminence of collision with the equipped vehicle by the other vehicle present exterior the equipped vehicle.

25. A collision avoidance system suitable for use in a vehicle, said collision avoidance system comprising:

a plurality of cameras disposed at a vehicle equipped with said collision avoidance system, each having a field of view exterior of the equipped vehicle;

said cameras comprising a forward-viewing camera disposed at the equipped vehicle, said forward-viewing camera having a field of view at least forward of the equipped vehicle;

wherein the field of view of said forward-viewing camera at least encompasses (i) a traffic lane the equipped vehicle is travelling along and (ii) at least one traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

said cameras comprising a rearward-viewing camera disposed at the equipped vehicle, said rearward-viewing camera having a field of view rearward of the equipped vehicle;

wherein the field of view of said rearward-viewing camera encompasses (i) the traffic lane the equipped vehicle is travelling along and (ii) at least one traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

said cameras comprising a driver side-viewing camera disposed at a driver side of the equipped vehicle, said driver side-viewing camera having a field of view at least sideward of the equipped vehicle;

said cameras comprising a passenger side-viewing camera disposed at a passenger side of the equipped vehicle, said passenger side-viewing camera having a field of view at least sideward of the equipped vehicle;

an electronic control unit;

wherein said electronic control unit receives image data captured by said cameras;

wherein said electronic control unit comprises an image processor operable to process image data captured by said cameras;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said forward-viewing camera, said collision avoidance system detects vehicles present ahead of the equipped vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said forward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in the traffic lane the equipped vehicle is travelling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by said forward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by said rearward-viewing camera, said collision avoidance system detects vehicles present rearward of the equipped vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by said rearward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in the traffic lane the equipped vehicle is travelling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said rearward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

a plurality of other sensors disposed at the equipped vehicle;

wherein said plurality of other sensors comprises at least one sensor that senses at least one of rearward and sideward of the equipped vehicle;

wherein said plurality of other sensors capture sensor data;

wherein said collision avoidance system determines a detected vehicle present in the traffic lane the equipped vehicle is travelling along is an immediately following other vehicle responsive at least in part to at least one of (a) image processing by said image processor of image data captured by said rearward-viewing camera and (b) sensor data sensed by at least one of said plurality of other sensors; and

wherein said collision avoidance system determines speed difference between the equipped vehicle and the detected vehicle present in the traffic lane the equipped vehicle is travelling along and determines distance from the equipped vehicle to the detected vehicle present in the traffic lane the equipped vehicle is travelling along, and based on such determinations, determines that impact is imminent.

26. The collision avoidance system of claim 25, wherein, responsive to the determination that impact is imminent, a pre-impact measure is undertaken.

27. The collision avoidance system of claim 26, wherein said pre-impact measure comprises at least one pre-tensioning a seat belt.

28. The collision avoidance system of claim 26, wherein said pre-impact measure comprises adjusting a vehicle seat.

29. The collision avoidance system of claim 26, wherein, responsive at least in part to image processing by said image processor of image data captured by at least one of said cameras and responsive at least in part to at least one of (i) radar data sensed by at least one radar sensor of said plurality of other sensors and (ii) lidar data sensed by at least one lidar sensor of said plurality of other sensors, said collision avoidance system is operable to determine imminence of collision with the equipped vehicle by another vehicle present exterior the equipped vehicle.

30. The collision avoidance system of claim 29, wherein the other vehicle present exterior the equipped vehicle is travelling in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along.

31. The collision avoidance system of claim 30, wherein information relating to the other vehicle present exterior the equipped vehicle that is travelling in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along is wirelessly transmitted to the equipped vehicle via a car2car (v2v) communication system.

32. The collision avoidance system of claim 31, wherein said collision avoidance system determines imminence of collision with the equipped vehicle by the other vehicle present exterior the equipped vehicle that is travelling in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along responsive at least in part to information transmitted to the equipped vehicle via the car2car (v2v) communication system.

33. A collision avoidance system suitable for use in a vehicle, said collision avoidance system comprising:

a plurality of cameras disposed at a vehicle equipped with said collision avoidance system, each having a field of view exterior of the equipped vehicle;

said cameras comprising a forward-viewing camera disposed at the equipped vehicle, said forward-viewing camera having a field of view at least forward of the equipped vehicle;

wherein the field of view of said forward-viewing camera at least encompasses (i) a traffic lane the equipped vehicle is travelling along and (ii) at least one traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

said cameras comprising a rearward-viewing camera disposed at the equipped vehicle, said rearward-viewing camera having a field of view rearward of the equipped vehicle;

wherein the field of view of said rearward-viewing camera encompasses (i) the traffic lane the equipped vehicle is travelling along and (ii) at least one traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

said cameras comprising a driver side-viewing camera disposed at a driver side of the equipped vehicle, said driver side-viewing camera having a field of view at least sideward of the equipped vehicle;

said cameras comprising a passenger side-viewing camera disposed at a passenger side of the equipped vehicle, said passenger side-viewing camera having a field of view at least sideward of the equipped vehicle;

an electronic control unit;

wherein said electronic control unit receives image data captured by said cameras;

wherein said electronic control unit comprises an image processor operable to process image data captured by said cameras;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said forward-viewing camera, said collision avoidance system detects vehicles present ahead of the equipped vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said forward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in the traffic lane the equipped vehicle is travelling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by said forward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by said rearward-viewing camera, said collision avoidance system detects vehicles present rearward of the equipped vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by said rearward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in the traffic lane the equipped vehicle is travelling along;

wherein, responsive at least in part to image processing by said image processor of image data captured by at least said rearward-viewing camera, said collision avoidance system is operable to determine a detected vehicle to be present in a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along;

a plurality of other sensors disposed at the equipped vehicle;

wherein said plurality of other sensors comprises at least one sensor that senses at least one of rearward and sideward of the equipped vehicle;

wherein said plurality of other sensors capture sensor data;

wherein, responsive at least in part to determination by said collision avoidance system of imminence of collision with the equipped vehicle by another vehicle present exterior the equipped vehicle, said collision avoidance system determines an evasive path for the equipped vehicle to avoid collision with the other vehicle present exterior the equipped vehicle; and

wherein said collision avoidance system controls a steering system of the equipped vehicle to move the equipped vehicle along the determined evasive path.

34. The collision avoidance system of claim 33, wherein said collision avoidance system controls the steering system of the equipped vehicle to move the equipped vehicle into a traffic lane that is adjacent to the traffic lane the equipped vehicle is traveling along.

35. The collision avoidance system of claim 33, wherein said collision avoidance system is operable to wirelessly communicate via a car2car (v2v) communication system to the other vehicle present exterior the equipped vehicle a request to control a vehicle system of the other vehicle.

36. The collision avoidance system of claim 35, wherein the vehicle system of the other vehicle present exterior the equipped vehicle comprises a brake system of the other vehicle.

37. The collision avoidance system of claim 33, wherein said collision avoidance system is operable, responsive at least in part to a communication wirelessly communicated to the equipped vehicle via a car2car (v2v) communication system, to at least control a braking system of the equipped vehicle and to control a steering system of the equipped vehicle.

38. The collision avoidance system of claim 37, wherein said forward-viewing camera is a component of an adaptive cruise control system of the equipped vehicle.

39. The collision avoidance system of claim 33, wherein said plurality of other sensors comprises at least one radar sensor.

40. The collision avoidance system of claim 39, wherein said plurality of other sensors comprises at least one lidar sensor.

41. The collision avoidance system of claim 39, wherein said collision avoidance system determines speed difference between the equipped vehicle and the other vehicle present exterior the equipped vehicle and determines distance from the equipped vehicle to the other vehicle present exterior the equipped vehicle, and based on such determinations, determines that impact is imminent.

42. The collision avoidance system of claim 41, wherein, responsive to the determination that impact is imminent, at least one of (i) a driver of the equipped vehicle is warned and (ii) pre-impact measures are undertaken.

43. The collision avoidance system of claim 41, wherein, responsive to the determination that impact is imminent, pre-impact measures are undertaken, said pre-impact measures comprising at least one of (i) seat belt pre-tensioning and (ii) adjusting a vehicle seat.

44. The collision avoidance system of claim 41, wherein, responsive to the determination that impact is imminent, said collision avoidance system controls the equipped vehicle to accelerate.

45. The collision avoidance system of claim 41, wherein, responsive at least in part to information transmitted to or from the equipped vehicle via a car2car (v2v) communication system, a braking system of the equipped vehicle is controlled.

46. The collision avoidance system of claim 45, wherein, responsive at least in part to information transmitted to or from the equipped vehicle via the car2car (v2v) communication system, a steering system of the equipped vehicle is controlled.