VEHICLE VISION SYSTEM WITH COLLISION MITIGATION

• US 20180075752A1
• Filed: 11/20/2017
• Published: 03/15/2018
• Est. Priority Date: 06/19/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Chundrlik, JR., William J., Raudszus, Dominik
• Granted Patent: US 10,692,380 B2
• Time in Patent Office: Days
• CPC Class Codes: B60T 2201/024 Collision mitigation systems
• CPC Class Codes: B60T 2210/32 Vehicle surroundings
• CPC Class Codes: B60T 7/22 initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle , or by means of contactless obstacle detectors mounted on the vehicle
• CPC Class Codes: B60T 8/171 Detecting parameters used in the regulation; Measuring values used in the regulation
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A method for determining potential collision with another vehicle by a vehicle equipped with a vision system includes providing, at the equipped vehicle, a vision sensor including a camera and at least one non-vision sensor, and determining presence of a leading vehicle ahead of the equipped vehicle. A time to collision to the leading vehicle is determined based at least in part on a determined distance to the leading vehicle and a determined relative velocity between the equipped vehicle and the leading vehicle. A braking level of the equipped vehicle is determined to mitigate collision of the equipped vehicle with the leading vehicle. A weighting factor is employed when determining the braking level, and the weighting factor is adjusted responsive at least in part to determining, via processing of image data captured by the camera, that a brake light of the leading vehicle ceases to be illuminated.

Claims

1. A method for determining potential collision with another vehicle by a vehicle equipped with a vision system, said method comprising:

providing, at the equipped vehicle, a vision sensor comprising a camera having at least one million photosensing elements;

providing, at the equipped vehicle, at least one non-vision sensor comprising at least one radar sensor or at least one lidar sensor;

capturing, using said camera, image data of an exterior environment ahead of the equipped vehicle;

determining presence of a leading vehicle ahead of the equipped vehicle;

when the leading vehicle is determined to be present ahead of the equipped vehicle, determining, via processing by an image processor of image data captured by said camera, that a brake light of the leading vehicle is illuminated;

determining distance to the leading vehicle;

determining relative velocity between the equipped vehicle and the leading vehicle;

determining a time to collision to the leading vehicle based at least in part on the determined distance to the leading vehicle and the determined relative velocity between the equipped vehicle and the leading vehicle;

determining a braking level of the equipped vehicle to mitigate collision of the equipped vehicle with the leading vehicle;

employing a weighting factor when determining the braking level of the equipped vehicle to mitigate collision of the equipped vehicle with the leading vehicle; and

adjusting the weighting factor responsive at least in part to determining, via processing of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated.

2. The method of claim 1, wherein adjusting the weighting factor comprises decreasing weight given to the determined time to collision to the leading vehicle responsive at least in part to determining, via processing of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated.

3. The method of claim 1, comprising, responsive at least in part to the determined time to collision being below a threshold value of time, and responsive at least in part to determining, via image processing by said image processor of image data captured by said camera, that the brake light of the leading vehicle is illuminated, determining a degree of warning to a driver of the equipped vehicle.

4. The method of claim 3, comprising, after determining the degree of warning to the driver of the equipped vehicle, and responsive at least in part to determining, via image processing by said image processor of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated, reducing the determined degree of warning to the driver of the equipped vehicle.

5. The method of claim 3, comprising providing a warning in accordance with the determined degree of warning.

6. The method of claim 5, comprising, after providing the warning in accordance with the determined degree of warning, and responsive at least in part to determining, via processing of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated, reducing the degree of warning provided to the driver of the equipped vehicle.

7. The method of claim 1, wherein determining distance to the leading vehicle comprises determining distance to the leading vehicle at least in part responsive to image processing by said image processor of image data captured by said camera.

8. The method of claim 1, wherein determining relative velocity between the equipped vehicle and the leading vehicle comprises determining relative velocity between the equipped vehicle and the leading vehicle responsive at least in part to image processing by said image processor of image data captured by said camera.

9. The method of claim 1, comprising determining velocity of the equipped vehicle at least in part via at least one sensor of the equipped vehicle.

10. The method of claim 1, wherein providing, at the equipped vehicle, at least one non-vision sensor comprises providing, at the equipped vehicle, at least one radar sensor.

11. The method of claim 1, wherein providing, at the equipped vehicle, at least one non-vision sensor comprises providing, at the equipped vehicle, at least one lidar sensor.

12. A method for determining potential collision with another vehicle by a vehicle equipped with a vision system, said method comprising:

providing, at the equipped vehicle, a vision sensor comprising a camera having at least one million photosensing elements;

providing, at the equipped vehicle, at least one non-vision sensor comprising at least one radar sensor or at least one lidar sensor;

capturing, using said camera, image data of an exterior environment ahead of the equipped vehicle;

determining presence of a leading vehicle ahead of the equipped vehicle;

when the leading vehicle is determined to be present ahead of the equipped vehicle, determining, via processing by an image processor of image data captured by said camera, that a brake light of the leading vehicle is illuminated;

determining, at least in part via image processing by said image processor of image data captured by said camera, distance to the leading vehicle;

determining relative velocity between the equipped vehicle and the leading vehicle;

determining a time to collision to the leading vehicle based at least in part on the determined distance to the leading vehicle and the determined relative velocity between the equipped vehicle and the leading vehicle;

determining a braking level of the equipped vehicle to mitigate collision of the equipped vehicle with the leading vehicle;

employing a weighting factor when determining the braking level of the equipped vehicle to mitigate collision of the equipped vehicle with the leading vehicle;

adjusting the weighting factor responsive at least in part to determining, via processing of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated; and

wherein adjusting the weighting factor comprises decreasing weight given to the determined time to collision to the leading vehicle responsive at least in part to determining, via processing of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated.

13. The method of claim 12, comprising, responsive at least in part to the determined time to collision being below a threshold value of time, and responsive at least in part to determining, via image processing by said image processor of image data captured by said camera, that the brake light of the leading vehicle is illuminated, determining a degree of warning to a driver of the equipped vehicle.

14. The method of claim 13, comprising, after determining the degree of warning to the driver of the equipped vehicle, and responsive at least in part to determining, via image processing by said image processor of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated, reducing the determined degree of warning to the driver of the equipped vehicle.

15. The method of claim 13, comprising providing a warning in accordance with the determined degree of warning.

16. The method of claim 15, comprising, after providing the warning in accordance with the determined degree of warning, and responsive at least in part to determining, via processing of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated, reducing the degree of warning provided to the driver of the equipped vehicle.

17. A method for determining potential collision with another vehicle by a vehicle equipped with a vision system, said method comprising:

providing, at the equipped vehicle, a vision sensor comprising a camera having at least one million photosensing elements;

providing, at the equipped vehicle, at least one non-vision sensor comprising at least one radar sensor;

capturing, using said camera, image data of an exterior environment ahead of the equipped vehicle;

determining presence of a leading vehicle ahead of the equipped vehicle;

when the leading vehicle is determined to be present ahead of the equipped vehicle, determining, via processing by an image processor of image data captured by said camera, that a brake light of the leading vehicle is illuminated;

determining distance to the leading vehicle;

determining relative velocity between the equipped vehicle and the leading vehicle;

wherein determining relative velocity between the equipped vehicle and the leading vehicle is responsive at least in part to at least one of (i) image processing by said image processor of image data captured by said camera and (ii) processing of radar data sensed by said at least one radar sensor of the equipped vehicle;

determining a time to collision to the leading vehicle based at least in part on the determined distance to the leading vehicle and the determined relative velocity between the equipped vehicle and the leading vehicle;

determining a braking level of the equipped vehicle to mitigate collision of the equipped vehicle with the leading vehicle;

employing a weighting factor when determining the braking level of the equipped vehicle to mitigate collision of the equipped vehicle with the leading vehicle; and

adjusting the weighting factor responsive at least in part to determining, via processing of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated.

18. The method of claim 17, comprising, responsive at least in part to the determined time to collision being below a threshold value of time, and responsive at least in part to determining, via image processing by said image processor of image data captured by said camera, that the brake light of the leading vehicle is illuminated, determining a degree of warning to a driver of the equipped vehicle.

19. The method of claim 18, comprising, after determining the degree of warning to the driver of the equipped vehicle, and responsive at least in part to determining, via image processing by said image processor of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated, reducing the determined degree of warning to the driver of the equipped vehicle.

20. The method of claim 18, comprising providing a warning in accordance with the determined degree of warning, and, after providing the warning in accordance with the determined degree of warning, and responsive at least in part to determining, via processing of image data captured by said camera, that the brake light of the leading vehicle ceases to be illuminated, reducing the degree of warning provided to the driver of the equipped vehicle.