Vehicular control system

• US 9,824,285 B2
• Filed: 01/26/2017
• Issued: 11/21/2017
• Est. Priority Date: 02/04/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Salomonsson, Ove J., Van Dan Elzen, Christopher L.
• Primary Examiner(s): Dunn, Alex C
• Application Number:
  US15/416,217
• Publication Number:
  US 20170132483A1
• Time in Patent Office: 299 Days
• CPC Class Codes: B60Q 1/08 automatically
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/80 characterised by the intended use of the viewing arrangement
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60T 7/22 initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle , or by means of contactless obstacle detectors mounted on the vehicle
• CPC Class Codes: F02D 41/042 for stopping the engine
• CPC Class Codes: F02D 41/065 at hot start or restart F02D41/067 takes precedence
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/096725 where the received information generates an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096766 : where the system is characterised by the origin of the information transmission
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

A control system for a vehicle includes a forward-viewing camera and an image processor operable to process image data captured by the forward-viewing camera. The control system is operable to detect a traffic light and to determine a change in state of the traffic light from red to green. The control system determines that another vehicle is ahead of the stopped equipped vehicle at the traffic light, and determines a change in state of the traffic light from red to green. Responsive to (a) a threshold period of time elapsing during which the other vehicle ahead of the equipped vehicle has not moved after the traffic light changes state from red to green and/or (b) the other vehicle ahead of the equipped vehicle moving a threshold distance away from the equipped vehicle, the control system (i) generates an alert and/or (ii) controls a vehicle system of the equipped vehicle.

Claims

1. A control system for a vehicle, said control system comprising:

a forward-viewing camera that is disposed behind a windshield of a vehicle equipped with said control system so as to view at least forwardly of the equipped vehicle through the windshield;

an image processor operable to process image data captured by said forward-viewing camera;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system is operable to detect a traffic light;

wherein said control system is operable to determine a change in state of the traffic light from red to green;

wherein said control system is operable to determine that the equipped vehicle is stopped;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines that the equipped vehicle is stopped at a red traffic light;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines that another vehicle is ahead of the equipped vehicle at the traffic light;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines a change in state of the traffic light from red to green;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines that the other vehicle ahead of the equipped vehicle is moving; and

wherein, responsive to at least one of (a) a threshold period of time elapsing during which the other vehicle ahead of the equipped vehicle has not moved after the traffic light changes state from red to green and (b) the other vehicle ahead of the equipped vehicle moving a threshold distance away from the equipped vehicle, said control system is operable to at least one of (i) generate an alert and (ii) control a vehicle system of the equipped vehicle.

2. The control system of claim 1, wherein, responsive at least in part to determination, via image processing by said image processor of image data captured by said forward-viewing camera, that the equipped vehicle is approaching the other vehicle ahead of the equipped vehicle, said control system is operable to apply a vehicle brake of the equipped vehicle to mitigate a collision with the other vehicle ahead of the equipped vehicle.

3. The control system of claim 2, wherein a rearward-viewing camera is disposed at a rear portion of the equipped vehicle so as to view at least rearwardly of the equipped vehicle, and wherein, when said control system is applying the vehicle brake to mitigate a collision with the other vehicle ahead of the equipped vehicle, and responsive at least in part to determination, via image processing by said image processor of image data captured by said rearward-viewing camera, that a following vehicle is following the equipped vehicle and may collide with the equipped vehicle, said control system adjusts control of the vehicle brake to mitigate a rear collision by the following vehicle.

4. The control system of claim 3, wherein, responsive at least in part to determination that the equipped vehicle is approaching the other vehicle ahead of the equipped vehicle, said control system is operable to apply a vehicle brake of the equipped vehicle at a first degree of braking, and wherein, when said control system is applying the vehicle brake at the first degree of braking, and responsive at least in part to determination of the following vehicle, said control system applies the vehicle brake of the equipped vehicle at a second degree of braking.

5. The control system of claim 4, wherein the second degree of braking is less than the first degree of braking.

6. The control system of claim 4, wherein said control system determines the first and second degrees of braking based on at least one of a distance of the determined following vehicle from the equipped vehicle and a rate of approach of the determined following vehicle to the equipped vehicle.

7. The control system of claim 1, wherein, responsive at least in part to determination, via processing by said image processor of image data captured by said forward-viewing camera, that the equipped vehicle is approaching an object present forwardly of the equipped vehicle, said control system generates an alert to a driver of the equipped vehicle.

8. The control system of claim 1, wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system detects the traffic light.

9. The control system of claim 1, wherein, responsive at least in part to a V2V communication, said control system detects the traffic light.

10. The control system of claim 1, wherein, responsive at least in part to an X2V communication, said control system detects the traffic light.

11. The control system of claim 1, wherein, responsive to a threshold period of time elapsing during which the other vehicle ahead of the equipped vehicle has not moved after the traffic light changes state from red to green, said control system controls a vehicle system of the equipped vehicle.

12. The control system of claim 1, wherein, responsive to the other vehicle ahead of the equipped vehicle moving a threshold distance away from the equipped vehicle, said control system controls a vehicle system of the equipped vehicle.

13. The control system of claim 1, wherein, responsive at least in part to determination via image processing by said image processor of image data captured by said forward-viewing camera that the equipped vehicle is approaching the other vehicle present ahead of the equipped vehicle, said control system is operable to apply maximum braking of the equipped vehicle when there is no vehicle determined to be following the equipped vehicle within a threshold distance from the equipped vehicle.

14. The control system of claim 13, wherein a rearward-viewing camera is disposed at a rear portion of the equipped vehicle so as to view at least rearwardly of the equipped vehicle, and wherein that there is no vehicle determined to be following the equipped vehicle within a threshold distance is determined, at least in part, via image processing by said image processor of image data captured by said rearward-viewing camera.

15. The control system of claim 1, wherein said image processor processes image data captured by said forward-viewing camera when the equipped vehicle is moving in a forward direction for at least one of (i) a headlamp control system of the equipped vehicle and (ii) a lane departure warning system of the equipped vehicle.

16. The control system of claim 1, wherein said control system determines when the equipped vehicle is stopped responsive at least in part to at least one of (i) a speed sensor of the equipped vehicle and (ii) a braking system of the equipped vehicle.

17. A control system for a vehicle, said control system comprising:

a forward-viewing camera that is disposed behind a windshield of a vehicle equipped with said control system so as to view at least forwardly of the equipped vehicle through the windshield;

an image processor operable to process image data captured by said forward-viewing camera;

wherein, responsive at least in part to at least one of (i) processing by said image processor of image data captured by said forward-viewing camera, (ii) a V2V communication and (iii) an X2V communication, said control system detects a traffic light;

wherein said control system is operable to determine that the equipped vehicle is stopped;

wherein, responsive at least in part to at least one of (i) processing by said image processor of image data captured by said forward-viewing camera, (ii) a V2V communication and (iii) an X2V communication, said control system determines that the equipped vehicle is stopped at a red traffic light;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines that another vehicle is ahead of the equipped vehicle at the traffic light;

wherein, responsive at least in part to at least one of (i) processing by said image processor of image data captured by said forward-viewing camera, (ii) a V2V communication and (iii) an X2V communication, said control system determines a change in state of the traffic light from red to green;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines that the other vehicle ahead of the equipped vehicle is moving; and

wherein, responsive to at least one of (a) a threshold period of time elapsing during which the other vehicle ahead of the equipped vehicle has not moved after the traffic light changes state from red to green and (b) the other vehicle ahead of the equipped vehicle moving a threshold distance away from the equipped vehicle, said control system controls a vehicle system of the equipped vehicle.

18. The control system of claim 17, wherein said image processor processes image data captured by said forward-viewing camera when the equipped vehicle is moving in a forward direction for at least one of (i) a headlamp control system of the equipped vehicle and (ii) a lane departure warning system of the equipped vehicle.

19. The control system of claim 17, wherein said control system determines when the equipped vehicle is stopped responsive at least in part to at least one of (i) a speed sensor of the equipped vehicle and (ii) a braking system of the equipped vehicle.

20. The control system of claim 19, wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines the change in state of the traffic light from red to green.

21. The control system of claim 19, wherein, responsive at least in part to a V2V communication, said control system determines the change in state of the traffic light from red to green.

22. The control system of claim 19, wherein, responsive at least in part to an X2V communication, said control system determines the change in state of the traffic light from red to green.

23. A control system for a vehicle, said control system comprising:

a forward-viewing camera that is disposed behind a windshield of a vehicle equipped with said control system so as to view at least forwardly of the equipped vehicle through the windshield;

an image processor operable to process image data captured by said forward-viewing camera;

wherein said control system is operable to detect a traffic light;

wherein said control system is operable to determine that the equipped vehicle is stopped;

wherein said control system determines that the equipped vehicle is stopped at a red traffic light;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines that another vehicle is ahead of the equipped vehicle at the traffic light;

wherein said control system determines that the traffic light changes state from red to green;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines that the other vehicle ahead of the equipped vehicle is moving;

wherein said image processor processes image data captured by said forward-viewing camera when the equipped vehicle is moving in a forward direction for at least one of (i) a headlamp control system of the equipped vehicle and (ii) a lane departure warning system of the equipped vehicle;

wherein said control system determines when the equipped vehicle is stopped responsive at least in part to at least one of (i) a speed sensor of the equipped vehicle and (ii) a braking system of the equipped vehicle; and

wherein, responsive at least in part to determination, via image processing by said image processor of image data captured by said forward-viewing camera, that the equipped vehicle is approaching the other vehicle ahead of the equipped vehicle, said control system is operable to apply a vehicle brake of the equipped vehicle to mitigate a collision with the other vehicle ahead of the equipped vehicle.

24. The control system of claim 23, wherein said control system detects the traffic light responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera.

25. The control system of claim 24, wherein, responsive at least in part to processing by said image processor of image data captured by said forward-viewing camera, said control system determines the change in state of the traffic light from red to green.

26. The control system of claim 23, wherein said control system detects the traffic light responsive at least in part to a V2V communication.

27. The control system of claim 26, wherein, responsive at least in part to a V2V communication, said control system determines the change in state of the traffic light from red to green.

28. The control system of claim 23, wherein said control system detects the traffic light responsive at least in part to an X2V communication.

29. The control system of claim 28, wherein, responsive at least in part to an X2V communication, said control system determines the change in state of the traffic light from red to green.