Vehicular lane change system

• US 10,406,980 B2
• Filed: 10/11/2018
• Issued: 09/10/2019
• Est. Priority Date: 07/31/2001
• Status: Expired due to Fees

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Schofield, Kenneth
• Primary Examiner(s): Swarthout, Brent
• Application Number:
  US16/157,226
• Publication Number:
  US 20190039516A1
• Time in Patent Office: 334 Days
• Field of Search: None
• CPC Class Codes: B60Q 1/346 with automatic actuation
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60T 2201/08 Lane monitoring; Lane Keeping Systems
• CPC Class Codes: B60T 2201/089 using optical detection
• CPC Class Codes: B62D 15/029 Steering assistants using warnings or proposing actions to the driver without influencing the steering system
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 2013/9315 Monitoring blind spots
• CPC Class Codes: G01S 2013/9316 combined with communication equipment with other vehicles or with base stations
• CPC Class Codes: G01S 2013/932 using own vehicle data, e.g. ground speed, steering wheel direction
• CPC Class Codes: G01S 2013/9323 Alternative operation using light waves
• CPC Class Codes: G01S 2013/9324 Alternative operation using ultrasonic waves
• CPC Class Codes: G01S 2013/9325 for inter-vehicle distance regulation, e.g. navigating in platoons
• CPC Class Codes: G01S 2013/93274 on the side of the vehicles
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/163 involving continuous checking
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A vehicular lane change system includes a forward-viewing camera that has a field of view through the vehicle windshield that encompasses a road being traveled along by the vehicle. Responsive at least in part to processing of image data captured by the camera, a control determines the lane traveled by the vehicle. The control is operable to detect a lane change maneuver of the vehicle to a lane immediately adjacent to the lane traveled by the vehicle. Detection of the lane change maneuver is based at least in part on vehicle steering data and/or image processing of captured image data. Responsive to the control detecting the lane change maneuver of the vehicle when the driver of the vehicle has neglected to turn on an appropriate turn signal indicator of the vehicle, the control automatically turns on the turn signal indicator at the appropriate side of the vehicle.

Claims

1. A vehicular lane change system, said vehicular lane change system comprising:

a forward-viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with said vehicular lane change system, said forward-viewing camera viewing through the windshield to capture image data at least forward of the equipped vehicle;

a radar sensor disposed at the equipped vehicle, wherein said radar sensor has a field of sensing exterior of the equipped vehicle and wherein said radar sensor captures radar data;

said forward-viewing camera having a field of view that encompasses a road being traveled along by the equipped vehicle;

a control disposed in the equipped vehicle and comprising a data processor;

said data processor comprising an image processor;

wherein image data captured by said forward-viewing camera is provided to said control and is processed by said image processor;

wherein radar data captured by said radar sensor is provided to said control;

wherein said image processor processes provided image data at a processing speed of at least 30 MIPS;

wherein, responsive to image processing by said image processor of provided image data captured by said forward-viewing camera, lane markers on the road being traveled along by the equipped vehicle are detected;

wherein, responsive at least in part to image processing by said image processor of provided image data captured by said forward-viewing camera, said control determines lane edges of a lane being traveled by the equipped vehicle;

wherein said control is operable to detect a lane change maneuver by a driver of the equipped vehicle to a lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein detection by said control of the lane change maneuver by the driver of the equipped vehicle is based at least in part on determining, via image processing by said image processor of provided image data captured by said forward-viewing camera, that the equipped vehicle is approaching a determined lane edge of the lane being traveled by the equipped vehicle to cross that determined lane edge of the lane being traveled by the equipped vehicle;

wherein detection by said control of the lane change maneuver by the driver of the equipped vehicle is irrespective of activation by the driver of the equipped vehicle of a turn signal indicator of the equipped vehicle;

wherein, responsive to said control detecting the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle when the driver of the equipped vehicle has neglected to turn on an appropriate turn signal indicator of the equipped vehicle, said control automatically turns on the turn signal indicator at the appropriate side of the equipped vehicle;

wherein, responsive at least in part to processing at said control of provided radar data captured by said radar sensor, said control detects another vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle; and

wherein, responsive to detection by said control of the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, and responsive to detection by said control of the other vehicle present in that lane immediately adjacent to the lane being traveled by the equipped vehicle, said vehicular lane change system generates an alert to the driver of the equipped vehicle.

2. The vehicular lane change system of claim 1, wherein said control receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle, and wherein said vehicle data comprises vehicle steering data, and wherein said vehicle bus comprises a CAN vehicle bus of the equipped vehicle.

3. The vehicular lane change system of claim 2, wherein a steering angle of the equipped vehicle is determined based at least in part on vehicle steering data received at said control via said CAN vehicle bus, and wherein, based at least in part on the determined steering angle of the equipped vehicle, said vehicular lane change system determines that the driver of the equipped vehicle is making or is intending to make the lane change maneuver.

4. The vehicular lane change system of claim 1, wherein the other vehicle is an oncoming vehicle that is approaching the equipped vehicle.

5. The vehicular lane change system of claim 1, wherein provided radar data captured by said radar sensor and provided image data captured by said forward-viewing camera are fused at said control.

6. The vehicular lane change system of claim 1, wherein, responsive to said control detecting the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, and when said control, via processing at said control of provided radar data captured by said radar sensor, determines that the vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle is not at a location where the equipped vehicle may collide with the other vehicle if the lane change maneuver is made, said control determines that the lane change maneuver can proceed without hazard of collision with the other vehicle detected present in the lane immediately adjacent to the lane being traveled by the equipped vehicle.

7. The vehicular lane change system of claim 1, wherein, responsive at least in part to processing at said control of provided radar data captured by said radar sensor and of provided image data captured by said forward-viewing camera, said control determines a hazard of collision of the equipped vehicle with the other vehicle.

8. The vehicular lane change system of claim 7, wherein, responsive at least in part to said control determining the hazard of collision with the other vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle.

9. The vehicular lane change system of claim 8, wherein, responsive at least in part to said control determining the hazard of collision, said control controls activation of at least one selected from the group consisting of (i) a horn system of the equipped vehicle to mitigate potential collision with the other vehicle and (ii) a lighting system of the equipped vehicle to mitigate potential collision with the other vehicle.

10. The vehicular lane change system of claim 7, wherein, responsive at least in part to said control determining the hazard of collision, said control controls a wireless transmission system of the equipped vehicle to transmit a safety warning to the other vehicle.

11. The vehicular lane change system of claim 7, wherein said radar sensor comprises a Doppler radar sensor.

12. A vehicular lane change system, said vehicular lane change system comprising:

a forward-viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with said vehicular lane change system, said forward-viewing camera viewing through the windshield to capture image data at least forward of the equipped vehicle;

said forward-viewing camera having a field of view that encompasses a road being traveled along by the equipped vehicle;

a control disposed in the equipped vehicle and comprising a data processor;

said data processor comprising an image processor;

wherein image data captured by said forward-viewing camera is provided to said control and is processed by said image processor;

wherein said image processor processes provided image data at a processing speed of at least 30 MIPS;

wherein, responsive to image processing by said image processor of provided image data captured by said forward-viewing camera, lane markers on the road being traveled along by the equipped vehicle are detected;

wherein, responsive at least in part to image processing by said image processor of provided image data captured by said forward-viewing camera, said control determines lane edges of a lane being traveled by the equipped vehicle;

wherein said control is operable to detect a lane change maneuver by a driver of the equipped vehicle to a lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein detection by said control of the lane change maneuver by the driver of the equipped vehicle is irrespective of activation by the driver of the equipped vehicle of a turn signal indicator of the equipped vehicle;

wherein a radar sensor is disposed at the equipped vehicle;

wherein said radar sensor has a field of sensing exterior of the equipped vehicle as the equipped vehicle travels along the road, and wherein said radar sensor captures radar data;

wherein radar data captured by said radar sensor is provided to said control;

wherein, responsive at least in part to processing at said control of provided radar data captured by said radar sensor and of provided image data captured by said forward-viewing camera, said control detects another vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein the other vehicle is an oncoming vehicle that is approaching the equipped vehicle; and

wherein, responsive to detection by said control of the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, and responsive to detection by said control of the other vehicle present in that lane immediately adjacent to the lane being traveled by the equipped vehicle, said vehicular lane change system generates an alert to the driver of the equipped vehicle.

13. The vehicular lane change system of claim 12, wherein provided radar data captured by said radar sensor and provided image data captured by said forward-viewing camera are fused at said control.

14. The vehicular lane change system of claim 13, wherein, responsive to said control detecting the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, and when said control, via processing at said control of provided radar data captured by said radar sensor, determines that the vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle is not at a location where the equipped vehicle may collide with the other vehicle if the lane change maneuver is made, said control determines that the lane change maneuver can proceed without hazard of collision with the other vehicle detected present in the lane immediately adjacent to the lane being traveled by the equipped vehicle.

15. The vehicular lane change system of claim 13, wherein, responsive at least in part to processing at said control of provided radar data captured by said radar sensor and of provided image data captured by said forward-viewing camera, said control determines a hazard of collision of the equipped vehicle with the other vehicle.

16. The vehicular lane change system of claim 15, wherein, responsive at least in part to said control determining the hazard of collision with the other vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle.

17. The vehicular lane change system of claim 15, wherein, responsive at least in part to said control determining the hazard of collision, said control controls activation of at least one selected from the group consisting of (i) a horn system of the equipped vehicle to mitigate potential collision with the other vehicle and (ii) a lighting system of the equipped vehicle to mitigate potential collision with the other vehicle.

18. The vehicular lane change system of claim 15, wherein, responsive at least in part to said control determining the hazard of collision, said control controls a wireless transmission system of the equipped vehicle to transmit a safety warning to the other vehicle.

19. The vehicular lane change system of claim 13, wherein, responsive to said control detecting the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle when the driver of the equipped vehicle has neglected to turn on an appropriate turn signal indicator of the equipped vehicle, said control automatically turns on the turn signal indicator at the appropriate side of the equipped vehicle.

20. The vehicular lane change system of claim 13, wherein said control receives vehicle data relating to the equipped vehicle via a CAN vehicle bus of the equipped vehicle, and wherein said vehicle data comprises vehicle steering data, and wherein detection by said control of a lane change maneuver by the driver of the equipped vehicle is based at least in part on determining, via image processing by said image processor of provided image data captured by said forward-viewing camera, that the equipped vehicle is approaching a determined lane edge of the lane being traveled by the equipped vehicle to cross that determined lane edge of the lane being traveled by the equipped vehicle.

21. A vehicular lane change system, said vehicular lane change system comprising:

a forward-viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with said vehicular lane change system, said forward-viewing camera viewing through the windshield to capture image data at least forward of the equipped vehicle;

said forward-viewing camera having a field of view that encompasses a road being traveled along by the equipped vehicle;

a control disposed in the equipped vehicle and comprising a data processor;

said data processor comprising an image processor;

wherein image data captured by said forward-viewing camera is provided to said control and is processed by said image processor;

wherein said image processor processes provided image data at a processing speed of at least 30 MIPS;

wherein, responsive to image processing by said image processor of provided image data captured by said forward-viewing camera, lane markers on the road being traveled along by the equipped vehicle are detected;

wherein, responsive at least in part to image processing by said image processor of provided image data captured by said forward-viewing camera, said control determines lane edges of a lane being traveled by the equipped vehicle;

wherein said control is operable to detect a lane change maneuver by a driver of the equipped vehicle to a lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein said control receives vehicle data relating to the equipped vehicle via a CAN vehicle bus of the equipped vehicle;

wherein said vehicle data comprises vehicle steering data, and wherein detection by said control of the lane change maneuver by the driver of the equipped vehicle is based at least in part on determining, responsive to vehicle steering data received at said control via said CAN vehicle bus and via image processing by said image processor of provided image data captured by said forward-viewing camera, that the equipped vehicle is approaching a determined lane edge of the lane being traveled by the equipped vehicle to cross that determined lane edge of the lane being traveled by the equipped vehicle;

wherein detection by said control of the lane change maneuver by the driver of the equipped vehicle is irrespective of activation by the driver of the equipped vehicle of a turn signal indicator of the equipped vehicle;

wherein a radar sensor is disposed at the equipped vehicle;

wherein said radar sensor has a field of sensing exterior of the equipped vehicle as the equipped vehicle travels along the road, and wherein said radar sensor captures radar data;

wherein radar data captured by said radar sensor is provided to said control;

wherein provided radar data captured by said radar sensor and provided image data captured by said forward-viewing camera are fused at said control;

wherein, responsive at least in part to processing at said control of provided radar data captured by said radar sensor and of provided image data captured by said forward-viewing camera, said control detects another vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein, responsive to detection by said control of the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, and responsive to detection by said control of the other vehicle present in that lane immediately adjacent to the lane being traveled by the equipped vehicle, said vehicular lane change system generates an alert to the driver of the equipped vehicle;

wherein, responsive at least in part to processing of provided radar data captured by said radar sensor and of provided image data captured by said forward-viewing camera, said control determines a hazard of collision of the equipped vehicle with the other vehicle; and

wherein, responsive at least in part to said control determining the hazard of collision with the other vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle.

22. The vehicular lane change system of claim 21, wherein the other vehicle is an oncoming vehicle that is approaching the equipped vehicle.

23. The vehicular lane change system of claim 22, wherein, responsive to said control detecting the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle when the driver of the equipped vehicle has neglected to turn on an appropriate turn signal indicator of the equipped vehicle, said control automatically turns on the turn signal indicator at the appropriate side of the equipped vehicle.

24. The vehicular lane change system of claim 23, wherein, responsive at least in part to said control determining the hazard of collision, said control controls activation of at least one selected from the group consisting of (i) a horn system of the equipped vehicle to mitigate potential collision with the other vehicle and (ii) a lighting system of the equipped vehicle to mitigate potential collision with the other vehicle.

25. The vehicular lane change system of claim 21, wherein, responsive to said control detecting the lane change maneuver by the driver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, and when said control, via processing at said control of provided radar data captured by said radar sensor, determines that the other vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle is not at a location where the equipped vehicle may collide with the other vehicle if the lane change maneuver is made, said control determines that the lane change maneuver can proceed without hazard of collision with the other vehicle detected present in the lane immediately adjacent to the lane being traveled by the equipped vehicle.

26. The vehicular lane change system of claim 21, wherein, responsive at least in part to said control determining the hazard of collision, said control controls a wireless transmission system of the equipped vehicle to transmit a safety warning to the other vehicle.