VEHICULAR LANE CHANGE SYSTEM

• US 20190039516A1
• Filed: 10/11/2018
• Published: 02/07/2019
• Est. Priority Date: 07/31/2001
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Schofield, Kenneth
• Granted Patent: US 10,406,980 B2
• Time in Patent Office: Days
• CPC Class Codes: B60Q 1/346 with automatic actuation
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60T 2201/08 Lane monitoring; Lane Keeping Systems
• CPC Class Codes: B60T 2201/089 using optical detection
• CPC Class Codes: B62D 15/029 Steering assistants using warnings or proposing actions to the driver without influencing the steering system
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 2013/9315 Monitoring blind spots
• CPC Class Codes: G01S 2013/9316 combined with communication equipment with other vehicles or with base stations
• CPC Class Codes: G01S 2013/932 using own vehicle data, e.g. ground speed, steering wheel direction
• CPC Class Codes: G01S 2013/9323 Alternative operation using light waves
• CPC Class Codes: G01S 2013/9324 Alternative operation using ultrasonic waves
• CPC Class Codes: G01S 2013/9325 for inter-vehicle distance regulation, e.g. navigating in platoons
• CPC Class Codes: G01S 2013/93274 on the side of the vehicles
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/163 involving continuous checking
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A vehicular lane change system includes a forward-viewing camera that has a field of view through the vehicle windshield that encompasses a road being traveled along by the vehicle. Responsive at least in part to processing of image data captured by the camera, a control determines the lane traveled by the vehicle. The control is operable to detect a lane change maneuver of the vehicle to a lane immediately adjacent to the lane traveled by the vehicle. Detection of the lane change maneuver is based at least in part on vehicle steering data and/or image processing of captured image data. Responsive to the control detecting the lane change maneuver of the vehicle when the driver of the vehicle has neglected to turn on an appropriate turn signal indicator of the vehicle, the control automatically turns on the turn signal indicator at the appropriate side of the vehicle.

Claims

1. A vehicular lane change system, said vehicular lane change system comprising:

a forward-viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with said vehicular lane change system, said forward-viewing camera viewing through the windshield to capture image data at least forward of the equipped vehicle;

said forward-viewing camera having a field of view that encompasses a road being traveled along by the equipped vehicle;

a control disposed in the equipped vehicle and comprising a data processor;

said data processor comprising an image processor;

wherein image data captured by said forward-viewing camera is provided to said control and is processed by said image processor;

wherein said image processor processes data at a processing speed of at least 30 MIPS;

wherein, responsive to image processing by said image processor of image data captured by said forward-viewing camera, lane markers on the road being traveled along by the equipped vehicle are detected;

wherein, responsive at least in part to image processing by said image processor of image data captured by said forward-viewing camera, said control determines a lane being traveled by the equipped vehicle;

wherein said control receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle;

wherein said vehicle data comprises vehicle steering data;

wherein said control is operable to detect a lane change maneuver of the equipped vehicle to a lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein detection of the lane change maneuver by said control is based at least in part on at least one selected from the group consisting of (i) vehicle steering data received at said control via said vehicle bus and (ii) image processing by said image processor of image data captured by said forward-viewing camera;

wherein detection of the lane change maneuver by said control is irrespective of activation by a driver of the equipped vehicle of a turn signal indicator of the equipped vehicle; and

wherein, responsive to said control detecting the lane change maneuver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle when the driver of the equipped vehicle has neglected to turn on an appropriate turn signal indicator of the equipped vehicle, said control automatically turns on the turn signal indicator at the appropriate side of the equipped vehicle.

2. The vehicular lane change system of claim 1, wherein said vehicle bus system comprises a CAN vehicle bus of the equipped vehicle.

3. The vehicular lane change system of claim 2, wherein detection of the lane change maneuver by said control is based at least in part on vehicle steering data received at said control via said CAN vehicle bus.

4. The vehicular lane change system of claim 1, wherein detection of the lane change maneuver by said control is based at least in part on image processing by said image processor of image data captured by said forward-viewing camera.

5. The vehicular lane change system of claim 1, wherein detection of the lane change maneuver by said control is based at least in part on vehicle steering data received at said control via said vehicle bus and on image processing by said image processor of image data captured by said forward-viewing camera.

6. The vehicular lane change system of claim 1, wherein a radar sensor is disposed at the equipped vehicle, and wherein said radar sensor has a field of sensing exterior of the equipped vehicle as the equipped vehicle travels along the road, and wherein radar data generated by said radar sensor is provided to said control, and wherein, responsive at least in part to processing at said control of radar data generated by said radar sensor and of image data captured by said forward-viewing camera, said control detects another vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle.

7. The vehicular lane change system of claim 6, wherein the other vehicle is an oncoming vehicle that is approaching the equipped vehicle.

8. The vehicular lane change system of claim 6, wherein radar data generated by said radar sensor and image data captured by said forward-viewing camera are fused at said control.

9. The vehicular lane change system of claim 6, wherein, responsive to said control detecting the lane change maneuver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, said control determines that the lane change can proceed without hazard of collision with the other vehicle detected present in the lane immediately adjacent to the lane being traveled by the equipped vehicle.

10. The vehicular lane change system of claim 6, wherein, responsive at least in part to processing at said control of radar data generated by said radar sensor and of image data captured by said forward-viewing camera, said control determines a hazard of collision of the equipped vehicle with the other vehicle.

11. The vehicular lane change system of claim 10, wherein, responsive at least in part to said control determining the hazard of collision with the other vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle.

12. The vehicular lane change system of claim 11, wherein, responsive at least in part to said control determining the hazard of collision, said control controls activation of at least one selected from the group consisting of (i) a horn system of the equipped vehicle to mitigate potential collision with the other vehicle and (ii) a lighting system of the equipped vehicle to mitigate potential collision with the other vehicle.

13. The vehicular lane change system of claim 10, wherein, responsive at least in part to said control determining the hazard of collision, said control controls a wireless transmission system of the equipped vehicle to transmit a safety warning to the other vehicle.

14. The vehicular lane change system of claim 10, wherein said radar sensor comprises a Doppler radar sensor.

15. A vehicular lane change system, said vehicular lane change system comprising:

a forward-viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with said vehicular lane change system, said forward-viewing camera viewing through the windshield to capture image data at least forward of the equipped vehicle;

said forward-viewing camera having a field of view that encompasses a road being traveled along by the equipped vehicle;

a control disposed in the equipped vehicle and comprising a data processor;

said data processor comprising an image processor;

wherein image data captured by said forward-viewing camera is provided to said control and is processed by said image processor;

wherein said image processor processes data at a processing speed of at least 30 MIPS;

wherein, responsive to image processing by said image processor of image data captured by said forward-viewing camera, lane markers on the road being traveled along by the equipped vehicle are detected;

wherein, responsive at least in part to image processing by said image processor of image data captured by said forward-viewing camera, said control determines a lane being traveled by the equipped vehicle;

wherein said control is operable to detect a lane change maneuver of the equipped vehicle to a lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein detection of the lane change maneuver by said control is irrespective of activation by a driver of the equipped vehicle of a turn signal indicator of the equipped vehicle;

wherein a radar sensor is disposed at the equipped vehicle;

wherein said radar sensor has a field of sensing exterior of the equipped vehicle as the equipped vehicle travels along the road;

wherein radar data generated by said radar sensor is provided to said control;

wherein, responsive at least in part to processing at said control of radar data generated by said radar sensor and of image data captured by said forward-viewing camera, said control detects another vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle; and

wherein the other vehicle is an oncoming vehicle that is approaching the equipped vehicle.

16. The vehicular lane change system of claim 15, wherein radar data generated by said radar sensor and image data captured by said forward-viewing camera are fused at said control.

17. The vehicular lane change system of claim 16, wherein, responsive to said control detecting the lane change maneuver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, said control determines that the lane change can proceed without hazard of collision with the other vehicle detected present in the lane immediately adjacent to the lane being traveled by the equipped vehicle.

18. The vehicular lane change system of claim 16, wherein, responsive at least in part to processing at said control of radar data generated by said radar sensor and of image data captured by said forward-viewing camera, said control determines a hazard of collision of the equipped vehicle with the other vehicle.

19. The vehicular lane change system of claim 18, wherein, responsive at least in part to said control determining the hazard of collision with the other vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle.

20. The vehicular lane change system of claim 18, wherein, responsive at least in part to said control determining the hazard of collision, said control controls activation of at least one selected from the group consisting of (i) a horn system of the equipped vehicle to mitigate potential collision with the other vehicle and (ii) a lighting system of the equipped vehicle to mitigate potential collision with the other vehicle.

21. The vehicular lane change system of claim 18, wherein, responsive at least in part to said control determining the hazard of collision, said control controls a wireless transmission system of the equipped vehicle to transmit a safety warning to the other vehicle.

22. The vehicular lane change system of claim 16, wherein, responsive to said control detecting the lane change maneuver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle when the driver of the equipped vehicle has neglected to turn on an appropriate turn signal indicator of the equipped vehicle, said control automatically turns on the turn signal indicator at the appropriate side of the equipped vehicle.

23. The vehicular lane change system of claim 16, wherein said control receives vehicle data relating to the equipped vehicle via a CAN vehicle bus of the equipped vehicle, and wherein said vehicle data comprises vehicle steering data, and wherein detection of a lane change maneuver by said control is based at least in part on at least one selected from the group consisting of (i) vehicle steering data received at said control via said CAN vehicle bus and (ii) image processing by said image processor of image data captured by said forward-viewing camera.

24. A vehicular lane change system, said vehicular lane change system comprising:

a forward-viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with said vehicular lane change system, said forward-viewing camera viewing through the windshield to capture image data at least forward of the equipped vehicle;

said forward-viewing camera having a field of view that encompasses a road being traveled along by the equipped vehicle;

a control disposed in the equipped vehicle and comprising a data processor;

said data processor comprising an image processor;

wherein image data captured by said forward-viewing camera is provided to said control and is processed by said image processor;

wherein said image processor processes data at a processing speed of at least 30 MIPS;

wherein, responsive to image processing by said image processor of image data captured by said forward-viewing camera, lane markers on the road being traveled along by the equipped vehicle are detected;

wherein, responsive at least in part to image processing by said image processor of image data captured by said forward-viewing camera, said control determines a lane being traveled by the equipped vehicle;

wherein said control is operable to detect a lane change maneuver of the equipped vehicle to a lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein said control receives vehicle data relating to the equipped vehicle via a CAN vehicle bus of the equipped vehicle;

wherein said vehicle data comprises vehicle steering data, and wherein detection of the lane change maneuver by said control is based at least in part on vehicle steering data received at said control via said CAN vehicle bus and on image processing by said image processor of image data captured by said forward-viewing camera;

wherein detection of the lane change maneuver by said control is irrespective of activation by a driver of the equipped vehicle of a turn signal indicator of the equipped vehicle;

wherein a radar sensor is disposed at the equipped vehicle;

wherein said radar sensor has a field of sensing exterior of the equipped vehicle as the equipped vehicle travels along the road;

wherein radar data generated by said radar sensor is provided to said control;

wherein radar data generated by said radar sensor and image data captured by said forward-viewing camera are fused at said control;

wherein, responsive at least in part to processing at said control of radar data generated by said radar sensor and of image data captured by said forward-viewing camera, said control detects another vehicle present in the lane immediately adjacent to the lane being traveled by the equipped vehicle;

wherein, responsive at least in part to processing of radar data generated by said radar sensor and of image data captured by said forward-viewing camera, said control determines a hazard of collision of the equipped vehicle with the other vehicle; and

wherein, responsive at least in part to said control determining the hazard of collision with the other vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle.

25. The vehicular lane change system of claim 24, wherein the other vehicle is an oncoming vehicle that is approaching the equipped vehicle.

26. The vehicular lane change system of claim 25, wherein, responsive to said control detecting the lane change maneuver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle when the driver of the equipped vehicle has neglected to turn on an appropriate turn signal indicator of the equipped vehicle, said control automatically turns on the turn signal indicator at the appropriate side of the equipped vehicle.

27. The vehicular lane change system of claim 26, wherein, responsive at least in part to said control determining the hazard of collision, said control controls activation of at least one selected from the group consisting of (i) a horn system of the equipped vehicle to mitigate potential collision with the other vehicle and (ii) a lighting system of the equipped vehicle to mitigate potential collision with the other vehicle.

28. The vehicular lane change system of claim 24, wherein, responsive to said control detecting the lane change maneuver of the equipped vehicle to the lane immediately adjacent to the lane being traveled by the equipped vehicle, said control determines that the lane change can proceed without hazard of collision with the other vehicle detected present in the lane immediately adjacent to the lane being traveled by the equipped vehicle.

29. The vehicular lane change system of claim 24, wherein, responsive at least in part to said control determining the hazard of collision, said control controls a wireless transmission system of the equipped vehicle to transmit a safety warning to the other vehicle.