Vehicular control system

• US 10,445,600 B2
• Filed: 12/17/2018
• Issued: 10/15/2019
• Est. Priority Date: 01/14/2015
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Divekar, Rohan J., VanOphem, Paul A.
• Primary Examiner(s): Shafi, Muhammad
• Application Number:
  US16/221,690
• Publication Number:
  US 20190114492A1
• Time in Patent Office: 302 Days
• Field of Search: 701 70
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60T 2201/022 Collision avoidance systems
• CPC Class Codes: B60T 7/18 operated by wayside apparatus
• CPC Class Codes: B60T 7/22 initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle , or by means of contactless obstacle detectors mounted on the vehicle
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/161 Decentralised systems, e.g. inter-vehicle communication

Abstract

A vehicular control system includes a camera and a control having a processor that processes image data captured by the camera. The control determines a projected path of travel of the equipped vehicle. The control processes information wirelessly communicated to the equipped vehicle to determine an estimated time to arrival of another vehicle at a location on a road being travelled by the other vehicle that is in the projected path of travel of the equipped vehicle. The projected path of travel of the equipped vehicle crosses a traffic lane being travelled by the other vehicle or joins a traffic lane being travelled by the other vehicle. Responsive at least in part to determination that the estimated time to arrival of the other vehicle is less than a threshold time, the control determines that it is not safe for the equipped vehicle to proceed along the projected path of travel.

Claims

1. A vehicular control system, said vehicular control system comprising:

a camera disposed at and behind a windshield of a vehicle equipped with said vehicular control system, said camera having a field of view through the windshield at least forward of the equipped vehicle;

a control comprising a processor operable to process image data captured by said camera to detect objects present in the field of view of said camera;

wherein said control determines a projected path of travel of the equipped vehicle;

wherein said control is operable to process information wirelessly communicated to the equipped vehicle via a communication system;

wherein said control processes information received via said communication system relating to another vehicle to determine an estimated time to arrival of the other vehicle at a location on a road being travelled by the other vehicle that is in the projected path of travel of the equipped vehicle;

wherein the projected path of travel of the equipped vehicle (i) crosses a traffic lane being travelled by the other vehicle or (ii) joins a traffic lane being travelled by the other vehicle;

wherein, responsive at least in part to a determination that the estimated time to arrival of the other vehicle is less than a threshold time, said control determines that it is not safe for the equipped vehicle to proceed along the projected path of travel; and

wherein, responsive at least in part to (i) a determination that the estimated time to arrival of the other vehicle is greater than a threshold time and (ii) processing by said processor of captured image data detecting an object present in the projected path of travel of the equipped vehicle, said control determines that it is not safe to proceed along the projected path of travel.

2. The vehicular control system of claim 1, wherein said communication system comprises at least one selected from the group consisting of (i) a vehicle-to-vehicle communication system and (ii) a vehicle-to-infrastructure communication system.

3. The vehicular control system of claim 1, wherein, responsive to said control determining based at least in part on processing by said processor of image data captured by said camera that the equipped vehicle may collide with the other vehicle, said control controls a brake system of the equipped vehicle to limit movement of the equipped vehicle along the projected path of travel of the equipped vehicle.

4. The vehicular control system of claim 3, wherein the projected path of travel comprises a turn onto a road with moving traffic.

5. The vehicular control system of claim 4, wherein information received via said communication system from the other vehicle comprises information indicative of location of the other vehicle.

6. The vehicular control system of claim 5, wherein said information indicative of location of the other vehicle is based at least in part on GPS data.

7. The vehicular control system of claim 4, wherein said control determines the estimated time to arrival of the other vehicle at least in part responsive to distance of the other vehicle from a current location of the equipped vehicle.

8. The vehicular control system of claim 4, wherein said control determines the projected path of travel of the equipped vehicle at least in part by processing of captured image data by said processor.

9. The vehicular control system of claim 8, wherein said camera comprises a two dimensional array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows.

10. The vehicular control system of claim 9, wherein said plurality of photosensor elements comprises at least 1 million photosensor elements.

11. The vehicular control system of claim 4, wherein, responsive at least in part to a determination that the estimated time to arrival of the other vehicle is greater than a threshold time, said control determines that there is sufficient space for the equipped vehicle to enter the traffic lane being travelled by the other vehicle.

12. The vehicular control system of claim 11, wherein, responsive at least in part to a determination that the estimated time to arrival of the other vehicle is less than a threshold time, said control determines that there is insufficient space for the equipped vehicle to enter the traffic lane being travelled by the other vehicle.

13. The vehicular control system of claim 1, wherein, responsive at least in part to (i) a determination that the estimated time to arrival is greater than a threshold time and (ii) processing by said processor of captured image data determining that an object is not present in the projected path of travel of the equipped vehicle, said control at least partially controls the equipped vehicle to proceed along the projected path of travel.

14. The vehicular control system of claim 13, wherein the projected path of travel comprises a turn onto a road with moving traffic, and wherein said control determines the estimated time to arrival of the other vehicle at least in part responsive to distance of the other vehicle from a current location of the equipped vehicle.

15. The vehicular control system of claim 1, wherein the projected path of travel of the equipped vehicle crosses the traffic lane being travelled by the other vehicle, and wherein a road being travelled by the equipped vehicle intersects and crosses the road being travelled by the other vehicle.

16. The vehicular control system of claim 1, wherein the projected path of travel of the equipped vehicle joins the traffic lane being travelled by the other vehicle, and wherein the projected path of travel of the equipped vehicle comprises a right-hand turn by the equipped vehicle into the traffic lane being travelled by the other vehicle.

17. The vehicular control system of claim 1, wherein, responsive at least in part to processing by said processor of captured image data, said control controls a brake system of the equipped vehicle to automatically brake the equipped vehicle in a situation where a high probability that a collision may occur exists.

18. The vehicular control system of claim 17, wherein the equipped vehicle comprises an autonomous vehicle.

19. The vehicular control system of claim 17, wherein the equipped vehicle comprises a partial autonomous vehicle.

20. The vehicular control system of claim 17, wherein a road being travelled by the equipped vehicle intersects the road being travelled by the other vehicle, and wherein the other vehicle travels right-to-left relative to the equipped vehicle along the traffic lane being travelled by the other vehicle, and wherein the projected path of travel of the equipped vehicle crosses at least one other traffic lane having traffic travelling left-to-right relative to the equipped vehicle to join the traffic lane being travelled by the other vehicle.

21. A vehicular control system, said vehicular control system comprising:

a camera disposed at and behind a windshield of a vehicle equipped with said vehicular control system, said camera having a field of view through the windshield at least forward of the equipped vehicle;

a control comprising a processor operable to process image data captured by said camera to detect objects present in the field of view of said camera;

wherein said control determines a projected path of travel of the equipped vehicle;

wherein said control is operable to process information wirelessly communicated to the equipped vehicle via a communication system;

wherein said control processes information received via said communication system relating to another vehicle to determine an estimated time to arrival of the other vehicle at a location on a road being travelled by the other vehicle that is in the projected path of travel of the equipped vehicle;

wherein, responsive at least in part to a determination that the estimated time to arrival of the other vehicle is greater than a threshold time, said control determines that there is sufficient space for the equipped vehicle to enter a traffic lane being travelled by the other vehicle;

wherein, responsive at least in part to a determination that the estimated time to arrival of the other vehicle is less than a threshold time, said control determines that there is insufficient space for the equipped vehicle to enter the traffic lane being travelled by the other vehicle; and

wherein, responsive at least in part to processing by said processor of captured image data, said control controls a brake system of the equipped vehicle to automatically brake the equipped vehicle in a situation where a high probability that a collision may occur exists.

22. The vehicular control system of claim 21, wherein the projected path of travel of the equipped vehicle crosses the traffic lane being travelled by the other vehicle.

23. The vehicular control system of claim 21, wherein a road being travelled by the equipped vehicle intersects the road being travelled by the other vehicle, and wherein the other vehicle travels right-to-left relative to the equipped vehicle along the traffic lane being travelled by the other vehicle, and wherein the projected path of travel of the equipped vehicle crosses at least one other traffic lane having traffic travelling left-to-right relative to the equipped vehicle to join the traffic lane being travelled by the other vehicle.

24. The vehicular control system of claim 23, wherein said camera comprises a two dimensional array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows, and wherein said plurality of photosensor elements comprises at least 1 million photosensor elements.

25. The vehicular control system of claim 24, wherein said control determines the projected path of travel of the equipped vehicle at least in part by processing of captured image data by said processor.

26. The vehicular control system of claim 21, wherein the projected path of travel of the equipped vehicle crosses the traffic lane being travelled by the other vehicle, and wherein a road being travelled by the equipped vehicle intersects and crosses the road being travelled by the other vehicle.

27. The vehicular control system of claim 26, wherein information received via said communication system from the other vehicle comprises information indicative of location of the other vehicle, and wherein said control determines the estimated time to arrival of the other vehicle at least in part responsive to distance of the other vehicle from a current location of the equipped vehicle.

28. The vehicular control system of claim 27, wherein said information indicative of location of the other vehicle is based at least in part on GPS data.

29. The vehicular control system of claim 21, wherein, responsive at least in part to (i) a determination that the estimated time to arrival is greater than a threshold time and (ii) processing by said processor of captured image data determining that an object is not present in the projected path of travel of the equipped vehicle, said control controls the equipped vehicle to proceed along the projected path of travel.

30. The vehicular control system of claim 29, wherein the projected path of travel comprises a turn onto a road with moving traffic, and wherein said control determines the estimated time to arrival of the other vehicle at least in part responsive to distance of the other vehicle from a current location of the equipped vehicle.

31. The vehicular control system of claim 21, wherein said communication system comprises a vehicle-to-vehicle communication system.

32. The vehicular control system of claim 21, wherein said communication system comprises a vehicle-to-infrastructure communication system.

33. A vehicular control system, said vehicular control system comprising:

a camera disposed at and behind a windshield of a vehicle equipped with said vehicular control system, said camera having a field of view through the windshield at least forward of the equipped vehicle;

said camera comprising a two dimensional array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows;

wherein said plurality of photosensor elements comprises at least 1 million photosensor elements;

a control comprising a processor operable to process image data captured by said camera to detect objects present in the field of view of said camera;

wherein said control determines a projected path of travel of the equipped vehicle at least in part by processing of captured image data by said processor;

wherein said control is operable to process information wirelessly communicated to the equipped vehicle via a communication system;

wherein said control processes information received via said communication system relating to another vehicle to determine an estimated time to arrival of the other vehicle at a location on a road being travelled by the other vehicle that is in the projected path of travel of the equipped vehicle;

wherein, responsive at least in part to a determination that the estimated time to arrival of the other vehicle is less than a threshold time, said control determines that it is not safe for the equipped vehicle to proceed along the projected path of travel; and

wherein, responsive at least in part to (i) a determination that the estimated time to arrival of the other vehicle is greater than a threshold time and (ii) processing by said processor of captured image data determining that an object is not present in the projected path of travel of the equipped vehicle, said control controls the equipped vehicle to autonomously proceed along the projected path of travel.

34. The vehicular control system of claim 33, wherein the projected path of travel of the equipped vehicle crosses a traffic lane being travelled by the other vehicle.

35. The vehicular control system of claim 33, wherein a road being travelled by the equipped vehicle intersects the road being travelled by the other vehicle, and wherein the other vehicle travels right-to-left relative to the equipped vehicle along a traffic lane being travelled by the other vehicle, and wherein the projected path of travel of the equipped vehicle crosses at least one other traffic lane having traffic travelling left-to-right relative to the equipped vehicle to join the traffic lane being travelled by the other vehicle.

36. The vehicular control system of claim 35, wherein, responsive to said control determining based at least in part on processing by said processor of image data captured by said camera that the equipped vehicle may collide with the other vehicle, said control controls a brake system of the equipped vehicle to limit movement of the equipped vehicle along the projected path of travel of the equipped vehicle.

37. The vehicular control system of claim 33, wherein the projected path of travel of the equipped vehicle crosses a traffic lane being travelled by the other vehicle, and wherein a road being travelled by the equipped vehicle intersects and crosses the road being travelled by the other vehicle.

38. The vehicular control system of claim 33, wherein information received via said communication system from the other vehicle comprises information indicative of location of the other vehicle, and wherein said control determines the estimated time to arrival of the other vehicle at least in part responsive to distance of the other vehicle from a current location of the equipped vehicle.

39. The vehicular control system of claim 38, wherein said information indicative of location of the other vehicle is based at least in part on GPS data.

40. The vehicular control system of claim 33, wherein the projected path of travel comprises a turn onto a road with moving traffic, and wherein said control determines the estimated time to arrival of the other vehicle at least in part responsive to distance of the other vehicle from a current location of the equipped vehicle.

41. The vehicular control system of claim 40, wherein said communication system comprises a vehicle-to-vehicle communication system.

42. The vehicular control system of claim 40, wherein said communication system comprises a vehicle-to-infrastructure communication system.

43. The vehicular control system of claim 33, wherein the projected path of travel of the equipped vehicle joins a traffic lane being travelled by the other vehicle, and wherein the projected path of travel of the equipped vehicle comprises a right-hand turn by the equipped vehicle into the traffic lane being travelled by the other vehicle.