Vehicular control system with remote processor

• US 10,870,427 B2
• Filed: 11/26/2018
• Issued: 12/22/2020
• Est. Priority Date: 12/05/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Koravadi, Krishna
• Primary Examiner(s): Trivedi, Atul
• APPLICATION: US 20190106105A1
• Time in patent office: 757 Days
• Field of Search: 701 23
• CPC Class Codes: B60T 7/12 for automatic initiation; for initiation not subject to will of driver or passenger limiting speed of vehicles other than rail vehicles B60K31/00
• CPC Class Codes: B60T 7/18 operated by wayside apparatus
• CPC Class Codes: B60W 30/09 Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: B62D 15/029 Steering assistants using warnings or proposing actions to the driver without influencing the steering system parking aids B62D15/027, determination or calculation of trajectory of land vehicles G05D1/021, B60W60/0027, image processing G06T
• CPC Class Codes: G08G 1/164 Centralised systems, e.g. external to vehicles

Abstract

A vehicular control system includes a camera, a non-vision sensor and a control having at least one data processor. The camera is disposed at a vehicle and has a field of view at least forward of the vehicle. The non-vision sensor is disposed at the vehicle and has a field of sensing at least forward of the vehicle. The control, responsive at least in part to processing at the control of captured image data captured sensor data, determines a fault of the camera or of the non-vision sensor. Responsive to determination of the fault of the camera or of the non-vision sensor, the control wirelessly communicates an alert to a remote processor that is located remote from the vehicle and that is not part of the vehicle. Responsive to receipt of the communicated alert, the remote processor at least in part assumes control of the vehicle.

Claims

1. A vehicular control system, said vehicular control system comprising:

a camera operable to capture image data;

a non-vision sensor operable to capture sensor data;

a control having at least one data processor;

wherein image data captured by said camera and sensor data captured by said non-vision sensor are processed at said control;

wherein said camera is disposed at a vehicle equipped with said control and wherein said camera has a field of view at least forward of the equipped vehicle;

wherein said non-vision sensor is disposed at the equipped vehicle and wherein said non-vision sensor has a field of sensing at least forward of the equipped vehicle;

wherein image data captured by said camera and sensor data captured by said non-vision sensor are provided to said control;

wherein said control, responsive at least in part to processing at said control of image data captured by said camera and processing at said control of sensor data captured by said non-vision sensor, determines a fault of said camera or of said non-vision sensor;

wherein, responsive to determination of the fault of said camera or of said non-vision sensor, said control wirelessly communicates an alert to a remote processor that is located remote from the equipped vehicle;

wherein said remote processor is not part of the equipped vehicle; and

wherein, responsive to receipt of the communicated alert, said remote processor at least in part assumes control of the equipped vehicle.

2. The vehicular control system of claim 1, wherein said camera comprises a forward viewing camera that is one of a plurality of cameras disposed at the equipped vehicle, and wherein said non-vision sensor comprises a forward sensing non-vision sensor that is one of a plurality of non-vision sensors disposed at the equipped vehicle.

3. The vehicular control system of claim 2, wherein said plurality of cameras comprises (i) at least one sideward viewing camera and (ii) at least one rearward viewing camera.

4. The vehicular control system of claim 1, wherein said non-vision sensor comprises a radar sensor.

5. The vehicular control system of claim 4, wherein said radar sensor comprises a forward sensing radar sensor that is one of a plurality of radar sensors disposed at the equipped vehicle.

6. The vehicular control system of claim 1, wherein said non-vision sensor comprises a LIDAR sensor.

7. The vehicular control system of claim 6, wherein said LIDAR sensor comprises a forward sensing LIDAR sensor that is one of a plurality of LIDAR sensors disposed at the equipped vehicle.

8. The vehicular control system of claim 1, wherein image data captured by said camera and provided to said control and sensor data captured by said non-vision sensor and provided to said control are processed at said control to detect and classify objects present external of the equipped vehicle.

9. The vehicular control system of claim 1, wherein the equipped vehicle is equipped with a GPS-enabled e-Horizon.

10. The vehicular control system of claim 9, wherein the GPS-enabled e-Horizon of the equipped vehicle provides to the equipped vehicle environment data related to one selected from the group consisting of (i) a speed limit, (ii) an exit ramp location, (iii) an entry ramp location, (iv) road curvature information and (v) traffic lanes.

11. The vehicular control system of claim 1, wherein said control wirelessly communicates to said remote processor vehicle data indicative of operation of the equipped vehicle, and wherein said control wirelessly communicates to said remote processor environment data indicative of the environment in which the equipped vehicle is traveling.

12. The vehicular control system of claim 11, wherein, responsive to vehicle data and environment data wirelessly received at said remote processor from the equipped vehicle, said remote processor determines if the equipped vehicle is at or approaching a hazardous condition.

13. The vehicular control system of claim 12, wherein, responsive to determination that the equipped vehicle is at or approaching a potentially hazardous condition, said remote processor controls a vehicle system of the equipped vehicle to mitigate the determined potentially hazardous condition.

14. The vehicular control system of claim 13, wherein the vehicle system comprises at least one system selected from the group consisting of (i) a brake system of the equipped vehicle, (ii) a steering system of the equipped vehicle, (iii) a torque control system of the equipped vehicle and (iv) a collision avoidance system of the equipped vehicle.

15. The vehicular control system of claim 11, wherein the communicated environment data comprises data pertaining to at least one selected from the group consisting of (i) map information, (ii) traffic information and (iii) weather condition information.

16. The vehicular control system of claim 11, wherein the communicated vehicle data comprises data pertaining to at least one selected from the group consisting of (i) longitudinal velocity of the equipped vehicle, (ii) lateral velocity of the equipped vehicle, (iii) longitudinal acceleration of the equipped vehicle, (iv) lateral acceleration of the equipped vehicle and (v) actuation of a turn signal indicator of the equipped vehicle.

17. The vehicular control system of claim 1, wherein said control, responsive at least in part to processing at said control of image data captured by said camera and processing at said control of sensor data captured by said non-vision sensor, autonomously controls the equipped vehicle.

18. The vehicular control system of claim 1, wherein said remote processor wirelessly receives communications from multiple other vehicles, and wherein said remote processor is not part of any vehicle of the multiple other vehicles.

19. The vehicular control system of claim 18, wherein said remote processor wirelessly receives, from the multiple other vehicles, respective vehicle data indicative of operation of the respective one of the multiple other vehicles and respective environment data indicative of the environment in which the respective one of the multiple other vehicles is operating.

20. The vehicular control system of claim 19, wherein each of the multiple other vehicles includes a vehicle-to-infrastructure communication system that is operable to communicate data to said remote processor.

21. A vehicular control system, said vehicular control system comprising:

a camera operable to capture image data;

a radar sensor operable to capture sensor data;

a control having at least one data processor;

wherein image data captured by said camera and sensor data captured by said radar sensor are processed at said control;

wherein said camera is disposed at a vehicle equipped with said control and wherein said camera has a field of view at least forward of the equipped vehicle;

wherein said radar sensor is disposed at the equipped vehicle and wherein said radar sensor has a field of sensing at least forward of the equipped vehicle;

wherein image data captured by said camera and sensor data captured by said radar sensor are provided to said control;

wherein said control, responsive at least in part to processing at said control of image data captured by said camera and processing at said control of sensor data captured by said radar sensor, determines a fault of said camera or of said radar sensor;

wherein, responsive to determination of the fault of said camera or of said radar sensor, said control wirelessly communicates an alert to a remote processor that is located remote from the equipped vehicle;

wherein said remote processor is not part of the equipped vehicle;

wherein, responsive to receipt of the communicated alert, said remote processor at least in part assumes control of the equipped vehicle;

wherein said control wirelessly communicates to said remote processor vehicle data indicative of operation of the equipped vehicle, and wherein said control wirelessly communicates to said remote processor environment data indicative of the environment in which the equipped vehicle is traveling;

wherein, responsive to vehicle data and environment data wirelessly received at said remote processor from the equipped vehicle, said remote processor determines if the equipped vehicle is at or approaching a hazardous condition; and

wherein, responsive to determination that the equipped vehicle is at or approaching a potentially hazardous condition, said remote processor controls a vehicle system of the equipped vehicle to mitigate the determined potentially hazardous condition.

22. The vehicular control system of claim 21, wherein said camera comprises a forward viewing camera that is one of a plurality of cameras disposed at the equipped vehicle, and wherein said radar sensor comprises a forward sensing radar sensor that is one of a plurality of radar sensors disposed at the equipped vehicle.

23. The vehicular control system of claim 21, wherein the vehicle system comprises at least one system selected from the group consisting of (i) a brake system of the equipped vehicle, (ii) a steering system of the equipped vehicle, (iii) a torque control system of the equipped vehicle and (iv) a collision avoidance system of the equipped vehicle.

24. The vehicular control system of claim 21, wherein the communicated environment data comprises data pertaining to at least one selected from the group consisting of (i) map information, (ii) traffic information and (iii) weather condition information.

25. The vehicular control system of claim 21, wherein the communicated vehicle data comprises data pertaining to at least one selected from the group consisting of (i) longitudinal velocity of the equipped vehicle, (ii) lateral velocity of the equipped vehicle, (iii) longitudinal acceleration of the equipped vehicle, (iv) lateral acceleration of the equipped vehicle and (v) actuation of a turn signal indicator of the equipped vehicle.

26. The vehicular control system of claim 21, wherein said remote processor wirelessly receives communications from multiple other vehicles, and wherein said remote processor is not part of any vehicle of the multiple other vehicles.

27. The vehicular control system of claim 26, wherein said remote processor wirelessly receives, from the multiple other vehicles, respective vehicle data indicative of operation of the respective one of the multiple other vehicles and respective environment data indicative of the environment in which the respective one of the multiple other vehicles is operating.

28. The vehicular control system of claim 27, wherein each of the multiple other vehicles includes a vehicle-to-infrastructure communication system that is operable to communicate data to said remote processor.

29. The vehicular control system of claim 21, wherein said control, responsive at least in part to processing at said control of image data captured by said camera and processing at said control of sensor data captured by said radar sensor, autonomously controls the equipped vehicle.

30. A vehicular control system, said vehicular control system comprising:

a camera operable to capture image data;

a LIDAR sensor operable to capture sensor data;

a control having at least one data processor;

wherein image data captured by said camera and sensor data captured by said LIDAR sensor are processed at said control;

wherein said camera is disposed at a vehicle equipped with said control and wherein said camera has a field of view at least forward of the equipped vehicle;

wherein said LIDAR sensor is disposed at the equipped vehicle and wherein said LIDAR sensor has a field of sensing at least forward of the equipped vehicle;

wherein image data captured by said camera and sensor data captured by said LIDAR sensor are provided to said control;

wherein said control, responsive at least in part to processing at said control of image data captured by said camera and processing at said control of sensor data captured by said LIDAR sensor, determines a fault of said camera or of said LIDAR sensor;

wherein, responsive to determination of the fault of said camera or of said LIDAR sensor, said control wirelessly communicates an alert to a remote processor that is located remote from the equipped vehicle;

wherein said remote processor is not part of the equipped vehicle;

wherein, responsive to receipt of the communicated alert, said remote processor at least in part assumes control of the equipped vehicle;

wherein said control wirelessly communicates to said remote processor vehicle data indicative of operation of the equipped vehicle, and wherein said control wirelessly communicates to said remote processor environment data indicative of the environment in which the equipped vehicle is traveling;

wherein, responsive to vehicle data and environment data wirelessly received at said remote processor from the equipped vehicle, said remote processor determines if the equipped vehicle is at or approaching a hazardous condition; and

wherein, responsive to determination that the equipped vehicle is at or approaching a potentially hazardous condition, said remote processor controls a vehicle system of the equipped vehicle to mitigate the determined potentially hazardous condition.

31. The vehicular control system of claim 30, wherein said camera comprises a forward viewing camera that is one of a plurality of cameras disposed at the equipped vehicle, and wherein said LIDAR sensor comprises a forward sensing LIDAR sensor that is one of a plurality of LIDAR sensors disposed at the equipped vehicle.

32. The vehicular control system of claim 30, wherein the vehicle system comprises at least one system selected from the group consisting of (i) a brake system of the equipped vehicle, (ii) a steering system of the equipped vehicle, (iii) a torque control system of the equipped vehicle and (iv) a collision avoidance system of the equipped vehicle.

33. The vehicular control system of claim 30, wherein the communicated environment data comprises data pertaining to at least one selected from the group consisting of (i) map information, (ii) traffic information and (iii) weather condition information.

34. The vehicular control system of claim 30, wherein the communicated vehicle data comprises data pertaining to at least one selected from the group consisting of (i) longitudinal velocity of the equipped vehicle, (ii) lateral velocity of the equipped vehicle, (iii) vehicle longitudinal acceleration of the equipped vehicle, (iv) lateral acceleration and (v) actuation of a turn signal indicator of the equipped vehicle.

35. The vehicular control system of claim 30, wherein said control, responsive at least in part to processing at said control of image data captured by said camera and processing at said control of sensor data captured by said LIDAR sensor, autonomously controls the equipped vehicle.

36. The vehicular control system of claim 30, wherein said remote processor wirelessly receives communications from multiple other vehicles, and wherein said remote processor is not part of any vehicle of the multiple other vehicles.

37. The vehicular control system of claim 36, wherein said remote processor wirelessly receives, from the multiple other vehicles, respective vehicle data indicative of operation of the respective one of the multiple other vehicles and respective environment data indicative of the environment in which the respective one of the multiple other vehicles is operating.

38. The vehicular control system of claim 37, wherein each of the multiple other vehicles includes a vehicle-to-infrastructure communication system that is operable to communicate data to said remote processor.