VEHICLE MONITORING SYSTEM

• US 20170066440A1
• Filed: 11/18/2016
• Published: 03/09/2017
• Est. Priority Date: 12/05/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Koravadi, Krishna
• Granted Patent: US 10,137,892 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60T 7/12 for automatic initiation; for initiation not subject to will of driver or passenger limiting speed of vehicles other than rail vehicles B60K31/00
• CPC Class Codes: B60T 7/18 operated by wayside apparatus
• CPC Class Codes: B60W 30/09 Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: B62D 15/029 Steering assistants using warnings or proposing actions to the driver without influencing the steering system
• CPC Class Codes: G08G 1/164 Centralised systems, e.g. external to vehicles

Abstract

A vehicle monitoring system includes a central processor operable to receive data from multiple vehicles, with each of the multiple vehicles being equipped with a plurality of vision sensors, a plurality of non-vision sensors, and an ECU. The central processor is operable to wirelessly receive, from each of the multiple vehicles, vehicle data and environment data. Responsive to vehicle data and environment data received from the multiple vehicles, the central processor determines if one or more of the vehicles is at or approaching a hazardous condition. Responsive to the determination that one or more of the vehicles is a threatened vehicle at a potentially hazardous condition, the central monitoring system at least one of (i) actuates an alert of the threatened vehicle to alert a driver of that vehicle of the determined hazardous condition and (ii) controls a vehicle system of the threatened vehicle to mitigate the determined hazardous condition.

Claims

1. A vehicle monitoring system, said vehicle monitoring system comprising:

a central processor operable to receive data from multiple vehicles;

wherein each of the multiple vehicles is equipped with a plurality of vision sensors and a plurality of non-vision sensors;

wherein said plurality of vision sensors comprises (i) at least one forward viewing camera, (ii) at least one sideward viewing camera and (iii) at least one rearward viewing camera;

wherein said plurality of non-vision sensors comprises at least one of (a) a radar sensor and (b) a LIDAR sensor;

wherein each of the multiple vehicles is equipped with an electronics control unit (ECU);

wherein image data captured by said plurality of vision sensors of each of the multiple vehicles is provided to the ECU of the respective one of the multiple vehicles;

wherein sensor data sensed by said plurality of non-vision sensors of each of the multiple vehicles is provided to the ECU of the respective one of the multiple vehicles;

wherein image data and sensor data provided to the ECU of each of the multiple vehicles is processed at that ECU to detect and classify objects external to the respective one of the multiple vehicles;

wherein said central processor is operable to wirelessly receive, from each of the multiple vehicles, vehicle data indicative of operation of the respective one of the multiple vehicles and environment data indicative of the environment in which the respective one of the multiple vehicles is operating;

wherein, responsive to vehicle data and environment data wirelessly received at said central processor from the multiple vehicles, said central processor determines if one or more of the multiple vehicles is at or approaching a hazardous condition; and

wherein, responsive to the determination that one or more of the multiple vehicles is a threatened vehicle at a potentially hazardous condition, said central monitoring system at least one of (i) actuates an alert of the threatened vehicle to alert a driver of the threatened vehicle of the determined hazardous condition and (ii) controls a vehicle system of the threatened vehicle to mitigate the determined hazardous condition.

2. The vehicle monitoring system of claim 1, wherein at least some of the multiple vehicles are equipped with a GPS-enabled e-Horizon.

3. The vehicle monitoring system of claim 2, wherein each of the multiple vehicles is a semi-autonomous vehicle.

4. The vehicle monitoring system of claim 2, wherein the GPS-enabled e-Horizon of the respective vehicle provides to the respective vehicle environment data related to at least one of (i) a speed limit, (ii) an exit ramp location, (iii) an entry ramp location, (iv) road curvature information and (v) lanes.

5. The vehicle monitoring system of claim 1, wherein, responsive to the determination that one or more of the multiple vehicles is a threatened vehicle at a potentially hazardous condition, said central monitoring system actuates an alert of the threatened vehicle to alert a driver of the threatened vehicle of the determined hazardous condition.

6. The vehicle monitoring system of claim 1, wherein, responsive to the determination that one or more of the multiple vehicles is a threatened vehicle at a potentially hazardous condition, said central monitoring system controls a vehicle system of the threatened vehicle to mitigate the determined hazardous condition.

7. The vehicle monitoring system of claim 6, wherein said vehicle system comprises at least one of (i) a brake system, (ii) a steering system, (iii) a torque control and (iv) a collision avoidance system.

8. The vehicle monitoring system of claim 1, wherein the environment data comprises at least one of (i) map information, (ii) traffic information and (iii) weather condition information.

9. The vehicle monitoring system of claim 1, wherein the vehicle data comprises at least one of (i) vehicle longitudinal velocity, (ii) vehicle lateral velocity, (iii) vehicle longitudinal acceleration, (iv) vehicle lateral acceleration and (v) actuation of a turn signal indicator of the respective vehicle.

10. The vehicle monitoring system of claim 1, wherein each of the multiple vehicles includes a vehicle-to-infrastructure communication system that is operable to communicate data to said central processor.

11. The vehicle monitoring system of claim 1, wherein at least one of the multiple vehicles comprises a semi-autonomous vehicle.

12. The vehicle monitoring system of claim 11, wherein, responsive to a determination that the semi-autonomous vehicle is a threatened vehicle at a potentially hazardous condition, said central monitoring system controls at least one vehicle system of the semi-autonomous threatened vehicle to mitigate the determined hazardous condition.

13. A vehicle monitoring system, said vehicle monitoring system comprising:

a central processor operable to receive data from multiple vehicles;

wherein each of the multiple vehicles is equipped with a plurality of vision sensors and a plurality of non-vision sensors;

wherein said plurality of vision sensors of each of the multiple vehicles comprises (i) at least one forward viewing camera viewing exterior the respective one of the multiple vehicles through a windshield of that vehicle, (ii) at least one sideward viewing camera mounted at a left side portion of the respective one of the multiple vehicles and at least one sideward viewing camera mounted at a right side portion of the respective one of the multiple vehicles and (iii) at least one rearward viewing camera mounted at a rear portion of the respective one of the multiple vehicles;

wherein said plurality of non-vision sensors of each of the multiple vehicles comprises at least (a) a radar sensor mounted at a left side portion of the respective one of the multiple vehicles, (b) a radar sensor mounted at a right side portion of the respective one of the multiple vehicles and (c) a radar sensor mounted at a front portion of the respective one of the multiple vehicles;

wherein each of the multiple vehicles is equipped with an electronics control unit (ECU);

wherein image data captured by said plurality of vision sensors of each of the multiple vehicles is provided to the ECU of the respective one of the multiple vehicles;

wherein sensor data sensed by said plurality of non-vision sensors of each of the multiple vehicles is provided to the ECU of the respective one of the multiple vehicles;

wherein image data and sensor data provided to the ECU of each of the multiple vehicles is processed at that ECU to detect and classify objects external to the respective one of the multiple vehicles;

wherein said central processor is operable to wirelessly receive, from each of the multiple vehicles, vehicle data indicative of operation of the respective one of the multiple vehicles and environment data indicative of the environment in which the respective one of the multiple vehicles is operating;

wherein, responsive to vehicle data and environment data wirelessly received at said central processor from the multiple vehicles, said central processor determines if one or more of the multiple vehicles is at or approaching a hazardous condition;

wherein the environment data comprises at least one of (i) map information, (ii) traffic information and (iii) weather condition information; and

wherein the vehicle data comprises at least one of (i) vehicle longitudinal velocity, (ii) vehicle lateral velocity, (iii) vehicle longitudinal acceleration, (iv) vehicle lateral acceleration and (v) actuation of a turn signal indicator of the respective vehicle.

14. The vehicle monitoring system of claim 13, wherein, responsive to the determination that one or more of the multiple vehicles is a threatened vehicle at a potentially hazardous condition, said central monitoring system actuates an alert of the threatened vehicle to alert a driver of the threatened vehicle of the determined hazardous condition.

15. The vehicle monitoring system of claim 13, wherein, responsive to the determination that one or more of the multiple vehicles is a threatened vehicle at a potentially hazardous condition, said central monitoring system controls a vehicle system of the threatened vehicle to mitigate the determined hazardous condition.

16. The vehicle monitoring system of claim 15, wherein said vehicle system comprises at least one of (i) a brake system, (ii) a steering system, (iii) a torque control and (iv) a collision avoidance system.

17. The vehicle monitoring system of claim 13, wherein each of the multiple vehicles includes a vehicle-to-infrastructure communication system that is operable to communicate data to said central processor and wherein at least one of the multiple vehicles comprises a semi-autonomous vehicle.

18. The vehicle monitoring system of claim 13, wherein at least some of the multiple vehicles are equipped with a GPS-enabled e-Horizon, and wherein the GPS-enabled e-Horizon of the respective vehicle provides to the respective vehicle environment data related to at least one of (i) a speed limit, (ii) an exit ramp location, (iii) an entry ramp location, (iv) road curvature information and (v) lanes.

19. A vehicle monitoring system, said vehicle monitoring system comprising:

a central processor operable to receive data from multiple vehicles;

wherein each of the multiple vehicles is equipped with a plurality of vision sensors and a plurality of non-vision sensors;

wherein said plurality of vision sensors of each of the multiple vehicles comprises (i) at least one forward viewing camera viewing exterior the respective one of the multiple vehicles through a windshield of that vehicle, (ii) at least one sideward viewing camera mounted at a left side portion of the respective one of the multiple vehicles and at least one sideward viewing camera mounted at a right side portion of the respective one of the multiple vehicles and (iii) at least one rearward viewing camera mounted at a rear portion of the respective one of the multiple vehicles;

wherein said plurality of non-vision sensors of each of the multiple vehicles comprises at least (a) a radar sensor mounted at a left side portion of the respective one of the multiple vehicles, (b) a radar sensor mounted at a right side portion of the respective one of the multiple vehicles and (c) a radar sensor mounted at a front portion of the respective one of the multiple vehicles;

wherein at least some of the multiple vehicles are equipped with a GPS-enabled e-Horizon;

wherein each of the multiple vehicles is equipped with an electronics control unit (ECU);

wherein image data captured by said plurality of vision sensors of each of the multiple vehicles is provided to the ECU of the respective one of the multiple vehicles;

wherein sensor data sensed by said plurality of non-vision sensors of each of the multiple vehicles is provided to the ECU of the respective one of the multiple vehicles;

wherein image data and sensor data provided to the ECU of each of the multiple vehicles is processed at that ECU to detect and classify objects external to the respective one of the multiple vehicles;

wherein said central processor is operable to wirelessly receive, from each of the multiple vehicles, vehicle data indicative of operation of the respective one of the multiple vehicles and environment data indicative of the environment in which the respective one of the multiple vehicles is operating;

wherein, responsive to vehicle data and environment data wirelessly received at said central processor from the multiple vehicles, said central processor determines if one or more of the multiple vehicles is at or approaching a hazardous condition;

wherein the environment data comprises at least one of (i) map information, (ii) traffic information and (iii) weather condition information; and

wherein the vehicle data comprises at least one of (i) vehicle longitudinal velocity, (ii) vehicle lateral velocity, (iii) vehicle longitudinal acceleration, (iv) vehicle lateral acceleration and (v) actuation of a turn signal indicator of the respective vehicle.

20. The vehicle monitoring system of claim 19, wherein said plurality of non-vision sensors comprises a LIDAR sensor.

21. The vehicle monitoring system of claim 20, wherein, responsive to the determination that one or more of the multiple vehicles is a threatened vehicle at a potentially hazardous condition, said central monitoring system actuates an alert of the threatened vehicle to alert a driver of the threatened vehicle of the determined hazardous condition.

22. The vehicle monitoring system of claim 20, wherein, responsive to the determination that one or more of the multiple vehicles is a threatened vehicle at a potentially hazardous condition, said central monitoring system controls a vehicle system of the threatened vehicle to mitigate the determined hazardous condition.

23. The vehicle monitoring system of claim 22, wherein said vehicle system comprises at least one of (i) a brake system, (ii) a steering system, (iii) a torque control and (iv) a collision avoidance system.

24. The vehicle monitoring system of claim 20, wherein each of the multiple vehicles includes a vehicle-to-infrastructure communication system that is operable to communicate data to said central processor and wherein at least one of the multiple vehicles comprises a semi-autonomous vehicle.

25. The vehicle monitoring system of claim 20, wherein the GPS-enabled e-Horizon of the respective vehicle provides to the respective vehicle environment data related to at least one of (i) a speed limit, (ii) an exit ramp location, (iii) an entry ramp location, (iv) road curvature information and (v) lanes.