CONTROL SYSTEM FOR VEHICLE

• US 20180093612A1
• Filed: 12/04/2017
• Published: 04/05/2018
• Est. Priority Date: 07/31/2001
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: McMahon, Martha A., Cooprider, Troy O.
• Granted Patent: US 10,046,702 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60Q 1/08 automatically
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 16/023 for transmission of signals between vehicle parts or subsystems
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60W 30/143 Speed control B60W30/16 takes precedence
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G05D 1/00 Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots drive control systems specially adapted for autonomous road vehicles B60W60/00
• CPC Class Codes: G05D 1/0033 by having the operator tracking the vehicle either by direct line of sight or via one or more cameras located remotely from the vehicle
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/76 Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

A vehicular control system suitable for use in a vehicle includes a data processor module for receiving and processing image data provided by a plurality of video sensors, which include at least five cameras, and sensor data provided by a plurality of non-video sensors, which include a radar sensor. The data processor module receives image data captured by the cameras and radar data captured by the radar sensor. The data processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle. Responsive at least in part to processing of image data and sensor data at the data processor module, other vehicles present exterior of the equipped vehicle are detected. Responsive at least in part to processing of image data and sensor data at the data processor module, a speed control system of the equipped vehicle is controlled.

Claims

1. A vehicular control system suitable for use in a vehicle, said vehicular control system comprising:

a data processor module disposed at a vehicle equipped with said vehicular control system;

said data processor module receiving and processing image data provided by a plurality of video sensors disposed at the equipped vehicle;

said data processor module receiving and processing sensor data provided by a plurality of non-video sensors disposed at the equipped vehicle;

said plurality of non-video sensors comprising a radar sensor;

said plurality of video sensors comprising at least five vehicular cameras;

said at least five vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle;

said at least five vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle;

said at least five vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle;

said at least five vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle;

said at least five vehicular cameras comprising a fifth vehicular camera disposed at an in-cabin side of a windshield of the equipped vehicle and viewing forwardly through the windshield of the equipped vehicle;

wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data;

wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data;

wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data;

wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data;

wherein said fifth vehicular camera has a fifth field of view exterior of the equipped vehicle and is operable to capture fifth image data;

wherein said data processor module receives first image data captured by said first vehicular camera at a first interface;

wherein said data processor module receives second image data captured by said second vehicular camera at a second interface;

wherein said data processor module receives third image data captured by said third vehicular camera at a third interface;

wherein said data processor module receives fourth image data captured by said fourth vehicular camera at a fourth interface;

wherein said data processor module receives fifth image data captured by said fifth vehicular camera at a fifth interface;

wherein said data processor module receives radar data captured by said radar sensor of said plurality of non-video sensors;

wherein said data processor module comprises a radar sensor interface configured for receiving radar data captured by said radar sensor of said plurality of non-video sensors;

wherein said data processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle;

wherein, responsive at least in part to processing of image data and sensor data at said data processor module, other vehicles present exterior of the equipped vehicle are detected; and

wherein, responsive at least in part to processing of image data and sensor data at said data processor module, a speed control system of the equipped vehicle is controlled.

2. The vehicular control system of claim 1, wherein other vehicles detected present exterior of the equipped vehicle are tracked based at least in part on processing of image data and sensor data at said data processor module.

3. The vehicular control system of claim 2, wherein, responsive at least in part to processing at said data processor module of image data captured by said fifth vehicular camera, an edge of a lane on a road along which the equipped vehicle is travelling is detected.

4. The vehicular control system of claim 3, wherein, responsive at least in part to processing at said data processor module of image data captured by said fifth vehicular camera, another vehicle present exterior of the equipped vehicle is detected.

5. The vehicular control system of claim 4, wherein, responsive at least in part to the detection of the other vehicle present exterior of the equipped vehicle, a state of headlamps of the equipped vehicle is controlled.

6. The vehicular control system of claim 1, wherein said data processor module receives first image data captured by said first vehicular camera at said first interface via a vehicle bus of the equipped vehicle, and wherein said data processor module receives second image data captured by said second vehicular camera at said second interface via a vehicle bus of the equipped vehicle, and wherein said data processor module receives third image data captured by said third vehicular camera at said third interface via a vehicle bus of the equipped vehicle, and wherein said data processor module receives fourth image data captured by said fourth vehicular camera at said fourth interface via a vehicle bus of the equipped vehicle.

7. The vehicular control system of claim 1, wherein said data processor module communicates with said radar sensor via a vehicle bus of the equipped vehicle.

8. The vehicular control system of claim 1, wherein said first vehicular camera is disposed at a driver-side exterior mirror assembly at the driver side of the equipped vehicle, and wherein said second vehicular camera is disposed at a passenger-side exterior mirror assembly at the passenger side of the equipped vehicle.

9. The vehicular control system of claim 8, wherein said data processor module communicates with other vehicle systems via a CAN vehicle bus of the equipped vehicle.

10. The vehicular control system of claim 9, wherein said data processor module comprises a video processor chip.

11. The vehicular control system of claim 1, wherein said third vehicular camera disposed at the rear portion of the equipped vehicle is located at or proximate to a longitudinal centerline of the equipped vehicle, and wherein said fourth vehicular camera disposed at the front portion of the equipped vehicle is located at or proximate to the longitudinal centerline of the equipped vehicle.

12. The vehicular control system of claim 1, wherein said data processor module receives and processes data derived from a global positioning system of the equipped vehicle, and wherein, responsive at least in part to processing of data derived from the global positioning system of the equipped vehicle, location of the equipped vehicle is wirelessly transmitted to an external receiver remote from the equipped vehicle.

13. The vehicular control system of claim 12, wherein data processing at said data processor module comprises performance of diagnostics.

14. The vehicular control system of claim 1, wherein said speed control system of the equipped vehicle comprises an adaptive speed control system of the equipped vehicle.

15. The vehicular control system of claim 1, wherein said first vehicular camera is disposed at a driver-side exterior mirror assembly at the driver side of the equipped vehicle, and wherein said second vehicular camera is disposed at a passenger-side exterior mirror assembly at the passenger side of the equipped vehicle, and wherein said first, second, third and fourth image data is processed at said data processor module and, responsive at least in part to said processing of said first, second, third and fourth image data, a synthesized image is output to a display system of the equipped vehicle to visually inform a driver of the equipped vehicle of what is occurring in the area surrounding the equipped vehicle as would be viewed by a single virtual camera located exterior the equipped vehicle.

16. The vehicular control system of claim 15, wherein said data processor module comprises a video processor chip, a power supply and memory.

17. A vehicular control system suitable for use in a vehicle, said vehicular control system comprising:

a data processor module disposed at a vehicle equipped with said vehicular control system;

said data processor module receiving and processing image data provided by a plurality of video sensors disposed at the equipped vehicle;

said data processor module receiving and processing sensor data provided by a plurality of non-video sensors disposed at the equipped vehicle;

said plurality of non-video sensors comprising a radar sensor;

said plurality of video sensors comprising at least five vehicular cameras;

said at least five vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle;

said at least five vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle;

said at least five vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle;

said at least five vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle;

said at least five vehicular cameras comprising a fifth vehicular camera disposed at an in-cabin side of a windshield of the equipped vehicle and viewing forwardly through the windshield of the equipped vehicle;

wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data;

wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data;

wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data;

wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data;

wherein said fifth vehicular camera has a fifth field of view exterior of the equipped vehicle and is operable to capture fifth image data;

wherein said data processor module receives first image data captured by said first vehicular camera at a first interface;

wherein said data processor module receives second image data captured by said second vehicular camera at a second interface;

wherein said data processor module receives third image data captured by said third vehicular camera at a third interface;

wherein said data processor module receives fourth image data captured by said fourth vehicular camera at a fourth interface;

wherein said data processor module receives fifth image data captured by said fifth vehicular camera at a fifth interface;

wherein said data processor module receives radar data captured by said radar sensor of said plurality of non-video sensors;

wherein said data processor module comprises a radar sensor interface configured for receiving radar data captured by said radar sensor of said plurality of non-video sensors;

wherein said data processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle;

wherein, responsive at least in part to processing of image data and sensor data at said data processor module, other vehicles present exterior of the equipped vehicle are detected;

wherein other vehicles detected present exterior of the equipped vehicle are tracked based at least in part on processing of image data and sensor data at said data processor module; and

wherein said data processor module receives and processes data derived from a global positioning system of the equipped vehicle, and wherein, responsive at least in part to processing of data derived from the global positioning system of the equipped vehicle, location of the equipped vehicle is wirelessly transmitted to an external receiver remote from the equipped vehicle.

18. The vehicular control system of claim 17, wherein said data processor module comprises a video processor chip.

19. The vehicular control system of claim 18, wherein said data processor module communicates with other vehicle systems via a CAN vehicle bus of the equipped vehicle.

20. The vehicular control system of claim 19, wherein said data processor module comprises a video processor chip, a power supply and memory.

21. The vehicular control system of claim 20, wherein said first vehicular camera is disposed at a driver-side exterior mirror assembly at the driver side of the equipped vehicle, and wherein said second vehicular camera is disposed at a passenger-side exterior mirror assembly at the passenger side of the equipped vehicle, and wherein said first, second, third and fourth image data is processed at said data processor module and, responsive at least in part to said processing of said first, second, third and fourth image data, a synthesized image is output to a display system of the equipped vehicle to visually inform a driver of the equipped vehicle of what is occurring in the area surrounding the equipped vehicle as would be viewed by a single virtual camera located exterior the equipped vehicle.

22. A vehicular control system suitable for use in a vehicle, said vehicular control system comprising:

a data processor module disposed at a vehicle equipped with said vehicular control system;

said data processor module receiving and processing image data provided by a plurality of video sensors disposed at the equipped vehicle;

said data processor module receiving and processing sensor data provided by a plurality of non-video sensors disposed at the equipped vehicle;

said plurality of non-video sensors comprising a radar sensor;

said plurality of video sensors comprising at least five vehicular cameras;

said at least five vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle;

said at least five vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle;

said at least five vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle;

said at least five vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle;

said at least five vehicular cameras comprising a fifth vehicular camera disposed at an in-cabin side of a windshield of the equipped vehicle and viewing forwardly through the windshield of the equipped vehicle;

wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data;

wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data;

wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data;

wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data;

wherein said fifth vehicular camera has a fifth field of view exterior of the equipped vehicle and is operable to capture fifth image data;

wherein said data processor module receives first image data captured by said first vehicular camera at a first interface;

wherein said data processor module receives second image data captured by said second vehicular camera at a second interface;

wherein said data processor module receives third image data captured by said third vehicular camera at a third interface;

wherein said data processor module receives fourth image data captured by said fourth vehicular camera at a fourth interface;

wherein said data processor module receives fifth image data captured by said fifth vehicular camera at a fifth interface;

wherein said data processor module receives radar data captured by said radar sensor of said plurality of non-video sensors;

wherein said data processor module comprises a radar sensor interface configured for receiving radar data captured by said radar sensor of said plurality of non-video sensors;

wherein said data processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle;

wherein, responsive at least in part to processing of image data and sensor data at said data processor module, other vehicles present exterior of the equipped vehicle are detected;

wherein other vehicles detected present exterior of the equipped vehicle are tracked based at least in part on processing of image data and sensor data at said data processor module;

wherein said data processor module comprises a video processor chip; and

wherein said first vehicular camera is disposed at a driver-side exterior mirror assembly at the driver side of the equipped vehicle, and wherein said second vehicular camera is disposed at a passenger-side exterior mirror assembly at the passenger side of the equipped vehicle, and wherein said first, second, third and fourth image data is processed at said data processor module and, responsive at least in part to said processing of said first, second, third and fourth image data, a synthesized image is output to a display system of the equipped vehicle to visually inform a driver of the equipped vehicle of what is occurring in the area surrounding the equipped vehicle as would be viewed by a single virtual camera located exterior the equipped vehicle.

23. The vehicular control system of claim 22, wherein, responsive at least in part to processing at said data processor module of image data captured by said fifth vehicular camera, another vehicle present exterior of the equipped vehicle is detected.

24. The vehicular control system of claim 23, wherein, responsive at least in part to the detection of the other vehicle present exterior of the equipped vehicle, a state of headlamps of the equipped vehicle is controlled.

25. The vehicular control system of claim 24, wherein said data processor module communicates with other vehicle systems via a CAN vehicle bus of the equipped vehicle.

26. The vehicular control system of claim 25, wherein said data processor module comprises a power supply and memory.

27. The vehicular control system of claim 26, wherein, responsive at least in part to processing of image data and sensor data at said data processor module, a speed control system of the equipped vehicle is controlled and wherein said speed control system of the equipped vehicle comprises an adaptive speed control system of the equipped vehicle.

28. The vehicular control system of claim 27, wherein said data processor module receives and processes data derived from a global positioning system of the equipped vehicle, and wherein, responsive at least in part to processing of data derived from the global positioning system of the equipped vehicle, location of the equipped vehicle is wirelessly transmitted to an external receiver remote from the equipped vehicle.

29. The vehicular control system of claim 28, wherein data processing at said data processor module comprises performance of diagnostics.