Scalable integrated electronic control unit for vehicle

• US 9,036,026 B2
• Filed: 06/14/2010
• Issued: 05/19/2015
• Est. Priority Date: 06/12/2009
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Dellantoni, Nikolaus, Schinkowitsch, Bernhard, Nix, Axel, Lynam, Niall R., Schoenekaes, Andr
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): Duley, Janese
• Application Number:
  US13/377,673
• Publication Number:
  US 20120218412A1
• Time in Patent Office: 1,800 Days
• Field of Search: None
• US Class Current: 348/148
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/20 characterised by the type of display used
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3679 Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities G01C21/3611 takes precedence
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vehicular scalable integrated control system includes a plurality of cameras, a vehicular scalable integrated control unit, and a display screen for displaying video information to a driver of the vehicle. Visual image data captured by the cameras is processed by an image processor to detect objects in the fields of view of the cameras. The control unit determines a current geographical location of the vehicle and accommodates downloading of applications, which may include a tour guide application, with the tour guide application providing information associated with various geographical locations of a selected tour area. The control unit, responsive to a determination that the current geographical location of the vehicle is at a location identified in the tour guide application for the selected tour area, controls the display screen to display information associated with the identified location of the tour guide application and the current geographical location of the vehicle.

Claims

1. A vehicular scalable integrated control system for a vehicle, said vehicular scalable integrated control system comprising:

a plurality of cameras having respective fields of view exterior of the vehicle;

a vehicular scalable integrated control unit, wherein said vehicular scalable integrated control unit comprises an image processor, and wherein visual image data captured by said cameras is processed by said image processor of said vehicular scalable integrated control unit to detect objects in the fields of view of said cameras;

a display screen for displaying video information to a driver of the vehicle, and wherein said display screen displays information responsive to said vehicular scalable integrated control unit;

wherein said vehicular scalable integrated control unit is responsive to a global positioning system of the vehicle to determine a current geographical location of the vehicle;

wherein said vehicular scalable integrated control unit accommodates downloading of applications and wherein said applications include a tour guide application, said tour guide application providing information associated with various geographical locations of a selected tour area;

wherein said vehicular scalable integrated control unit, responsive to a determination that the current geographical location of the vehicle is at a location identified in said tour guide application for the selected tour area, controls said display screen to display information associated with the identified location of said tour guide application and the current geographical location of the vehicle; and

wherein said vehicular scalable integrated control unit, responsive to a determination that the current geographical location of the vehicle is at a location identified in said tour guide application for the selected tour area, controls said display screen to display video images captured by one of said plurality of cameras and wherein the displayed video images are associated with the identified location of said tour guide application.

2. The vehicular scalable integrated control system of claim 1, wherein said vehicular scalable integrated control unit is operable to process said tour guide application responsive to a determination that the current geographical location of the vehicle is approaching the selected tour area.

3. The vehicular scalable integrated control system of claim 1, wherein said vehicular scalable integrated control system comprises a driver assistant system situation analysis vehicle control unit.

4. The vehicular scalable integrated control system of claim 1, wherein said plurality of cameras comprises a plurality of forward facing cameras having respective forward fields of view in a forward direction of travel of the vehicle.

5. The vehicular scalable integrated control system of claim 4, wherein said plurality of forward facing cameras is operable to capture images for a lane departure warning system.

6. The vehicular scalable integrated control system of claim 1, wherein said plurality of cameras comprises at least one forward facing camera having a forward field of view in a forward direction of travel of the vehicle.

7. The vehicular scalable integrated control system of claim 6, wherein said vehicular scalable integrated control system is operable to determine that the vehicle is stopped at a cross traffic situation via image processing of images captured by said at least one forward facing camera.

8. The vehicular scalable integrated control system of claim 7, wherein said vehicular scalable integrated control system is operable to detect a stop sign via image processing of images captured by said at least one forward facing camera.

9. The vehicular scalable integrated control system of claim 7, wherein said vehicular scalable integrated control system is operable to determine that the vehicle had been driving in a forward direction and is stopped at a cross traffic situation at least in part via image processing of images captured by said at least one forward facing camera.

10. The vehicular scalable integrated control system of claim 6, wherein said vehicular scalable integrated control system is operable to determine a driving condition of the vehicle via image processing of images captured by said at least one forward facing camera.

11. The vehicular scalable integrated control system of claim 1, wherein, responsive at least in part to said image processing of images captured by at least one camera of said plurality of cameras, said vehicular scalable integrated control system is operable to determine that the vehicle is at a situation.

12. The vehicular scalable integrated control system of claim 1, wherein, responsive at least in part to said image processing of images captured by at least one camera of said plurality of cameras, said vehicular scalable integrated control system is operable to determine that the vehicle is at a parallel parking situation.

13. The vehicular scalable integrated control system of claim 12, wherein said vehicular scalable integrated control system is operable to determine that the vehicle is at a parallel parking situation by determining that the vehicle is driven alongside a vacant parking space and shifted into reverse to back into the vacant parking space.

14. The vehicular scalable integrated control system of claim 13, wherein, responsive to a determination that the vehicle is at a parallel parking situation, said vehicular scalable integrated control system is operable to display images at a display screen viewable by the driver of the vehicle to assist the driver in parking the vehicle in the vacant parking space.

15. The vehicular scalable integrated control system of claim 1, wherein said vehicular scalable integrated control system is part of an overall active safety sensing system of the vehicle.

16. The vehicular scalable integrated control system of claim 15, wherein said overall active safety sensing system includes fusion of outputs from a plurality of sensing devices to provide environmental awareness at and surrounding the vehicle.

17. The vehicular scalable integrated control system of claim 16, wherein said overall active safety sensing system is operable to at least one of (i) at least partially control the vehicle as the vehicle is driven along a road and (ii) provide alert warnings to the driver of the vehicle.

18. The vehicular scalable integrated control system of claim 1, wherein said plurality of cameras captures images for use by at least one other system of the vehicle.

19. The vehicular scalable integrated control system of claim 18, wherein said at least one other system of the vehicle comprises at least one of (i) a lane departure warning system of the vehicle, (ii) a traffic sign recognition system of the vehicle, (iii) a forward collision warning system of the vehicle, (iv) a pedestrian detection system of the vehicle, (v) a vehicle detection system of the vehicle and (vi) a hazard detection system of the vehicle.

20. The vehicular scalable integrated control system of claim 19, wherein said at least one other system of the vehicle is operable to communicate with at least one of (i) an intelligent headlamp control of the vehicle, (ii) an automatic headlamp control of the vehicle, (iii) an intelligent light ranging system of the vehicle and (iv) a lane keep assist system of the vehicle.

21. The vehicular scalable integrated control system of claim 1, wherein said vehicular scalable integrated control system is at least in part responsive to a communication from another vehicle via a car to car communication system.

22. The vehicular scalable integrated control system of claim 1, wherein said vehicular scalable integrated control system is operable to fuse image data captured by at least one camera of said plurality of cameras with data captured by at least one of (i) a radar device, (ii) an ultrasonic sensor and (iii) an infrared sensor.

23. The vehicular scalable integrated control system of claim 22, wherein, responsive to processing of said fused image data, said vehicular scalable integrated control system is operable to detect an object and to at least in part control braking of the vehicle in response to detection of an object.

24. The vehicular scalable integrated control system of claim 1, wherein display of video images is synchronized with said tour guide application and the current geographical location of the vehicle.

25. The vehicular scalable integrated control system of claim 1, wherein said vehicular scalable integrated control system, responsive to a determination that the current geographical location of the vehicle is at a location identified in said tour guide application for the selected tour area, controls said display screen to highlight an object displayed in the display video images captured by one of said plurality of cameras and wherein the highlighted object is associated with the identified location of said tour guide application.

26. The vehicular scalable integrated control system of claim 25, wherein highlighting of an object is synchronized with said tour guide application and the current geographical location of the vehicle.