Vehicle control system utilizing multi-camera module

• US 10,462,354 B2
• Filed: 12/06/2017
• Issued: 10/29/2019
• Est. Priority Date: 12/09/2016
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Koravadi, Krishna
• Primary Examiner(s): Shaawat, Mussa A
• Application Number:
  US15/832,803
• Publication Number:
  US 20180167551A1
• Time in Patent Office: 692 Days
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/101 using cameras with adjustable capturing direction
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/605 the adjustment being automatic
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 30/00 Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
• CPC Class Codes: B60W 30/12 Lane keeping
• CPC Class Codes: B62D 15/0255 Automatic changing of lane, e.g. for passing another vehicle
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A control system for a vehicle includes a camera module having a plurality of cameras. A control is operable to adjust a field of view of the cameras responsive to an input. When the vehicle is traveling in and along a traffic lane, the control sets the field of view of at least some of the cameras forward through the vehicle windshield. Responsive to an input indicative of an intended lane change, the control adjusts at least one camera to set the field of view of the camera toward an exterior rearview mirror at the side of the vehicle at which the target lane is located. Responsive to determination, via processing of captured image data when the camera views the exterior rearview mirror of the vehicle, that the target lane is clear, the control controls the at least one vehicle control system to maneuver the vehicle into the target lane.

Claims

1. A control system for a vehicle, said control system comprising:

a camera module disposed in a vehicle, said camera module comprising a plurality of cameras;

a control operable to adjust a field of view of any one of said cameras responsive to an input;

wherein, responsive to image processing of image data captured by said cameras, said control generates an output to control at least one vehicle control system to maneuver the vehicle;

wherein, when the vehicle is traveling in and along a traffic lane, said control sets the field of view of at least some of said cameras to be forward through a windshield of the vehicle;

wherein, responsive to an input indicative of an intended lane change by the vehicle, said control adjusts an orientation of at least one camera of said cameras to set the field of view of said at least one camera to be toward an exterior rearview mirror at the side of the vehicle at which a target lane is located such that the field of view of said at least one camera encompasses a mirror reflective element of that exterior rearview mirror; and

wherein, responsive to determination, via image processing of captured image data when said at least one camera views the mirror reflective element of the exterior rearview mirror of the vehicle, that the target lane is clear, said control generates an output to control the at least one vehicle control system to maneuver the vehicle into the target lane.

2. The control system of claim 1, wherein said camera module comprises said control.

3. The control system of claim 1, wherein said camera module generates the output to maneuver the vehicle into the target lane at least in part responsive to a blind spot detection system of the vehicle.

4. The control system of claim 1, wherein said camera module changes the field of view of individual ones of said cameras via at least one actuator of said camera module.

5. The control system of claim 1, wherein said camera module is configured to be disposed at an upper region of a driver'"'"'s seat of the vehicle.

6. The control system of claim 1, wherein, responsive to an input indicative of an intended lane change by the vehicle, said control adjusts the orientation of another camera of said cameras to set the field of view of the other camera to be toward an interior rearview mirror of the vehicle.

7. The control system of claim 1, wherein, responsive to an input indicative of an intended lane change by the vehicle, said control adjusts the orientation of another camera of said cameras to set the field of view of the other camera to be toward a blind spot region at the side of the vehicle toward the target lane.

8. The control system of claim 1, wherein said cameras comprise an array of cameras that is adjustable to change the respective fields of view of said cameras.

9. The control system of claim 1, wherein at least some of said cameras have different focal lengths as compared to others of said cameras.

10. The control system of claim 1, wherein at least some of said cameras have different resolutions as compared to others of said cameras.

11. A control system for a vehicle, said control system comprising:

a camera module disposed in a vehicle, said camera module comprising at least one camera;

a control operable to adjust a field of view of said at least one camera responsive to an input;

wherein, responsive to image processing of image data captured by said at least one camera, said control generates an output to control at least one vehicle control system to maneuver the vehicle;

wherein, when the vehicle is traveling in and along a traffic lane, said control sets the field of view of said at least one camera to be forward through a windshield of the vehicle;

wherein, responsive to an input indicative of an intended lane change by the vehicle, said control adjusts an orientation of said at least one camera to set the field of view of said at least one camera to be toward an exterior rearview mirror at the side of the vehicle at which a target lane is located such that the field of view of said at least one camera encompasses a mirror reflective element of that exterior rearview mirror; and

wherein, responsive to determination, via image processing of captured image data when said at least one camera views the mirror reflective element of the exterior rearview mirror of the vehicle, that the target lane is clear, said control generates an output to control the at least one vehicle control system to maneuver the vehicle into the target lane.

12. The control system of claim 11, wherein said camera module comprises said control.

13. The control system of claim 11, wherein said camera module generates the output to maneuver the vehicle into the target lane at least in part responsive to a blind spot detection system of the vehicle.

14. The control system of claim 11, wherein said camera module changes the field of view of said at least one camera via at least one actuator of said camera module.

15. The control system of claim 11, wherein said camera module is configured to be disposed at an upper region of a driver'"'"'s seat of the vehicle.

16. A control system for a vehicle, said control system comprising:

a camera module disposed in a vehicle, said camera module comprising a plurality of cameras;

a control operable comprising a processor that processes image data captured by said cameras;

wherein, responsive to image processing of image data captured by said cameras, said control generates an output to control at least one vehicle control system to maneuver the vehicle;

wherein a first camera of said plurality of cameras views forward through a windshield of the vehicle, and wherein, when the vehicle is traveling in and along a traffic lane, said processor processes at least image data captured by said first camera;

wherein a second camera of said plurality of cameras is oriented so that a field of view of said second camera is toward an exterior rearview mirror at a side of the vehicle at which a target lane is located such that the field of view of said second camera encompasses a mirror reflective element of that exterior rearview mirror, and wherein, responsive to an input indicative of an intended lane change by the vehicle, said processor processes at least image data captured by said second camera; and

wherein, responsive to determination, via image processing of image data captured by said second camera, that the target lane is clear, said control generates an output to control the at least one vehicle control system to maneuver the vehicle into the target lane.

17. The control system of claim 16, wherein said camera module generates the output to maneuver the vehicle into the target lane at least in part responsive to a blind spot detection system of the vehicle.

18. The control system of claim 16, wherein said camera module is configured to be disposed at an upper region of a back of a driver'"'"'s seat of the vehicle.

19. The control system of claim 16, wherein a third camera of said plurality of cameras has a field of view toward an interior rearview mirror of the vehicle, and wherein, responsive to the input indicative of the intended lane change by the vehicle, said processor processes image data captured by said third camera.

20. The control system of claim 16, wherein a third camera of said plurality of cameras has a field of view toward a blind spot region at the side of the vehicle toward the target lane, and wherein, responsive to the input indicative of the intended lane change by the vehicle, said processor processes image data captured by said third camera.