Vehicular multi-camera vision system

• US 10,057,489 B2
• Filed: 09/18/2017
• Issued: 08/21/2018
• Est. Priority Date: 05/06/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Lu, Yuesheng, Shriner, Richard D.
• Primary Examiner(s): Chio, Tat C
• Application Number:
  US15/707,025
• Publication Number:
  US 20180035050A1
• Time in Patent Office: 337 Days
• CPC Class Codes: B32B 17/10 of synthetic resin
• CPC Class Codes: B32B 17/10005 laminated safety glass or glazing
• CPC Class Codes: B32B 17/10036 comprising two outer glass sheets
• CPC Class Codes: B32B 17/10477 thermochromic
• CPC Class Codes: B32B 17/10651 comprising colorants, e.g. dyes or pigments
• CPC Class Codes: B32B 17/10761 containing vinyl acetal
• CPC Class Codes: B32B 2367/00 Polyesters, e.g. PET, i.e. polyethylene terephthalate
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/50 characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: B60R 2300/605 the adjustment being automatic
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: E06B 9/24 Screens or other constructions affording protection against light, especially against sunshine; Similar screens for privacy or appearance; Slat blindsoperating, guiding or securing devices or arrangements for roll-type closures E06B9/56; free-hanging flexible screens A47H23/00
• CPC Class Codes: G02F 1/009 Thermal properties
• CPC Class Codes: G02F 1/0147 based on thermo-optic effects G02F1/132 takes precedence
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A vision system for a vehicle includes a plurality of cameras with one camera functioning as a master camera and other cameras functioning as slave cameras. During a forward driving maneuver of the vehicle, a forward viewing camera functions as the master camera and at least a driver-side sideward viewing camera and a passenger-side sideward viewing camera function as slave cameras. During a reversing maneuver of the vehicle, a rearward viewing camera functions as the master camera and at least the driver-side sideward viewing camera and the passenger-side sideward viewing camera function as slave cameras. The vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and the driver-side sideward viewing camera and the passenger-side sideward viewing camera. Operating parameters of the master camera are used at least by the driver-side sideward viewing camera and the passenger-side sideward viewing camera.

Claims

1. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at a driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at a passenger side of the vehicle;

an electronic control unit;

wherein each of said cameras is operable to automatically control its exposure, gain and white balance responsive to a first control signal received from said electronic control unit and is operable to disable automatic control of its exposure, gain and white balance responsive to a second control signal received from said electronic control unit;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

wherein, during a forward driving maneuver of the vehicle, said forward viewing camera functions as the master camera and at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera function as slave cameras, and wherein, during the forward driving maneuver of the vehicle, (i) said forward viewing camera receives the first signal from said electronic control unit to enable the automatic control of exposure, gain and white balance of said forward viewing camera, (ii) at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera receive respective second signals from said electronic control unit to disable automatic control of exposure, gain and white balance of at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera, and (iii) said electronic control unit controls exposure, gain and white balance of at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera in accordance with the enabled automatic control of said forward viewing camera;

wherein, during a reversing maneuver of the vehicle, said rearward viewing camera functions as the master camera and at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera function as slave cameras, and wherein, during the reversing maneuver of the vehicle, (i) said rearward viewing camera receives the first signal from said electronic control unit to enable the automatic control of exposure, gain and white balance of said rearward viewing camera, (ii) at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera receive respective second signals from said electronic control unit to disable automatic control of exposure, gain and white balance of at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera, and (iii) said electronic control unit controls exposure, gain and white balance of at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera in accordance with the enabled automatic control of said rearward viewing camera;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and the slave cameras;

wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by at least the master camera and the slave cameras;

wherein exposure, gain and white balance parameters of the master camera are used at least by the master camera and the slave cameras;

wherein exposure, gain and white balance parameters of the master camera are carried between the master camera and the electronic control unit; and

wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to at least the slave cameras so that borders of adjacent image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in at least one of (i) brightness at the borders of the image sections and (ii) color at the borders of the image sections.

2. The vision system of claim 1, wherein, when said electronic control unit makes a viewing mode change, selection of which of said plurality of cameras comprises the master camera is made by said electronic control unit, and wherein configuration commands are sent to said plurality of cameras to re-configure them to suitable master and slave modes.

3. The vision system of claim 1, wherein exposure, gain and white balance parameters of the master camera are sent by said electronic control unit to slave cameras so slave cameras operate with a same set of exposure, gain and white balance parameters as used by the master camera.

4. The vision system of claim 1, wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to slave cameras so that the borders of the adjacent image sections of the composite image, when displayed to a driver of the vehicle by the display device of the vehicle, appear uniform in brightness at the borders of the image sections.

5. The vision system of claim 1, wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to slave cameras so that the borders of the adjacent image sections of the composite image, when displayed to a driver of the vehicle by the display device of the vehicle, appear uniform in color at the borders of the image sections.

6. The vision system of claim 1, wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by said rearward viewing camera, said driver-side sideward viewing camera, said forward viewing camera and said passenger-side sideward viewing camera.

7. The vision system of claim 1, wherein, during a forward driving maneuver of the vehicle, the automatic control of exposure, gain and white balance of said rearward viewing camera is disabled.

8. The vision system of claim 1, wherein, during the reversing maneuver of the vehicle, the automatic control of exposure, gain and white balance of said forward viewing camera is disabled.

9. The vision system of claim 1, wherein, when the driving maneuver of the vehicle comprises a forward driving maneuver, said vision system selects said forward viewing camera as the master camera and selects said rearward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera as slave cameras, and wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to said rearward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera.

10. The vision system of claim 1, wherein, when the driving maneuver of the vehicle comprises a reversing maneuver, said vision system selects said rearward viewing camera as the master camera and selects said forward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera as slave cameras, and wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to said forward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera.

11. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at a driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at a passenger side of the vehicle;

an electronic control unit;

wherein each of said cameras is operable to automatically control its exposure, gain and white balance responsive to a first control signal received from said electronic control unit and is operable to disable automatic control of its exposure, gain and white balance responsive to a second control signal received from said electronic control unit;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

wherein, during a reversing maneuver of the vehicle, said rearward viewing camera functions as the master camera and at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera function as slave cameras, and wherein, during the reversing maneuver of the vehicle, (i) said rearward viewing camera receives the first signal from said electronic control unit to enable the automatic control of exposure, gain and white balance of said rearward viewing camera, (ii) at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera receive respective second signals from said electronic control unit to disable automatic control of exposure, gain and white balance of at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera, and (iii) said electronic control unit controls exposure, gain and white balance of at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera in accordance with the enabled automatic control of said rearward viewing camera;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and the slave cameras;

wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by at least the master camera and the slave cameras;

wherein exposure, gain and white balance parameters of the master camera are used at least by the master camera and the slave cameras;

wherein exposure, gain and white balance parameters of the master camera are carried between the master camera and the electronic control unit; and

wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to at least the slave cameras so that borders of adjacent image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform.

12. The vision system of claim 11, wherein, during the reversing maneuver of the vehicle, the automatic control of exposure, gain and white balance of said forward viewing camera is disabled.

13. The vision system of claim 12, wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to slave cameras so that the borders of the adjacent image sections of the composite image, when displayed to the driver of the vehicle by the display device of the vehicle, appear uniform in brightness at the borders of the adjacent image sections.

14. The vision system of claim 12, wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to slave cameras so that the borders of the adjacent image sections of the composite image, when displayed to the driver of the vehicle by the display device of the vehicle, appear uniform in color at the borders of the adjacent image sections.

15. The vision system of claim 12, wherein exposure, gain and white balance parameters of the master camera are sent by said electronic control unit to slave cameras so slave cameras operate with a same set of exposure, gain and white balance parameters as used by the master camera.

16. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at a driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at a passenger side of the vehicle;

an electronic control unit;

wherein each of said cameras is operable to automatically control its exposure, gain and white balance responsive to a first control signal received from said electronic control unit and is operable to disable automatic control of its exposure, gain and white balance responsive to a second control signal received from said electronic control unit;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

wherein, during a forward driving maneuver of the vehicle, said forward viewing camera functions as the master camera and at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera function as slave cameras, and wherein, during the forward driving maneuver of the vehicle, (i) said forward viewing camera receives the first signal from said electronic control unit to enable the automatic control of exposure, gain and white balance of said forward viewing camera, (ii) at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera receive respective second signals from said electronic control unit to disable automatic control of exposure, gain and white balance of at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera, and (iii) said electronic control unit controls exposure, gain and white balance of at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera in accordance with the enabled automatic control of said forward viewing camera;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and the slave cameras;

wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by at least the master camera and the slave cameras;

wherein exposure, gain and white balance parameters of the master camera are used at least by the master camera and the slave cameras;

wherein exposure, gain and white balance parameters of the master camera are carried between the master camera and the electronic control unit; and

wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to the slave cameras so that borders of adjacent image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform.

17. The vision system of claim 16, wherein, during the forward driving maneuver of the vehicle, the automatic control of exposure, gain and white balance of said rearward viewing camera is disabled.

18. The vision system of claim 17, wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to slave cameras so that borders of adjacent image sections of the composite image, when displayed to the driver of the vehicle by the display device of the vehicle, appear uniform in brightness at the borders of the adjacent image sections.

19. The vision system of claim 17, wherein said electronic control unit sends exposure, gain and white balance parameters carried between the master camera and said electronic control unit to slave cameras so that borders of adjacent image sections of the composite image, when displayed to the driver of the vehicle by the display device of the vehicle, appear uniform in color at the borders of the adjacent image sections.

20. The vision system of claim 17, wherein exposure, gain and white balance parameters of the master camera are sent by said electronic control unit to slave cameras so slave cameras operate with a same set of exposure, gain and white balance parameters as used by the master camera.