VEHICULAR MULTI-CAMERA VISION SYSTEM

• US 20170078571A1
• Filed: 11/28/2016
• Published: 03/16/2017
• Est. Priority Date: 05/06/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Lu, Yuesheng, Shriner, Richard D.
• Granted Patent: US 9,769,381 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B32B 17/10 of synthetic resin
• CPC Class Codes: B32B 17/10005 laminated safety glass or glazing
• CPC Class Codes: B32B 17/10036 comprising two outer glass sheets
• CPC Class Codes: B32B 17/10477 thermochromic
• CPC Class Codes: B32B 17/10651 comprising colorants, e.g. dyes or pigments
• CPC Class Codes: B32B 17/10761 containing vinyl acetal
• CPC Class Codes: B32B 2367/00 Polyesters, e.g. PET, i.e. polyethylene terephthalate
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/50 characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: B60R 2300/605 the adjustment being automatic
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: E06B 9/24 Screens or other constructions affording protection against light, especially against sunshine; Similar screens for privacy or appearance; Slat blindsoperating, guiding or securing devices or arrangements for roll-type closures E06B9/56; free-hanging flexible screens A47H23/00
• CPC Class Codes: G02F 1/009 Thermal properties
• CPC Class Codes: G02F 1/0147 based on thermo-optic effects G02F1/132 takes precedence
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A vision system for a vehicle includes a plurality of cameras having respective fields of view exterior of the vehicle. One of the cameras functions as a master camera and others of the cameras function as slave cameras. Responsive to processing of captured image data, the vision system is operable to synthesize a composite image derived from image data captured by at least two of the cameras, at least one of which is a slave camera. Operating parameters of the master camera are used by slave cameras. An electronic control unit sends via Ethernet connection operating parameters to a slave camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in at least one of (i) brightness at the borders of the sections and (ii) color at the borders of the sections.

Claims

1. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at the driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at the passenger side of the vehicle;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by at least two cameras of said plurality of cameras;

wherein at least one of said at least two cameras comprises a slave camera;

wherein operating parameters of the master camera are used by slave cameras of said plurality of cameras;

wherein operating parameters of the master camera comprise at least one of (i) white balance and (ii) color control;

wherein each of said plurality of cameras receives and sends signals via an Ethernet connection to an electronic control unit;

wherein operating parameters of the master camera are carried via Ethernet connection between the master camera and the electronic control unit; and

wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said at least one of said at least two cameras that comprises a slave camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in at least one of (i) brightness at the borders of the sections and (ii) color at the borders of the sections.

2. The vision system of claim 1, wherein operating parameters of the master camera comprise at least one of (i) exposure control and (ii) gain control.

3. The vision system of claim 1, wherein said vision system selects which camera of said plurality of cameras to function as the master camera responsive to a driving maneuver of the vehicle.

4. The vision system of claim 1, wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by at least the rearward viewing camera, the driver-side sideward viewing camera and the passenger-side sideward viewing camera.

5. The vision system of claim 1, wherein any one of said plurality of cameras is capable of operating as the master camera.

6. The vision system of claim 1, wherein operating parameters of the master camera are sent by the electronic control unit to the slave cameras so the slave cameras operate with the same set of operating parameters as used by the master camera.

7. The vision system of claim 1, wherein the master camera comprises the forward viewing camera having at least a forward field of view forward of the vehicle.

8. The vision system of claim 1, wherein the master camera comprises the rearward viewing camera having at least a rearward field of view rearward of the vehicle.

9. The vision system of claim 1, wherein, when the electronic control unit makes a viewing mode change, selection of which of said plurality of cameras comprises the master camera is made by the electronic control unit.

10. The vision system of claim 9, wherein configuration commands are sent to said plurality of cameras to re-configure them to suitable master and slave modes.

11. The vision system of claim 1, wherein one of said at least two cameras comprises the master camera.

12. The vision system of claim 1, wherein two of said at least two cameras each comprises a slave camera.

13. The vision system of claim 1, wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said at least one of said at least two cameras that comprises a slave camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in brightness at the borders of the sections.

14. The vision system of claim 1, wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said at least one of said at least two cameras that comprises a slave camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in a color at the borders of the sections.

15. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at the driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at the passenger side of the vehicle;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by at least three cameras of said plurality of cameras;

wherein at least two of said at least three cameras each comprises a slave camera;

wherein one of said at least three cameras comprises the rearward viewing camera having at least a rearward field of view rearward of the vehicle;

wherein the composite image comprises a bird'"'"'s eye view image;

wherein operating parameters of the master camera are used by slave cameras of said plurality of cameras;

wherein each of said plurality of cameras receives and sends signals via an Ethernet connection to an electronic control unit;

wherein operating parameters of the master camera are carried via Ethernet connection between the master camera and the electronic control unit; and

wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said at least two of said at least three cameras that each comprises a slave camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform at the borders of the sections.

16. The vision system of claim 15, wherein operating parameters of the master camera comprise at least one of (i) exposure control and (ii) gain control.

17. The vision system of claim 16, wherein selection of which of said plurality of cameras comprises the master camera is made by the electronic control unit.

18. The vision system of claim 17, wherein configuration commands are sent to said plurality of cameras to re-configure them to suitable master and slave modes.

19. The vision system of claim 15, wherein one of said at least three cameras comprises the master camera.

20. The vision system of claim 19, wherein the rearward viewing camera having at least a rearward field of view rearward of the vehicle comprises the master camera.

21. The vision system of claim 15, wherein three of said at least three cameras each comprises a slave camera.

22. The vision system of claim 15, wherein operating parameters of the master camera comprise color control.

23. The vision system of claim 22, wherein operating parameters of the master camera comprise white balance.

24. The vision system of claim 15, wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said at least two of said at least three cameras that each comprises a slave camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in brightness at the borders of the sections.

25. The vision system of claim 24, wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said at least two of said at least three cameras that each comprises a slave camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in color at the borders of the sections.

26. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at the driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at the passenger side of the vehicle;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by said plurality of cameras;

wherein said driver-side sideward viewing camera comprises a slave camera;

wherein said passenger-side sideward viewing camera comprises a slave camera;

wherein the composite image comprises a bird'"'"'s eye view image;

wherein operating parameters of the master camera are used by said driver-side sideward viewing camera;

wherein operating parameters of the master camera are used by said passenger-side sideward viewing camera;

wherein each of said plurality of cameras receives and sends signals via an Ethernet connection to an electronic control unit;

wherein operating parameters of the master camera are carried via Ethernet connection between the master camera and the electronic control unit;

wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said driver-side sideward viewing camera and to said passenger-side sideward viewing camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform at the borders of the sections; and

wherein the master camera comprises one of (i) the forward viewing camera having at least a forward field of view forward of the vehicle and (ii) the rearward viewing camera having at least a rearward field of view rearward of the vehicle.

27. The vision system of claim 26, wherein operating parameters of the master camera comprise exposure control and gain control.

28. The vision system of claim 27, wherein said vision system selects which camera of said plurality of cameras to function as the master camera responsive to a driving maneuver of the vehicle.

29. The vision system of claim 27, wherein the master camera comprises the forward viewing camera having at least a forward field of view forward of the vehicle.

30. The vision system of claim 27, wherein the master camera comprises the rearward viewing camera having at least a rearward field of view rearward of the vehicle.

31. The vision system of claim 26, wherein configuration commands are sent to said plurality of cameras to re-configure them to suitable master and slave modes.

32. The vision system of claim 26, wherein operating parameters of the master camera comprise at least one of (i) white balance and (ii) color control.

33. The vision system of claim 26, wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said driver-side sideward viewing camera and to said passenger-side sideward viewing camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in color at the borders of the sections.

34. The vision system of claim 33, wherein the electronic control unit sends via Ethernet connection operating parameters carried via Ethernet connection between the master camera and the electronic control unit to said driver-side sideward viewing camera and to said passenger-side sideward viewing camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in brightness at the borders of the sections.