VEHICULAR MULTI-CAMERA VISION SYSTEM

• US 20180035050A1
• Filed: 09/18/2017
• Published: 02/01/2018
• Est. Priority Date: 05/06/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Lu, Yuesheng, Shriner, Richard D.
• Granted Patent: US 10,057,489 B2
• Time in Patent Office: Days
• CPC Class Codes: B32B 17/10 of synthetic resin
• CPC Class Codes: B32B 17/10005 laminated safety glass or glazing
• CPC Class Codes: B32B 17/10036 comprising two outer glass sheets
• CPC Class Codes: B32B 17/10477 thermochromic
• CPC Class Codes: B32B 17/10651 comprising colorants, e.g. dyes or pigments
• CPC Class Codes: B32B 17/10761 containing vinyl acetal
• CPC Class Codes: B32B 2367/00 Polyesters, e.g. PET, i.e. polyethylene terephthalate
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/50 characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: B60R 2300/605 the adjustment being automatic
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: E06B 9/24 Screens or other constructions affording protection against light, especially against sunshine; Similar screens for privacy or appearance; Slat blindsoperating, guiding or securing devices or arrangements for roll-type closures E06B9/56; free-hanging flexible screens A47H23/00
• CPC Class Codes: G02F 1/009 Thermal properties
• CPC Class Codes: G02F 1/0147 based on thermo-optic effects G02F1/132 takes precedence
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A vision system for a vehicle includes a plurality of cameras with one camera functioning as a master camera and other cameras functioning as slave cameras. During a forward driving maneuver of the vehicle, a forward viewing camera functions as the master camera and at least a driver-side sideward viewing camera and a passenger-side sideward viewing camera function as slave cameras. During a reversing maneuver of the vehicle, a rearward viewing camera functions as the master camera and at least the driver-side sideward viewing camera and the passenger-side sideward viewing camera function as slave cameras. The vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and the driver-side sideward viewing camera and the passenger-side sideward viewing camera. Operating parameters of the master camera are used at least by the driver-side sideward viewing camera and the passenger-side sideward viewing camera.

Claims

1. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at a driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at a passenger side of the vehicle;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

wherein, during a forward driving maneuver of the vehicle, said forward viewing camera functions as the master camera and at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera function as slave cameras;

wherein, during a reversing maneuver of the vehicle, said rearward viewing camera functions as the master camera and at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera function as slave cameras;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by at least the master camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein operating parameters of the master camera are used at least by said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein operating parameters of the master camera are carried between the master camera and an electronic control unit; and

wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in at least one of (i) brightness at borders of the sections and (ii) color at borders of the sections.

2. The vision system of claim 1, wherein, when the electronic control unit makes a viewing mode change, selection of which of said plurality of cameras comprises the master camera is made by the electronic control unit, and wherein configuration commands are sent to said plurality of cameras to re-configure them to suitable master and slave modes.

3. The vision system of claim 1, wherein operating parameters of the master camera are sent by the electronic control unit to slave cameras so slave cameras operate with a same set of operating parameters as used by the master camera.

4. The vision system of claim 1, wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to slave cameras so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in brightness at borders of the sections.

5. The vision system of claim 1, wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to slave cameras so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in color at borders of the sections.

6. The vision system of claim 1, wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by said rearward viewing camera, said driver-side sideward viewing camera, said forward viewing camera and said passenger-side sideward viewing camera.

7. The vision system of claim 1, wherein operating parameters of the master camera comprise at least one of (i) exposure control and (ii) gain control.

8. The vision system of claim 1, wherein operating parameters of the master camera comprise exposure control and gain control.

9. The vision system of claim 1, wherein, when the driving maneuver of the vehicle comprises a forward driving maneuver, said vision system selects said forward viewing camera as the master camera and selects said rearward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera as slave cameras, and wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to said rearward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera.

10. The vision system of claim 1, wherein, when the driving maneuver of the vehicle comprises a reversing maneuver, said vision system selects said rearward viewing camera as the master camera and selects said forward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera as slave cameras, and wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to said forward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera.

11. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at a driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at a passenger side of the vehicle;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

wherein, during a reversing maneuver of the vehicle, said rearward viewing camera functions as the master camera and at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera function as slave cameras;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by at least the master camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein operating parameters of the master camera are used at least by said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein operating parameters of the master camera are carried between the master camera and an electronic control unit; and

wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to at least some of said forward viewing camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform.

12. The vision system of claim 11, wherein operating parameters of the master camera comprise at least one of (i) exposure control and (ii) gain control.

13. The vision system of claim 12, wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to slave cameras so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in brightness at borders of the sections.

14. The vision system of claim 12, wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to slave cameras so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in color at borders of the sections.

15. The vision system of claim 12, wherein operating parameters of the master camera are sent by the electronic control unit to slave cameras so slave cameras operate with a same set of operating parameters as used by the master camera.

16. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle;

wherein said plurality of cameras comprises a forward viewing camera having at least a forward field of view forward of the vehicle, a rearward viewing camera having at least a rearward field of view rearward of the vehicle, a driver-side sideward viewing camera having at least a sideward field of view at a driver side of the vehicle and a passenger-side sideward viewing camera having at least a sideward field of view at a passenger side of the vehicle;

wherein one of said plurality of cameras functions as a master camera and other cameras of said plurality of cameras function as slave cameras;

wherein, during a forward driving maneuver of the vehicle, said forward viewing camera functions as the master camera and at least said driver-side sideward viewing camera and said passenger-side sideward viewing camera function as slave cameras;

an image processing system operable to process image data captured by said plurality of cameras;

wherein, responsive to processing of captured image data, said vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein the composite image comprises a bird'"'"'s eye view image derived from image data captured by at least the master camera, said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein operating parameters of the master camera are used at least by said driver-side sideward viewing camera and said passenger-side sideward viewing camera;

wherein operating parameters of the master camera are carried between the master camera and an electronic control unit; and

wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to said driver-side sideward viewing camera and said passenger-side sideward viewing camera so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform.

17. The vision system of claim 16, wherein operating parameters of the master camera comprise at least one of (i) exposure control and (ii) gain control.

18. The vision system of claim 17, wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to slave cameras so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in brightness at borders of the sections.

19. The vision system of claim 17, wherein the electronic control unit sends operating parameters carried between the master camera and the electronic control unit to slave cameras so that image sections of the composite image, when displayed to a driver of the vehicle by a display device of the vehicle, appear uniform in color at borders of the sections.

20. The vision system of claim 17, wherein operating parameters of the master camera are sent by the electronic control unit to slave cameras so slave cameras operate with a same set of operating parameters as used by the master camera.