Vehicle vision system with enhanced low light capabilities

• US 10,063,786 B2
• Filed: 03/05/2018
• Issued: 08/28/2018
• Est. Priority Date: 06/03/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Weber, Christian
• Primary Examiner(s): Williams, Jeffery
• Application Number:
  US15/911,462
• Publication Number:
  US 20180198969A1
• Time in Patent Office: 176 Days
• Field of Search: 348148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: H04N 23/73 by influencing the exposure time

Abstract

A method for displaying video images includes providing a control having an image processor operable to process image data captured by cameras of a vehicular multi-camera vision system, and disposing a display device in the vehicle that is viewable by a driver of the vehicle, with the display device having a video display screen that displays video images derived at least in part from image data captured by at least one of the cameras. A display intensity of video images displayed by the video display screen is controlled and, responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, the display intensity of video images displayed by the video display screen is held to within 15 percent of the display intensity that was displayed before the determination of the reduction in exterior ambient light level.

Claims

1. A method for displaying video images derived at least in part from image data captured by at least one camera of a vehicular multi-camera vision system, said method comprising:

disposing a plurality of cameras at a vehicle, wherein each camera comprises a two dimensional array of a plurality of photosensing elements;

wherein disposing the plurality of cameras at the vehicle comprises disposing a rear-mounted camera at a rear portion of the vehicle so that said rear-mounted camera has a field of view at least rearward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a front-mounted camera at a front portion of the vehicle so that said front-mounted camera has a field of view at least forward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a driver side-mounted camera at a driver side portion of the vehicle so that said driver side-mounted camera has a field of view at least sideward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a passenger side-mounted camera at a passenger side portion of the vehicle so that said passenger side-mounted camera has a field of view at least sideward of the vehicle;

providing a control comprising an image processor operable to process image data captured by the cameras of the plurality of cameras;

disposing a display device in the vehicle that is viewable by a driver of the vehicle, and wherein the display device comprises a video display screen;

capturing image data via the cameras of the plurality of cameras;

providing captured image data to the control;

processing captured image data at the control;

displaying, via the video display screen, video images derived at least in part from image data captured by at least one camera of the plurality of cameras;

controlling a display intensity of video images displayed by the video display screen;

determining an exterior ambient light level within the field of view of at least one of the cameras of the plurality of cameras;

responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, holding display intensity of video images displayed by the video display screen to within 15 percent of the display intensity that was displayed before the determination of the reduction in exterior ambient light level; and

wherein holding display intensity comprises (a) adjusting, via the control, exposure time for image data capture by the at least one camera of the plurality of cameras and (b) at least one of (i) adjusting, via the control, frame rate of image data capture by the at least one camera of the plurality of cameras and (ii) adjusting, via the control, gain of the at least one camera of the plurality of cameras.

2. The method of claim 1, wherein adjusting exposure time comprises adjusting, via the control, and responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, exposure time for image data captured by the at least one camera of the plurality of cameras to hold display intensity of video images displayed by the video display screen to within 10 percent of the display intensity that was displayed before the determination of the reduction in exterior ambient light level.

3. The method of claim 1, wherein adjusting exposure time comprises increasing, via the control, and responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, exposure time of the at least one camera of the plurality of cameras.

4. The method of claim 3, wherein adjusting exposure time comprises increasing, via the control, and responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, exposure time of the at least one camera of the plurality of cameras to a multiple of the exposure time used at higher ambient lighting levels.

5. The method of claim 1, comprising controlling, via the control, the at least one camera of the plurality of cameras to provide a consistent display intensity of displayed video images irrespective of whether the vehicle is operated at nighttime in a rural driving environment or a city driving environment.

6. The method of claim 1, comprising controlling, via the control, an analog gain of at least one of the cameras of the plurality of cameras.

7. The method of claim 1, comprising adjusting, via the control, and responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, (i) exposure time for image data capture by the at least one of the cameras of the plurality of cameras and (ii) frame rate of image data capture by the at least one of the cameras of the plurality of cameras.

8. The method of claim 7, wherein adjusting exposure time comprises adjusting, via the control, and responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, exposure time for image data capture by the at least one of the cameras of the plurality of cameras to a longer exposure time and adjusting their frame rate to a slower frame rate.

9. The method of claim 1, comprising decoupling color processing and luminance processing of image data captured by the at least one of the cameras of the plurality of cameras to improve detail visibility.

10. The method of claim 1, wherein the vehicular multi-camera vision system comprises a bird'"'"'s eye-view vision system.

11. The method of claim 1, wherein displaying video images via the video display screen comprises displaying, via the video display screen, video images, as viewed by a driver of the vehicle, with a display intensity greater than 200 candelas per square meter.

12. The method of claim 11, comprising controlling, via the control, illumination in displayed video images derived, at least in part, from image data captured by at least one of the cameras of the plurality of cameras.

13. A method for displaying video images derived at least in part from image data captured by at least one camera of a vehicular multi-camera vision system, said method comprising:

disposing a plurality of cameras at a vehicle, wherein each camera comprises a two dimensional array of a plurality of photosensing elements;

wherein disposing the plurality of cameras at the vehicle comprises disposing a rear-mounted camera at a rear portion of the vehicle so that said rear-mounted camera has a field of view at least rearward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a front-mounted camera at a front portion of the vehicle so that said front-mounted camera has a field of view at least forward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a driver side-mounted camera at a driver side portion of the vehicle so that said driver side-mounted camera has a field of view at least sideward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a passenger side-mounted camera at a passenger side portion of the vehicle so that said passenger side-mounted camera has a field of view at least sideward of the vehicle;

providing a control comprising an image processor operable to process image data captured by the cameras of the plurality of cameras;

disposing a display device in the vehicle that is viewable by a driver of the vehicle, and wherein the display device comprises a video display screen;

capturing image data via the cameras of the plurality of cameras;

providing captured image data to the control;

processing captured image data at the control;

displaying, via the video display screen, video images derived at least in part from image data captured by at least one of the cameras of the plurality of cameras;

controlling a display intensity of video images displayed by the video display screen;

determining an exterior ambient light level within the field of view of at least one of the cameras of the plurality of cameras;

responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, holding display intensity of video images displayed by the video display screen to within 15 percent of the display intensity that was displayed before the determination of the reduction in exterior ambient light level;

wherein holding display intensity comprises (a) adjusting, via the control, exposure time for image data capture by the at least one of the cameras of the plurality of cameras and (b) adjusting frame rate of image data capture by the at least one of the cameras of the plurality of cameras;

wherein adjusting exposure time comprises adjusting, via the control, and responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, exposure time for image data capture by the at least one of the cameras of the plurality of cameras to a longer exposure time and adjusting the frame rate to a slower frame rate; and

wherein the vehicular multi-camera vision system comprises a bird'"'"'s eye-view vision system.

14. The method of claim 13, wherein adjusting exposure time comprises increasing, via the control, and responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, exposure time of the at least one of the cameras of the plurality of cameras to a multiple of the exposure time used at higher ambient lighting levels.

15. The method of claim 13, comprising controlling, via the control, the at least one camera of the plurality of cameras to provide a consistent display intensity of displayed video images irrespective of whether the vehicle is operated at nighttime in a rural driving environment or a city driving environment.

16. The method of claim 13, comprising controlling, via the control, an analog gain of at least one of the cameras of the plurality of cameras.

17. A method for displaying video images derived at least in part from image data captured by at least one camera of a vehicular multi-camera vision system, said method comprising:

disposing a plurality of cameras at a vehicle, wherein each camera comprises a two dimensional array of a plurality of photosensing elements;

wherein disposing the plurality of cameras at the vehicle comprises disposing a rear-mounted camera at a rear portion of the vehicle so that said rear-mounted camera has a field of view at least rearward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a front-mounted camera at a front portion of the vehicle so that said front-mounted camera has a field of view at least forward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a driver side-mounted camera at a driver side portion of the vehicle so that said driver side-mounted camera has a field of view at least sideward of the vehicle;

wherein disposing the plurality of cameras at the vehicle comprises disposing a passenger side-mounted camera at a passenger side portion of the vehicle so that said passenger side-mounted camera has a field of view at least sideward of the vehicle;

providing a control comprising an image processor operable to process image data captured by the cameras of the plurality of cameras;

disposing a display device in the vehicle that is viewable by a driver of the vehicle, and wherein the display device comprises a video display screen;

capturing image data via the cameras of the plurality of cameras;

providing captured image data to the control;

processing captured image data at the control;

displaying, via the video display screen, video images derived at least in part from image data captured by at least one camera of the plurality of cameras;

controlling a display intensity of video images displayed by the video display screen;

determining an exterior ambient light level within the field of view of at least one of the cameras of the plurality of cameras;

responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, holding display intensity of video images displayed by the video display screen to within 15 percent of the display intensity that was displayed before the determination of the reduction in exterior ambient light level;

wherein holding display intensity comprises (a) adjusting, via the control, exposure time for image data capture by the at least one camera of the plurality of cameras and (b) at least one of (i) adjusting, via the control, frame rate of image data capture by the at least one camera of the plurality of cameras and (ii) adjusting, via the control, gain of the at least one camera of the plurality of cameras;

wherein adjusting exposure time comprises adjusting, via the control, and responsive to determination of a reduction in exterior ambient light level within the field of view of the at least one of the cameras, exposure time for image data capture by the at least one camera of the plurality of cameras to a longer exposure time and adjusting frame rate of image data capture by the at least one camera of the plurality of cameras to a slower frame rate; and

wherein displaying video images via the video display screen comprises displaying, via the video display screen, video images, as viewed by a driver of the vehicle, with a display intensity greater than 200 candelas per square meter.

18. The method of claim 17, comprising decoupling color processing and luminance processing of image data captured by at least one of the cameras of the plurality of cameras to improve detail visibility.

19. The method of claim 17, wherein the vehicular multi-camera vision system comprises a bird'"'"'s eye-view vision system.

20. The method of claim 17, comprising controlling, via the control, illumination in displayed video images derived, at least in part, from image data captured by at least one of the cameras of the plurality of cameras.