METHOD FOR ENHANCING VEHICLE CAMERA IMAGE QUALITY

• US 20180027188A1
• Filed: 09/25/2017
• Published: 01/25/2018
• Est. Priority Date: 09/26/2011
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Kussel, Marcel
• Granted Patent: US 10,257,432 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: H04N 23/76 by influencing the image signals

Abstract

A method of image enhancement for a vehicle vision system includes providing a camera at the vehicle and providing a processor operable to process image data. Multiple frames of image data are captured with the camera, and contrast is enhanced in image data by tone mapping. As the vehicle moves, contrast thresholds are tracked within the captured frames of image data with respect to image flow caused by the vehicle'"'"'s movement. Image data of a first frame of captured image data may be passed through two individual image transfer functions to generate a first transferred frame of image data. The first transferred frame may be blended with a second frame of image data. Presence of an object is detected in the field of view of the camera, and an output is generated responsive to detection of the object present in the field of view of the camera.

Claims

1. A method of image enhancement for a vehicle vision system, said method comprising:

(a) providing a camera at a vehicle so that the camera has an exterior field of view;

(b) providing a processor operable to process image data;

(c) capturing multiple frames of image data with the camera;

(d) enhancing contrast in image data by tone mapping;

(e) tracking, as the vehicle moves, contrast thresholds within the captured frames of image data with respect to image flow caused by the vehicle'"'"'s movement;

(f) passing image data of a first frame of captured image data through two individual image transfer functions to generate a first transferred frame of image data;

(g) blending the first transferred frame with a second frame of image data;

(h) detecting, at least via processing of image data by the processor, presence of an object in the field of view of the camera; and

(i) generating an output responsive to detection of the object present in the field of view of the camera.

2. The method of claim 1, comprising executing a brightness transfer function to enhance contrast of image data.

3. The method of claim 1, comprising executing tone mapping of multiple frames of image data to enhance detection of the object present in the field of view of the camera.

4. The method of claim 1, comprising classifying the detected object present in the field of view of the camera.

5. The method of claim 4, comprising generating an output responsive to classification of the detected object.

6. The method of claim 1, comprising determining a low visibility driving condition and, responsive to determination of the low visibility driving condition, increasing contrast of features in captured image data by brightening brighter areas of image data and dampening darker areas of image data.

7. The method of claim 6, comprising increasing contrast of features over multiple successive frames of captured image data.

8. The method of claim 7, comprising tracking, via processing by the processor of multiple successive frames of captured image data during the determined low visibility driving condition, image flow caused by movement of the vehicle to enhance detection and identification of objects present in the field of view of the camera.

9. The method of claim 1, wherein at least one previously captured frame of image data is retrieved from memory.

10. The method of claim 1, comprising determining a low visibility driving condition via processing by the processor of image data.

11. The method of claim 1, comprising determining that fog is present in the field of view of the camera via processing by the processor of image data.

12. The method of claim 1, comprising providing blended frames of image data to a video display screen that is disposed in the vehicle at a location viewable by a driver of the vehicle when operating the vehicle.

13. The method of claim 1, wherein capturing multiple frames of image data with the camera comprises capturing multiple frames of image data with the camera at a frame rate of at least 30 frames per second.

14. The method of claim 1, wherein blending the first transferred frame with the second frame of image data generates a blended image frame of image data that is up to 20 percent derived from the first frame of image data.

15. The method of claim 1, comprising executing a brightness transfer function on at least one previously captured frame of image data.

16. The method of claim 1, comprising providing the generated output to a driver assistance system of the vehicle.

17. The method of claim 16, wherein the driver assistance system of the vehicle comprises a system selected from the group consisting of (i) a lane change assist system of the vehicle, (ii) a lane departure warning system of the vehicle, (iii) a blind spot detection system of the vehicle, (iv) an adaptive cruise control system of the vehicle, (v) a collision avoidance system of the vehicle, (vi) a traffic sign recognition system of the vehicle and (vii) a vehicle headlamp control system of the vehicle.

18. The method of claim 1, comprising tracking the detected object over successive frames of image data to determine if the detected object is an object of interest in the field of view of the camera.

19. The method of claim 1, wherein processing by the processor of image data by the processor is responsive at least in part to steering of the vehicle.

20. The method of claim 1, comprising distinguishing, via processing by the processor of image data, moving objects from non-moving objects.

21. The method of claim 20, wherein distinguishing moving objects comprises distinguishing moving objects responsive at least in part to at least one of (i) speed of the vehicle and (ii) steering of the vehicle.

22. The method of claim 1, wherein providing the camera at the vehicle comprises disposing the camera at a rear portion of the vehicle with an exterior field of view at least rearward of the vehicle, and wherein said method comprises providing a plurality of cameras at the vehicle so as to have respective exterior fields of view, and wherein the plurality of cameras comprises the camera at the rear portion of the vehicle.

23. The method of claim 22, comprising providing a display for displaying images derived, at least in part, from image data captured by the camera at the rear portion of the vehicle and derived, at least in part, from image data captured by other cameras of the plurality of cameras.

24. The method of claim 1, wherein providing the camera at the vehicle comprises disposing the camera at a rear portion of the vehicle with an exterior field of view at least rearward of the vehicle, and wherein said method comprises providing a display for displaying images derived, at least in part, from image data captured by the camera during a reversing maneuver of the vehicle.

25. A method of image enhancement for a vehicle vision system, said method comprising:

(a) disposing a camera at a front portion of a vehicle with an exterior field of view at least forward of the vehicle;

(b) providing a processor operable to process image data;

(c) capturing multiple frames of image data with the camera;

(d) executing a brightness transfer function on at least one frame of image data;

(e) tracking, as the vehicle moves, image flow caused by the vehicle'"'"'s movement;

(f) detecting, at least via processing of image data by the processor, presence of an object in the field of view of the camera;

(g) tracking the detected object over successive frames of image data to determine if the detected object is an object of interest in the field of view of the camera;

(h) generating an output responsive to detection of the object present in the field of view of the camera; and

(i) providing the generated output to a driver assistance system of the vehicle, wherein the driver assistance system of the vehicle comprises a system selected from the group consisting of (i) a lane change assist system of the vehicle, (ii) a lane departure warning system of the vehicle, (iii) a blind spot detection system of the vehicle, (iv) an adaptive cruise control system of the vehicle, (v) a collision avoidance system of the vehicle, (vi) a traffic sign recognition system of the vehicle and (vii) a vehicle headlamp control system of the vehicle.

26. The method of claim 25, comprising determining a low visibility driving condition via processing of image data by the processor.

27. The method of claim 26, comprising, responsive to determination of the low visibility driving condition, increasing contrast of features in captured image data by brightening brighter areas of image data and dampening darker areas of image data.

28. The method of claim 27, comprising distinguishing, at least via processing of image data by the processor, moving objects from non-moving objects.

29. The method of claim 28, wherein distinguishing moving objects comprises distinguishing moving objects responsive at least in part to at least one of (i) speed of the vehicle and (ii) steering of the vehicle.

30. A method of image enhancement for a vehicle vision system, said method comprising:

(a) disposing a plurality of cameras at the vehicle so as to have respective exterior fields of view, wherein the plurality of cameras comprises a rear camera at a rear portion of a vehicle with an exterior field of view at least rearward of the vehicle;

(b) providing a processor operable to process image data;

(c) capturing multiple frames of image data with the rear camera;

(d) executing tone mapping of multiple frames of image data to enhance contrast;

(e) detecting presence of an object in the field of view of the rear camera;

(f) generating an output responsive to detection of the object present in the field of view of the rear camera; and

(g) providing a display for displaying images derived, at least in part, from image data captured by the rear camera at the rear portion of the vehicle and derived, at least in part, from image data captured by other cameras of the plurality of cameras.

31. The method of claim 30, comprising determining a low visibility driving condition via processing of image data by the processor captured by at least one of the plurality of cameras.

32. The method of claim 31, comprising, responsive to determination of the low visibility driving condition, increasing contrast of features in captured image data by brightening brighter areas of image data and dampening darker areas of image data.