Vehicle vision system with color correction

• US 9,883,080 B2
• Filed: 03/20/2017
• Issued: 01/30/2018
• Est. Priority Date: 11/07/2011
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Wierich, Thomas
• Primary Examiner(s): TRUONG, NGUYEN T
• Application Number:
  US15/463,297
• Publication Number:
  US 20170195525A1
• Time in Patent Office: 316 Days
• Field of Search: 348148
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04N 1/6027 Correction or control of colour gradation or colour contrast H04N1/6058 takes precedence
• CPC Class Codes: H04N 23/12 with one sensor only
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/88 for colour balance, e.g. white-balance circuits or colour temperature control

Abstract

A method for processing color image data captured by a vehicular camera includes providing a color camera having an imaging array having a plurality of photosensors, and disposing one or more spectral filters at or in front of photosensors of the plurality of photosensors of the imaging array. The color camera is disposed at a vehicle so as to have a field of view exterior of the vehicle. The color camera captures image data that is provided to an image processor, which processes the image data captured by the color camera. The processing of image data includes processing via an algorithmic loop that corrects color variation due to lighting conditions so that images derived from captured image data are color corrected. The algorithmic loop includes processing image data in a color correction loop for color correction.

Claims

1. A method for processing color image data captured by a vehicular camera disposed at a vehicle to correct for color error, said method comprising:

providing a color camera comprising an imaging array having a plurality of photosensors;

disposing one or more spectral filters at or in front of photosensors of the plurality of photosensors of the imaging array;

disposing the color camera at a vehicle so as to have a field of view exterior of the vehicle;

providing an image processor;

capturing image data with the color camera;

providing captured image data to the image processor;

processing image data captured by the color camera via the image processor;

wherein said processing of image data comprises processing via an algorithmic loop that corrects color variation due to lighting conditions so that images derived from captured image data are color corrected; and

wherein the algorithmic loop comprises processing image data in a color correction loop for color correction.

2. The method of claim 1, wherein said processing of image data utilizes pre-determining illumination scenarios.

3. The method of claim 2, wherein said processing of image data comprises pre-determining illumination scenarios, such that, when a particular illumination scenario is determined, the system can utilize a predetermined polynomial equation to calculate data points along an x-y color curve based on the determined particular illumination scenario.

4. The method of claim 1, wherein disposing the color camera comprises disposing the color camera at a rear of the vehicle so as to have a field of view rearward of the vehicle.

5. The method of claim 4, comprising providing an illumination source at the rear of the vehicle.

6. The method of claim 5, wherein said processing of image data comprises processing for color correction to account for a color of light emitted by the illumination source.

7. The method of claim 1, wherein the hysteresis loop corrects color variation due to lighting conditions so that white colors are properly determined to be along a Planckian Locus.

8. The method of claim 1, wherein said processing of image data comprises utilization of a color correction algorithm that includes a color correction matrix algorithm.

9. The method of claim 8, wherein the color correction algorithm comprises the color correction matrix algorithm and a histogram algorithm to determine a color correction for the captured image data.

10. The method of claim 8, wherein said processing of image data comprises receiving an output from a histogram algorithm and, after processing the output, generating an output that is used as an input to the color correction matrix algorithm.

11. The method of claim 10, wherein an output of the color correction matrix algorithm is used as an input to the histogram algorithm.

12. The method of claim 11, comprising repeating the color correction matrix algorithm and the histogram algorithm until a desired level of color correction is determined.

13. The method of claim 12, wherein the color correction matrix algorithm and the histogram algorithm repeatedly operate to migrate a plurality of data points representative of white points through a color room towards a center line of white points along a Planckian locus.

14. The method of claim 13, wherein the histogram algorithm does not use the data points when an RGB component of the data points exceeds a threshold fraction of full scale.

15. The method of claim 14, wherein the threshold fraction of full scale of the RGB component is ninety percent.

16. The method of claim 1, wherein the image processor includes polynomial equations representative of light plots in white illuminated illumination scenarios, and wherein the image processor, responsive to a determination that captured image data is representative of a typical illumination scenario, uses a corresponding polynomial equation to determine a desired point along a polynomial equation without having to interpolate between data points.

17. A method for processing color image data captured by a vehicular camera disposed at a vehicle to correct for color error, said method comprising:

providing a color camera comprising an imaging array having a plurality of photosensors;

disposing one or more spectral filters at or in front of photosensors of the plurality of photosensors of the imaging array;

disposing the color camera at a rear of a vehicle so as to have a field of view rearward of the vehicle;

providing an illumination source at the rear of the vehicle;

providing an image processor;

capturing image data with the color camera;

providing captured image data to the image processor;

processing image data captured by the color camera via the image processor;

wherein said processing of image data comprises processing that corrects color variation due to lighting conditions so that images derived from captured image data are color corrected; and

wherein said processing of image data comprises processing for color correction to account for a color of light emitted by the illumination source.

18. The method of claim 17, wherein said processing of image data comprises utilization of a color correction algorithm that includes a color correction matrix algorithm, and wherein the color correction algorithm comprises the color correction matrix algorithm and a histogram algorithm to determine a color correction for the captured image data.

19. The method of claim 17, wherein the image processor, responsive to a determination that captured image data is representative of a typical illumination scenario, uses a corresponding polynomial equation to determine a desired point along a polynomial equation without having to interpolate between data points.

20. A method for processing color image data captured by a vehicular camera disposed at a vehicle to correct for color error, said method comprising:

providing a color camera comprising an imaging array having a plurality of photosensors;

disposing one or more spectral filters at or in front of photosensors of the plurality of photosensors of the imaging array;

disposing the color camera at a rear of a vehicle so as to have a field of view rearward of the vehicle;

providing an illumination source at the rear of the vehicle;

providing an image processor;

capturing image data with the color camera;

providing captured image data to the image processor;

processing image data captured by the color camera via the image processor;

wherein said processing of image data comprises processing via an algorithmic loop that corrects color variation due to lighting conditions so that images derived from captured image data are color corrected;

wherein the algorithmic loop comprises processing image data in a color correction loop for color correction;

wherein said processing of image data comprises pre-determining illumination scenarios, such that, when a particular illumination scenario is determined, the system can calculate data points along an x-y color curve based on the determined particular illumination scenario; and

wherein said processing of image data comprises processing for color correction to account for a color of light emitted by the illumination source.

21. The method of claim 20, wherein, when a particular illumination scenario is determined, the system utilizes a predetermined polynomial equation to calculate data points along an x-y color curve based on the determined particular illumination scenario.