Imaging system including dynamic compensation for color attenuation for vehicle windscreens

• US 9,434,327 B2
• Filed: 11/14/2014
• Issued: 09/06/2016
• Est. Priority Date: 11/15/2013
• Status: Active Grant

• Current Assignee: HL Klemove Corporation
• Original Assignee: Gentex Corporation
• Inventors: Pierce, Phillip R.
• Primary Examiner(s): GORADIA, SHEFALI DINESH
• Application Number:
  US14/541,385
• Publication Number:
  US 20150142206A1
• Time in Patent Office: 662 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60R 16/02 electric constitutive elements
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 2207/30268 Vehicle interior
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/62 relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 2201/08 Detecting or categorising vehicles
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An imaging system for a vehicle is disclosed having an image sensor positioned in the vehicle for capturing images through a windscreen of the vehicle and for generating image data corresponding to the captured images, and a processor coupled to the image sensor for receiving and analyzing the image data and detecting vehicle light sources in the captured images. The processor: detects a predetermined number of vehicle light sources; averages color values of each detected vehicle light source; determines differences between the averaged color values and target color values; and stores the differences as color compensation values. A vehicle equipment control system is further disclosed having the imaging system above, wherein the processor compensates color values of subsequently detected vehicle light sources and generates a control signal that is used to control the vehicle equipment in response to the detection of color compensated vehicle light sources in the captured images.

Claims

1. An imaging system for a vehicle comprising:

an image sensor positioned in the vehicle for capturing images through a windscreen of the vehicle and for generating image data corresponding to the captured images; and

a processor coupled to the image sensor configured for receiving and analyzing the image data and detecting vehicle light sources in the captured images, wherein the processor is further configured to;

(a) detect a predetermined number of vehicle light sources;

(b) average color values of each detected vehicle light source;

(c) determine differences between the averaged color values and target color values; and

(d) store the differences as color compensation values to compensate color values of subsequently detected vehicle light sources.

2. The imaging system of claim 1, wherein the processor is further configured to:

(e) determine if color compensation values have been previously determined;

(f) detect vehicle light sources in a captured image, if color compensation values have been previously determined, the processor performs at least steps (g) and (h) below;

(g) calculate a weighted average of color values using previously averaged color values and color values of vehicle light sources detected in the captured image;

(h) determine if the weighted average has exceeded a predefined difference limit from the target value, and

based on determining that the weighted average has exceeded the predefined difference limit, the processor is further configured to;

(i) determine differences between the weighted averaged color values and target color values; and

(j) store the differences as color compensation values to be used to compensate color values of subsequently detected vehicle light sources; and

(k) detect vehicle light sources in each subsequently captured image and performs steps (f)-(h) for each captured image.

3. The imaging system of claim 1, wherein the predetermined number is 100.

4. The imaging system of claim 1, wherein the processor further categorizes the detected vehicle light sources into at least two light source bands and performs each of at least steps (a)-(d) for each of the at least two light source bands.

5. The imaging system of claim 1, wherein the processor is further configured to repeat steps (a)-(d) using a second predetermined number of light sources.

6. The imaging system of claim 5, wherein the second predetermined number is 500.

7. A vehicle equipment control system comprising:

an image sensor positioned in the vehicle, the image sensor operable to capture images through a windscreen of the vehicle and generate image data corresponding to the captured images; and

a processor coupled to the image sensor, the processor configured to receive and analyze the image data and detect vehicle light sources in the captured images, wherein the processor is further configured to;

(a) detect a predetermined number of vehicle light sources;

(b) average color values of each detected vehicle light source;

(c) determined differences between the averaged color values and target color values; and

(d) store the differences as color compensation values to compensate color values of subsequently detected vehicle light source,

wherein the processor is further configured to compensate color values of subsequently detected vehicle light sources and generate a signal used to control a vehicle equipment in response to the detection of color compensated vehicle light sources in the captured images.

8. The vehicle equipment control system of claim 7, wherein the vehicle equipment comprises exterior lights of the controlled vehicle.

9. A vehicle equipment control system for a controlled vehicle comprising:

an image sensor positioned in the vehicle for capturing images through a windscreen of the controlled vehicle and for generating image data corresponding to the captured images; and

a processor coupled to the image sensor configured for receiving and analyzing the image data and detecting vehicle light sources in the captured images, wherein the processor is configured to;

(a) categorize the detected vehicle light sources into at least two light source bands;

(b) detect vehicle light sources in each light source band;

(c) average color values of each detected vehicle light source in each light source band;

(d) determine differences between the averaged color values and target color values in each light source band;

(e) store the differences as color compensation values in each light source band to compensate color values of subsequently detected vehicle light sources categorized in a corresponding light source band; and

(f) generate a signal used to control a vehicle equipment in response to the detection of color compensated vehicle light sources in the captured images.

10. The vehicle equipment control system of claim 9, wherein the processor is further configured to:

(g) determine if color compensation values have been previously determined in each light source band, and based on a determination that color compensation values have been previously determined, the processor is further configured to;

(h) detect vehicle light sources in a captured image and categorizes the detected vehicle light sources into the at least two light source bands;

(i) calculate a weighted average of color values for each light source band using previously averaged color values and color values of vehicle light sources detected in the captured image within each respective light source band; and

(j) determine if the weighted average has exceeded a predefined difference limit from the target value, and based on a determination that the weighted average has exceeded the predefined difference limit, the processor is further configured to;

(k) determine differences between the weighted averaged color values and target color values for each light source band; and

(l) store the differences as color compensation values for each light source band to compensate color values of subsequently detected vehicle light sources categorized in a corresponding light source band; and

(m) detect vehicle light sources in each subsequently captured image and performs steps (i) and (j) for each captured image.

11. The vehicle equipment control system of claim 9, wherein the vehicle equipment includes exterior lights of the controlled vehicle.

12. The vehicle equipment control system of claim 9, wherein the processor is further configured to repeat steps (a)-(e) using a second predetermined number of light sources.

13. A method for controlling equipment of a controlled vehicle, comprising:

(a) acquiring images of a scene external and forward of the controlled vehicle and generating image data corresponding to the acquired images;

(b) detecting a predetermined number of vehicle light sources;

(c) averaging color values of each detected vehicle light source;

(d) determining differences between the averaged color values and target color values;

(e) storing the differences as color compensation values to compensate color values of subsequently detected vehicle light sources; and

(f) generating a signal used to control a vehicle equipment in response to the detection of color compensated vehicle light sources in the captured images.

14. The method of claim 13 further comprising:

(g) determining if color compensation values have been previously determined;

(h) detecting vehicle light sources in a captured image, and based on a determination that color compensation values have been previously determined;

(i) calculating a weighted average of color values using previously averaged color values and color values of vehicle light sources detected in the captured image; and

(j) determining if the weighted average has exceeded a predefined difference limit from the target value, if the weighted average has exceeded the predefined difference limit;

(k) determining differences between the weighted averaged color values and target color values; and

(l) storing the differences as color compensation values to compensate color values of subsequently detected vehicle light sources; and

(m) detecting vehicle light sources in each subsequently captured image and performing steps (h)-(j) for each captured image.

15. The method of claim 13 and further comprising categorizing the detected vehicle light sources into at least two light source bands and performing each of at least steps (a)-(f) for each of the at least two light source bands.

16. The method of claim 13, wherein the vehicle equipment includes exterior lights of the controlled vehicle.

17. A non-transitory computer readable medium having stored thereon software instructions that, when executed by a processor, cause the processor to:

(a) acquire images of a scene external and forward of the controlled vehicle and generating image data corresponding to the acquired images;

(b) detect vehicle light sources;

(c) average color values of each detected vehicle light source;

(d) determine differences between the averaged color values and target color values;

(e) store the differences as color compensation values to compensate color values of subsequently detected vehicle light sources; and

(f) generate a signal to control a vehicle equipment in response to the detection of color compensated vehicle light sources in the captured images.

18. The non-transitory computer readable medium of claim 17, wherein the software instructions further cause the processor to:

(g) determine if color compensation values have been previously determined;

(h) detect vehicle light sources in a captured image, and based on a determination that color compensation values have been previously determined, the software instructions further cause the processor to;

(i) calculate a weighted average of color values using previously averaged color values and color values of vehicle light sources detected in the captured image; and

(j) determine if the weighted average has exceeded a predefined difference limit from the target value, and based on a determination that the weighted average has exceeded the predefined difference limit, the software instructions further cause the processor to

(k) determine differences between the weighted averaged color values and target color values; and

(l) store the differences as color compensation values to be used to compensate color values of subsequently detected vehicle light sources; and

(m) detect vehicle light sources in each subsequently captured image and performing steps (h)-(j) for each captured image.

19. The non-transitory computer readable medium of claim 17, wherein the software instructions further cause the processor to categorize the detected vehicle light sources into at least two light source bands and wherein each of at least steps (a)-(e) are executed for each of the at least two light source bands.

20. The non-transitory computer readable medium of claim 17, wherein the vehicle equipment includes exterior lights of the controlled vehicle.