Color mask for an image sensor of a vehicle camera

• US 9,883,148 B2
• Filed: 02/09/2011
• Issued: 01/30/2018
• Est. Priority Date: 04/07/2010
• Status: Expired due to Fees

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Seger, Ulrich, Wuerz-Wessel, Alexander, Ruhnau, Paul
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): Slater, Alison
• Application Number:
  US13/639,034
• Publication Number:
  US 20130027560A1
• Time in Patent Office: 2,547 Days
• CPC Class Codes: H04N 23/88 for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 25/133 including elements passing panchromatic light, e.g. filters passing white light
• CPC Class Codes: H04N 25/135 based on four or more different wavelength filter elements

Abstract

A color mask for an image sensor of a vehicle camera, the color mask having a matrix configuration of filter pixels having different spectral transmission behaviors, some filter pixels being transparent filter pixels, which are at least essentially uniformly transparent for optical light, and additional filter pixels being color pixels having a wavelength-selective transmission behavior, the color mask having a color pattern as a repeating configuration of filter pixels having a specific transmission behavior. The color mask has a central area having a first color pattern and a lower area and/or an upper area having a second color pattern, the first color pattern and the second color pattern being different, and the first color pattern containing transparent filter pixels.

Claims

1. A color mask for an image sensor of a vehicle camera, the image sensor having a matrix of sensor pixels, the color mask comprising:

a matrix configuration of filter pixels having different spectral transmission behaviors, the matrix configuration sized to overlay the matrix of sensor pixels, the filter pixels including at least one transparent filter pixel that is transparent for optical light and at least one color filter pixel having a wavelength-selective transmission behavior, each of the filter pixels of the matrix configuration configured to sit in front of a corresponding sensor pixel of the image sensor,

wherein the matrix configuration has a central area having a first color pattern and at least one second area having a second color pattern, the at least one second area including an upper area of the matrix configuration above the central area; and

wherein the first color pattern and the second color pattern are different repeating configurations of the filter pixels, the first color pattern contains transparent and color filter pixels, the first color pattern has a larger relative proportion of transparent filter pixels than the second color pattern, and

the second color pattern is configured as a full-color pattern without any transparent filter pixels.

2. The color mask of claim 1, wherein the at least one second area includes multiple complete rows of the matrix configuration of the filter pixels, and the central area includes more rows of the matrix configuration than the at least one second area.

3. The color mask of claim 1, wherein the second color pattern is configured as an RGGB pattern.

4. The color mask of claim 1, wherein the at least one second area also includes a lower area of the matrix configuration below the central area, which is configured to detect a road surface in front of a vehicle having the vehicle camera.

5. The color mask of claim 1, wherein the upper area of the matrix configuration is configured to detect sky.

6. The color mask of claim 1, wherein the central area is configured to detect objects including at least one of:

lane markings, buildings, or trees.

7. The color mask of claim 1, wherein the central area is configured to detect objects at a higher spatial resolution than the at least one second area.

8. The color mask of claim 1, wherein the at least one second area includes a lower area having a third color pattern, the second color pattern and the third color pattern being different repeating configurations of the filter pixels.

9. The color mask of claim 1, wherein a signal from a portion of the image sensor corresponding to at least one second area provides information to determine a quantity including at least one of:

an ambient temperature, or a color temperature; and

the determined quantity is used to perform at least one of;

a white balance on a signal from a portion of the image sensor corresponding to the central area of the color mask, or a color correction on the signal from the portion of the image sensor corresponding to the central area of the color mask.

10. A vehicle camera, comprising:

an image sensor;

the color mask of claim 1; and

a processor to;

determine, based on a signal from a portion of the image sensor corresponding to the at least one second area of the color mask, a quantity including at least one of;

an ambient temperature, or a color temperature; and

perform, as a function of the determined quantity, at least one of;

a white balance on a signal from a portion of the image sensor corresponding to the central area of the color mask, or a color correction on the signal from the portion of the image sensor corresponding to the central area of the color mask.

11. The color mask of claim 1, wherein the central area having the first color pattern and the at least one second area having the second color pattern are located along a same vertical axis.

12. A vehicle camera, comprising:

an image sensor having a matrix of sensor pixels;

a color mask situated in front of the image sensor, wherein the color mask includes;

a matrix configuration of filter pixels having different spectral transmission behaviors, the matrix configuration sized to overlay the matrix of sensor pixels, the filter pixels including at least one transparent filter pixel that is transparent for optical light and at least one color filter pixel having a wavelength-selective transmission behavior, each of the filter pixels configured to sit in front of a corresponding sensor pixel of the image sensor;

wherein the matrix configuration has a central area having a first color pattern and at least one second area having a second color pattern, the at least one second area including at least one of;

a lower area of the matrix configuration, or an upper area of the matrix configuration; and

wherein the first color pattern and the second color pattern are different repeating configurations of the filter pixels, and the first color pattern contains transparent and color filter pixels; and

a control and analyzing unit;

wherein the image sensor is configured to output to the control and analyzing unit first pixel signals of the sensor pixels covered with the filter pixels of the central area having the first color pattern and second pixel signals of the sensor pixels covered with the filter pixels of the at least one second area having the second color pattern;

wherein the control and analyzing unit is configured to ascertain from the second pixel signals a quantity including at least one of;

an average color value, a color temperature, or an average gray value; and

wherein the control and analyzing unit is configured to use the ascertained quantity to perform at least one of;

a white balance of the first pixel signals, or a color correction of the first pixel signals.

13. The vehicle camera of claim 12, wherein the first pixel signals are color corrected, and the control and analyzing unit is configured to ascertain, from the corrected first pixel signals, the objects in a central image area of the image transmitted by the image signals and ascertains color values of the objects and of the partial areas of the objects.

14. The vehicle camera of claim 12, wherein the control and analyzing unit is configured to check whether an object extends into the at least one second area, and partial areas of the at least one second area in which an ascertained object is situated are not used to ascertain the quantity.

15. The vehicle camera of claim 12, wherein an imaging lens and a fuzziness-creating device are situated in front of the image sensor, the fuzziness-creating device creating a diffuse or fuzzy image in the at least one second area.

16. The vehicle camera of claim 15, wherein the fuzziness-creating device is a diffuser.

17. The vehicle camera of claim 12, wherein the central area having the first color pattern and the at least one second area having the second color pattern are located along a same vertical axis.

18. The vehicle camera of claim 12, wherein the at least one second area includes the upper area, which is above the central area and is configured to detect sky.

19. The vehicle camera of claim 18, wherein the at least one second area also includes the lower area, which is below the central area and is configured to detect a road surface in front of a vehicle having the vehicle camera.

20. The vehicle camera of claim 12, wherein the central area is configured to detect objects including at least one of:

lane markings, buildings, or trees.

21. The vehicle camera of claim 12, wherein the central area is configured to detect objects at a higher spatial resolution than the at least one second area.

22. The vehicle camera of claim 12, wherein the at least one second area includes the lower area, and the upper area includes a third color pattern, the second color pattern and the third color pattern being different repeating configurations of the filter pixels.

23. A method for processing signals of a vehicle camera, the method comprising:

detecting vehicle surroundings using a camera having an image sensor and a color mask situated in front of the image sensor, the image sensor including a matrix of sensor pixels, the color mask including a matrix configuration of filter pixels having different spectral transmission behaviors, each of the filter pixels configured to sit in front of a corresponding sensor pixel of the image sensor, the matrix configuration having a central area having a first color pattern and at least one second area having a second color pattern, the first color pattern containing transparent and color filter pixels, the at least one second area including at least one of;

a lower area of the matrix configuration, or an upper area of the matrix configuration;

recording first pixel signals from sensor pixels situated behind the central area having the first color pattern and second pixel signals from sensor pixels situated behind the at least one second area having the second color pattern;

ascertaining from the second pixel signals a quantity including at least one of;

an average color value, a color temperature, or an average gray value; and

using the ascertained quantity to perform at least one of;

a white balance of the first pixel signals, or a color correction of the first pixel signals.

24. The method of claim 23, wherein the transparent filter pixels are transparent for optical light and the color filter pixels have a wavelength-selective transmission behavior.

25. The method of claim 23, wherein the central area having the first color pattern and the at least one second area having the second color pattern are located along a same vertical axis.