Camera system, especially for a vehicle, and method for ascertaining image information of a signal source pulsed as a function of time

• US 9,832,398 B2
• Filed: 01/23/2015
• Issued: 11/28/2017
• Est. Priority Date: 01/23/2014
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Moesle, Frank, Weiss, Daniela, Ruhnau, Paul, Bariamis, Dimitrios
• Primary Examiner(s): Bailey, Frederick
• Application Number:
  US14/603,922
• Publication Number:
  US 20150208005A1
• Time in Patent Office: 1,040 Days
• Field of Search: None
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 25/13 characterised by the spectral characteristics of the filter elements
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/534 depending on the spectral component
• CPC Class Codes: H04N 25/583 with different integration times
• CPC Class Codes: H04N 25/585 with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes

Abstract

A camera system is described, particularly for a vehicle, the camera system having at least: a camera which has an image sensor and a filter mask, and a control and evaluation device which receives image signals output by the image sensor, the image sensor having an array of sensor pixels outputting pixel signals, and the filter mask having an array of filters which are disposed in front of the sensor pixels and have different wavelength-selective transmission response, a portion of the filters being attenuation filters, and sensor pixels, in front of which in each case one of the attenuation filters is disposed, outputting attenuation pixel signals. The attenuation filters advantageously attenuate white light more strongly than the other filters of the filter mask; in particular, they are blue pixels.

Claims

1. A camera system, comprising:

a camera that includes an image sensor and a filter mask; and

a control and evaluation device that receives an image signal output by the image sensor, wherein;

the image sensor includes an array of sensor pixels outputting pixel signals,

the filter mask includes an array of filters that are situated in front of the sensor pixels and have different wavelength-selective transmission responses,

a portion of the filters includes attenuation filters including blue filters for transmitting light in a short-wave wavelength range, and another portion of the filters including red filters,

blue sensor pixels, in front of which in each case one of the blue filters is disposed, output blue attenuation pixel signals, and red sensor pixels, in front of which in each case one of the red filters is disposed, output red pixel signals,

the image signal output by the image sensor has a first subsequence of first frames taken with a first exposure time and a second subsequence of second frames taken with a second exposure time,

the second exposure time is greater than the first exposure time, and

the control and evaluation device evaluates the blue attenuation pixel signals of the second subsequence, but omits evaluating the red filter pixels of the second subsequence, to recognize signal sources whose light signals have at least one of;

a signal period which is greater than the first exposure time, or a signal frequency which is greater than a readout rate of the image sensor.

2. The camera system as recited in claim 1, wherein the blue attenuation filters attenuate incident white light more strongly than the red filters of the filter mask.

3. The camera system as recited in claim 1, wherein the filter mask further includes at least one of:

green filters,

intensity filters, or

transparent filters.

4. The camera system as recited in claim 3, wherein the red filters and the green filters are arranged in one of a RGGB pattern and a RIIB pattern.

5. The camera system as recited in claim 1, wherein the sensor pixels, in front of which no attenuation filters are provided, one of are in saturation and go into saturation during the second exposure time.

6. The camera system as recited in claim 5, wherein the sensor pixels in front of which no attenuation filters are provided include one of green filters, intensity filters, transparent filters, and red filters.

7. The camera system as recited in claim 1, wherein from only the blue attenuation pixel signals in the second subsequence, the control and evaluation device at least one of generates a two-dimensional sub-image and performs an image evaluation.

8. The camera system as recited in claim 1, wherein from the first frames of the first subsequence, the control and evaluation device receives all pixel signals for an evaluation.

9. The camera system as recited in claim 8, wherein the evaluation is at least one of for display on a display device and for a vehicle control system.

10. The camera system as recited in claim 1, wherein the control and evaluation device carries out an image recognition using the first frames of the first subsequence in order to determine positions of signal sources in sub-images of the second subsequence.

11. The camera system as recited in claim 1, wherein the camera includes an optical element having one of a transparency, attenuation, and light transmission that is variable, the optical element being in a light path in front of the filter mask.

12. The camera system as recited in claim 11, wherein the optical element is controllable by the control and evaluation device in order to adjust a higher attenuation in response to a bright vehicle environment and lower or no attenuation in response to a darker vehicle environment.

13. The camera system as recited in claim 11, wherein the optical element is designed to be self-darkening or to automatically adjust its attenuation, and attenuates more strongly in response to at least one of high intensity of incident light and great brightness of a vehicle environment.

14. The camera system as recited in claim 13, wherein the optical element outputs a status signal concerning its attenuation.

15. The camera system as recited in claim 14, wherein the status signal is output to the control and evaluation device.

16. The camera system as recited in claim 11, wherein a difference in at least one of transparency, attenuation, and light transmission is adjustable in at least two stages.

17. The camera system as recited in claim 1, wherein the camera system is for a vehicle.

18. The camera system as recited in claim 1, wherein the signal sources include variable message signs.

19. A camera system, comprising:

a camera that includes an image sensor, a filter mask, and an optical element having one of a transparency, attenuation, and light transmission that is variable, the optical element being in a light path in front of the filter mask; and

a control and evaluation device that receives an image signal output by the image sensor, wherein;

the image sensor includes an array of sensor pixels outputting pixel signals,

the filter mask includes an array of filters that are situated in front of the sensor pixels and have different wavelength-selective transmission responses,

a portion of the filters includes attenuation filters,

sensor pixels, in front of which in each case one of the attenuation filters is disposed, outputs attenuation pixel signals,

the image signal output by the image sensor has a first subsequence of first frames taken with a first exposure time and a second subsequence of second frames taken with a second exposure time,

the second exposure time is greater than the first exposure time,

the control and evaluation device evaluates the attenuation pixel signals of the second subsequence, and

the optical element has a plurality of segments that are controllable individually, for different attenuation of an incident beam in different image areas.

20. The camera system as recited in claim 19, wherein the optical element is adjustable to be more strongly attenuating in those segments which correspond to image areas in which the control and evaluation device ascertains a higher probability for a signal source for higher-frequency signal light.

21. The camera system as recited in claim 19, wherein the optical element is adjustable to be more strongly attenuating in a segment in which an upper image area corresponding to a sky in the vehicle environment is to be imaged.

22. The camera system as recited in claim 19, wherein the control and evaluation device evaluates the attenuation pixel signals of the second subsequence to recognize signal sources including a variable message sign.

23. A method for ascertaining image information of a signal source pulsed as a function of time, comprising:

imaging light through a filter mask onto an image sensor of a multimodal camera;

one of filtering and attenuating incident light in different wavelength ranges by filters of the filter mask that are situated in front of sensor pixels of the image sensor;

outputting blue attenuation pixel signals from sensor pixels, in front of which attenuation filters including blue filters are disposed, and outputting red pixel signals from sensor pixels, in front of which red filters are disposed;

reading out the image sensor with at least a first subsequence having a short first exposure time and a second subsequence having a long second exposure time;

evaluating the blue attenuation pixel signals of the second subsequence, but omitting evaluating the red filter pixels of the second subsequence, to recognize signal sources whose light signals have at least one of;

a signal period which is greater than the first exposure time, or a signal frequency which is greater than a readout rate of the image sensor.

24. The method as recited in claim 23, wherein the signal sources include variable message signs.

25. The method as recited in claim 23, wherein the evaluating at least one of:

carries out an image recognition, or generates a two-dimensional sub-image.