Vehicle control system and image sensor

• US 9,626,570 B2
• Filed: 09/26/2014
• Issued: 04/18/2017
• Est. Priority Date: 09/26/2013
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Murao, Toshikazu, Shiota, Kentarou, Sugiyama, Naoki, Kimura, Takayuki
• Primary Examiner(s): Liu, Li
• Application Number:
  US14/497,450
• Publication Number:
  US 20150086079A1
• Time in Patent Office: 935 Days
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A vehicle control system includes a light-receiving section which has a plurality of filters having different pass bands, and a plurality of light-receiving elements, each of which receives incident light via any one of the filters; an image data generation section which, when receiving general image data which is an output of the light-receiving section, extracts outputs of the light-receiving elements correlated to the filters to generate discrete image data, which is image data for each of the filters; an image data processing section which detects at least one object, based on the discrete image data generated by the image data generation section or composite image data generated by combining the discrete image data; and a vehicle control section which performs vehicle control, according to the object detected by the image data processing section.

Claims

1. A vehicle control system for a vehicle, the vehicle control system, comprising:

a light-receiving section which has a plurality of filters having different wavelength pass bands, and a plurality of light-receiving elements, each of which receives incident light via any one of the filters;

an image data generation section which, when receiving general image data of a scene around the vehicle which is an output of the light-receiving section, extracts outputs of the light-receiving elements correlated to the filters to generate a plurality of discrete image data, each of the plurality of discrete image data being for a respective one of the plurality of filters;

an image data processing section which detects, based on at least one of the plurality of discrete image data generated by the image data generation section or composite image data generated by combining two or more of the plurality of discrete image data, at least one object included in a group of objects; and

a vehicle control section which performs vehicle control according to the at least one object detected by the image data processing section;

wherein

the filters include at least one type of limited filter whose light-receiving band is a band to which the light-receiving elements are sensitive and whose pass band is a part of the light-receiving band, and an all-pass filter whose pass band is at least the combined pass band of the limited filters;

the image data generation section generates, as the discrete image data, high-sensitivity image data based on the output of the light-receiving section which receives light via the all-pass filter, and low-sensitivity image data based on the output of the light-receiving section which receives light via the limited filter; and

the image data processing section selects the high-sensitivity image data if a brightness of the scene around the vehicle is equal to or lower than a predetermined threshold, and the image selection means selects the low-sensitivity image data if the brightness is higher than the predetermined threshold.

2. The vehicle control system according to claim 1, wherein

the light-receiving band includes a band corresponding to visible light, and

the limited filter has the pass band corresponding to any one of red, green, and blue.

3. The vehicle control system according to claim 1, wherein

the light-receiving section has a plurality of light-receiving element rows in which the light-receiving elements are arranged in line and reads outputs of light-receiving elements of each of the light-receiving element rows, and

types of the filters applied to the light-receiving elements are limited for each of the light-receiving element rows.

4. The vehicle control system according to claim 1, further comprising an image selection means for selecting the discrete image data used for detecting the object, according to at least one of a type of the object to be detected and the scene of an image represented by the discrete image data, wherein

the image data processing section detects the object by using the image data selected by the image selection means.

5. The vehicle control system according to claim 1, wherein

the image data generation section includes a scene determination unit determining whether or not a scene represented by the image data is a specific scene having a probability of including overexposure areas or underexposure areas, and

if the scene determination unit determines that the scene represented by the image data is the specific scene, the image data generation section generates the composite image data, in which the high-sensitivity image data is used in an area whose brightness is equal to or lower than a predetermined threshold and the low-sensitivity image data is used in an area whose brightness is higher than the predetermined threshold.

6. The vehicle control system according to claim 5, wherein

the scene determination unit determines that a scene in which a construction is present is the specific scene, the construction casting a shadow equal to or larger than the object.

7. The vehicle control system according to claim 5, wherein

the scene determination unit performs the determination by using at least one of a detection result of the object in the past and prepared map information.

8. The vehicle control system according to claim 1, wherein

the filters of the light-receiving section are set so that the discrete image data individually generated for the filters are under conditions in which angles of view and resolutions are substantially the same.