Apparatus for determining the presence of fog using image obtained by vehicle-mounted imaging device

• US 8,786,697 B2
• Filed: 01/10/2008
• Issued: 07/22/2014
• Est. Priority Date: 01/11/2007
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Kawasaki, Naoki
• Primary Examiner(s): Nguyen, Thuong
• Application Number:
  US12/008,408
• Publication Number:
  US 20080169912A1
• Time in Patent Office: 2,385 Days
• Field of Search: 348/135, 348/148, 340/425.5, 382/181
• US Class Current: 348/135
• CPC Class Codes: B60Q 2300/312 Adverse weather
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights

Abstract

An apparatus that detects the presence of a constituent such as fog affecting a view of space which is present ahead of a vehicle, the constituent resulting from a natural phenomenon in the space is provided. In this apparatus, the determination of whether the presence of the element is determined based on an image that captured by a vehicle-mounted camera and in which a picture of a high-luminance obstacle located on a road over which the vehicle is traveling is masked.

Claims

1. An apparatus for determining whether or not an image of a space captured by a vehicle-mounted camera contains fog, the apparatus comprising:

means for determining a reference image which is at least a part of the image of the space captured by the vehicle-mounted camera;

means for estimating an actual luminance of the sky at a location where the vehicle is traveling on the basis of the captured image,

estimating an actual luminance of a road scene which corresponds to each of a plurality of pixels which form the reference image on the basis of a corresponding relationship determined in advance between pixel values and the actual luminance of the sky,

determining an area in the reference image, in which a high luminance object as a headlight of a preceding vehicle is present, on the basis of the comparison result of the estimated actual luminance of the sky and the luminance of each of the pixels, and

masking an area in the reference image including the high luminance object in the reference image to generate a masked reference image; and

means for performing one of a spatial frequency analysis and an edge intensity analysis of the masked reference image, and judging a presence of fog in the reference image on the basis of a strength of a high frequency component contained in the masked reference image when the spatial frequency analysis is executed, and a total amount of an edge strength contained in the masked reference image when the edge intensity analysis is executed wherein

when the spatial frequency analysis is executed, fog is determined as being present in the reference image when the strength of the high frequency component contained in the masked reference image is less than a first predetermined reference value, and

when the edge intensity analysis is executed, fog is determined as being present in the reference image when the total amount of the edge strength contained in the masked reference image is less than a second predetermined reference value.

2. The apparatus according to claim 1, wherein the masking means masks an enlarged area in the reference image, where the enlarged area is obtained by enlarging the high luminance area containing the headlight of the preceding vehicle with a predetermined relationship.

3. The apparatus according to claim 1, wherein the performing means uses as the reference image a part of the image captured by the vehicle-mounted camera.

4. The apparatus according to claim 1, wherein the area in the single reference image determined to have the high luminance object present is smaller than an area of the single reference image.

5. An apparatus for determining whether or not an image of a space captured by a vehicle-mounted camera contains fog, the apparatus comprising:

means for determining a reference image which is at least a part of the image of the space captured by the vehicle-mounted camera;

means for estimating an illumination of the vehicle on the basis of the reference image,

estimating an actual luminance of a road scene which corresponds to each of a plurality of pixels which form the reference image on the basis of a corresponding relationship determined in advance between pixel values and an actual luminance of the sky,

determining an area in the reference image, in which a high luminance object as a headlight of a preceding vehicle is present, on the basis of the comparison result of the estimated illumination of the vehicle and the luminance of each of the plurality of pixels, and

masking an area in the reference image including a lighting object as a high luminance object in the reference image to generate a masked reference image; and

means for performing one of a spatial frequency analysis and an edge intensity analysis of the masked reference image, and judging a presence of fog in the reference image on the basis of a strength of a high frequency component contained in the masked reference image when the spatial frequency analysis is executed, and a total amount of an edge strength contained in the masked reference image when the edge intensity analysis is executed wherein

when the spatial frequency analysis is executed, fog is determined as being present in the reference image when the strength of the high frequency component contained in the masked reference image is less than a first predetermined reference value, and

when the edge intensity analysis is executed, fog is determined as being present in the reference image when the total amount of the edge strength contained in the masked reference image is less than a second predetermined reference value.

6. The apparatus according to claim 5, wherein the masking means masks an enlarged area in the reference image, where the enlarged area is obtained by enlarging the high luminance area containing the headlight of the preceding vehicle with a predetermined relationship.

7. The apparatus according to claim 5, wherein the performing means uses as the reference image a part of the image captured by the vehicle-mounted camera.

8. The apparatus according to claim 5, wherein the area in the single reference image determined to have the high luminance object present is smaller than an area of the single reference image.

9. An apparatus for determining whether or not an image of a space captured by a vehicle-mounted camera contains fog, the apparatus comprising:

means for determining a reference image which is at least a part of an image of the space captured by the vehicle-mounted camera;

means for determining an area in the reference image, in which a high luminance object as a headlight of a preceding vehicle is present, on the basis of a comparison result between pixels corresponding to the sky in the reference image and a plurality of pixels forming the reference image, and masking an area in the reference image including the high luminance object in the reference image to generate a masked reference image; and

means for performing one of a spatial frequency analysis and an edge intensity analysis of the masked reference image, and judging a presence of fog in the reference image on the basis of a strength of a high frequency component contained in the masked reference image when the spatial frequency analysis is executed, and a total amount of an edge strength contained in the masked reference image when the edge intensity analysis is executed wherein

when the spatial frequency analysis is executed, fog is determined as being present in the reference image when the strength of the high frequency component contained in the masked reference image is less than a first predetermined reference value, and

when the edge intensity analysis is executed, fog is determined as being present in the reference image when the total amount of the edge strength contained in the masked reference image is less than a second predetermined reference value.

10. The apparatus according to claim 9, wherein the masking means masks an enlarged area in the reference image, where the enlarged area is obtained by enlarging the high luminance area containing the headlight of the preceding vehicle with a predetermined relationship.

11. The apparatus according to claim 9, wherein the performing means uses as the reference image a part of the image captured by the vehicle-mounted camera.

12. The apparatus according to claim 9, wherein the area in the single reference image determined to have the high luminance object present is smaller than an area of the single reference image.