Vehicle-mounted environment recognition device

• US 9,467,687 B2
• Filed: 06/28/2013
• Issued: 10/11/2016
• Est. Priority Date: 07/03/2012
• Status: Active Grant

• Current Assignee: Clarion Co., Ltd. (Faurecia SA)
• Original Assignee: Clarion Co., Ltd. (Faurecia SA)
• Inventors: Takemura, Masayuki, Muramatsu, Shoji, Kiyohara, Masahiro, Utagawa, Akira
• Primary Examiner(s): YENKE, BRIAN P
• Application Number:
  US14/410,392
• Publication Number:
  US 20150334385A1
• Time in Patent Office: 1,201 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06V 10/96 Management of image or video recognition tasks
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof

Abstract

A vehicle-mounted environment recognition device includes an imaging unit that acquires an image taken by an imaging device; an image self-diagnosis unit that diagnoses contamination of a lens of the imaging device with respect to the image acquired by the imaging unit; an application execution unit that executes an application selected from a predetermined application group; and a fail determination unit that determines, on the basis of a diagnosis result from the image self-diagnosis unit, whether the lens contamination state is in an endurance range of the application and, if within the endurance range, sets the operation of the application executed by the application execution unit to a suppression mode. If outside the endurance range, contamination removal control is implemented, or a fail determination is made for the application. Contamination removal and fail determination can be implemented utilizing parameter adjustment and hardware, or an image-based self-diagnosis can be conducted.

Claims

1. A vehicle-mounted environment recognition device comprising:

an imaging unit that acquires an image taken by an imaging device;

an image self-diagnosis unit that diagnoses a lens contamination state of the imaging device and an ambient environment with respect to the image acquired by the imaging unit;

an application execution unit that executes an application selected from a predetermined application group comprising lane recognition, vehicle detection, and pedestrian detection; and

a fail determination unit that determines, based on a result of comparison of a result of diagnosis by the image self-diagnosis unit relating to the lens contamination state and the ambient environment with a threshold value set in advance for each application, one or more from the group consisting of;

whether the application executed by the application execution unit is to be transitioned to a suppression mode with an adjusted processing parameter for erroneous detection suppression, whether lens contamination removal control is to be performed, and whether a fail determination is to be made for the application,

wherein the image self-diagnosis unit sets a processing region for each application executed by the application execution unit, divides the processing region, diagnoses the lens contaminated state for each divided region, and outputs the diagnosis result.

2. The vehicle-mounted environment recognition device according to claim 1, wherein the image self-diagnosis unit includes a lens waterdrop detection unit, a lens cloudiness detection unit, and a low visibility detection unit, and outputs the diagnosis result relating to the lens contaminated state for each detection unit.

3. The vehicle-mounted environment recognition device according to claim 2, wherein the image self-diagnosis unit includes a reflection detection unit, a road surface water film detection unit, a travel road environment detection unit, a light source environment detection unit, and a weather detection unit, and outputs the diagnosis result relating to the ambient environment.

4. The vehicle-mounted environment recognition device according to claim 1, wherein the image self-diagnosis unit includes a reflection detection unit, a road surface water film detection unit, a travel road environment detection unit, a light source environment detection unit, and a weather detection unit, and outputs the diagnosis result relating to the ambient environment for each detection unit.

5. The vehicle-mounted environment recognition device according to claim 1, wherein

the image self-diagnosis unit computes a score indicating the lens contaminated state using a preset weight of an importance for each divided region, and

the fail determination unit performs the determination using the score as the diagnosis result.

6. The vehicle-mounted environment recognition device according to claim 1, wherein the image self-diagnosis unit dynamically changes the processing region to be divided in accordance with a movement of an object of recognition.

7. The vehicle-mounted environment recognition device according to claim 1, wherein the image self-diagnosis unit computes a score indicating the lens contaminated state on the basis of a percentage occupied by a contamination in world coordinates in the processing region, and

the fail determination unit performs the determination using the score as the diagnosis result.