IMAGING APPARATUS WHICH SUPPRESSES FIXED PATTERN NOISE GENERATED BY AN IMAGE SENSOR OF THE APPARATUS

• US 20130335601A1
• Filed: 06/13/2013
• Published: 12/19/2013
• Est. Priority Date: 06/13/2012
• Status: Abandoned Application

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: KIMURA, Takayuki, SHIOTA, Kentarou, MURAO, Toshikazu
• Application Number:
  US13/916,876
• Publication Number:
  US 20130335601A1
• Time in Patent Office: Days
• US Class Current: 348/247
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise
• CPC Class Codes: H04N 25/67 applied to fixed-pattern noise, e.g. non-uniformity of response
• CPC Class Codes: H04N 25/683 by defect estimation performed on the scene signal, e.g. real time or on the fly detection

Abstract

An imaging apparatus detects and registers fixed-noise pixels as those pixels of the image sensor which produce fixed pattern noise, and includes an optical element which disperses light that is incident on the image sensor. The detection is performed by identifying isolated high-luminance pixels within captured images and, for each isolated high-luminance pixel, evaluating the luminance values of peripherally adjacent pixels. A judgement is made as to whether an isolated high-luminance pixel is a fixed-noise pixel based upon comparing luminance values of the peripherally adjacent pixels with a predetermined threshold value, the judgement preferably being performed only while images are captured during hours of darkness.

Claims

1. An imaging apparatus comprising

an optical system incorporating an optical dispersion element, the optical dispersion element disposed for effecting dispersion of incident light entering the optical system, and

an image sensor comprising an array of photo-sensors disposed to receive dispersed incident light from the optical system, for capturing an image data frame, the image data frame comprising respective luminance values of the photo-sensors and expressing a captured image of an external scene,

wherein the imaging apparatus comprises:

p2 extraction circuitry configured for processing the image data frame for identifying isolated high-luminance photo-sensors as respective photo-sensors each producing a luminance value exceeding a first predetermined threshold value and each spatially separated from all other photo-sensors producing a luminance value exceeding the first threshold value, and

judgement circuitry configured for judging, for each of the isolated high-luminance photo-sensors, whether the isolated high-luminance photo-sensor is a fixed-noise photo-sensor producing a fixed high value of luminance.

2. The imaging apparatus as claimed in claim 1 wherein the judgement circuitry judges whether an isolated high-luminance photo-sensor is a fixed-noise photo-sensor based upon respective luminance values of a corresponding set of one or more photo-sensors located peripherally adjacent to the isolated high-luminance photo-sensor.

3. The imaging apparatus as claimed in claim 2, wherein the judgement circuitry determines that an isolated high-luminance photo-sensor is a fixed-noise photo-sensor when each of the luminance values of the corresponding peripherally adjacent photo-sensors is judged to be less than a second predetermined threshold value.

4. The imaging apparatus as claimed in claim 2, wherein the judgement circuitry determines that an isolated high-luminance photo-sensor is a fixed-noise photo-sensor when an average of the luminance values of the corresponding peripherally adjacent photo-sensors is judged to be less than a second predetermined threshold value.

5. The imaging apparatus as claimed in claim 2, wherein the judgement circuitry determines that an isolated high-luminance photo-sensor is a fixed-noise photo-sensor when a total of the luminance values of the corresponding peripherally adjacent photo-sensors is judged to be less than a second predetermined threshold value.

6. The imaging apparatus as claimed in claim 1 wherein image data frames are captured successively by the image sensor, and comprising image data correction circuitry configured for subtracting a corresponding correction amount from the luminance value of each of the fixed-noise photo-sensors in each of the image data frames, to thereby obtain corrected image data frames having a fixed pattern noise component excluded therefrom, the correction amount corresponding to a fixed-noise photo-sensor being derived based upon luminance values obtained for the fixed-noise photo-sensor in respective ones of a plurality of image data frames previously produced from the image sensor.

7. The imaging apparatus as claimed in claim 6, wherein the extraction circuitry extracts the isolated high-luminance pixels based on processing the corrected image data frames.

8. The imaging apparatus as claimed in claim 6 comprising a non-volatile rewritable memory, wherein the image data correction circuitry:

stores luminance history data in the rewritable memory with respect to each of the fixed-noise photo-sensors, the luminance history data of a fixed-noise photo-sensor comprising a plurality of luminance values previously obtained for the fixed-noise photo-sensor from respective image data frames, and

derives the correction amount corresponding to a fixed-noise photo-sensor based upon the luminance history data corresponding to the fixed-noise photo-sensor.

9. The imaging apparatus as claimed in claim 8 wherein,

for each of the fixed-noise photo-sensors, the image data correction circuitry updates the luminance history data corresponding to the fixed-noise photo-sensor each time that an image data frame is newly captured by the image sensor, and

the updating is executed by adding to the corresponding luminance history data a luminance value produced from the fixed-noise photo-sensor, contained in the newly captured image data frame.

10. The imaging apparatus as claimed in claim 9, wherein:

the judgement circuitry executes the judgement of the isolated photo-sensors only while the captured images are images of an outdoor scene, captured during hours of darkness; and

,

the image data correction circuitry updates the luminance history data only while the captured images are images of an outdoor scene, captured during hours of darkness.

11. The imaging apparatus as claimed in claim 9 wherein, for each of the fixed-noise photo-sensors, the image data correction circuitry derives the correction amount corresponding to the fixed-noise photo-sensor based upon a plurality of luminance values from the luminance history data corresponding to the fixed-noise photo-sensor, including a most recently updated luminance value.

12. The imaging apparatus as claimed in claim 9 wherein, for each of the fixed-noise photo-sensors, the image data correction circuitry derives the correction amount corresponding to the fixed-noise photo-sensor as an average value of at least a part of the luminance values of the luminance history data corresponding to the fixed-noise photo-sensor.

13. The imaging apparatus as claimed in claim 6, wherein:

the imaging apparatus is installed in a motor vehicle, disposed for capturing images of a region ahead of the vehicle;

the imaging apparatus further comprises vehicle light detection circuitry configured for detecting lights of other vehicles when such lights are expressed within the captured images, the detection being executed based on contents of the corrected image data frames;

the judgement circuitry executes judgement of the isolated photo-sensors only while the vehicle is operating during hours of darkness; and

,

the image data correction circuitry updates the luminance history data only while the vehicle is operating during hours of darkness.