Image pickup apparatus having function of suppressing fixed pattern noise

• US 20050068431A1
• Filed: 09/10/2004
• Published: 03/31/2005
• Est. Priority Date: 09/17/2003
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Mori, Keiichi
• Granted Patent: US 7,355,638 B2
• Time in Patent Office: Days
• US Class Current: 348/241
• CPC Class Codes: H04N 25/67 applied to fixed-pattern noise, e.g. non-uniformity of response
• CPC Class Codes: H04N 25/68 applied to defects
• CPC Class Codes: H04N 25/73 using interline transfer [IT]

Abstract

An image pickup apparatus comprises an image pickup unit including a light receiving pixel area including plural pixels each configured to accumulate photoelectric charge and to output signal and a comparative pixel area configured to output always, for example, dark signal in a state free of photoelectric charge, a first storing unit configured to store FPN component values of the light receiving pixel area, a second storing unit configured to store preliminarily FPN component value of the comparative pixel area, a first correction unit configured to perform predetermined comparison processing between the signal from the comparative pixel area and the FPN component value stored in the second storing unit, and to correct the FPN component values stored in the first storing unit, and a second correction unit configured to correct the signal from the light receiving pixel area by the FPN component values after correction by the first correction unit.

Claims

1. An image pickup apparatus comprising:

an image pickup unit including a light receiving pixel area including plural pixels each configured to accumulate photoelectric charge and to output signal and a comparative pixel area configured to output always one of dark signal in a state free of photoelectric charge and signal in a state of resetting photoelectric charge;

a first storing unit configured to store and hold preliminarily fixed pattern noise (FPN) component values of the light receiving pixel area of the image pickup unit;

a second storing unit configured to store and hold preliminarily FPN component value of the comparative pixel area of the image pickup unit;

a first correction unit configured to perform predetermined comparison processing between the signal from the comparative pixel area of the image pickup unit and the FPN component value stored and held in the second storing unit, and to correct the FPN component values stored and held in the first storing unit; and

a second correction unit configured to correct the signal from the light receiving pixel area of the image pickup unit by the FPN component values after correction by the first correction unit.

2. The apparatus according to claim 1, wherein

the first storing unit is configured to store and hold one of the dark signal in a state free of photoelectric charge in each pixel in the light receiving pixel area of the image pickup unit and the signal in a state of resetting photoelectric charge in each pixel in the light receiving pixel area, one of at predetermined timing and in a predetermined condition, preliminarily as the FPN component value for the pixel, and

the second storing unit is configured to store and hold the FPN component value in the comparative pixel area of the image pickup unit one of at the same timing and in the same condition as in the first storing unit.

3. The apparatus according to claim 1, wherein

the comparative pixel area of the image pickup unit includes a plurality of pixels;

and

the second storing unit is configured to store and hold one of an average value and a median value of one of the dark signals in a state free of photoelectric charge in each pixel in the comparative pixel area and the signals in a state of resetting photoelectric charge in each pixel in the comparative pixel area, as the FPN component value.

4. The apparatus according to claim 1, wherein the first correction unit includes:

a comparative pixel area FPN component detecting unit configured to detect the FPN component value of the output signal of the comparative pixel area of the image pickup unit, out of the output signals of the image pickup unit;

a comparing unit configured to calculate a coefficient from the FPN component value detected by the comparative pixel area FPN component detecting unit and the FPN component value stored and held in the second storing unit; and

an arithmetic unit configured to compute and output according to the coefficient outputted from the comparing unit to the FPN component values stored and held in the first stored unit.

5. The apparatus according to claim 1, wherein the second correction unit includes:

a subtracting unit configured to remove the FPN by subtracting the output of the first correction unit from the output signal of the light receiving pixel area of the image pickup unit.

6. The apparatus according to claim 1, wherein the second correction unit further includes:

an FPN abnormal pixel detecting unit configured to compare the output signal of the first correction unit and a predetermined reference value, and to determine presence or absence of an abnormal FPN component value of an object pixel; and

an FPN abnormal pixel correction unit configured to correct the output signal of the subtracting unit corresponding to the pixel determined to be abnormal by the FPN abnormal pixel detecting unit, from peripheral pixel signals.

7. The apparatus according to claim 4, wherein

the comparative pixel area FPN component detecting unit of the first correction unit is configured to calculate one of an average value and a median value of the signals from pixels of the comparative pixel area of the image pickup unit, out of the output signals of the image pickup unit, as the FPN component,

the comparing unit of the first correction unit is configured to calculate the ratio of the FPN component value detected by the comparative pixel area FPN component detecting unit and the FPN component value stored and held in the second storing unit, and to output it as the coefficient;

and

the arithmetic unit of the first correction unit is configured to multiply the FPN component values stored and held in the first storing unit and the coefficient outputted from the comparing unit, and to output it as the output signal.

8. The apparatus according to claim 2, wherein

the first storing unit and second storing unit include nonvolatile memories, and

the FPN component values stored and held by the first and second storing units are one of:

the signals of the light receiving pixel area and comparative pixel area read out once from the image pickup unit at an arbitrary timing; and

one of the average values and the median values obtained by reading out plural times the signals of the light receiving pixel area and comparative pixel area from the image pickup unit in the same condition.

9. The apparatus according to claim 2, wherein the first storing unit and second storing unit include volatile memories, and

are configured to store and hold the signals read out from the light receiving pixel area and comparative pixel area by driving the image pickup unit in a predetermined driving condition right after the power source is supplied in the image pickup apparatus.

10. The apparatus according to claim 1, wherein the image pickup unit is configured to output the output signal of the comparative pixel area ahead of the output signal of the light receiving pixel area, within a signal reading period of one of one field and one frame.

11. An image pickup apparatus comprising:

image pickup means including a light receiving pixel area including plural pixels each for accumulating photoelectric charge and outputting signal and a comparative pixel area for outputting always one of dark signal in a state free of photoelectric charge and signal in a state of resetting photoelectric charge;

first storing means for storing and holding preliminarily fixed pattern noise (FPN) component values of the light receiving pixel area of the image pickup means;

second storing means for storing and holding preliminarily FPN component value of the comparative pixel area of the image pickup means;

first correction means for performing predetermined comparison processing between the signal from the comparative pixel area of the image pickup means and the FPN component value stored and held in the second storing means, and for correcting the FPN component values stored and held in the first storing means; and

second correction means for correcting the signal from the light receiving pixel area of the image pickup means by the FPN component values after correction by the first correction means.

12. A method of suppressing fixed pattern noise of an image pickup apparatus, comprising:

configuring an image pickup unit to include a light receiving pixel area including plural pixels configured to accumulate photoelectric charge and to output signal and a comparative pixel area configured to output always one of dark signal in a state free of photoelectric charge and signal in a state of resetting photoelectric charge;

storing and holding preliminarily fixed pattern noise (FPN) component values of the light receiving pixel area of the image pickup unit;

storing and holding preliminarily FPN component value of the comparative pixel area of the image pickup unit;

performing predetermined comparing processing between the signal from the comparative pixel area of the image pickup unit and the FPN component value stored and held, and correcting the FPN component values of the light receiving pixel area stored and held preliminarily; and

correcting the signal from the light receiving pixel area of the image pickup unit by the FPN component values after the correcting.