Correction of image sensor fixed-pattern noise (FPN) due to color filter pattern

• US 9,154,750 B2
• Filed: 05/28/2013
• Issued: 10/06/2015
• Est. Priority Date: 05/28/2013
• Status: Active Grant

• Current Assignee: Omnivision Technologies Incorporated (Will Semiconductor Co., Ltd. Shanghai)
• Original Assignee: Omnivision Technologies Incorporated (Will Semiconductor Co., Ltd. Shanghai)
• Inventors: Pang, Chin Poh
• Primary Examiner(s): Berhan, Ahmed A
• Application Number:
  US13/903,714
• Publication Number:
  US 20140354861A1
• Time in Patent Office: 861 Days
• US Class Current: 1/1
• CPC Class Codes: H01L 27/14621 Colour filter arrangements
• CPC Class Codes: H01L 27/14627 Microlenses
• CPC Class Codes: H01L 27/14645 Colour imagers
• CPC Class Codes: H04N 25/133 including elements passing panchromatic light, e.g. filters passing white light
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/611 Correction of chromatic aberration
• CPC Class Codes: H04N 25/67 applied to fixed-pattern noise, e.g. non-uniformity of response

Abstract

Embodiments of an apparatus including a pixel array and a color filter array optically coupled to the pixel array, the color filter array including a plurality of tiled minimal repeating units. Processing circuitry is coupled to the pixel array to correct fixed pattern noise (FPN) in an image captured by the pixel array. The processing circuitry corrects the values of pixels that are part of a correction group, and wherein the corrections comprise a combination of a color ratio correction that is based on the ratios of selected colors within the minimal repeating unit, and one or more crosstalk corrections that are based on a chief ray angle (CRA) correction and the color ratio correction.

Claims

1. An apparatus comprising:

a pixel array;

a color filter array optically coupled to the pixel array, the color filter array including a plurality of tiled minimal repeating units;

processing circuitry coupled to the pixel array to correct fixed pattern noise (FPN) in an image captured by the pixel array, wherein the processing circuitry corrects values of pixels that are part of a correction group, and wherein the corrections comprise a combination of;

a color ratio correction that is based on the ratios of selected colors within each minimal repeating unit of the plurality of minimal repeating units, and

one or more crosstalk corrections that are based on a chief ray angle (CRA) correction and the color ratio correction.

2. The apparatus of claim 1 wherein each of the plurality of minimal repeating units is:

3. The apparatus of claim 2 wherein a, b, and c are each respectively blue, red, and green.

4. The apparatus of claim 1 wherein each of the plurality of minimal repeating units includes a plurality of non-overlapping cells, each having at least two clear filters and at least two filters of a single color selected from a set of three colors, wherein each pixel optically coupled to a clear filter is a clear pixel and each pixel optically coupled to a color filter is a color pixel.

5. The apparatus of claim 4 wherein each of the plurality of minimal repeating units is:

6. The apparatus of claim 5 wherein a, b, and c are each respectively red, blue, and green.

7. The apparatus of claim 5 wherein a, b, and c are each respectively cyan, magenta, and yellow.

8. The apparatus of claim 4 wherein the clear pixels can be classified into a plurality of groups, such that all clear pixels in the same group are surrounded by the same combination of color pixels but clear pixels in different groups are surrounded by different combinations of color pixels.

9. The apparatus of claim 8 wherein the correction group can comprise all of the plurality of groups or less than all of the plurality of groups.

10. The apparatus of claim 4 wherein the color ratio correction is based on the ratio of the average of color pixels in one cell to the average of the clear pixels in the same cell.

11. The apparatus of claim 1 wherein the one or more crosstalk corrections include a vertical crosstalk correction and a horizontal crosstalk correction.

12. The apparatus of claim 11 wherein the correction is a linear combination of the color ratio correction and the one or more crosstalk corrections.

13. A process comprising:

receiving a signal from each pixel in a pixel array optically coupled to a color filter array, the color filter array including a plurality of tiled minimal repeating units;

correcting the signals of pixels that are part one or more correction groups in the pixel array to reduce or eliminate fixed pattern noise (FPN) in an image captured by the pixel array, wherein correcting the signal comprises, for each individual pixel in the array;

determining a color ratio correction for the individual pixel that is based on the ratios of selected colors within each minimal repeating unit of the plurality of minimal repeating units,

determining one or more crosstalk corrections for the individual pixel that are based on a chief ray angle (CRA) correction and the color ratio correction, and

if the individual pixel is part of a correction group, correcting the signal from the individual pixel using a combination of the color ratio correction and the one or more crosstalk corrections.

14. The process of claim 13 wherein each of the plurality of minimal repeating units is:

15. The apparatus of claim 14 wherein a, b, and c are each respectively blue, red, and green.

16. The process of claim 13 wherein each of the plurality of minimal repeating units includes a plurality of non-overlapping cells, each having at least two clear filters and at least two filters of a single color selected from a set of three colors, wherein each pixel optically coupled to a clear filter is a clear pixel and each pixel optically coupled to a color filter is a color pixel.

17. The process of claim 16 wherein each of the plurality of minimal repeating units is:

18. The process of claim 17 wherein a, b, and c are each respectively red, blue, and green.

19. The process of claim 17 wherein a, b, and c are each respectively cyan, magenta, and yellow.

20. The process of claim 16, further comprising classifying the clear pixels into a plurality of groups, such that all clear pixels in the same group are surrounded by the same combination of color pixels but clear pixels in different groups are surrounded by different combinations of color pixels.

21. The process of claim 20 wherein the correction group can comprise all of the plurality of groups or less than all of the plurality of groups.

22. The process of claim 16 wherein the color ratio correction is based on the ratio of the average of color pixels in one cell to the average of the clear pixels in the same cell.

23. The process of claim 13 wherein the one or more crosstalk corrections include a vertical crosstalk correction and a horizontal crosstalk correction.

24. The process of claim 13 wherein the correction is a linear combination of the color ratio correction and the one or more crosstalk corrections.