Processing color and panchromatic pixels

• US 8,711,452 B2
• Filed: 09/14/2012
• Issued: 04/29/2014
• Est. Priority Date: 07/28/2005
• Status: Active Grant

• Current Assignee: Omnivision Technologies Incorporated (Will Semiconductor Co., Ltd. Shanghai)
• Original Assignee: Omnivision Technologies Incorporated (Will Semiconductor Co., Ltd. Shanghai)
• Inventors: Hamilton, John F. Jr., Compton, John T.
• Primary Examiner(s): SARPONG, AKWASI
• Application Number:
  US13/618,593
• Publication Number:
  US 20130016250A1
• Time in Patent Office: 592 Days
• Field of Search: 358/518, 358/426.01, 358/445, 358/446, 358/471, 358/498, 358/509, 358/517, 348/277, 348/276, 348/273, 348/340, 382/284, 382/294, 382/273
• US Class Current: 358/512
• CPC Class Codes: H04N 23/84 for processing colour signals
• CPC Class Codes: H04N 25/133 including elements passing panchromatic light, e.g. filters passing white light
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/135 based on four or more different wavelength filter elements

Abstract

A method for forming a final digital color image includes capturing an image using an image sensor having panchromatic pixels and color pixels corresponding to at least two color photoresponses; providing from the captured image a digital panchromatic image and an intermediate digital color image; and using the digital panchromatic image and the intermediate digital color image to provide the final digital color image.

Claims

1. A method for forming a digital color image comprising:

capturing an image using a solid state image sensor having a pixel array that includes both panchromatic pixels and color pixels, wherein the color pixels correspond to at least two color photoresponses and wherein the pixel array is made up of a plurality of tiled minimal repeating units, each minimal repeating unit including a plurality of cells, each cell including at least two panchromatic pixels and at least two pixels having the same color photoresponse, wherein the minimal repeating unit is

2. The method of claim 1 wherein A, B, and C are each respectively red, green, and blue.

3. The method of claim 1 wherein A, B, and C are each respectively cyan, yellow, and magenta.

4. A method for processing a color image captured by an image sensor to permit the effective reproduction of a color image captured under low lighting conditions, comprising:

(a) using a solid state image sensor to capture an image, the image sensor having a pixel array including both panchromatic pixels and color pixels, wherein the color pixels correspond to at least two color photoresponses, and wherein the pixel array is made up of a plurality of tiled minimal repeating units, each minimal repeating unit including a plurality of cells, each cell including at least two panchromatic pixels and at least two pixels having the same color photoresponse, wherein the minimal repeating unit is;

5. The method of claim 4 wherein element (b) includes summing the first signals from the plurality of pixels having the same color photoresponse in each group.

6. The method of claim 5 wherein element (e) includes:

summing pixel values from the high-resolution panchromatic image to produce a low-resolution panchromatic image having the first resolution;

using the low-resolution panchromatic image and the low-resolution partial color image to produce a color difference image; and

using the color difference image and the high-resolution panchromatic image to produce a high-resolution color image.

7. The method of claim 4 wherein element (e) includes:

summing pixel values from the high-resolution panchromatic image to produce a low-resolution panchromatic image having the first resolution;

using the low-resolution panchromatic image and the low-resolution color image to produce a color difference image; and

using the color difference image and the high-resolution panchromatic image to produce a high-resolution color image.

8. The method of claim 4 wherein A, B, and C are each respectively red, green, and blue.

9. The method of claim 4 wherein A, B, and C are each respectively cyan, yellow, and magenta.

10. A method for forming a digital color image comprising:

capturing an image using a solid state image sensor having a pixel array that includes both panchromatic pixels and color pixels, wherein the color pixels correspond to at least two color photoresponses and wherein the pixel array is made up of a plurality of tiled minimal repeating units, each minimal repeating unit including a plurality of cells, each cell including at least two panchromatic pixels and at least two pixels having the same color photoresponse, wherein the minimal repeating pattern is;

11. The method of claim 10 wherein A, B, and C are each respectively red, green, and blue.

12. The method of claim 10 wherein A, B, and C are each respectively cyan, yellow, and magenta.

13. A method for processing a color image captured by an image sensor to permit the effective reproduction of a color image captured under low lighting conditions, comprising:

(a) using a solid state image sensor to capture an image, the image sensor having a pixel array including both panchromatic pixels and color pixels, wherein the color pixels correspond to at least two color photoresponses, and wherein the pixel array is made up of a plurality of tiled minimal repeating units, each minimal repeating unit including a plurality of cells, each cell including at least two panchromatic pixels and at least two pixels having the same color photoresponse, wherein the minimal repeating pattern is;

14. The method of claim 13 wherein element (b) includes summing the first signals from the plurality of pixels having the same color photoresponse in each group.

15. The method of claim 14 wherein element (e) includes:

summing pixel values from the high-resolution panchromatic image to produce a low-resolution panchromatic image having the first resolution;

using the low-resolution panchromatic image and the low-resolution partial color image to produce a color difference image; and

using the color difference image and the high-resolution panchromatic image to produce a high-resolution color image.

16. The method of claim 13 wherein element (e) includes:

summing pixel values from the high-resolution panchromatic image to produce a low-resolution panchromatic image having the first resolution;

using the low-resolution panchromatic image and the low-resolution color image to produce a color difference image; and

using the color difference image and the high-resolution panchromatic image to produce a high-resolution color image.

17. The method of claim 13 wherein A, B, and C are each respectively red, green, and blue.

18. The method of claim 13 wherein A, B, and C are each respectively cyan, yellow, and magenta.