Method and apparatus for color interpolation

• US 7,623,163 B2
• Filed: 11/03/2006
• Issued: 11/24/2009
• Est. Priority Date: 08/19/1999
• Status: Expired due to Fees

• Current Assignee: Youliza Gehts BV LLC (Intellectual Ventures LLC)
• Original Assignee: Digital Imaging Systems GmbH
• Inventors: Neter, Sarit
• Primary Examiner(s): Hannett; James M
• Application Number:
  US11/592,798
• Publication Number:
  US 20070052813A1
• Time in Patent Office: 1,117 Days
• Field of Search: 348/222.1, 348/247
• US Class Current: 348/247
• CPC Class Codes: H04N 2209/046 Colour interpolation to calculate the missing colour values
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/443 by reading pixels from selected 2D regions of the array, e.g. for windowing or digital zooming
• CPC Class Codes: H04N 25/445 by skipping some contiguous pixels within the read portion of the array
• CPC Class Codes: H04N 25/46 by combining or binning pixels
• CPC Class Codes: H04N 25/67 applied to fixed-pattern noise, e.g. non-uniformity of response
• CPC Class Codes: H04N 25/683 by defect estimation performed on the scene signal, e.g. real time or on the fly detection
• CPC Class Codes: H04N 25/70 SSIS architectures; Circuits associated therewith

Abstract

This invention is directed to imaging methods and systems for flexibly addressing and processing imaging pixel sensor elements. A novel architecture is described which allows for a highly integrated, low cost imager with high speed performance and good image quality. The imaging system provides on-the-fly color interpolation, color compensation (also called color correction, color maximization or white balance) and/or fixed pattern noise reduction. The hardware and/or software related to on-the-fly color interpolation, color compensation and/or fixed pattern noise reduction may be provided on-chip.

Claims

1. A color imaging system providing on-the-fly color interpolation using analog signals to reconstruct colors during sensor readout, the imaging system comprising:

an array of pixel sensor elements wherein at least part of the array is arranged in rows and columns;

a color filter including a plurality of color filter components organized in a predefined pattern, the color filter overlaying at least a portion of the array;

a readout control circuit coupled to the array wherein the readout control circuit is configured to simultaneously read out values for a group of pixel elements within a first portion of the array, including at least two pixel elements from two different rows and two pixel elements from two different columns and to reconstruct color components for at least a first pixel sensor element and a second pixel sensor element using color information from other pixels elements within at least the first portion of the array while the readout control circuit is reading said first portion of the array and wherein said readout control circuit enables sub-sampling said array by skipping pixel elements along horizontal or vertical directions of said array;

a plurality of color amplifiers for generating a buffered color video signal from said readout pixel elements each corresponding to one of said color filter components wherein each said color amplifier has a programmable gain, said programmable gain is used to provide on-the-fly color interpolation, and wherein said color amplifiers are contained within said array of pixel sensors;

a comparator circuit adapted to compare an address of a pixel sensor element currently being read by the readout control circuit with a stored list of defective pixel sensor addresses; and

at least one delay element for storing at least one previous analog pixel value read by the readout control circuit, wherein if the address of the current pixel sensor element matches a defective pixel address in the stored liet, the readout control circuit reads the previous analog value.

2. The system of claim 1, further comprising:

a first analog line storage unit, the first analog line storage unit being 25 adapted to store a first line readout from the array; and

a second analog line storage unit, the second analog line storage unit being adapted to store a third line readout from the array, wherein the readout control circuit averages a second consecutive line readout from the array with the first line readout stored in the first analog line storage unit to produce a first red-green-blue (RGB) triplet, the readout control circuit averaging a fourth consecutive line readout from the array with the third line readout stored in the second analog line storage unit to produce a second RGB triplet.

3. The system of claim 2, wherein the analog storage units are capacitors.

4. The system of claim 1, wherein the readout control circuit is programmable to read a first pixel element in a first mode and to read a second pixel element in a second mode.

5. The system of claim 1, wherein the pixel sensor elements form a portion of a charge coupled device.

6. The system of claim 1, wherein the pixel sensor elements form a portion of a complementary metal oxide semiconductor device.

7. The system of claim 1, further comprising a first programmable gain amplifier adapted to amplify a first color readout signal a first amount and a second programmable gain amplifier adapted to amplify a second color readout signal a second amount.

8. The system of claim 7, wherein the programmable gain amplifiers are implemented as a separate stage.

9. The system of claim 7, wherein the programmable gain amplifiers are contained within a pixel circuitry of the array.

10. The system of claim 7, wherein the programmable gain amplifiers are within a plurality of column buffers.

11. The system of claim 7, wherein the programmable gain amplifiers have different transfer functions.

12. The system of claim 1, wherein at least a portion of the pixel sensor elements are active.

13. The system of claim 1, wherein at least a portion of the pixel sensor elements are passive.

14. The system of claim 1, wherein at least a first pixel sensor element is associated with a different color filter component than a neighboring pixel sensor element.

15. The system of claim 1, wherein the predefined pattern is a Bayer color configuration.

16. The system of claim 1, wherein the predefined pattern comprises the colors of red, blue and green.

17. The system of claim 1, wherein the predefined pattern comprises the colors of yellow, cyan and magenta.

18. The system of claim 1, further comprising a micro-lenses layer.

19. The system of claim 1, wherein the readout control circuit and the array controller process a first set of pixel sensor elements and then process a second set of pixel sensor elements, such that the second set of pixel sensor elements overlaps a portion of the first set of pixel sensor elements.

20. The system of claim 1, wherein the readout control circuit and the array controller process a first set of pixel sensor elements and then process a second set of pixel sensor elements, such that the second set of pixel sensor elements does not overlap the first set of pixel sensor elements.

21. The system of claim 1, wherein the readout control circuit and the array controller process a first set of pixel sensor elements, skip a second set of pixel sensor elements and process a third set of pixel sensor elements.

22. The system of claim 1, wherein the readout control circuit and the array controller only processes a sub-region of the array of pixel sensor elements.

23. The system of claim 1, further comprising a television coupled to said readout control circuit.

24. The system of claim 1, further comprising a personal computer coupled to said readout control circuit.

25. The system of claim 1, further comprising a monitor coupled to said readout control circuit.

26. The system of claim 1, further comprising a camera coupled to said readout control circuit.