Digital image system and method for combining sensing and image processing on sensor with two-color photo-detector

• US 7,196,829 B2
• Filed: 01/10/2002
• Issued: 03/27/2007
• Est. Priority Date: 01/10/2002
• Status: Active Grant

• Current Assignee: Aptina Imaging Corporation (ON Semiconductor Corporation)
• Original Assignee: Micron Technology, Inc.
• Inventors: Vook, Dietrich W., Baharav, Izhak
• Primary Examiner(s): Lee; Thomas D.
• Assistant Examiner(s): Gibbs; Heather D
• Application Number:
  US10/043,464
• Publication Number:
  US 20030128409A1
• Time in Patent Office: 1,902 Days
• Field of Search: 358513-514, 358/213.11, 358/482, 345/426, 345/593, 382/164, 257/440, 257/458, 257/431, 348272-273
• US Class Current: 358/513
• CPC Class Codes: H04N 1/648 Transmitting or storing the primary (additive or subtractive) colour signals; Compression thereof H04N1/642 - H04N1/646 take precedence
• CPC Class Codes: H04N 2209/045 using mosaic colour filter
• CPC Class Codes: H04N 2209/046 Colour interpolation to calculate the missing colour values
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/11 Arrangement of colour filter arrays [CFA]; Filter mosaics

Abstract

A digital image system is disclosed having a sensor with an elevated two-color photo-detector for sensing two different color values in combination with a single-color photo-detector for sensing a third color value. Minimal demosaicing is performed to obtain at least one luminance value at each photo-detector location. The sampled chrominance values and sampled and demosaiced luminance values are directly compressed without converting between color spaces and with minimal or no processing required. With a reduced amount of image processing prior to image compression, all of the pre-compression image processing may be performed on the image sensor itself instead of on a separate image processing system.

Claims

1. A digital image system, comprising:

a digital image sensor including at least an array of photo-detectors having one or more repeat units therein, each said repeat unit including at least one single-color photo-detector capable of detecting a luminance value and a two-color photo-detector capable of detecting first and second chrominance values; and

interpolation logic connected to receive said detected luminance value and interpolate at least one interpolated luminance value associated with said two-color photo-detector, said interpolation logic being further connected to output said detected luminance value without interpolating said first or second chrominance value associated with said detected luminance value.

2. The system of claim 1, wherein said luminance value is associated with the intensity of light within a first range of wavelengths, said first chrominance value is associated with the intensity of light within a second range of wavelengths and said third chrominance value is associated with the intensity of light within a third range of wavelengths.

3. The system of claim 2, further comprising:

output logic connected to receive said detected luminance value, said detected first and second chrominance values and said interpolated luminance value and output at least one group of color values including four output luminance values, one first output chrominance value and one second output chrominance value, at least one of said four output luminance values being derived from said detected luminance value or said interpolated luminance value, said first output chrominance value being derived from said first chrominance value and said second output chrominance value being derived from said second chrominance value.

4. The system of claim 3, wherein said interpolation logic and said output logic are included within said digital image sensor.

5. The system of claim 3, wherein said four output luminance values, said first output chrominance value and said second output chrominance value are directly compressed with no additional processing.

6. The system of claim 3, further comprising:

chrominance processing logic connected to receive said detected first and second chrominance values and produce said first output chrominance value and said second output chrominance value.

7. The system of claim 6, wherein said chrominance processing logic is capable of subtracting said interpolated luminance value from said first chrominance value to produce said first output chrominance value.

8. The system of claim 6, wherein said chrominance processing logic is further connected to receive additional detected first and second chrominance values, said chrominance processing logic averaging said detected first chrominance value and said additional detected first chrominance value to produce said first output chrominance value and averaging said detected second chrominance value with said additional detected second chrominance value to produce said second output chrominance value.

9. The system of claim 3, wherein said single-color photo-detector for said repeat unit comprises a first single-color photo-detector capable of detecting a first luminance value and a second single-color photo-detector capable of detecting a second luminance value.

10. The system of claim 9, wherein said at least one interpolated luminance value comprises a single interpolated luminance value associated with said two-color photo-detector.

11. The system of claim 9, wherein said at least one interpolated luminance value comprises first and second interpolated luminance values associated with said two-color photo-detector.

12. The system of claim 11, wherein said four output luminance values are derived from said first and second interpolated luminance values and said first and second detected luminance values.

13. The system of claim 3, wherein said single-color photo-detector for said repeat unit comprises a first single-color photo-detector capable of detecting a first luminance value, a second single-color photo-detector capable of detecting a second luminance value and a third single-color photo-detector capable of detecting a third luminance value.

14. The system of claim 13, wherein said four output luminance values are derived from said first, second and third detected luminance values and said interpolated luminance value.

15. A digital image system, comprising:

a digital image sensor including at least an array of photo-detectors having one or more repeat units therein, each said repeat unit including at least one single-color photo-detector capable of detecting a luminance value and a two-color photo-detector capable of detecting first and second chrominance values; and

interpolation logic connected to receive said detected luminance value and interpolate at least one interpolated luminance value associated with said two-color photo-detector, said interpolation logic being further connected to assign said first and second chrominance values to said detected luminance value and output said detected luminance value and said first and second chrominance values.

16. The system of claim 15, wherein said luminance value is associated with the intensity of light within a first range of wavelengths, said first chrominance value is associated with the intensity of light within a second range of wavelengths and said third chrominance value is associated with the intensity of light within a third range of wavelengths.

17. The system of claim 16, further comprising:

output logic connected to receive said detected luminance value, said detected first and second different chrominance values and said interpolated luminance value and output at least one group of color values including four output luminance values, one first output chrominance value and one second output chrominance value, at least one of said four output luminance values being derived from said detected luminance value or said interpolated luminance value, said first output chrominance value being derived from said first chrominance value and said second output chrominance value being derived from said second chrominance value.

18. The system of claim 17, wherein said interpolation logic and said output logic are included within said digital image sensor.

19. The system of claim 17, wherein said four output luminance values, said first output chrominance value and said second output chrominance value are directly compressed with no additional processing.

20. The system of claim 17, further comprising:

chrominance processing logic connected to receive said detected first and second chrominance values and produce said first output chrominance value and said second output chrominance value.

21. The system of claim 20, wherein said chrominance processing logic is capable of subtracting said interpolated luminance value from said first chrominance value to produce said first output chrominance value.

22. The system of claim 20, wherein said chrominance processing logic is further connected to receive additional detected first and second chrominance values, said chrominance processing logic averaging said detected first chrominance value and said additional detected first chrominance value to produce said first output chrominance value and averaging said detected second chrominance value with said additional detected second chrominance value to produce said second output chrominance value.

23. A method for processing raw digital color image values, comprising:

providing an array of photo-detectors on a digital image sensor, said array of photo-detectors having one or more repeat units therein, each said repeat unit including at least one single-color photo-detector capable of detecting a luminance value and a two-color photo-detector capable of detecting first and second chrominance values;

interpolating at least one interpolated luminance value associated with said two-color photo-detector; and

processing said detected luminance value without interpolating said first or second chrominance value associated with said detected luminance value.

24. The method of claim 23, further comprising:

outputting at least one group of color values including four output luminance values, one first output chrominance value and one second output chrominance value, at least one of said four output luminance values being derived from said detected luminance value or said interpolated luminance value, said first output chrominance value being derived from said first chrominance value and said second output chrominance value being derived from said second chrominance value.

25. The method of claim 24, further comprising:

compressing said four output luminance values, said first output chrominance value and said second output chrominance value directly with no additional processing.

26. The method of claim 24, further comprising:

subtracting said interpolated luminance value from said detected first chrominance value to produce said first output chrominance value.

27. The method of claim 23, further comprising:

detecting additional first and second chrominance values;

averaging said detected first chrominance value and said detected additional first chrominance value to produce said first output chrominance value; and

averaging said detected second chrominance value with said detected additional second chrominance value to produce said second output chrominance value.