Apparatus and method for adaptively interpolating a full color image utilizing chrominance gradients

• US 5,373,322 A
• Filed: 06/30/1993
• Issued: 12/13/1994
• Est. Priority Date: 06/30/1993
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Laroche, Claude A., Prescott, Mark A.
• Primary Examiner(s): Powell, Mark R.
• Assistant Examiner(s): Cohen, Cheryl
• Application Number:
  US08/085,519
• Time in Patent Office: 531 Days
• Field of Search: 358/41, 358/42, 358/43, 358/44, 358/163, 358/213.15, 358/213.17, 348/266, 348/272, 348/273
• US Class Current: 348/273
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G06T 3/4015 Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
• CPC Class Codes: H04N 2209/046 Colour interpolation to calculate the missing colour values
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements

Abstract

Adaptive interpolation is performed by apparatus operating upon a digitized image signal obtained from an image sensor having color photosites that generate a plurality of color values, but only one color per photosite. A digital processor obtains gradient values from the differences between chrominance values in vertical and horizontal image directions. The gradient values are compared with each other in order to select one of the directions as the preferred orientation for the interpolation of additional luminance values. The interpolation is then performed upon values selected to agree with the preferred orientation.

Claims

1. Apparatus for processing a digitized image signal obtained from an image sensor having color photosites that generate a plurality of color values, but only one color value for each photosite location, said apparatus comprising:

means for storing the digitized image signal;

a processor operative with said storing means for generating a color value missing from a photosite location by the interpolation of an additional color value for such photosite locations from color values at nearby photosite locations, said processor including

means for obtaining gradient values in at least two image directions;

means responsive to the gradient values for selecting a preferred orientation for the interpolation of the additional color values; and

means for interpolating the additional color values for such photosite location from color values at nearby locations selected to agree with the preferred orientation.

2. Apparatus as claimed in claim 1 wherein said gradient values are obtained for two orthogonal image directions.

3. Apparatus as claimed in claim 2 wherein said orthogonal image directions are associated with horizontal and vertical directions in the image.

4. Apparatus as claimed in claim 1 wherein said preferred orientation for the interpolation of additional color values coincides with one of said at least two image directions.

5. Apparatus as claimed in claim 1 wherein said means for obtaining gradient values generates differences between color values oriented in each image direction.

6. Apparatus as claimed in claim 1 wherein said means for selecting a preferred orientation compares the gradient values with each other.

7. Apparatus as claimed in claim 1 wherein said color values include a pattern of chrominance values interspersed in a checkerboard pattern of luminance values.

8. Apparatus for processing a digitized image signal obtained from an image sensor having color photosites that generate a plurality of color values, but only one color value for each photosite location, said apparatus comprising:

means for storing the digitized image signal as a pattern of luminance and chrominance values, wherein some photosite locations lack luminance values;

a processor operative with said storing means for generating an additional luminance value missing from a photosite location by the interpolation of the additional luminance value for such locations from luminance values at nearby photosite locations, said processor including

means for generating gradient values in at least two image directions;

means responsive to the gradient values for selecting a preferred orientation for the interpolation of an additional luminance value; and

means for interpolating the additional luminance value from luminance values selected to agree with the preferred orientation.

9. Apparatus as claimed in claim 8 wherein said gradient values are obtained for two orthogonal image directions.

10. Apparatus as claimed in claim 9 wherein said orthogonal image directions are associated with horizontal and vertical directions in the image.

11. Apparatus as claimed in claim 8 wherein said preferred orientation for the interpolation of additional color values coincides with one of said at least two image directions.

12. Apparatus as claimed in claim 8 wherein said means for obtaining gradient values generates differences between chrominance values oriented in each image direction to obtain chrominance gradients in said directions.

13. Apparatus as claimed in claim 12 wherein said means for selecting a preferred orientation compares the chrominance gradients to each other.

14. Apparatus for processing a digitized image signal obtained from a color image sensor having photosites that generate a pattern of chrominance and luminance values, but only one value for each photosite location, said apparatus comprising:

means for storing the digitized image signal as a pattern of luminance and chrominance values, wherein some photosite locations are chrominance locations lacking luminance values;

a processor operative with the pattern of values in said storing means, said processor generating a luminance value missing from a chrominance location by the interpolation of a missing luminance value for such locations from luminance values at nearby luminance locations, said processor comprising;

means for generating chrominance gradient values from the difference between a pair of chrominance values each oriented in at least two image directions;

means for comparing the chrominance gradient values to each other;

means responsive to the outcome of the gradient comparison for selecting a particular image direction as a preferred orientation for the interpolation of a missing luminance value; and

means for interpolating the missing luminance value from luminance values selected to agree with the preferred orientation.

15. Apparatus as claimed in claim 14 wherein said pattern of luminance and chrominance comprises chrominance values interspersed in a checkerboard pattern of luminance values.

16. Apparatus as claimed in claim 15 wherein said luminance color is green, and said chrominance colors are red and blue.

17. A method for interpolating missing color values from a digitized image signal obtained from a color image sensor having photosites that generate a pattern of chrominance and luminance color values, one value for each photosite location, said method comprising the steps of:

obtaining gradient values from the differences between color values in at least two image directions;

evaluating the gradient values relative to a predetermined criterion;

selecting, based on the step of evaluating the gradient values, a preferred orientation for the interpolation of the missing color values; and

interpolating each missing color value from like color values at nearby locations selected to agree with the preferred orientation.

18. A method as claimed in claim 17 wherein the step of obtaining gradient values obtains said gradient values from the differences between chrominance values in said directions.

19. A method as claimed in claim 17 wherein the missing color values being interpolated are luminance values.