Interpolating operation method and apparatus for color image signals

• US 6,175,430 B1
• Filed: 07/01/1998
• Issued: 01/16/2001
• Est. Priority Date: 07/02/1997
• Status: Expired due to Term

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Ito, Wataru
• Primary Examiner(s): Coles, Edward L.
• Assistant Examiner(s): WALLERSON, MARK E
• Application Number:
  US09/108,196
• Time in Patent Office: 930 Days
• Field of Search: 358/448, 358/463, 358/518, 358/520, 358/525, 348/272, 348/273, 348/222, 348/242, 348/234, 348/235, 348/237, 348/663, 382/162
• US Class Current: 358/525
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G06T 3/4015 Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
• CPC Class Codes: H04N 1/56 Processing of colour picture signals H04N1/52 takes precedence

Abstract

To obtain an interpolating operation apparatus which provides an interpolation image in which the sharpness in kept high and noise due to hue variations is kept small after the interpolating operation.

For a primary image signal Sorg (R, G, B) which is inputted into an interpolating operation apparatus 30, R, G, and B color signal components, which represent each of picture elements in a color image represented by an orignal image signal, are converted into YCC luminance and color difference signal components through a first signal conversion means 31. With a cubic spline interpolating operation means 32, an interpolated luminance signal component Y′ is obtained with respect to luminance signal components Y. With a B spline interpolating operation means 33, interpolated color difference signal components C1′ and C2′ are obtained with respect to color difference signal component C1 and C2. Then, the interpolated luminance signal component Y′ and the interpolated color difference signal components C1′ and C2′ are converted into interpolated color signal components R′, G′, and B′ through a second signal conversion means 34, whereby an interpolated image signal S′ (R′, G′, B′) is obtained.

Claims

1. An interpolating operation method for a color image signal composed of image signal components representing picture elements in a color image, the method comprising the steps of:

i) converting original R, G, and B color signal components, representing each of the picture elements of the original image signal, into a luminance signal component and a color difference signal component for each of the picture elements;

ii) obtaining an interpolated luminance signal component from the converted luminance signal component by employing a first interpolating procedure for enhancing sharpness of the interpolated luminance signal components;

iii) obtaining an interpolated color difference signal component from the converted color difference signal component by employing a second interpolating procedure for enhancing stability of the interpolated color difference signal components; and

iv) converting said interpolated luminance signal component and said interpolated color difference signal component into supplemental R, G, and B color signal components to obtain an interpolation image signal, composed of said supplemental R,G, and B color signal components, for supplementing the original R, G, and B signal components.

2. A method as defined in claim 1 wherein said first interpolating procedure comprises a process utilizing a cubic spline interpolating operation, and said second procedure comprises a process utilizing a B spline interpolating operation.

3. An interpolating operation method for a color image signal composed of image signal components representing picture elements in a color image, the method comprising the steps of:

i) converting original R, G, and B color signal components, representing each of the picture elements of the original image signal, into a luminance signal component and a color difference signal component for each of the picture elements;

ii) obtaining an interpolated luminance signal component from the converted luminance signal component by;

a) employing one interpolating procedure for enhancing stability of the interpolated luminance signal components with regard to particular ones of the picture elements representing flesh color in the original color image, and

b) employing another interpolating procedure for enhancing sharpness of the interpolated luminance signal components with regard to remaining ones of the picture elements other than the picture elements representing flesh color in the original color image,

iii) obtaining an interpolated color difference signal component from the converted color difference signal component by employing an interpolating operation procedure for enhancing stability of the interpolated color difference signal components; and

iv) converting said interpolated luminance signal component and said interpolated color difference signal component into supplemental R, G, and B color signal components to obtain an interpolation image signal, composed of said supplemental R, G, and B color signal components, for supplementing the original R, G, and B signal components.

4. A method as defined in claim 3 wherein said first interpolating procedure comprises a process utilizing a cubic spline interpolating operation, and said second interpolating procedure comprises a process utilizing a B spline interpolating operation.

5. An interpolating operation apparatus for a color image signal composed of image signal components representing picture elements in a color image, the apparatus comprising:

i) a first converter for converting original R, G, and B color signal components, representing each of the picture elements of the original image signal, into a luminance signal component and a color difference signal component, for each of the picture elements;

ii) an interpolator accepting input of the converted luminance and color difference signals and outputting;

an interpolated luminance signal component by employing a first interpolating procedure for enhancing estimated sharpness of the interpolated luminance signal component; and

an interpolated color difference signal component by employing a second interpolating procedure for enhancing stability of the interpolated color difference signal component; and

iii) a second converter for converting said interpolated luminance signal component and said interpolated color difference signal component into supplemental R, G, and B color signals, to obtain an interpolation image signal, composed of said supplemental R, G, and B color signal components, for supplementing the original R, G, and B signal components.

6. An apparatus as defined in claim 5 wherein the interpolator of said luminance and color difference signals employs a cubic spline interpolating operation as said first interpolating procedure and employs a B spline interpolating operation as said second interpolating procedure.

7. An interpolating operation apparatus for a color image signal composed of image signal components representing picture elements in a color image, the apparatus comprising:

i) a first converter for converting original R, G, and B color signal components, representing each of the picture elements of the original image signal, into a luminance signal component and a color difference signal component for each of the picture elements;

ii) an interpolator accepting an input of the converted luminance and color difference signals and outputting an interpolated luminance signal component by;

a) employing one interpolating procedure for enhancing stability of the interpolated luminance signal components with regard to particular ones of the picture elements representing flesh color in the original color image, and

b) employing another interpolating procedure for enhancing sharpness of the interpolated luminance signal components with regard to remaining ones of the picture elements other than the picture elements representing flesh color among the picture elements in the color image, and

obtaining an interpolated color difference signal component from the converted color difference signal component by employing an interpolating operation, and

iii) a second converter for converting said interpolated luminance signal component and said interpolated color difference signal component into supplemental R, G, and B color signal components to obtain an interpolation image signal, composed of said supplemental R, G, and B color signal components.

8. An apparatus as defined in claim 7 wherein said luminance and color difference signals interpolating operation means employs a cubic spline interpolating operation as said interpolating operations process, which attaches importance to sharpness, and employs a B spline interpolating operation as said interpolating operation process, which attaches importance to stability.

9. A method for processing a color image composed of pixels, the method comprising the steps of:

separating an original image signal of the color image into a luminance signal component for each pixel and color difference signal components associated with corresponding primary colors for each pixel;

interpolating the separated luminance signal component in accordance with a first interpolating procedure for enhancing sharpness of the interpolated luminance signal components;

interpolating the separated color difference signal components in accordance with a second interpolating procedure for enhancing stability of the interpolated color difference signal components; and

converting said interpolated luminance signal component and said interpolated color difference signal components into a supplemental image signal, for supplementing the original image signal to improve resolution of a resultant image composed of the supplemental image signal and the original image signal.

10. The method according to claim 9 wherein the first interpolation procedure is applied to the luminance signal components of pixels that are not associated with flesh color of the original image.

11. The method according to claim 9 wherein the first interpolation procedure includes employing one interpolating procedure for enhancing stability of the interpolated luminance signal components with regard to particular ones of the picture elements representing flesh color in the original color image, and employing another interpolating procedure for enhancing sharpness of the interpolated luminance signal components with regard to remaining ones of the picture elements other than the picture elements representing flesh color in the original color image.

12. The method according to claim 9 wherein the first procedure comprises a cubic spline interpolation operation.

13. The method according to claim 12 wherein the second procedure comprises a B spline interpolation operation.

14. The method according to claim 9 wherein the first procedure emphasizes discontinuity of the signal values of the separated luminance signal components for different pixels in the original image signal.

15. The method according to claim 9 wherein the second procedure emphasizes continuity of the signal values of the separated color difference signal components for different pixels in the original image signal.

16. The method according to claim 9 wherein the primary colors represent red, green, and blue.

17. A system for processing a color image composed of pixels, the system comprising:

a separator for separating an original image signal of the color image into a luminance signal component for each pixel and color difference signal components associated with corresponding primary colors for each pixel;

a first interpolator for interpolating the separated luminance signal component in accordance with a first interpolating procedure for enhancing sharpness of the interpolated luminance signal components;

a second interpolator for interpolating the separated color difference signal components in accordance with a second interpolating procedure for enhancing stability of the interpolated color difference signal components; and

a converter for converting said interpolated luminance signal component and said interpolated color difference signal components into a supplemental image signal, for supplementing the original image signal to improve resolution of a resultant image signal composed of the original image signal and the supplemental image signal.

18. The system according to claim 17 wherein the first interpolator interpolates the luminance signal components of pixels that are not associated with flesh color of the original image.

19. The system according to claim 17 wherein the first procedure comprises a cubic spline interpolation operation.

20. The system according to claim 19 wherein the second procedure comprises a B spline interpolation operation.

21. The system according to claim 17 wherein the first procedure emphasizes discontinuity of the signal values of the separated luminance signal components for different pixels in the original image signal.

22. The system according to claim 17 wherein the second procedure emphasizes continuity of the signal values of the separated color difference signal components for different pixels in the original image signal.

23. The system according to claim 17 wherein the primary colors represent red, green, and blue.