Reconstruction of color components in digital image processing

• US 20030214594A1
• Filed: 05/14/2002
• Published: 11/20/2003
• Est. Priority Date: 05/14/2002
• Status: Active Grant

• Current Assignee: KWE International, Inc.
• Original Assignee: KWE International, Inc.
• Inventors: Bezryadin, Sergey N.
• Granted Patent: US 6,933,971 B2
• Time in Patent Office: Days
• US Class Current: 348/280
• CPC Class Codes: G06T 3/4015 Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
• CPC Class Codes: H04N 2209/046 Colour interpolation to calculate the missing colour values
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios

Abstract

In some embodiments of the invention, when a color component (e.g. red, green or blue) is reconstructed at a pixel from the intensity values for this component at adjacent pixels, the intensities at the adjacent pixels are assigned weights. Greater weights are assigned to those pixels for which a gradient is smaller. The gradient for each adjacent pixel is indicative of a magnitude of a change of another color component in the direction of the adjacent pixel and/or a magnitude of the rate of change of the other color component in the direction of the adjacent pixel. In some embodiments, the weights are chosen to reduce the impact of noise. In some embodiments, the reconstructed value of a color component is adjusted to incorporate information on color spikes that is carried by another color component.

Claims

1. A digital image processing method comprising reconstructing, by circuitry, a value of a first color component of an image in a first area from values of the first color component in two or more second areas, wherein each second area lies in a corresponding direction from the first area, and each direction is associated with a gradient value indicative of a magnitude of a change of a second color component in that direction and/or a magnitude of a rate of change of the second color component in that direction, and the first color component value in the second area is given a greater weight in the reconstructing operation if the corresponding gradient value is smaller, and is given a smaller weight if the corresponding gradient value is greater, with at least two weights being non-zero weights different from each other.

2. The method of claim 1 wherein there are at least four second areas lying in at least four corresponding different directions, and at least four weights are not zero and are different from each other.

3. The method of claim 1 wherein each weight is directly proportional to:

1/(D+α

)

where D is indicative of the magnitude of the change of the second color component in the corresponding direction between the first area and the corresponding second area and/or the magnitude of the rate of change of the second color component in the corresponding direction between the first area and the corresponding second area; and

α

is a positive value independent of said magnitude.

4. The method of claim 3 wherein α

=M_max* ε

, where;

M_max is the maximum value for the first and second color components; and

ε

is indicative of a relative noise level in a system from which the first and second color components were obtained.

5. The method of claim 1 wherein the reconstructing operation comprises determining by the circuitry an reconstructed value of the first color component according to an equation:

reconstructed value=F1(C1,k)+F2(Δ

C2)

where;

C1 represents the values of the first color component in the second areas;

k represents said weights;

F1(C1, k) is a value of a predetermined function F1 on the values of the first color component in the second areas, wherein each value of the first color component in a second area is taken with its corresponding weight;

F2 is a predetermined increasing function; and

Δ

C2 is the difference between;

(i) a value of the second color component in the first area; and

(ii) a value F1 (C2, k) of the function F1 on values of the second color components and the weights k, wherein each value of the second color component is a value in an area in one of said directions from the first area, and each value of the second color component is taken with the corresponding weight associated with the direction.

6. The method of claim 5 wherein F2(Δ

C2)=q*Δ

C2 where q is a predetermined positive constant.

7. A computer readable medium comprising a plurality of computer instructions for causing a computer processor to perform the method of claim 1.

8. An apparatus comprising digital image processing circuitry for reconstructing a value of a first color component of an image in a first area from values of the first color component in two or more second areas, wherein each second area lies in a corresponding direction from the first area, and each direction is associated with a gradient value indicative of a magnitude of a change of a second color component in that direction and/or a magnitude of a rate of change of the second color component in that direction, wherein in at least one reconstructing operation the circuitry is operable to give a greater weight to a first color component value in a second area if the corresponding gradient value is smaller, and to give a smaller weight if the corresponding gradient value is greater, with at least two weights being non-zero weights different from each other.

9. The apparatus of claim 8 wherein in said one reconstructing operation each weight is directly proportional to:

1/(D+α

)

where D is indicative of the magnitude of the change of the second color component in the corresponding direction between the first area and the corresponding second area and/or the magnitude of the rate of change of the second color component in the corresponding direction between the first area and the corresponding second area; and

α

is a positive value independent of said magnitude.

10. The apparatus of claim 9 further comprising a user operable control for manually adjusting the value α

.

11. The apparatus of claim 8 wherein in said at least one reconstructing operation the circuitry is operable to generate an reconstructed value of the first color component according to an equation:

reconstructed value=F1(C1,k)+F2(Δ

C2)

where;

C1 represents the values of the first color component in the second areas;

k represents said weights;

F1(C1, k) is a value of a predetermined function F1 on the values of the first color component in the second areas, wherein each value of the first color component in a second area is taken with its corresponding weight;

F2 is a predetermined increasing function; and

Δ

C2 is the difference between;

(i) a value of the second color component in the first area; and

(ii) a value F1 (C2, k) of the function F1 on values of the second color components and the weights k, wherein each value of the second color component is a value in an area in one of said directions from the first area, and each value of the second color component is taken with the corresponding weight associated with the direction.

12. The apparatus of claim 11 wherein F2(Δ

C2)=q*Δ

C2 where q is a predetermined positive constant.

13. A digital image processing method comprising reconstructing, by circuitry, a value of a first color component of an image in a first area from values of the first color component in two or more second areas, wherein each second area overlaps a corresponding line originating from the first area, and each line is associated with a gradient value indicative of a magnitude of a change of a second color component along the line and/or a magnitude of a rate of change of the second color component along the corresponding line, and the first color component value in the second area is given a greater weight in the reconstructing operation if the corresponding gradient value is smaller, and is given a smaller weight if the corresponding gradient value is greater, with at least two weights being non-zero weights different from each other.

14. The method of claim 13 wherein each said line is a straight line.

15. The method of claim 14 wherein each weight is directly proportional to:

1/(D+α

)

where D is indicative of the magnitude of the change of the second color component along the corresponding line between the first area and the corresponding second area and/or the magnitude of the rate of change of the second color component along the corresponding line between the first area and the corresponding second area; and

α

is a positive value independent of said magnitude.

16. The method of claim 15 wherein α

=M_max* ε

, where;

M_max is the maximum value for the first and second color components; and

ε

is indicative of a relative noise level in a system from which the first and second color components were obtained.

17. The method of claim 14 wherein the reconstructing operation comprises determining by the circuitry an reconstructed value of the first color component according to an equation:

reconstructed value=F1(C1,k)+F2(Δ

C2)

where;

C1 represents the values of the first color component in the second areas;

k represents said weights;

F1 (C1, k) is a value of a predetermined function F1 on the values of the first color component in the second areas, wherein each value of the first color component in a second area is taken with its corresponding weight;

F2 is a predetermined increasing function; and

Δ

C2 is the difference between;

(i) a value of the second color component in the first area; and

(ii) a value F1 (C2, k) of the function FI on values of the second color components and the weights k, wherein each value of the second color component is a value on one of said lines, and each value of the second color component is taken with the corresponding weight associated with the line.

18. The method of claim 17 wherein F2(Δ

C2)=q*Δ

C2 where q is a predetermined positive constant.

19. A computer readable medium comprising a plurality of computer instructions for causing a computer processor to perform the method of claim 13.

20. A circuit for performing the method of claim 13.

21. An apparatus comprising:

a circuit for performing the method of claim 15;

and

a user operable control for manually adjusting the value a used by the circuit.