Localized image recoloring using ellipsoid boundary function

• US 5,130,789 A
• Filed: 12/13/1989
• Issued: 07/14/1992
• Est. Priority Date: 12/13/1989
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Dobbs, Christopher M., Goodwin, Robert M.
• Primary Examiner(s): BRINICH, STEPHEN M
• Application Number:
  US07/449,163
• Time in Patent Office: 944 Days
• Field of Search: 358/75, 358/80, 358/76, 358/77, 358/78
• US Class Current: 358/500
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/624 Red-eye correction control of camera based on recognised facial parts H04N23/611

Abstract

A mechanism for recoloring a color image defines a spatial region within the image (such as the pupil of the eye) a color characteristic of which (e.g. the `red-eye` phenomenon) is to be selectively modified. To determine whether the color of an image sample within a spatial region is to be modified, the value of the chrominance component of each sample within the region is compared with a regularly shaped (e.g. elliptical) chrominance variation discriminator that surrounds a target color of interest (e.g. red, in the case of a `red-eye` correction). The major axis of the ellipse coincides with the saturation direction of the chrominance plane and its minor axis coincides with the hue direction. For each sampling location within the spatial region, the value of the chrominance component is examined to determine whether it falls within the elliptical chrominance discriminator. If the value of the chrominance component falls within the ellipse, it is modified to a destination chrominance value, based upon where the chrominance value of the sampled of interest falls, so as to soften the color at its edges. The luminance component is modified by an offset based upon the difference in the value of the luminance component of the target color and that of the new color. This luminance value difference is weighted in accordance with the product of the previously determined chrominance weighting coefficient and a prescribed relationship between the geometrical location of the luminance component for the sample of interest and the extent of a prescribed range of luminance variation projected from the elliptical discriminator along the luminance axis of the Y,I,Q coordinate system.

Claims

1. A method of controllably modifying a color characteristic of a colored image that has been spatially sampled to obtain a plurality of color-representative data values, each of which is associated with a respective sampling location within said image comprising the steps of:

(a) defining a region within said image whereat a color characteristic may be selectively modified;

(b) forming a visual representation of a color variation characteristic that is bounded by a regular geometric shape, surrounding a target color;

(c) for each sampling location within said region, identifying whether or not the color represented by its associated data value is located within the regular geometrical shape of the color variation characteristic defined in step (b); and

(d) for a sampling location, the color-representative data value for which has been identified in step (c) as being located within said regular geometrical shape, modifying its identified color-representative data value to a value that is representative of a `destination` color.

2. A method according to claim 1, wherein said color variation characteristic is geometrically centered at said target color.

3. A method according to claim 2, wherein said target color is determined in accordance with a prescribed relationship among the color-representative data values associated with plural spatial sampling locations within said region and said regular geometrical shape.

4. A method according to claim 3, wherein said color variation characteristic is geometrically centered at a target color corresponding to the average of the color-representative data values associated with selected spatial sampling locations within said region and said regular geometrical shape.

5. A method according to claim 4, wherein step (b) comprises the steps of:

(b1) determining a first average of a plurality of color-representative data values, for a specified spatial location within said region and a plurality of spatial sampling locations surrounding said selected spatial location and geometrically centering said color variation characteristic at a color corresponding to said first average;

(b2) determining a second average of color-representative data values associated with all of the spatial sampling locations within said region and said regular geometrical shape;

(b3) substituting said second average of color-representative data values for said first average so as to recenter said color variation characteristic at a color corresponding to said second average;

(b4) repeating steps (b2) and (b3) until the difference between successive average iterations is less than a preselected value; and

(b5) defining said target color as the center of said color variation characteristic that was last recentered in step (b3).

6. A method according to claim 5, wherein each of said first and second averages is a respective weighted average.

7. A method according to claim 6, wherein, for each weighted average determined in step (b2), the geometrical shape of said color variation characteristic is defined in accordance with a prescribed set of geometry-defining parameters.

8. A method according to claim 6, wherein, for each weighted average determined in step (b2), the size of said color variation characteristic is adjusted, as necessary, to encompass a preselected number of spatial sampling locations within said average.

9. A method according to claim 1, wherein said color variation characteristic is an elliptically shaped chrominance variation characteristic, the major axis of which coincides with the saturation direction of a chrominance coordinate system and the minor axis of which coincides with a direction orthogonal to the saturation direction of said chrominance coordinate system.

10. A method according to claim 9, wherein the intersection of the major and minor axes of said elliptically shaped chrominance variation characteristic coincides with the origin of said chrominace coordinate system, centered at said target color.

11. A method according to claim 1, wherein step (d) comprises modifying said identified color-representative data value to said `destination` color representative value in accordance with a prescribed relationship between the location of said identified color data value within said color variation characteristic and the perimeter of said regular geometrical shape.

12. A method according to claim 11, wherein step (d) comprises the steps of

(d1) for a sampling location the color-representative data value for which has been identified in step (c) as lying within said regular geometrical shape, specifying a color representative value that is representative of said `destination` color, and

(d2) adjusting the `destination` color representative value specified in step (d1) in accordance with a prescribed relationship between the geometrical location of said identified color data value within said regular geometrical shape and the border of said prescribed regular geometrical shape.

13. A method according to claim 12, wherein said color variation characteristic is a an elliptically shaped chrominance variation characteristic, the major axis of which coincides with the saturation direction of a chrominance coordinate system and the minor axis of which coincides with a direction orthogonal to the saturation direction of said chrominance coordinate system.

14. A method according to claim 13, wherein the intersection of the major and minor axes of said elliptically shaped chrominance variation characteristic coincides with the origin of said chrominance coordinate system centered at said target color.

15. A method according to claim 12, wherein step (d2) includes adjusting the value of the chrominance of said `destination` color specified in step (d1) by a chrominance weight that is established in accordance with a prescribed relationship between the geometrical location of said identified color data value within said regular geometrical shape and the border of said regular geometrical shape, and defining the value of the luminance of said `destination` color specified in step (d1) in accordance with said chrominance weight.

16. A method according to claim 15, wherein step (d2) includes the step of defining the value of the luminance of said `destination` color specified in step (d1) as the value of the luminance of said image at said identified sampled location, modified by an offset based upon the difference in luminance of said target color and said `destination` color, said difference in luminance being weighted in accordance with said chrominance weight and a luminance weight that is established in accordance with a prescribed relationship between the geometrical location of said identified color data value and the extent of a prescribed range of luminance variation projected from said regular geometrical shape.

17. A method according to claim 1, wherein step (b) comprises the step of defining said color variation characteristic in terms of a chrominance coordinate system the origin of which is centered at said target color, said color variation characteristic having a regular geometrical shape that is centered about the origin of said chrominance coordinate system.

18. A method according to claim 17, wherein step (c) comprises, for each sampling location within said region, defining the color represented by its associated data value in terms of chrominance and luminance components, and identifying whether or not the its chrominance components lies within the regular geometrical shape of the color variation characteristic defined in step (b).

19. A method according to claim 18, wherein step (d) comprises, for a sampling location the chrominance component of the color-representative data value for which has been identified in step (c) as lying within said regular geometrical shape, modifying the value of the chrominance component thereof to a chrominance value that is associated with of a `destination` color.

20. A method according to claim 19, wherein step (d) comprises the steps of

(d1) for a sampling location the chrominance component for which has been identified in step (c) as lying within said regular geometrical shape, specifying a chrominance value that is associated with said `destination` color, and

(d2) adjusting the `destination` color associated chrominance value specified in step (d1) in accordance with a prescribed relationship between the geometrical location of said identified chrominance component within said regular geometrical shape and the border of said prescribed regular geometrical shape.

21. A method according to claim 20, wherein step (d2) includes adjusting the value of the chrominance component of said `destination` color specified in step (d1) by a chrominance weight that is established in accordance with a prescribed relationship between the geometrical location of said identified chrominance component within said regular geometrical shape and the border of said regular geometrical shape, and defining the value of the luminance component of said `destination` color specified in step (d1) in accordance with said chrominance weight.

22. A method according to claim 21, wherein step (d2) includes the step of defining the value of the luminance component of said `destination` color specified in step (d1) as the value of the luminance component of said image at said identified sampled location, modified by an offset based upon the difference in the value of the luminance component of said target color and that of said `destination` color, said luminance value difference being weighted in accordance with said chrominance weight and a luminance weight that is established in accordance with a prescribed relationship between the geometrical location of the luminance component that is associated with said identified chrominance component location and the extent of a prescribed range of luminance variation projected from said regular geometrical shape.

23. A method according to claim 22, wherein said color variation characteristic is a an elliptically shaped chrominance variation characteristic, the major and minor axes of which intersect at the origin of said chrominance coordinate system, and wherein said major axis coincides with the saturation direction of said chrominance coordinate system and said minor axis coincides with a direction orthogonal to the saturation direction of said chrominance coordinate system.

24. A color image processing system comprising:

an image converter for generating a plurality of output signals representative of color characteristics of a plurality of spatial locations within a color image, prescribed color characteristics of which are to be controllably modified;

a digital converter coupled to receive the output signals from said image converter and generating a plurality of digital code signals, respectively representative of the color characteristics of said image at said plurality of spatial locations; and

a digital signal processor which receives digital codes generated by said digital converter and controllably modifies selected ones of said digital codes so as to effect a modification of a color characteristic of said color image in accordance with a program through which the following steps (a)-(d) are executed;

(a) defining a spatial region within said image whereat a color characteristic may be selectively modified;

(b) forming a visual representation of a color variation characteristic that is bounded by a regular geometric shape, surrounding a target color;

(c) for each sampling location within said spatial region, identifying whether or not the color represented by its associated digital code is located within the regular geometrical shape of the color variation characteristic defined in step (b); and

(d) for a sampling location, the digital code for which has been identified in step (c) as being representative of a color located within said regular geometrical shape, modifying its identified digital code to a changed digital code which is representative of a `destination` color.

25. A system according to claim 24, wherein said color variation characteristic is an elliptically shaped chrominance variation characteristic, the major axis of which coincides with the saturation direction of a chrominance coordinate system and the minor axis of which coincides with a direction orthogonal to the saturation direction of said chrominance coordinate system.

26. A system according to claim 25, wherein the intersection of the major and minor axes of said elliptically shaped chrominance variation characteristic coincides with the origin of said chrominance coordinate system, centered at said target color.

27. A system according to claim 24, wherein step (d) comprises modifying said identified digital code to said changed code in accordance with a prescribed relationship between the location of the color represented by said digital code within said color variation characteristic and the perimeter of said regular geometrical shape.

28. A system according to claim 27, wherein step (d) comprises the steps of

(d1) for a sampling location the color represented by the digital code for which has been identified in step (c) as lying within said regular geometrical shape, specifying a color representative digital code that is representative of said `destination` color, and

(d2) adjusting said `destination` color representative digital code specified in step (d1) in accordance with a prescribed relationship between the geometrical location of said identified color within said regular geometrical shape and the border of said prescribed regular geometrical shape.

29. A system according to claim 28, wherein said color variation characteristic is a an elliptically shaped chrominance variation characteristic, the major axis of which coincides with the saturation direction of a chrominance coordinate system and the minor axis of which coincides with a direction orthogonal to the saturation direction of said chrominance coordinate system.

30. A system according to claim 29, wherein the intersection of the major and minor axes of said elliptically shaped chrominance variation characteristic coincides with the origin of said chrominance coordinate system centered at said target color.

31. A system according to claim 28, wherein step (d2) includes adjusting the value of the chrominance of said `destination` color specified in step (d1) by a chrominance weight that is established in accordance with a prescribed relationship between the geometrical location the identified color within said regular geometrical shape and the border of said regular geometrical shape, and defining the value of the luminance of said `destination` color specified in step (d1) in accordance with said chrominance weight.

32. A system according to claim 31, wherein step (d2) includes the step of defining the value of the luminance of said `destination` color specified in step (d1) as the value of the luminance of said image at said identified sampled location, modified by an offset based upon the difference in luminance of said target color and said `destination` color, said difference in luminance being weighted in accordance with said chrominance weight and a luminance weight that is established in accordance with a prescribed relationship between the geometrical location of said identified color and the extent of a prescribed range of luminance variation projected from said regular geometrical shape.

33. A system according to claim 24, wherein step (b) comprises the step of defining said color variation characteristic in terms of a chrominance coordinate system the origin of which is centered at said target color, said color variation characteristic having a regular geometrical shape that is centered about the origin of said chrominance coordinate system.

34. A system according to claim 24, wherein step (c) comprises, for each sampling location within said spatial region, defining the color represented by its associated digital code in terms of chrominance and luminance components, and identifying whether or not the its chrominance component lies within the regular geometrical shape of the color variation characteristic defined in step (b).

35. A system according to claim 34, wherein step (d) comprises, for a sampling location the chrominance component of the color value represented by the digital code for which has been identified in step (c) as lying within said regular geometrical shape, modifying the value of the chrominance component thereof to a chrominance value that is associated with of a `destination` color.

36. A system according to claim 35, wherein step (d) comprises the steps of

(d1) for a sampling location the chrominance component for which has been identified in step (c) as lying within said regular geometrical shape, specifying a chrominance code that is associated with said `destination` color, and

(d2) adjusting the `destination` color associated chrominance code specified in step (d1) in accordance with a prescribed relationship between the geometrical location of said identified chrominance component within said regular geometrical shape and the border of said prescribed regular geometrical shape.

37. A system according to claim 36, wherein step (d2) includes adjusting the value of the chrominance component of said `destination` color specified in step (d1) by a chrominance weight that is established in accordance with a prescribed relationship between the geometrical location of said identified chrominance component within said regular geometrical shape and the border of said regular geometrical shape, and defining the value of the luminance component of said `destination` color specified in step (d1) in accordance with said chrominance weight.

38. A system according to claim 37, wherein step (d2) includes the step of defining the code value of the luminance component of said `destination` color specified in step (d1) as the code value of the luminance component of said image at said identified sampled location, modified by an offset based upon the difference in the value of the luminance component of said target color and that of said `destination` color, said luminance value difference being weighted in accordance with said chrominance weight and a luminance weight that is established in accordance with a prescribed relationship between the geometrical location of the luminance component that is associated with said identified chrominance component location and the extent of a prescribed range of luminance variation projected from said regular geometrical shape.

39. A system according to claim 38, wherein said color variation characteristic is a an elliptically shaped chrominance variation characteristic, the major and minor axes of which intersect at the origin of said chrominance coordinate system, and wherein said major axis coincides with the saturation direction of said chrominance coordinate system and said minor axis coincides with a direction orthogonal to the saturation direction of said chrominance coordinate system.

40. A system according to claim 24, wherein said color variation characteristic is geometrically centered at said target color.

41. A system according to claim 40, wherein said target color is determined in accordance with a prescribed relationship among the color-representative data values associated with plural spatial sampling locations within said region and said regular geometrical shape.

42. A system according to claim 41, wherein said color variation characteristic is geometrically centered at a target color corresponding to the average of the color-representative data values associated with selected spatial sampling locations within said region and said regular geometrical shape.

43. A system according to claim 42, wherein step (b) comprises the steps of:

(b1) determining a first average of a plurality of color-representative data values, for a specified spatial location within said region and a plurality of spatial sampling locations surrounding said selected spatial location and geometrically centering said color variation characteristic at a color corresponding to said first average;

(b2) determining a second average of color-representative data values associated with all of the spatial sampling locations within said region and said regular geometrical shape;

(b3) substituting said second average of color-representative data values for said first average so as to recenter said color variation characteristic at a color corresponding to said second average;

(b4) repeating steps (b2) and (b3) until the difference between successive average iterations is less than a preselected value; and

(b5) defining said target color as the center of said color variation characteristic that was last recentered in step (b3).

44. A system according to claim 43, wherein each of said first and second averages is a respective weighted average.

45. A system according to claim 44, wherein, for each weighted average determined in step (b2), the geometrical shape of said color variation characteristic is defined in accordance with a prescribed set of geometry-defining parameters.

46. A system according to claim 44, wherein, for each weighted average determined in step (b2), the size of said color variation characteristic is adjusted, as necessary, to encompass a preselected number of spatial sampling locations within said average.