Method and apparatus to automatically enhance the quality of digital images by measuring grain trace magnitudes

• US 6,792,162 B1
• Filed: 04/18/2000
• Issued: 09/14/2004
• Est. Priority Date: 08/20/1999
• Status: Expired due to Fees

• Current Assignee: Kodak Alaris Inc (KPP (no. 2) Trustees Ltd.)
• Original Assignee: Eastman Kodak Company
• Inventors: Edgar, Albert D.
• Primary Examiner(s): Johns, Andrew W.
• Application Number:
  US09/551,486
• Time in Patent Office: 1,610 Days
• Field of Search: 382/100, 382/112, 382/254, 382/275, 382/286, 348/96
• US Class Current: 382/275
• CPC Class Codes: G06T 2207/10008 from scanner, fax or copier
• CPC Class Codes: G06T 2207/20056 Discrete and fast Fourier transform, [DFT, FFT]
• CPC Class Codes: G06T 2207/20204 Removing film grain; Adding simulated film grain
• CPC Class Codes: G06T 5/10 using non-spatial domain filtering
• CPC Class Codes: G06T 5/70 Denoising; Smoothing

Abstract

One aspect of the invention is a method of automatically enhancing a digital image. The magnitudes of grain traces are measured in at least two segments in the digital negative and the digital negative is enhanced using the magnitudes of the grain traces measured in the at least two segments.

Claims

1. A method of automatically enhancing a digital image comprising the steps of:

measuring magnitudes of grain traces in at least two segments in the digital image; and

altering the digital image using the magnitudes of the grain traces measured in at least the two segments.

2. The method of claim 1, wherein the measurement of the grain traces further comprises measuring the magnitude of the grain traces as a function of intensity and deriving a function relating the magnitude of the grain traces to intensity.

3. The method of claim 2, wherein the step of measuring the magnitude of the grain traces is further characterized as measuring the magnitude of high frequency components of the grain traces.

4. The method of claim 2, wherein the measurement of the grain traces further comprises the step of subdividing the digital image into a plurality of segments, including at least a first and a second segment.

5. The method of claim 4, wherein the first and second segments overlap.

6. The method of claim 4, wherein the measurement of grain magnitude includes the step of measuring the grain magnitude in the first segment.

7. The method of claim 6, wherein the digital image within the first and second segments is further characterized as containing a mix of grain traces and image.

8. The method of claim 7, wherein the measurement of the grain traces further includes the step of segregating the grain traces from the image in spatial frequency.

9. The method of claim 7:

wherein the first segment is further characterized as containing information from at least a first and second color channel; and

wherein the measurement of grain traces is a function of the relationship between the color channels.

10. The method of claim 9, wherein the relationship between color channels includes a cross-correlation.

11. The method of claim 10:

wherein the first and second segments have similar intensities; and

wherein the segment with the lowest correlation is given a greater weight ascribed to that intensity.

12. The method of claim 10:

wherein overall signal magnitude is the combination of image magnitude and grain trace magnitude; and

wherein the magnitude of the correlation is functionally subtracted from the overall signal magnitude to provide an estimate of the portion of the signal magnitude ascribed to the magnitude of the grain traces.

13. The method of claim 2, wherein the step of enhancing the digital image further comprises the step of depriving a contrast curve to give substantially equal grain trace magnitudes for at least a selected first and second intensity.

14. The method of claim 13, wherein the step of deriving the contrast curve further includes the step of setting the contrast curve such that the ration of contrast between the first and second intensities is inversely proportional to the ratio of measured grain traces at the first and second intensity levels.

15. The method of claim 14:

wherein the image is further characterized as containing information from a first and second color channel; and

wherein a first and second contrast curve are separately derived based on the magnitude of the grain traces in the first and second color channels.

16. The method of claim 15, wherein the step of enhancing the digital image further comprises the step of reducing a perceived effect of the grain traces.

17. The method of claim 1, wherein the measurement of the grain traces further comprises measuring the magnitude of the grain traces as a function of frequency and deriving a function relating the magnitude of the grain traces to frequency.

18. The method of claim 17, wherein the measurement of the grain traces further comprises the step of subdividing the digital image into a plurality of segments, including at least a first and a second segment.

19. A method of claim 18, wherein the first and second segments overlap.

20. The method of claim 18:

wherein the first and second segments have similar intensities; and

wherein the measurement of grain strength for that intensity includes a weighted average of the first and second segments.

21. The method of claim 20, wherein the weighted average is a median.

22. The method of claim 20, wherein the weights of the first and second segments are inversely related to the measured grain trace magnitude of each segment.

23. The method of claim 20:

wherein the first segment is further characterized as containing information from at least a first and second color channel; and

wherein the measurement of grain traces is a function of the relationship between the color channels.

24. The method of claim 23, wherein the relationship between color channels includes a cross-correlation.

25. The method of claim 24, wherein the weighted average is an inversely proportional function of the cross-correlation.

26. The method of claim 17, wherein the step of enhancing the digital image further comprises the step of deriving a frequency boost curve to give substantially equal grain trace magnitudes for at least a selected first and second frequency.

27. The method of claim 26, wherein the step of deriving the frequency boost curve further includes the step of setting the frequency boost curve such that the ratio of boost between the first and second frequencies is inversely proportional to the ratio of measured grain traces at the first and second frequencies.

28. The method of claim 1, wherein the measurement of the grain traces further comprises measuring the magnitude of the grain traces as a function of intensity and frequency.

29. The method of claim 28, wherein the measurement of the grain traces further comprises the step of subdividing the digital image into a plurality of segments, including at least a first and a second segment.

30. The method of claim 29, wherein the first and second segments overlap.

31. The method of claim 29, wherein the measurement of grain magnitude includes the step of measuring the grain magnitude in the first segment.

32. The method of claim 31, wherein the digital image within the first and second segments is further characterized as containing a mix of grain traces and image.

33. The method of claim 32, wherein the measurement of the grain traces further includes the step of segregating the grain traces from the image in spatial frequency.

34. The method of claim 32:

wherein the first segment is further characterized as containing information from at least a first and second color channel; and

wherein the measurement of grain traces is a function of the relationship between the color channels.

35. The method of claim 34, wherein the relationship between color channels includes a cross-correlation.

36. The method of claim 35:

wherein the first and second segments have similar intensities; and

wherein the segment with the lowest cross-correlation is given the greater weight ascribed to that intensity.

37. The method of claim 35:

wherein overall signal magnitude is the combination of image magnitude and grain trace magnitude; and

wherein the magnitude of the correlation is functionally subtracted from the overall signal magnitude to provide an estimate of the portion of the signal magnitude ascribed to the magnitude of the grain traces.

38. A method of determining grain characteristics of a silver halide film that has been digitally scanned, said film containing at least one image, comprising the steps of:

segmenting at least a portion of said image into a plurality of regions, each region containing data corresponding to a different spatial area of said scanned negative image, there being a sufficient plurality of regions to enable a representative approximation of different grain trace magnitudes represented on said silver halide negative film for a density range of interest;

removing image data relating to image detail from each of said regions to obtain a plurality of grain highlighted regions;

determining a regional average grain trace magnitude for each of said plurality of grain highlighted regions; and

obtaining a representative grain trace magnitude for said density range of interest within said silver halide film based upon said regional average grain density of certain ones of said grain highlighted regions.

39. A method according to claim 38, wherein each of said certain ones of said grain highlighted regions have an average density that is within said density range of interest.

40. A method according to claim 39, wherein said density range of interest is variable, such that the more of said certain ones of said grain highlighted regions that exist for a density range, the narrower said density range of interest will be.

41. A method according to claim 39 wherein said step of obtaining said representative grain trace magnitude obtains an average of the regional average grain trace magnitudes for grain highlighted regions having said average density within said density range of interest.

42. A method according to claim 38, further comprising the step of applying said representative grain trace magnitude to certain other grain highlighted regions within said portion of said negative image, said certain other grain highlighted regions having a density similar to that of said density range of interest.

43. A method according to claim 38, further comprising the step of applying said representative grain trace magnitude to certain other grain highlighted regions outside of said portion of said negative image, said certain other grain highlighted regions having grain traces similar to that of said density range of interest.

44. A method according to claim 38, wherein said step of obtaining obtains a plurality of representative grain trace magnitudes, each of said obtained plurality of obtained representative grain trace magnitudes corresponding to a different density range of interest.

45. A method according to claim 44, wherein each of said obtained representative grain trace magnitudes are based upon said regional average grain trace magnitudes whose corresponding grain highlighted region has a density corresponding to an associated one of said different density ranges of interest.

46. A method according to claim 45 wherein none of said different density ranges of interest overlap with each other.

47. A method according to claim 45 wherein certain ones of said corresponding density ranges of interest overlap, such that higher densities within a first density range overlap with lower densities within a second density range.

48. A digital image scanning system comprising:

scanning hardware operable to scan a photographic image and convert the photographic image into a digital image; and

computer software associated with the scanning hardware and operable to;

measure magnitudes of grain traces in at least two segments of the digital image; and

alter the digital image using the magnitudes of the grain traces measured in at least the two segments.

49. The digital image scanning system of claim 48, wherein the measurement of the magnitudes of grain traces further comprises measuring the magnitude of the grain traces as a function of intensity and deriving a function relating the magnitude of the grain traces to intensity.

50. The digital image scanning system of claim 49, wherein the software is further operable to alter the digital image by deriving a contrast curve to give substantially equal grain trace magnitudes for at least a selected first and second intensity levels.

51. The digital image scanning system of claim 50, wherein the deriving the contrast curve further includes the step of setting the contrast curve such that the ratio of contrast between the first and second intensities is inversely proportional to the ratio of measured grain traces at the first and second intensity levels.

52. The digital image scanning system of claim 51:

wherein the image is further characterized as containing information from a first and second color channel; and

wherein a first and second contrast curve are separately derived based on the magnitude of the grain traces in the first and second color channels.

53. The digital image scanning system of claim 49, wherein the step of measuring the magnitudes of the grain traces is further characterized as measuring the magnitude of the high frequency components of the grain traces.

54. The digital image scanning system of claim 49, wherein the measurement of the magnitude of the grain traces further comprises subdividing the digital image into a plurality of segments, including at least a first and a second segment.

55. The digital image scanning system of claim 54, wherein the measurement of the magnitudes of the grain traces further comprises segregating the grain traces from the image in spatial frequency.

56. The digital image scanning system of claim 54:

wherein the first segment is further characterized as containing information from at least a first and second color channel, and;

wherein the measurement of grain traces is a function of the relationship between the color channels.

57. The digital image scanning system of claim 56, wherein the relationship between color channels includes a cross-correlation.

58. The digital image scanning system of claim 57:

wherein overall signal magnitude is the combination of image magnitude and grain trace magnitude; and

wherein the magnitude of the correlation is functionally subtracted from the overall signal magnitude to provide an estimate of the portion of the signal magnitude ascribed to the magnitude of the grain traces.

59. The digital image scanning system of claim 48, wherein the measurement of the magnitudes of the grain traces further comprises measuring the magnitude of the grain traces as a function of frequency and deriving a function relating the magnitude of the grain traces to frequency.

60. The digital image scanning system of claim 48, wherein the measurement of the magnitudes of the grain traces further comprises measuring the magnitude of the grain traces as a function of intensity and frequency.

61. The digital image scanning system of claim 60, wherein the measurement of the grain traces further comprises the step of subdividing the digital image into a plurality of segments, including at least a first and a second segment.

62. The digital image scanning system of claim 61:

wherein the first segment is further characterized as containing information from at least a first and second color channel; and

wherein the measurement of the magnitudes of grain traces is a function of the relationship between the color channels.

63. The digital image scanning system of claim 62, wherein the relationship between color channels includes a cross-correlation.

64. The digital image scanning system of claim 63:

wherein overall signal magnitude is the combination of image magnitude and grain trace magnitude; and

wherein the magnitude of the correlation is functionally subtracted from the overall signal magnitude to provide an estimate of the portion of the signal magnitude ascribed to the magnitude of the grain traces.

65. The method of claim 60, wherein the software is further operable to derive a frequency boost curve to give substantially equal grain trace magnitudes for at least a selected first and second frequency.

66. A digital image processing system comprising:

a computer readable storage medium; and

computer software stored on the computer readable storage medium and operable to;

measure the magnitudes of grain traces in at least two segments of a digital image; and

alter the digital image using the magnitudes of the grain traces measured in at least the two segments.

67. The digital image scanning system of claim 66, wherein the measurement of the magnitudes of grain traces further comprises measuring the magnitude of the grain traces as a function of intensity and deriving a function relating the magnitude of the grain traces to intensity.

68. The digital image scanning system of claim 67, wherein the step of measuring the magnitudes of the grain traces is further characterized as measuring the magnitude of high frequency components of the grain traces.

69. The digital image scanning system of claim 67, wherein the measurement of the magnitude of the grain traces further comprises subdividing the digital image into a plurality of segments, including at least a first and a second segment.

70. The digital image scanning system of claim 69, wherein the measurement of the magnitudes of the grain traces further comprises segregating the grain traces from the image in spatial frequency.

71. The digital image scanning system of claim 69:

wherein the first segment is further characterized as containing information from at least a first and second color channel; and

wherein the measurement of grain traces is a function of the relationship between the color channels.

72. The digital image scanning system of claim 71, wherein the relationship between color channels includes a cross-correlation.

73. The digital image scanning system of claim 72:

wherein overall signal magnitude is the combination of image magnitude and grain trace magnitude; and

wherein the magnitude of the correlation is functionally subtracted from the overall signal magnitude to provide an estimate of the portion of the signal magnitude ascribed to the magnitude of the grain traces.

74. The digital image scanning system of claim 67, wherein the software is further operable to alter the digital image by deriving a contrast curve to give substantially equal grain trace magnitudes for at least a selected first and second intensity levels.

75. The digital image scanning system of claim 74, wherein the deriving the contrast curve further includes the step of setting the contrast curve such that the ratio of contrast between the first and second intensities is inversely proportional to the ratio of measured grain traces at the first and second intensity levels.

76. The digital image scanning system of claim 75:

wherein the image is further characterized as containing information from a first and second color channel; and

wherein a first and second contrast curve are separately derived based on the magnitude of the grain traces in the first and second color channels.

77. The digital image scanning system of claim 66, wherein the measurement of the magnitudes of the grain traces further comprises measuring the magnitude of the grain traces as a function of frequency and deriving a function relating the magnitude of the grain traces to frequency.

78. The digital image scanning system of claim 66, wherein the measurement of the magnitudes of the grain traces further comprises measuring the magnitude of the grain traces as a function of intensity and frequency.

79. The digital image scanning system of claim 78, wherein the measurement of the grain traces further comprises the step of subdividing the digital image into a plurality of segments, including at least a first and a second segment.

80. The digital image scanning system of claim 79:

wherein the first segment is further characterized as containing information from at least a first and second color channel; and

wherein the measurement of the magnitudes of grain traces is a function of the relationship between the color channels.

81. The digital image scanning system of claim 80, wherein the relationship between color channels includes a cross-correlation.

82. The digital image scanning system of claim 81:

wherein overall signal magnitude is the combination of image magnitude and grain trace magnitude; and

wherein the magnitude of the correlation is functionally subtracted from the overall signal magnitude to provide an estimate of the portion of the signal magnitude ascribed to the magnitude of the grain traces.

83. The method of claim 78, wherein the software is further operable to derive a frequency boost curve to give substantially equal grain trace magnitudes for at least a selected first and second frequency.