Apparatus and method for processing digital images having eye color defects

• US 7,035,462 B2
• Filed: 08/29/2002
• Issued: 04/25/2006
• Est. Priority Date: 08/29/2002
• Status: Expired due to Fees

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Eastman Kodak Company
• Inventors: White, Timothy J., Delong, Kevin R., Smith, Craig M., Christoffel, Douglas W., Blanco, Felix, Leem, Yojin, Gerard, Michael J., Kurtenbach, Thomas J.
• Primary Examiner(s): Johns, Andrew W.
• Assistant Examiner(s): Alavi, Amir
• Application Number:
  US10/230,913
• Publication Number:
  US 20040041924A1
• Time in Patent Office: 1,335 Days
• Field of Search: 382/115, 382/117, 382/162, 382/164, 382/167, 382/168, 382/171, 382/172, 382/181, 382/203, 382/214, 382/254, 382/260, 382/274, 382/275, 348/222, 348/239, 348/370, 348/371, 348/376, 348/576, 348/577, 358/506, 358/518, 358/521, 358/527, 345/581, 396/158
• US Class Current: 382/167
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/624 Red-eye correction control of camera based on recognised facial parts H04N23/611

Abstract

An apparatus and method for processing digital images having eye color defects. In one method for detecting and correcting eye color defects of a subject in a digital image, the steps comprise: (a) processing the digital image to automatically detect one or more candidate positions of eye color defects in the digital image; (b) automatically applying an eye color defect algorithm to the digital image at the detected candidate positions to automatically correct for the eye color defect; (c) displaying, on a display, at least a portion of the digital image comprising at least one of the corrected eye color defects; and (d) displaying, on the display, an indicator located proximate the at least one of the corrected eye color defects indicative of the at least one of the corrected eye color defects.

Claims

1. An imaging device for correcting eye color defects of a subject in a digital image, comprising:

(a) accessing means for accessing the digital image;

(b) processing means for detecting one or more candidate positions of eye color defects in the digital image;

(c) automatic correction means for applying an eye color defect algorithm to the digital image at the detected candidate positions to automatically correct for the eye color defect;

(d) a display for presenting at least a portion of the digital image comprising at least one of the one or more corrected eye color defects; and

(e) at least one indicator, presented on the display, indicating the at least one of the one or more corrected eye color defects.

2. The imaging device of claim 1, wherein the imaging device is a digital camera and further comprises an image sensor for capturing and digitizing an image to produce the digital image.

3. The imaging device of claim 1, wherein the at least one indicator is located proximate the at least one of the one or more corrected eye color defects.

4. The imaging device of claim 1, wherein the at least one indicator comprises a predetermined color to indicate a level of confidence of correction.

5. The imaging device of claim 1, wherein the at least one indicator comprises an audio sound to indicate a level of confidence of correction.

6. The imaging device of claim 1, wherein the at least one indicator comprises a textual information to indicate a level of confidence of correction.

7. The imaging device of claim 1, wherein the at least one indicator comprises a pop-up textual box to indicate a level of confidence of correction.

8. The imaging device of claim 1, wherein the at least one indicator comprises a predetermined color to differentiate the at least one indicator from a background portion of the digital image where the at least one indicator is located.

9. The imaging device of claim 1, wherein the at least one indicator has a predetermined shape.

10. The imaging device of claim 1, wherein the at least one indicator comprises a predetermined size to indicate a level of confidence of correction.

11. The imaging device of claim 1, wherein the at least one indicator comprises a predetermined size relative to a size of the detected eye color defect.

12. The imaging device of claim 1, wherein the at least one indicator comprises a predetermined size relative to a size of the digital image.

13. The imaging device of claim 1, wherein the at least one indicator comprises a predetermined size relative to a location of at least a second indicator.

14. The imaging device of claim 1, wherein the at least one indicator comprises a predetermined size relative to a number of indicators.

15. The imaging device of claim 1, wherein the at least one indicator comprises a number, alphabetic character, icon, or symbolic character.

16. The imaging device of claim 1, wherein the at least one indicator references a single eye color defect.

17. The imaging device of claim 1, wherein the at least one indicator references a pair of eye color defects.

18. The imaging device of claim 1, wherein the at least one indicator references a plurality of eye color defects.

19. The imaging device of claim 1, further comprising selection means for accepting the at least one of the one or more corrected eye color defects.

20. The imaging device of claim 1, further comprising selection means for rejecting the at least one of the one or more corrected eye color defects.

21. The imaging device of claim 1, further comprising:

selection means for selecting the at least one of the one or more corrected eye color defects; and

correction means for applying a refined defect algorithm to the selected at least one of the one or more corrected eye color defects to generate a further corrected eye color defect.

22. The imaging device of claim 21 wherein the eye color defect algorithm differs from the refined defect algorithm.

23. The imaging device of claim 21 the refined defect algorithm is the eye color defect algorithm.

24. The imaging device of claim 21, further comprising a visual indicator indicating further correction of the corrected eye color defect.

25. The imaging device of claim 21, further comprising selection means for indicating acceptance or rejection of the further corrected eye color defect.

26. The imaging device of claim 1, further comprising:

selection means for selecting the at least one of the one or more corrected eye color defects; and

an audio or visual indicator applied to the selected at least one of the one or more corrected eye color defect to indicate review of the selected at least one of the one or more corrected eye color defect.

27. The imaging device of claim 1, further comprising:

selection means for selecting at least one undetected candidate position of eye color defect; and

correction means for applying the eye color defect algorithm to digitized pixel data at the selected at least one undetected candidate position of eye color defect to correct for the eye color defect.

28. The imaging device of claim 1, further comprising metadata associated with the digital file the selected at least one of the one or more corrected eye color defect.

29. The imaging device of claim 1, further comprising metadata associated with pixel information of the digital image.

30. An imaging device for correcting eye color defects of a subject in a digital image, comprising:

(a) accessing means for accessing the digital image;

(b) processing means for detecting one or more candidate positions of eye color defects in the digital image;

(c) automatic correction means for applying an eye color defect algorithm to the digital image at the detected candidate positions to automatically correct for the eye color defect;

(d) a display comprising (i) a first viewing area displaying the digital image comprising at least one of the one or more corrected eye color defects, and (ii) a second viewing area proximate the first viewing area displaying a portion of the digital image displayed in the first viewing area; and

(e) at least one indicator, displayed in the first viewing area or the second viewing area, indicating the at least one of the one or more corrected eye color defects.

31. The imaging device of claim 30, further comprising selection means for selecting the at least one indicator.

32. The imaging device of claim 30, further comprising correction means for applying a refined defect algorithm to digitized pixel data at the corrected eye color defect corresponding with the selected at least one indicator.

33. A method for detecting and correcting eye color defects of a subject in a digital image, comprising the steps of:

(a) processing the digital image to automatically detect one or more candidate positions of eye color defects in the digital image;

(b) automatically applying an eye color defect algorithm to the digital image at the detected candidate positions to automatically correct for the eye color defect;

(c) displaying, on a display, at least a portion of the digital image comprising at least one of the corrected eye color defects;

(d) displaying, on the display, an indicator located proximate the at least one of the corrected eye color defects indicative of the at least one of the corrected eye color defects;

(e) providing selection means for selecting the indicator;

(f) applying the eye color defect algorithm to the selected at least one of the corrected eye color defects to generate a further corrected eye color defect; and

(g) presenting, on the display, at least a portion of the digital image comprising the further corrected eye color defect.

34. The method of claim 33, further comprising the step of:

(h) displaying a second indicator located proximate the further corrected eye color defect indicative of the further corrected eye color defect.

35. The method of claim 34, further comprising the step of:

(i) providing selection means for selecting the second indicator.

36. The method of claim 33, further comprising the step of:

(h) storing metadata with the digital image, the metadata comprising pixel information which corresponds with the corrected eye color defects.

37. The method of claim 36, further comprising the step of:

(i) applying the stored pixel information of the metadata to the digital image.

38. A computer storage product having at least one computer storage medium having instructions stored therein causing one or more computers to perform the method of claim 33.

39. A method for detecting and correcting eye color defects of a subject in a digital image, comprising the steps of:

(a) processing the digital image to automatically detect one or more candidate positions of eye color defects in the digital image;

(b) automatically applying an eye color defect algorithm to the digital image at the detected candidate positions to automatically correct for the eye color defect;

(c) displaying, in a first viewing area of a display, the digital image comprising the corrected eye color defects;

(d) displaying, in a second viewing area of the display proximate the first viewing area, a portion of the digital image displayed in the first viewing area;

(e) displaying, in the first viewing area of the display, an indicator located proximate at least one of the corrected eye color defects indicative of the at least one of the corrected eye color defects; and

(f) providing selection means for selecting the indicator.

40. The method of claim 39, further comprising the steps of:

(g) applying the eye color defect algorithm to the selected at least one of the corrected eye color defects associated with the indicator to generate a further corrected eye color defect; and

(h) displaying, in the second viewing area, at least a portion of the digital image comprising the further corrected eye color defect.

41. An imaging device for correcting an image artifact of a subject in a digital image, comprising:

(a) accessing means for accessing the digital image;

(b) processing means for detecting one or more candidate positions of eye color defects in the digital image;

(c) automatic correction means for applying an image artifact removal algorithm to the digital image at the detected candidate positions to automatically correct for the image artifact;

(d) a display for presenting at least a portion of the digital image comprising at least one of the one or more corrected image artifacts; and

(e) at least one indicator, presented on the display, indicating the at least one of the one or more corrected image artifacts.

42. The imaging device of claim 41, wherein the image artifact includes scratches, tears, dust, blemishes, wrinkles, creases, hair, and specular highlights due to flash illumination.