Red-eye filter method and apparatus

• US 7,042,505 B1
• Filed: 06/12/2002
• Issued: 05/09/2006
• Est. Priority Date: 10/09/1997
• Status: Expired due to Fees

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Ireland Limited (Adeia Inc.)
• Inventors: DeLuca, Michael J.
• Primary Examiner(s): Vu, Ngoc-Yen
• Assistant Examiner(s): JERABEK, KELLY L
• Application Number:
  US10/170,511
• Time in Patent Office: 1,427 Days
• Field of Search: 348576-577, 348/227.1, 348/229.1, 348370-371, 382/260, 382/117, 382274-275, 396/158, 396/166
• US Class Current: 348/241
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/624 Red-eye correction control of camera based on recognised facial parts H04N23/611
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A digital camera has an integral flash and a means for storing and displaying a digital image. Under certain conditions, a flash photograph taken with the camera may result in a red-eye phenomenon due to a reflection within an eye of a subject of the photograph. The digital camera has a red-eye filter which analyzes the stored image for the red-eye phenomenon and modifies the stored image to eliminate the red-eye phenomenon by changing the red area to black. The modification of the image is enabled when a photograph is taken under conditions indicative of the red-eye phenomenon. The modification is subject to anti-falsing analysis which further examines the area around the red-eye area for indicia of the eye of the subject.

Claims

1. A digital apparatus having no photographic film, comprising:

(a) a source of light for providing illumination during image acquisition;

(b) a digital image detector for acquiring an image; and

(c) a red-eye filter for modifying pixels within the image indicative of a red-eye phenomenon.

2. A digital apparatus having no photographic film as cited in claim 1, wherein said apparatus is portable.

3. A digital apparatus having no photographic film as cited in claim 1, wherein said source of light is an integral flash unit.

4. The apparatus according to claim 1, further comprising memory for saving said acquired image after applying said filter for said modifying pixels as a modified image.

5. The apparatus according to claim 4, wherein said modified pixels are stored directly in said image by replacing said pixels within the image indicative of red-eye phenomenon to create said modified image.

6. The apparatus according to claim 4, wherein said modified pixels are stored as an overlay of said image thus preserving the original said image.

7. The apparatus according to claim 4, wherein said modified pixels are stored as instruction sets of said image thus preserving the original said image.

8. The apparatus according to claim 5, wherein said modified pixels are processed by an external device.

9. The apparatus according to claim 8, wherein said external device is a personal computer.

10. The apparatus according to claim 8, wherein said external device is a computing appliance.

11. The apparatus according to claim 8, wherein said external device is a printer.

12. The apparatus according to claim 1, further comprising an integral image display for displaying the modified image.

13. The apparatus according to claim 1, further comprising an image output capability for downloading said modified image for printing.

14. The apparatus according to claim 1 wherein the pixels indicative of the red-eye phenomenon have a color and shape indicative of the red-eye phenomenon and the image is modified to change the color to an at least substantially dark color, and further wherein:

said light source provides illumination during image acquisition; and

said red-eye filter is enabled to modify the image in response to said source of light providing illumination during image acquisition.

15. The apparatus according to claim 14, further comprising an exposure control means for determining if the image was acquired in a condition conducive to the red-eye phenomenon and for generating a red-eye indicator in response thereto, wherein said red-eye filter is further enabled in response to the red-eye indicator.

16. The apparatus according to claim 1, wherein said red-eye filter further includes a false-detection avoidance apparatus which enables modification of the pixels indicative of the red-eye phenomenon in response to an absence of color indicative of the red-eye phenomenon within a vicinity of and exclusive to the pixels.

17. The apparatus according to claim 1, wherein said red-eye filter further includes a false-detection avoidance apparatus which disables modification of the pixels indicative of the red-eye phenomenon in response to an absence of one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the area.

18. The apparatus according to claim 1, wherein said red-eye filter detects said pixels within the image indicative of a red-eye phenomenon based on one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the area around said pixels indicative of said red-eye phenomenon.

19. The apparatus according to claim 1, wherein said red-eye filter comprises:

a pixel locator for locating pixels having a color indicative of the red-eye phenomenon;

a shape analyzer for determining if a grouping of at least a portion of the pixels located by said pixel locator comprise a shape indicative of the red-eye phenomenon; and

a pixel modifier for modifying the color of the pixels within the grouping.

20. The apparatus according to claim 19, further comprising a false-detection analyzer for further processing the image in a vicinity of the grouping for details indicative of an eye, and for enabling said pixel modifier in response thereto.

21. The apparatus according to claim 19, further comprising an exposure analyzer for determining if the image was acquired in a condition indicative of the red-eye phenomenon.

22. The apparatus according to claim 21, wherein said exposure analyzer for determining if the image was acquired in a condition indicative of the red-eye phenomenon including determining whether said light source was used during image acquisition.

23. The apparatus according to claim 21, wherein said exposure analyzer for determining if the image was acquired in a condition indicative of the red-eye phenomenon includes determining whether low ambient lighting conditions existed during image acquisition.

24. The apparatus according to claim 19, further comprises a distance analyzer for determining if the distance of the subject to the apparatus during image acquisition is indicative of said red-eye phenomenon.

25. Within a digital apparatus, a method of filtering a red-eye phenomenon from a digital image comprising a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, the method comprising the steps of:

(a) detecting a digital image;

(b) locating pixels having a color indicative of a red-eye phenomenon;

(c) determining a grouping of pixels having one or more features indicative of the red-eye phenomenon; and

(d) modifying the color of the grouping in response to said determining step.

26. The method of claim 25, the determining step including locating pixels having a color indicative of the red-eye phenomenon.

27. The method of claim 26, the determining step further including determining if a grouping of at least a portion of the pixels of said step locating comprise a shape indicative of the red-eye phenomenon.

28. The method of claim 25, further comprising the step of displaying the image upon the apparatus in response to said step of modifying.

29. The method of claim 25, the acquisition step not being performed in conjunction with a pre-flash.

30. A method of filtering a red-eye phenomenon from a digital image comprising a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, the method comprising the steps of:

(a) determining a grouping of pixels having one or more features indicative of the red-eye phenomenon;

(b) determining if pixels in a vicinity of the grouping have one or more features indicative of an eye; and

(c) in response to an absence of the one or more features, inhibiting a step of modifying of the color of the grouping in response to said grouping determining step.

31. The method according to claim 30, wherein the one or more features include an absence of additional pixels having a color indicative of the red-eye phenomenon within the vicinity of the grouping.

32. The method according to claim 30, wherein the one or more features include a substantially white area within the vicinity of the grouping.

33. The method according to claim 30, wherein the one or more features include an eyebrow line within the vicinity of the grouping.

34. The method according to claim 30, wherein the one or more features include an iris ring within the vicinity of the grouping.

35. The method according to claim 30, the grouping determining step including locating pixels having a color indicative of the red-eye phenomenon.

36. The method of claim 35, the grouping determining step further comprising the step of determining if a grouping of at least a portion of the pixels comprises a shape indicative of the red-eye phenomenon.

37. The method according to claim 35, further comprising a step of acquiring the digital image, said grouping determining step including said shape and pixel color determining, and the inhibiting step, being performed in response to the acquisition step.

38. The method according to claim 37, the modifying step not being performed wherein said response to the acquisition step of said inhibiting step is the absence of flash in said acquisition step.

39. Within a digital apparatus having no photographic film, a method of filtering a red-eye phenomenon from a digital image comprising a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, the method comprising the steps of:

(a) digitally detecting the image;

(b) determining a grouping of pixels having one or more features indicative of the red-eye phenomenon;

(c) modifying the color of the grouping in response to said step of determining; and

(d) said determining and modifying steps having been performed in response to said detecting step, displaying the image upon the apparatus in response to said step of modifying.

40. The method according to claim 39, the grouping determining step including locating pixels having a color indicative of the red-eye phenomenon.

41. The method of claim 40, the grouping determining step further including determining if a grouping of at least a portion of the pixels of said grouping determining step comprise a shape indicative of the red-eye phenomenon.

42. A method of filtering a red-eye phenomenon from a digital image comprising a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, the method comprising the steps of:

(a) determining a grouping of pixels having one or more features indicative of the red-eye phenomenon;

(b) analyzing if one or more conditions of detection of the image are indicative of the red-eye phenomenon, at least including determining if a flash was used in conjunction with the acquisition of the image, said flash having been used or not in response to at least one of a light sensor of ambient brightness and a manual input from a user; and

(c) modifying the color of the grouping in response to said determining and analyzing steps only if said flash was used when the image was acquired.

43. The method according to claim 42, the grouping determining step including locating pixels having a color indicative of the red-eye phenomenon.

44. The method according to claim 43, the grouping determining step further including determining if a grouping of at least a portion of the pixels of said grouping determining step comprise a shape indicative of the red-eye phenomenon.

45. The method according to claim 44, further comprising the step of recording the digital image, said grouping determining step including said color locating and shape determining steps, and said inhibiting step, being performed in response to the acquisition step.

46. The method according to claim 45, the recording step not being performed in conjunction with a pre-flash.

47. The method according to claim 42, the grouping determining step including determining if a grouping of at least a portion of the pixels of said locating step comprise a shape indicative of the red-eye phenomenon.

48. Within a portable digital image acquisition apparatus having no photographic film, a method of filtering a red-eye phenomenon from a digital image comprising a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, the method comprising the steps of:

(a) locating pixels having a color indicative of the red-eye phenomenon;

(b) determining if a grouping of at least a portion of the pixels of said step locating comprise a shape indicative of the red-eye phenomenon;

(c) modifying the color of the grouping in response to said step of determining; and

(d) analyzing if conditions of acquiring of the image are indicative of the red-eye phenomenon, wherein said step of modifying is selectively performed in response thereto.

49. The method according to claim 48, wherein the color indicative of the red-eye phenomenon corresponds to a substantially red color, and the shape indicative of the red-eye phenomenon corresponds to a substantially round, semi-circular or oval shape.

50. The method according to claim 48, wherein said step of analyzing includes determining if a flash was used in conjunction with the acquiring of the image.

51. The method according to claim 48, wherein said step of analyzing includes determining if a flash was used in conjunction with the acquiring of the image, the distance between a subject of the image and the digital image acquisition apparatus for recording the image and an ambient light level during the acquisition of the image.

52. The method according to claim 48, wherein said step of modifying changes the color of the grouping to substantially dark color.

53. The method according to claim 48, wherein said step of determining further comprises the steps of:

determining if pixels in a vicinity of the grouping have a feature indicative an eye;

and inhibiting said step of modifying in response to an absence of the feature.

54. The method according to claim 53, wherein the feature includes an absence of additional pixels having a color indicative of the red-eye phenomenon within the vicinity of the grouping.

55. The method according to claim 53, wherein the feature includes a substantially white area within the vicinity of the grouping.

56. The method according to claim 48, wherein the portable digital image acquisition apparatus includes an integral flash and an electronic display, said method further comprising the steps of:

initiating a photographic flash by the flash;

digitally acquiring the image in response to said step of initiating;

performing said steps of locating, determining and modifying in response to said acquisition step; and

displaying the image in response to said step of modifying on the electronic display.

57. A portable digital image acquisition apparatus and printer system having no photographic film, comprising:

(a) a digital image capturing apparatus including an integral flash and image output means for downloading image data to another device; and

(b) a printer coupled with the digital image capturing apparatus at the image output means for receiving the image data,

(c) the system including a red-eye filter for modifying areas within images indicative of red-eye phenomenon, such that the printer prints red-eye corrected images.

58. The system of claim 57, the portable digital image capturing apparatus comprising a portable digital camera.

59. A portable digital image acquisition apparatus and printer system having no photographic film, comprising:

(a) a digital image capturing apparatus including an integral flash and image output means for downloading image data to another device; and

(b) a printer coupled with the digital image capturing apparatus camera at the image output means for receiving the image data,

(c) the system including a red-eye filter for correcting red-eye phenomenon, such that the printer prints red-eye corrected images.

60. The system of claim 59, the portable digital image capturing apparatus comprising a portable digital camera.

61. A portable digital image acquisition apparatus and printer system having no photographic film, comprising:

(a) an integral flash for providing illumination during image recording;

(b) a digital image capturing apparatus for recording an image;

(c) image output means for downloading image data to a printer for printing;

(d) a red-eye filter for modifying an area within the image indicative of a red-eye phenomenon; and

(e) the printer.

62. The system of claim 61, the portable digital image acquisition apparatus comprising a portable digital camera.

63. A portable digital image acquisition apparatus and printer system having no photographic film, comprising:

(a) an integral flash for providing illumination during image recording;

(b) a digital image capturing apparatus for recording an image;

(c) image output means for downloading image data to a printer for printing;

(d) a red-eye filter for correcting a red-eye phenomenon; and

(e) the printer.

64. The system of claim 63, the portable digital image acquisition apparatus comprising a portable digital camera.

65. A portable digital image acquisition apparatus and printer system having no photographic film, comprising:

(a) an integral flash for providing illumination during image recording;

(b) a digital image capturing apparatus for recording an image;

(c) a red-eye filter for modifying an area within the image indicative of a red-eye phenomenon; and

(d) a printer for printing the image.

66. The system of claim 65, the portable digital image acquisition apparatus comprising a portable digital camera.

67. A portable digital image acquisition apparatus and printer system having no photographic film, comprising:

(a) an integral flash for providing illumination during image recording;

(b) a digital image capturing apparatus for recording an image;

(c) a red-eye filter for correcting a red-eye phenomenon; and

(d) a printer for printing a red-eye corrected image.

68. The system of claim 67, the portable digital image acquisition apparatus comprising a portable digital camera.