Detecting red eye filter and apparatus using meta-data

• US 7,804,531 B2
• Filed: 08/15/2008
• Issued: 09/28/2010
• Est. Priority Date: 10/09/1997
• Status: Expired due to Fees

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Vision Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Bigioi, Petronel, Corcoran, Peter, Pososin, Alexei, DeLuca, Michael J.
• Primary Examiner(s): Chan; Jason
• Assistant Examiner(s): Giles; Nicholas G
• Application Number:
  US12/192,897
• Publication Number:
  US 20080316341A1
• Time in Patent Office: 774 Days
• Field of Search: 348/241, 348/222.1, 348/370, 348/371, 382/117, 382/274, 382/275, 396/158
• US Class Current: 348/241
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30041 Eye; Retina; Ophthalmic
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 1/6086 by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/624 Red-eye correction control of camera based on recognised facial parts H04N23/611
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise

Abstract

A method of filtering a red-eye phenomenon from an acquired digital image including a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, includes analyzing meta-data information, determining one or more regions within the digital image suspected as including red eye artifact, and determining, based at least in part on the meta-data analysis, whether the regions are actual red eye artifact. The meta-data information may include information describing conditions under which the image was acquired, captured and/or digitized, acquisition device-specific information, and/film information.

Claims

1. A method of filtering a red-eye phenomenon from an acquired digital image comprising a multiplicity of pixels indicative of color, the pixels forming various shapes within the image, the method comprising:

using a portable digital camera device including a red eye filter;

acquiring a digital image of a scene that includes a real face;

analyzing meta-data information including image acquisition device-specific information, including f-stop, aperture, exposure, gain, white balance or color transformation, or combinations thereof; and

utilizing meta-data information of user preference device-specific setup information for said analyzing meta-data; and

determining, based at least in part on said meta-data analysis, whether one or more regions within said digital image are suspected as including red eye artifact.

2. The method of claim 1, further comprising analyzing pixel information within one or more regions suspected as including red eye artifact based on said meta-data analysis, and determining whether any of said one or more suspected regions continue to be suspected as including red eye artifact based on said pixel analysis.

3. The method of claim 1, said filtering being executed at least partially within a portable image acquisition device, having no photographic film.

4. The method of claim 1, said filtering being executed at least in part as a post-processing operation on an external computation device.

5. The method of claim 1, said determining operation including a probability determination process based upon a plurality of criteria.

6. The method of claim 1, further comprising adjusting a pixel color within regions wherein red eye artifact is suspected, and outputting an adjusted image to a printer.

7. The method of claim 1, said meta-data information further comprising information describing conditions under which the image was acquired.

8. The method of claim 7, said meta-data information that describes conditions under which the image was acquired comprising an indication of whether a flash was used when the image was acquired.

9. A portable digital camera, comprising:

(a) a camera housing,

(b) one or more optics and a sensor disposed within said camera housing for acquiring digital images of scenes that include real faces, and

(c) a red eye filter within said camera housing, to perform a method of filtering within said camera a red-eye phenomenon from an acquired digital image that comprises a multiplicity of pixels indicative of color, the pixels forming various shapes within the image, the image being acquired of a scene that includes a real face;

(d) wherein the method of filtering a red eye phenomenon comprising;

analyzing meta-data information including image acquisition device-specific information including f-stop, aperture, exposure, gain, white balance or color transformation, or combinations thereof; and

utilizing meta-data information of user preference device-specific setup information for said analyzing meta-data; and

determining, based at least in part on said meta-data analysis, whether one or more regions within said digital image are suspected as including red eye artifact.

10. The camera of claim 9, wherein the method further comprises analyzing pixel information within one or more regions suspected as including red eye artifact based on said meta-data analysis, and determining whether any of said one or more suspected regions continue to be suspected as including red eye artifact based on said pixel analysis.

11. The camera of claim 9, said filtering being executed at least partially within a portable image acquisition device, having no photographic film.

12. The camera of claim 9, said filtering being executed at least in part as a post-processing operation on an external computation device.

13. The camera of claim 9, said determining operation including a probability determination process based upon a plurality of criteria.

14. The camera of claim 9, wherein the method further comprises adjusting a pixel color within regions wherein red eye artifact is suspected, and outputting an adjusted image to a printer.

15. The camera of claim 9, said meta-data information further comprising information describing conditions under which the image was acquired.

16. The camera of claim 15, said meta-data information that describes conditions under which the image was acquired comprising an indication of whether a flash was used when the image was acquired.

17. A red eye filter within a portable digital camera device configured to acquire digital images of scenes that include real faces, the red eye filter being configured to perform a method of filtering a red-eye phenomenon from an acquired digital image that comprises a multiplicity of pixels indicative of color, the pixels forming various shapes within the digital image, the digital image being acquired of a scene that includes a real face, the method comprising:

analyzing meta-data information including image acquisition device-specific information, including f-stop, aperture, exposure, gain, white balance or color transformation, or combinations thereof;

utilizing meta-data information of user preference device-specific setup information for said analyzing meta-data; and

determining, based at least in part on said meta-data analysis, whether one or more regions within said digital image are suspected as including red eye artifact.

18. The red eye filter of claim 17, wherein the method further comprises analyzing pixel information within one or more regions suspected as including red eye artifact based on said meta-data analysis, and determining whether any of said one or more suspected regions continue to be suspected as including red eye artifact based on said pixel analysis.

19. The red eye filter of claim 17, said filtering being executed at least partially within a portable image acquisition device, having no photographic film.

20. The red eye filter of claim 17, said filtering being executed at least in part as a post-processing operation on an external computation device.

21. The red eye filter of claim 17, said determining operation including a probability determination process based upon a plurality of criteria.

22. The red eye filter of claim 17, wherein the method further comprises adjusting a pixel color within regions wherein red eye artifact is suspected, and outputting an adjusted image to a printer.

23. The red eye filter of claim 17, said meta-data information further comprising information describing conditions under which the image was acquired.

24. The red eye filter of claim 23, said meta-data information that describes conditions under which the image was acquired comprising an indication of whether a flash was used when the image was acquired.