Detecting red eye filter and apparatus using meta-data

• US 8,493,478 B2
• Filed: 12/01/2010
• Issued: 07/23/2013
• Est. Priority Date: 10/09/1997
• Status: Expired due to Fees

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia Inc.)
• Inventors: DeLuca, Michael J, Prilutsky, Yury, Steinberg, Eran, Corcoran, Peter, Bigioi, Petronel, Pososin, Alexei
• Primary Examiner(s): GILES, NICHOLAS G
• Application Number:
  US12/957,594
• Publication Number:
  US 20110069186A1
• Time in Patent Office: 965 Days
• Field of Search: 348/241, 348/222.1, 348/370, 348/371, 348/78, 382/117, 382/274, 382/275, 396/158
• US Class Current: 348/241
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30041 Eye; Retina; Ophthalmic
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 1/6086 by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/624 Red-eye correction control of camera based on recognised facial parts H04N23/611
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise
• CPC Class Codes: H04N 25/68 applied to defects

Abstract

A method of filtering a red-eye phenomenon from an acquired digital image including a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, includes analyzing meta-data information, determining one or more regions within the digital image suspected as including red eye artifact, and determining, based at least in part on the meta-data analysis, whether the regions are actual red eye artifact. The meta-data information may include information describing conditions under which the image was acquired, captured and/or digitized, acquisition device-specific information, and/film information.

Claims

1. A method of detecting and correcting an eye defect within an acquired digital image comprising a multiplicity of pixels indicative of luminance and color, the pixels forming various shapes within the image, the method comprising:

acquiring a digital image including said multiplicity of pixels indicative of luminance and color;

detecting a candidate eye defect region based on degree of color or shape, or both, within the digital image;

determining a size of the candidate eye defect region;

analyzing meta-data information including image acquisition device-specific information, including distance information as recorded by an auto-focus mechanism of the portable digital camera, and information describing conditions under which the image was acquired;

analyzing anthropometric information including statistics relating to relationships between said size of said candidate eye defect region and said distance information as recorded by said auto-focus mechanism and between said size of said candidate eye defect region and a location of a second detected eye, lips, nostrils or a surrounding face, or combinations thereof; and

determining, based at least in part on said meta-data and anthropometric information, and on a probability of detection of said second detected eye, lips, nostrils or said surrounding face, or combinations thereof, whether said candidate eye defect region is suspected as including an eye defect region; and

filtering said candidate eye defect region from the digital image.

2. The method of claim 1, further comprising analyzing pixel information within one or more regions suspected as including an eye defect based on said meta-data analysis, and determining whether any of said one or more suspected regions continue to be suspected as including the eye defect based on said pixel analysis.

3. The method of claim 1, said filtering being executed at least partially within a portable image acquisition device, having no photographic film.

4. The method of claim 1, said filtering being executed at least in part as a post-processing operation on an external computation device.

5. The method of claim 1, said determining operation including a probability determination process based upon a plurality of criteria.

6. The method of claim 1, further comprising adjusting a pixel color within regions wherein an eye defect is suspected, and outputting an adjusted image to a printer.

7. The method of claim 1, said meta-data information comprising an indication of whether a flash was used when the image was acquired.

8. A portable digital camera, including optics and a sensor for acquiring digital images, a processor and one or more processor-readable media having embedded code therein for programming the processor to perform a method of detecting and correcting eye defects within an acquired digital image that comprises a multiplicity of pixels indicative of luminance and color, the pixels forming various shapes within the image, the method comprising:

acquiring a digital image including said multiplicity of pixels indicative of luminance and color;

detecting a candidate eye defect region based on degree of color or shape, or both, within the digital image;

determining a size of the candidate eye defect region;

analyzing meta-data information including image acquisition device-specific information, including distance information as recorded by an auto-focus mechanism of the portable digital camera, and information describing conditions under which the image was acquired;

analyzing anthropometric information including statistics relating to relationships between said size of said candidate eye defect region and said distance information as recorded by said auto-focus mechanism and between said size of said candidate eve defect region and a location of a second detected eve, lips, nostrils or a surrounding face, or combinations thereof; and

determining, based at least in part on said meta-data and anthropometric information, and on a probability of detection of said second detected eve, lips, nostrils or said surrounding face, or combinations thereof, whether said candidate eye defect region is suspected as including an eye defect region; and

filtering said candidate eye defect region from the digital image.

9. The camera of claim 8, wherein the method further comprises analyzing pixel information within one or more regions suspected as including an eye defect based on said meta-data analysis, and determining whether any of said one or more suspected regions continue to be suspected as including the eye defect based on said pixel analysis.

10. The camera of claim 8, said filtering being executed at least partially within a portable image acquisition device, having no photographic film.

11. The camera of claim 8, said filtering being executed at least in part as a post-processing operation on an external computation device.

12. The camera of claim 8, said determining operation including a probability determination process based upon a plurality of criteria.

13. The camera of claim 8, wherein the filtering comprises adjusting a pixel color within regions wherein an eye defect is suspected, and outputting an adjusted image to a printer, display or other rendering device.

14. The camera of claim 8, said meta-data information comprising an indication of whether a flash was used when the image was acquired.

15. One or more non-transitory processor-readable media having embedded code therein for programming a processor to perform a method of detecting and correcting defect eyes within an acquired digital image that comprises a multiplicity of pixels indicative of luminance and color, the pixels forming various shapes within the image, the method comprising:

acquiring a digital image including said multiplicity of pixels indicative of luminance and color;

detecting a candidate eye defect region based on degree of color or shape, or both, within the digital image;

determining a size of the candidate eye defect region;

analyzing meta-data information including image acquisition device-specific information, including distance information as recorded by an auto-focus mechanism of the portable digital camera, and information describing conditions under which the image was acquired;

analyzing anthropometric information including statistics relating to relationships between said size of said candidate eye defect region and said distance information as recorded by said auto-focus mechanism and between said size of said candidate eye defect region and a location of a second detected eye, lips, nostrils or a surrounding face, or combinations thereof; and

determining, based at least in part on said meta-data and anthropometric information, and on a probability of detection of said second detected eye, lips, nostrils or said surrounding face, or combinations thereof, whether said candidate eye defect region is suspected as including an eye defect region; and

filtering said candidate eye defect region from the digital image.

16. The one or more media of claim 15, wherein the method further comprises analyzing pixel information within one or more regions suspected as including an eye defect based on said meta-data analysis, and determining whether any of said one or more suspected regions continue to be suspected as including the eye defect based on said pixel analysis.

17. The one or more media of claim 15, said filtering being executed at least partially within a portable image acquisition device, having no photographic film.

18. The one or more media of claim 15, said filtering being executed at least in part as a post-processing operation on an external computation device.

19. The one or more media of claim 15, said determining operation including a probability determination process based upon a plurality of criteria.

20. The one or more media of claim 15, wherein the filtering comprises adjusting a pixel color within regions wherein an eye defect is suspected, and outputting an adjusted image to a printer.

21. The one or more media of claim 15, said meta-data information comprising an indication of whether a flash was used when the image was acquired.