Detecting Red Eye Filter and Apparatus Using Meta-Data

• US 20110134271A1
• Filed: 12/01/2010
• Published: 06/09/2011
• Est. Priority Date: 10/09/1997
• Status: Abandoned Application

• Current Assignee: DigitalOptics Corporation Europe Limited (Adeia Inc.)
• Original Assignee: Tessera Technologies Ireland Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Bigioi, Petronel, Corcoran, Peter, Pososin, Alexei, DeLuca, Michael J.
• Application Number:
  US12/958,130
• Publication Number:
  US 20110134271A1
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30041 Eye; Retina; Ophthalmic
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 1/6086 by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/624 Red-eye correction control of camera based on recognised facial parts H04N23/611
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise
• CPC Class Codes: H04N 25/68 applied to defects

Abstract

A method of filtering a red-eye phenomenon from an acquired digital image including a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, includes analyzing meta-data information, determining one or more regions within the digital image suspected as including red eye artifact, and determining, based at least in part on the meta-data analysis, whether the regions are actual red eye artifact. The meta-data information may include information describing conditions under which the image was acquired, captured and/or digitized, acquisition device-specific information, and film information.

Claims

1. A portable digital apparatus having no photographic film, comprising:

(a) a housing;

(b) a source of light coupled to the housing for providing illumination during image capturing;

(c) a digital image capturing apparatus within the housing;

(d) at least one of an image display and an image output coupled to the housing; and

(e) an auto-focus mechanism

(f) a red-eye filter within the housing for modifying pixels indicative of a red-eye phenomenon within said at least one of said image display and said image output, wherein the red eye filter is configured to modify an area within the image indicative of red-eye phenomenon based on a metadata analysis, including;

(i) a comparison of a calculated range of expected sizes of said area based on distance information as recorded by the auto-focus mechanism and on one or more stored human facial anthropometrical values; and

(ii) a search for a second eye, a surrounding face, lips, nostrils or another associated peripheral region, or combinations thereof, at an estimated distance based on said distance information as recorded by the auto-focus mechanism.

2. The apparatus of claim 1, wherein said red-eye filter comprises:

a pixel locator for locating the pixels having a color indicative of the red-eye phenomenon;

a pixel analyzer for determining if a grouping of at least a portion of the pixels located by said pixel locator comprise one or more parameters indicative of the red-eye phenomenon; and

a pixel modifier for modifying the color of the pixels within the grouping.

3. The apparatus of claim 2, further comprising a meta-data analyzer for determining whether to preclude a red-eye phenomenon determination based upon analysis of meta-data.

4. The apparatus of claim 3, said meta-data analysis being performed before said pixel analysis.

5. The apparatus of claim 3, said meta-data analyzer comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.

6. The apparatus of claim 3, said meta-data comprising digital apparatus-specific information.

7. A portable digital apparatus having no photographic film, comprising:

(a) a housing;

(b) an integral flash embedded within said housing for providing illumination during image recording;

(c) a digital image capturing apparatus within said housing for recording an image; and

(d) a red-eye filter within said housing for modifying an area within the image indicative of a red-eye phenomenon, and

(e) wherein whether said area within said image is indicative of said red-eye phenomenon is determined based at least in part on a metadata analysis, including;

(i) a comparison of a calculated range of expected sizes of said area based on distance information as recorded by the auto-focus mechanism and on one or more stored human facial anthropometrical values; and

(ii) a search for a second eye, a surrounding face, lips, nostrils or another associated peripheral region, or combinations thereof, at an estimated distance based on said distance information as recorded by the auto-focus mechanism.

8. The apparatus of claim 7, further comprising memory for recording said image after applying said red-eye filter, thereby recording a modified image.

9. The apparatus of claim 8, wherein said area is stored directly in said image by replacing pixels within the image indicative of red-eye phenomenon to create said modified image.

10. The apparatus of claim 8, wherein said area is stored as an overlay of said image thus preserving the original said image.

11. The apparatus of claim 10, wherein said area is processed by an external device.

12. The apparatus of claim 11, wherein said external device comprises a personal computer.

13. The apparatus of claim 11, wherein said external device comprises a printer.

14. The apparatus of claim 7, further comprising an image output for downloading an integral image display for printing said image modified by said red-eye filter.

15. The apparatus of claim 7, further comprising the red eye filter for generating an overlay for said area indicative of the red-eye phenomenon of the captured image for at least one of image display and image output.

16. The apparatus of claim 7, wherein the area that is indicative of the red-eye phenomenon comprises a color and shape indicative of the red-eye phenomenon and the image is modified to change the color to a black color and further wherein:

the integral flash selectively provides illumination during image capturing; and

said red-eye filter is enabled to modify the image in response to said source of light providing illumination during image capturing.

17. The apparatus of claim 16, further comprising an exposure control means for determining if the image was captured in a condition conducive to the red-eye phenomenon and for generating a red-eye signal in response thereto, wherein said red-eye filter is further enabled in response to the red-eye signal.

18. The apparatus of claim 7, wherein said red-eye filter further includes a false-detection avoidance apparatus which enables modification of the area that is indicative of the red-eye phenomenon in response to an absence of color indicative of the red-eye phenomenon within a vicinity of and exclusive to the area.

19. The apparatus of claim 7, wherein said red-eye filter further includes a false-detection avoidance apparatus which enables modification of the area in response to one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the area.

20. The apparatus of claim 7, wherein said red-eye filter detects said area within the image indicative of a red-eye phenomenon based on one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the area.

21. The apparatus of claim 7, wherein said red-eye filter comprises:

a pixel locator for locating the pixels having a color indicative of the red-eye phenomenon;

a shape analyzer for determining if a grouping of at least a portion of the pixels located by said pixel locator comprise a shape indicative of the red-eye phenomenon; and

a pixel modifier for modifying the color of the pixels within the grouping.

22. The apparatus of claim 21, further comprising a false-detection analyzer for further processing the image in a vicinity of the grouping for details indicative of an eye, and for enabling said pixel modifier in response thereto.

23. The apparatus of claim 21, further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.

24. The apparatus of claim 21, wherein the red-eye filter further comprises an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.

25. The apparatus of claim 21, further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon including determining whether said flash was used during image recording.

26. The apparatus of claim 21, further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon including determining whether low ambient lighting conditions existed during image recording.

27. The apparatus of claim 21, further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon, and a distance analyzer for determining if the subject was at a relatively close distance to the apparatus during image recording.

28. The apparatus of claim 7, said meta-data information being analyzed in said red-eye phenomenon determination prior to a pixel analysis.

29. The apparatus of claim 7, said meta-data information comprising digital apparatus-specific information.

30. The apparatus of claim 29, said meta-data information comprising information regarding conditions under which the image was acquired.