Red Eye False Positive Filtering Using Face Location and Orientation

• US 20080219518A1
• Filed: 03/05/2008
• Published: 09/11/2008
• Est. Priority Date: 03/05/2007
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Vision Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Nanu, Florin, Drimbarean, Alexandru
• Granted Patent: US 7,995,804 B2
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships

Abstract

An image is acquired including a red eye defect and non red eye defect regions having a red color. An initial segmentation of candidate redeye regions is performed. A location and orientation of one or more faces within the image are determined. The candidate redeye regions are analyzed based on the determined location and orientation of the one or more faces to determine a probability that each redeye region appears at a position of an eye. Any confirmed redeye regions having at least a certain threshold probability of being a false positive are removed as candidate redeye defect regions. The remaining redeye defect regions are corrected and a red eye corrected image is generated.

Claims

1. A method of detecting and correcting a red-eye defect within a digital image, comprising:

(a) acquiring an image including one or more non red eye defect regions having a red color;

(b) performing in a first stage an initial segmentation of candidate redeye regions to determine a first set of one or more confirmed redeye regions designated for correction;

(c) determining a location and orientation of any faces within the image;

(d) analyzing the first set of confirmed redeye regions based on the determined location and orientation of said any faces, or based on a determination that there are no faces present within the image, to determine a probability that each confirmed redeye region appears at a position of an eye;

(e) removing from the first set any confirmed redeye regions having at least a certain threshold probability of being a false positive, and thereby generating a second set;

(f) correcting the second set of confirmed red eye regions and generating a red eye corrected image which has the second set of confirmed red eye regions corrected therein; and

(g) electronically storing, transmitting, further processing or editing, or displaying the red eye corrected image, or combinations thereof.

2. The method of claim 1, wherein the performing of the first stage initial segmentation of red eye regions comprises pixel analyzing.

3. The method of claim 2, wherein the performing of the first stage initial segmentation of red eye regions comprises falsing and verification filtering.

4. The method of claim 1, wherein the analyzing and removing are performed prior to any correcting of the image.

5. The method of claim 1, further comprising initially correcting the first set of confirmed redeye regions and generating an initial corrected image prior to the analyzing and removing and the generating of said red eye corrected image.

6. The method of claim 1, wherein the one or more faces further include at least one red eye defect such that the second set comprises a non-empty set.

7. The method of claim 1, wherein the second set comprises an empty set such that no actual redeye regions are corrected in the image.

8. An embedded image acquisition and processing system, comprising.

(a) an image acquisition subsystem;

(b) a red eye filter that performs in a first stage an initial segmentation of candidate redeye regions detected within an acquired image to determine a first set of one or more confirmed redeye regions designated for correction;

(c) a face location and orientation detector;

(d) an analysis filter that determines a probability that each confirmed redeye region appears at a position of an eye based on determining face location and orientation information from the face location and orientation detector;

(e) a processor for correcting the red eye defects of the confirmed red eye regions of the first set minus any having at least a certain threshold probability of being a false positive and generating a red eye corrected image; and

(f) wherein the red eye corrected image is electronically stored, transmitted, further processed or edited, or displayed, or combinations thereof.

9. The system of claim 8, wherein the performing of the first stage initial segmentation of red eye regions comprises pixel analyzing.

10. The system of claim 9, wherein the performing of the first stage initial segmentation of red eye regions comprises falsing and verification filtering.

11. The system of claim 8, wherein the analyzing and removing are performed prior to any correcting of the image.

12. The system of claim 8, wherein the processor further for initially correcting the first set of confirmed redeye regions and generating an initial corrected image prior to the analyzing and removing and the generating of said red eye corrected image.

13. The one or more storage devices of claim 8, wherein no redeye defects are corrected when no faces are detected within the image.

14. One or more storage devices having processor-readable code embodied therein for programming one or more processors to perform a method of detecting and correcting a red-eye defect within a digital image, the method comprising:

(a) acquiring an image including one or more non red eye defect regions having a red color;

(b) performing in a first stage an initial segmentation of candidate redeye regions to determine a first set of one or more confirmed redeye regions designated for correction;

(c) determining a location and orientation of any faces within the image;

(d) analyzing the first set of confirmed redeye regions based on the determined location and orientation of said any faces, or based on a determination that there are no faces present within the image, to determine a probability that each confirmed redeye region appears at a position of an eye;

(e) removing from the first set any confirmed redeye regions having at least a certain threshold probability of being a false positive, and thereby generating a second set;

(f) correcting the second set of confirmed red eye regions and generating a red eye corrected image which has the second set of confirmed red eye regions corrected therein; and

(g) electronically storing, transmitting, further processing or editing, or displaying the red eye corrected image, or combinations thereof.

15. The one or more storage devices of claim 14, wherein the performing of the first stage initial segmentation of red eye regions comprises pixel analyzing.

16. The one or more storage devices of claim 15, wherein the performing of the first stage initial segmentation of red eye regions comprises falsing and verification filtering.

17. The one or more storage devices of claim 14, wherein the analyzing and removing are performed prior to any correcting of the image.

18. The one or more storage devices of claim 14, further comprising initially correcting the first set of confirmed redeye regions and generating an initial corrected image prior to the analyzing and removing and the generating of said red eye corrected image.

19. The one or more storage devices of claim 14, wherein the one or more faces further include at least one red eye defect such that the second set comprises a non-empty set.

20. The one or more storage devices of claim 14, wherein the second set comprises an empty set such that no actual redeye regions are corrected in the image.