Two stage detection for photographic eye artifacts

• US 8,131,021 B2
• Filed: 04/04/2011
• Issued: 03/06/2012
• Est. Priority Date: 11/18/2005
• Status: Expired due to Fees

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia Inc.)
• Inventors: Prilutsky, Yury, Steinberg, Eran, Corcoran, Peter, Pososin, Alexei, Bigioi, Petronel, Ciuc, Mihai
• Primary Examiner(s): Rahmjoo, Mike
• Application Number:
  US13/079,810
• Publication Number:
  US 20110262038A1
• Time in Patent Office: 337 Days
• Field of Search: 382/117, 382/275, 382/260, 382/274, 382/103, 358/515, 358/518
• US Class Current: 382/117
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction

Abstract

The detection of red-eye defects is enhanced in digital images for embedded image acquisition and processing systems. A two-stage redeye filtering system includes a speed optimized filter that performs initial segmentation of candidate redeye regions and optionally applies a speed-optimized set of falsing/verification filters to determine a first set of confirmed redeye regions for correction. Some of the candidate regions which are rejected during the first stage are recorded and re-analyzed during a second stage by an alternative set of analysis-optimized filters to determine a second set of confirmed redeye regions.

Claims

1. One or more non-transitory, processor-readable media having code embedded therein that is configured to program one or more processors to perform a method of detecting and correcting a red-eye defect within an acquired digital image, wherein the method comprises:

performing in a first stage an initial segmentation of candidate redeye regions within an acquired digital image to determine a first set of one or more confirmed redeye regions designated for correction;

correcting the first set of red eye regions for generating a first red eye corrected image;

analyzing the image or the subset of rejected candidate red eye regions, or both, in a later second stage to determine a second set of confirmed redeye regions;

correcting the second set of confirmed red eye regions and generating a second red eye corrected image which has the second set of confirmed red eye regions corrected therein; and

electronically storing, transmitting, further processing or editing, or displaying one or both of the first or the second red eye corrected image, or combinations thereof,

wherein the initial segmentation is performed upon acquisition of the image and the second later stage occurs in a background or playback mode or both.

2. The one or more non-transitory, processor-readable media of claim 1, wherein the method further comprises applying a speed-optimized set of one or more falsing/verification filters in the first stage.

3. The one or more non-transitory, processor-readable media of claim 1, wherein the method further comprises re-analyzing the first set of confirmed red eye regions in the second stage.

4. The one or more non-transitory, processor-readable media of claim 1, wherein the method further comprises displaying in real time the first red eye corrected image on a display screen prior to the later second stage without input from a user.

5. A method of detecting and correcting a red-eye defect within an acquired digital image, comprising:

using a processor;

acquiring an image including one or more faces including a red eye defect;

performing in a first stage an initial segmentation of candidate redeye regions within the image to determine a first set of one or more confirmed redeye regions designated for correction;

correcting the first set of red eye regions for generating a first red eye corrected image;

analyzing the image or the subset of rejected candidate red eye regions, or both, in a later second stage to determine a second set of confirmed redeye regions;

correcting the second set of confirmed red eye regions and generating a second red eye corrected image which has the second set of confirmed red eye regions corrected therein; and

electronically storing, transmitting, further processing or editing, or displaying one or both of the first or the second red eye corrected image, or combinations thereof,

wherein the initial segmentation is performed upon acquisition of the image and the second later stage occurs in a background or playback mode or both.

6. The method of claim 5, further comprising applying a speed-optimized set of one or more falsing/verification filters in the first stage.

7. The method of claim 5, further comprising re-analyzing the first set of confirmed red eye regions in the second stage.

8. The method of claim 5, further comprising displaying in real time the first red eye corrected image on a display screen prior to the later second stage without input from a user.

9. An embedded image acquisition and processing system, comprising:

an image acquisition subsystem;

a speed-optimized filter that performs in a first stage an initial segmentation of candidate redeye regions detected within an acquired image to determine a first set of one or more confirmed redeye regions designated for correction;

an analysis-optimized filter that determines in a later second stage a second set of one or more confirmed red eye regions within the image designated for correction;

a processor for correcting the first set of red eye regions for generating a first red eye corrected image; and

a storage device to record a subset of rejected candidate red eye regions that were rejected for correction in the first stage or the second stage, or both;

wherein the processor is further for electronically storing, transmitting, further processing or editing, or displaying one or both of the first or the second red eye corrected image, or combinations thereof,

wherein the speed-optimized filter is applied upon acquisition of the image and the analysis-optimized filter is applied in a background or playback mode or both.

10. The system of claim 9, wherein the speed-optimized filter applies a speed-optimized set of one or more falsing/verification filters.

11. The system of claim 9, wherein the first set of confirmed redeye regions is also passed through the analysis-optimized filter.

12. The system of claim 9, wherein the analysis-optimized filter includes an enhanced correction filter for application to the first set of one or more confirmed red eye regions.

13. The system of claim 9, further comprising a “

RE lib”

component for displaying in real time an initial red eye corrected image on a display screen prior to the later second stage without input from a user.