Optimized Performance and Performance for Red-Eye Filter Method and Apparatus

• US 20080043121A1
• Filed: 07/02/2007
• Published: 02/21/2008
• Est. Priority Date: 08/05/2003
• Status: Abandoned Application

• Current Assignee: Tessera Technologies Ireland Limited (Adeia Inc.)
• Original Assignee: FotoNation Vision Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Prilutsky, Yury, Capata, Adrian, Nanu, Florin, Drimbarean, Alexandru, Bigioi, Petronel, Corcoran, Peter, Pososin, Alexei
• Application Number:
  US11/772,427
• Publication Number:
  US 20080043121A1
• Time in Patent Office: Days
• US Class Current: 348/239
• CPC Class Codes: G03B 15/05 Combinations of cameras with electronic flash apparatus; Electronic flash units
• CPC Class Codes: G03B 2215/05 Combinations of cameras with electronic flash units
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/178 estimating age from face image; using age information for improving recognition
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/624 Red-eye correction control of camera based on recognised facial parts H04N23/611
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A digital camera has an integral flash and stores and displays a digital image. Under certain conditions, a flash photograph taken with the camera may result in a red-eye phenomenon due to a reflection within an eye of a subject of the photograph. A digital apparatus has a red-eye filter which analyzes the stored image for the red-eye phenomenon and modifies the stored image to eliminate the red-eye phenomenon by changing the red area to black. The modification of the image is enabled when a photograph is taken under conditions indicative of the red-eye phenomenon. The modification is subject to anti-falsing analysis which further examines the area around the red-eye area for indicia of the eye of the subject. The detection and correction can be optimized for performance and quality by operating on subsample versions of the image when appropriate.

Claims

1. :

A digital apparatus, comprising;

(a) an image store for holding;

(i) a temporary copy of an unprocessed image known as a pre-capture image;

(ii) a permanent copy of a digitally processed, captured image, and

(iii) a subsample representation of selected regions of the pre-capture image; and

(b) a red-eye filter for modifying an area within said at least one of the images indicative of a red-eye phenomenon based on an analysis of the subsample representation, and on an analysis of meta-data information.

2. :

The apparatus of claim 1, wherein said at least one of the images comprises the digitally processed, captured image.

3. :

The apparatus of claim 2, wherein said subsample representation of selected regions of said image is determined in hardware.

4. :

The apparatus of claim 2, wherein said analysis is performed in part on the full resolution image and in part on a subsample resolution of said image.

5. :

The apparatus of claim 2, further comprising a module for changing the degree of said subsampling.

6. :

The apparatus of claim 5, wherein said changing the degree of said subsampling is determined empirically.

7. :

The apparatus of claim 5, wherein said changing the degree of said subsampling is determined based on a size of said image.

8. :

The apparatus of claim 5, wherein said changing the degree of said subsampling is determined based on a region size.

9. :

The apparatus of claim 5, wherein said changing the degree of said subsampling is determined based on a complexity of calculation for said red eye filter.

10. :

The apparatus of claim 5, wherein said subsample representation is determined using a spline interpolation.

11. :

The apparatus of claim 5, wherein said subsample representation is determined using bi-cubic interpolation.

12. :

The apparatus of claim 5, wherein said changing the degree of said subsampling is determined based on data obtained from the camera relating to the settings of the camera at the time of image acquisition.

13. :

The apparatus of claim 12, wherein the data obtained from the camera includes an aperture setting or focus of the camera, or both.

14. :

The apparatus of claim 12, wherein the data obtained from the camera includes the distance of the subject from the camera.

15. :

The apparatus of claim 5, wherein said changing the degree of said subsampling is determined based on data obtained from the camera relating to image processing analysis of said precapture images.

16. :

The apparatus of claim 15, wherein said image processing analysis is based on histogram data obtained from said pre-capture image.

17. :

The apparatus of claim 15, wherein said image processing analysis is based on color correlogram data obtained from said pre-capture image.

18. :

The apparatus of claim 15, wherein said image processing analysis is based on global luminance or white balance image data, or both, obtained from said pre-capture image.

19. :

The apparatus of claim 15, wherein said image processing analysis is based on face detection analysis of said pre-capture image.

20. :

The apparatus of claim 15, wherein said image processing analysis is based on determining pixel regions with a color characteristic indicative of redeye.

21. :

The apparatus of claim 15, wherein said image processing analysis is performed in hardware.

22. :

The apparatus of claim 5, wherein said changing the degree of said subsampling is determined based on image metadata information.

23. :

The apparatus of claim 2, wherein said modifying the area is performed including the full resolution of said image.

24. :

The apparatus of claim 2, wherein said red-eye filter comprises a plurality of sub filters.

25. :

The apparatus of claim 1, wherein the metadata information comprises image acquisition device-specific metadata.

26. :

The apparatus of claim 25, wherein the metadata information comprises digitized image metadata.

27. :

The apparatus of claim 1, wherein the metadata information comprises digitized image metadata.