Two stage detection for photographic eye artifacts

• US 7,689,009 B2
• Filed: 11/18/2005
• Issued: 03/30/2010
• Est. Priority Date: 11/18/2005
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: FotoNation Vision Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Ciuc, Mihai, Corcoran, Peter, Pososin, Alexei
• Primary Examiner(s): Bella; Matthew C
• Assistant Examiner(s): LIEW, ALEX KOK SOON
• Application Number:
  US11/282,954
• Publication Number:
  US 20070116379A1
• Time in Patent Office: 1,593 Days
• Field of Search: None
• US Class Current: 382/117
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction

Abstract

An image acquisition device includes a first speed-optimized filter for producing a first set of candidate red-eye regions for an acquired image; and a second analysis-optimized filter for operating on the first set of candidate red eye regions and the acquired image.

Claims

1. A digital image acquisition system, comprising:

(a) an image acquisition device comprising;

(i) an imaging optic and detector for acquiring an image;

(ii) a first speed-optimized filter for producing a first set of candidate red-eye regions for an acquired image;

(iii) an image encoder for encoding said acquired image

(iv) a display; and

(v) a first image correction module for correcting one or more of said first set of candidate face regions in an acquired image prior to display of said corrected image on said display;

(b) an image store memory for storing therein said encoded image in association with said first set of candidate red-eye regions for later image processing of said encoded image; and

(c) a second analysis-optimized filter configured to be activated after display of said first speed-optimized corrected acquired image on said display to produce a second set of candidate red-eye regions for the acquired image, wherein the second analysis-optimized filter is configured to operate on regions of said array identified as corresponding to regions of said first speed-optimized set of candidate red eye regions.

2. A device according to claim 1, wherein said first speed-optimized filter is configured to operate on a low resolution version of said acquired image.

3. A device according to claim 2, wherein said first speed-optimized filter is configured to operate on a sub-sampled version of said acquired image.

4. A device according to claim 2, wherein said image acquisition device is configured to perform a Discrete Cosine Transformation (DCT) of an acquired image of N*M pixels to produce an array of X*Y DCT blocks, where X and Y are less than N and M, respectively, and wherein said first speed-optimized filter is configured to operate on DCT characteristics of said DCT blocks.

5. A device according to claim 4, in which said filter is configured to selectively operate on the chroma coefficients of said DCT characteristics.

6. A device according to claim 4, in which said filter is configured to operate on the DC coefficients of said DCT characteristics.

7. A device according to claim 4, wherein said image compressor is configured to produce a lossy encoded image from said DCT blocks.

8. A device according to claim 7, wherein said encoded image comprises a JPEG image.

9. A device according to claim 8, wherein said image compressor is configured to store said first set of candidate red-eye regions in a header or a footer, or both, of said JPEG image.

10. A device according to claim 4, wherein said first set of candidate red-eye regions comprises a set of DCT block identifiers.

11. A device according to claim 1, further comprising a first image correction module for correcting one or more of said first set of candidate red-eye regions in an acquired image prior to display of said corrected image on said display.

12. A device according to claim 11, in which said first image correction module is configured to correct said acquired image prior to encoding by said image compressor, and wherein an indication of a region corrected by said first image correction module is stored in association with said corrected image.

13. A device according to claim 11, wherein said image acquisition device is configured to acquire a subsequent image after display of said corrected acquired image on said display.

14. A device according to claim 11, further comprising a second analysis-optimised filter configured to be activated after display of said first speed-optimized corrected acquired image on said display.

15. A device according to claim 1, operable for communication between the device and the second analysis-optimised filter to produce a second set of candidate red-eye regions for said encoded image based on an analysis of said encoded image and said first set of candidate red-eye regions.

16. A device according to claim 1, wherein said device is configured to partially decompress said stored image to produce an array of regions, each corresponding to a one or more pixels of an originally acquired image.

17. A device according to claim 16, wherein said second analysis-optimized filter is configured to fully decompress said identified regions and to analyse said regions at a pixel level.

18. A device according to claim 15 further comprising an image correction module for correcting an acquired imaged based on one or both of said first and second set of red-eye candidate regions.

19. A device according to claim 15, wherein said second analysis-optimized filter is implemented in an image playback module configured to render said compressed image at a relatively high resolution.

20. A device according to claim 19, in which said image playback module is integrally implemented on said digital image acquisition device and wherein said image playback module is configured to display an image on said image display.

21. A device according to claim 19, in which said image playback module is configured to run on a remote device and wherein said digital image acquisition device is configured to communicate said compressed image and said associated first set of candidate red-eye regions to said remote device.

22. A device according to claim 14, wherein said second analysis-optimized filter is optimized for accuracy.

23. A device according to claim 1, wherein the image acquisition device further comprises an image compressor for compressing said acquired image.

24. A device according to claim 1, wherein the display for displaying an image stored on said acquisition device.

25. A device according to claim 1, further comprising a signal connection for transferring said image to a PC or other microprocessor-based device, or both, for further image processing of said encoded image.

26. An image acquisition device comprising:

an imaging optic and detector for acquiring an image;

a first speed optimized filter for producing a first set of candidate red-eye regions for an acquired image;

an image encoder for encoding said acquired image a display;

a first image correction module for correcting one or more of said first set of candidate face regions in an acquired image prior to display of said corrected image on said display;

a second analysis-optimized filter configured to be activated after display of said first speed-optimized corrected acquired image on said display for producing a second set of candidate red-eye regions for the acquired image; and

an image store memory for storing therein an encoded image in association with said first set of candidate red-eye regions for later image processing by said second analysis-optimized filter.

27. An device according to claim 26, wherein the display for displaying an image processed by said first speed-optimized filter.

28. A device according to claim 26, further comprising an image compressor for compressing said acquired image.

29. A device according to claim 26, further comprising a signal connection for transferring said image to a PC or other microprocessor-based device, or both, for further image processing of said encoded image.

30. A method of processing a digital image comprising:

using one or more processors in performing the following;

filtering an acquired image with a first speed optimized filter to produce a first set of candidate red-eye regions;

encoding said acquired image;

storing said encoded image in association with said first set of candidate red-eye regions for later image processing of said encoded image;

displaying a first corrected image based on said encoding;

correcting one or more of said first set of candidate face regions in an acquired image prior to displaying said first corrected image;

activating a second analysis-optimized filter after displaying said first corrected image for producing a second set of candidate red-eye regions for the acquired image; and

, operating the second analysis-optimized filter on regions of said array identified as corresponding to regions of said first speed-optimized set of candidate red-eye regions.

31. A method according to claim 30, wherein said filtering comprises operating on a low resolution version of said acquired image.

32. A method according to claim 31, wherein said filtering comprises operating on a sub-sampled version of said acquired image.

33. A method according to claim 31, further comprising performing a Discrete Cosine Transformation (DCT) of an acquired image of N*M pixels to produce an array of X*Y DCT blocks, where X and Y are less than N and M, respectively, and wherein said filtering comprises operating on DCT characteristics of said DCT blocks.

34. A method according to claim 33, wherein said filtering comprises selectively operating on the chroma coefficients of said DCT characteristics.

35. A method according to claim 33, wherein said filtering comprises operating on the DC coefficients of said DCT characteristics.

36. A method according to claim 33, further comprising producing a lossy encoded image from said DCT blocks.

37. A method according to claim 33, further comprising storing said first set of candidate red-eye regions in a header or a footer, or both, of said encoded image.

38. A method according to claim 30, further comprising correcting one or more of said first set of candidate red-eye regions in an acquired image prior to display of said corrected image on said display.

39. A method according to claim 38, comprising correcting said acquired image prior to encoding by said image compressor, and storing an indication of a region corrected by said first image correction module in association with said corrected image.

40. A method according to claim 38, further comprising acquiring a subsequent image after display of said first corrected image on said display.

41. A method according to claim 30, further comprising communicating with the second analysis-optimized filter configured to produce a second set of candidate red-eye regions for said stored image based on an analysis of said stored image and said first set of candidate red-eye regions.

42. A method according to claim 30, further comprising transferring said encoded image to a PC or other microprocessor-based device, or both, for further processing of said encoded image.

43. A method according to claim 30, further comprising displaying said encoded image.

44. A method according to claim 30, further comprising compressing said encoded image.

45. A method according to claim 44, further comprising at least partially decompressing said encoded image to produce an array of regions, each corresponding to a one or more pixels of an originally acquired image.

46. A method according to claim 45, comprising fully decompressing said identified regions and analyzing said regions at a pixel level.

47. A method according to claim 45, further comprising correcting an acquired imaged based on one or both of said first and second set of red-eye candidate regions.

48. A method according to claim 45, further comprising implementing a further analysis filter in an image playback module for rendering said compressed image at a relatively high resolution.

49. A method according to claim 48, comprising integrally implementing said playback module on said digital image acquisition device for displaying an image on said image display.

50. A method according to claim 48, further comprising running said image playback module on a remote device and communicating said compressed image and said associated first set of candidate red-eye regions to said remote device.

51. One or more processor readable storage devices having processor readable code embodied thereon, said processor readable code for programming one or more processors to perform a method of processing a digital image,

the method comprising:

filtering an acquired image with a first speed optimized filter to produce a first set of candidate red-eye regions;

encoding said acquired image;

storing said encoded image in association with said first set of candidate red-eye regions for later image processing of said encoded image;

displaying a first corrected image based on the encoding;

a first image correction module for correcting one or more of said first set of candidate face regions in an acquired image prior to displaying said first corrected image; and

activating a second analysis-optimized filter after displaying said first corrected image for producing a second set of candidate red-eye regions for the acquired image; and

operating the second analysis-optimized filter on regions of said array identified as corresponding to regions of said first speed-optimized set of candidate red-eye regions.

52. The one or more storage devices of claim 51, wherein said filtering comprises operating on a low resolution version of said acquired image.

53. The one or more storage devices of claim 51, the method further comprising correcting one or more of said first set of candidate red-eye regions in an acquired image prior to display of said corrected image on said display.

54. The one or more storage devices of claim 51, the method further comprising communicating with a second analysis-optimized filter configured to produce a second set of candidate red-eye regions for said stored image based on an analysis of said stored image and said first set of candidate red-eye regions.

55. The one or more storage device of claim 51, the method further comprising transferring said encoded image to a PC or other microprocessor-based device, or both, for further processing of said encoded image.

56. The one or more storage devices of claim 51, the method further comprising displaying said encoded image.

57. The one or more storage devices of claim 51, the method further comprising compressing said encoded image.

58. The one or more storage devices of claim 57, the method further comprising at least partially decompressing said encoded image to produce an array of regions, each corresponding to a one or more pixels of an originally acquired image.

59. The one or more storage devices of claim 58, the method further comprising fully decompressing said identified regions and analyzing said regions at a pixel level.

60. The one or more storage devices of claim 58, the method further comprising correcting an acquired imaged based on one or both of said first and second set of red-eye candidate regions.

61. The one or more storage devices of claim 58, the method further comprising implementing a further analysis filter in an image playback module for rendering said compressed image at a relatively high resolution.

62. The one or more storage devices of claim 61, comprising integrally implementing said playback module on said digital image acquisition device for displaying an image on said image display.

63. The one or more storage devices of claim 61, further comprising running said image playback module on a remote device and communicating said compressed image and said associated first set of candidate red-eye regions to said remote device.