Methods and apparatuses for using image acquisition data to detect and correct image defects

• US 8,212,864 B2
• Filed: 01/29/2009
• Issued: 07/03/2012
• Est. Priority Date: 01/30/2008
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia Inc.)
• Inventors: Nanu, Florin, Corcoran, Peter, Stan, Cosmin Nicolae
• Primary Examiner(s): Giles, Nicholas
• Application Number:
  US12/362,399
• Publication Number:
  US 20090189998A1
• Time in Patent Office: 1,251 Days
• Field of Search: 348/77, 348/78, 348/207.99, 348/222.1, 348/241, 348/246
• US Class Current: 348/78
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/624 Red-eye correction control of camera based on recognised facial parts H04N23/611
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation

Abstract

A method and device for detecting a potential defect in an image comprises acquiring a digital image at a time; storing image acquisition data, wherein the image acquisition data includes at least one of a position of a source of light relative to a lens, a distance from the source of light to the lens, a focal length of the lens, a distance from a point on a digital image acquisition device to a subject, an amount of ambient light, or flash intensity; determining dynamic anthropometric data, wherein the dynamic anthropometric data includes one or more dynamically changing human body measurements, of one or more humans represented in the image, captured at the time; and determining a course of corrective action based, at least in part, on the image acquisition data and the dynamic anthropometric data.

Claims

1. A portable digital image acquisition device comprising:

a lens;

a digital imaging capturing apparatus;

a source of light for providing illumination during image capture;

logic for performing the following operations;

acquiring a digital image at a time;

storing image acquisition data describing a condition at the lime;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data and the eye gaze angle; and

determining whether the eye gaze angle is greater than a value, and

wherein the course of action comprises performing at least one of the following operations responsive to determining that the eye gaze angle is greater than the value;

analyzing the image to identify yellow-eye defect candidates;

or analyzing the image to identify golden-eye defect candidates.

2. The portable digital acquisition device of claim 1 wherein the logic includes one or more processors executing software instructions.

3. The portable digital image acquisition device of claim 1, wherein:

the image acquisition data comprises a distance from the portable image acquisition device to a subject, and a separation between the source of light and a lens; and

the value is determined based, at least in part, on the distance and the separation.

4. The portable digital acquisition device of claim 3 wherein the logic includes one or more processors executing software instructions.

5. A portable digital image acquisition device comprising:

a lens;

a digital imaging capturing apparatus;

a source of light for providing illumination during image capture;

logic for performing the following operations;

acquiring a digital image at a time;

storing image acquisition data describing a condition at the lime;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data and the eye gaze angle; and

determining whether the eye gaze angle is greater than a value, and

wherein the course of action comprises analyzing the image to identify flash-eye defect candidates other than red-eye defect candidates responsive to determining that the eye gaze angle is greater than the value.

6. The portable digital acquisition device of claim 5 wherein the logic includes one or more processors executing software instructions.

7. A portable digital image acquisition device comprising:

a lens;

a digital imaging capturing apparatus;

a source of light for providing illumination during image capture; and

logic for performing the following operations;

acquiring a digital image at a time;

storing image acquisition data describing a condition at the lime;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data and the eye gaze angle

identifying a pair of eyes in the image, the pair of eyes including a first eye and a second eye;

determining that the eye gaze angle of the first eye indicates that it is likely that a first type of defect exists;

determining that the eye gaze angle of the second eye indicates that it is likely that a second type of defect exists;

analyzing the image to determine whether the image contains the first type of defect; and

analyzing the image to determine whether the image contains the second type of defect.

8. The portable digital acquisition device of claim 7 wherein the logic includes one or more processors executing software instructions.

9. A portable digital image acquisition device comprising:

a lens;

a digital imaging capturing apparatus;

a source of light for providing illumination during image capture; and

logic for performing the following operations;

acquiring a digital image at a time;

storing image acquisition data describing a condition at the time, including detecting a first value indicative of ambient light at the time and storing the first value;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data, the first value and the eye gaze angle

determining a second value indicative of a distance between an image capture apparatus and a subject;

storing the second value;

using the value to determine an on-subject pupil size;

using the on-subject pupil size and the second value to determine a critical distance; and

determining whether to perform a corrective action on the image based, at least in part, on the critical distance.

10. The portable digital image acquisition device of claim 9 further comprising logic for determining whether the eye gaze angle is less than a value, wherein the course of action comprises analyzing the image to identify red-eye defect candidates responsive to determining that the eye gaze angle is less than the value.

11. The portable digital acquisition device of claim 10 wherein the logic includes one or more processors executing software instructions.

12. The portable digital acquisition device of claim 9 wherein the logic includes one or more processors executing software instructions.

13. A portable digital image acquisition device comprising:

a lens;

a digital imaging capturing apparatus;

a source of light for providing illumination during image capture; and

logic for performing the following operations;

acquiring a digital image at a time;

storing image acquisition data describing a condition at the time, including detecting a first value indicative of ambient light at the time and storing the first value;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data, the first value and the eye gaze angle

determining a second value indicative of a distance between an image capture apparatus and a subject;

determining a third value indicative of a lens focal length;

storing the second value and the third value;

using the value, the second value, and the third value to determine an in-image pupil size; and

identifying defects in the image based at least in part on the in-image pupil size.

14. The portable digital acquisition device of claim 13 wherein the logic includes one or more processors executing software instructions.

15. The portable digital image acquisition device of claim 13 further comprising logic for determining whether the eye gaze angle is less than a value, wherein the course of action comprises analyzing the image to identify red-eye defect candidates responsive to determining that the eye gaze angle is less than the value.

16. A portable digital image acquisition device comprising:

a lens;

a digital imaging capturing apparatus;

a source of light for providing illumination during image capture; and

logic for performing the following operations;

acquiring a digital image at a time;

storing image acquisition data describing a condition at the lime;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data and the eye gaze angle

storing a value indicative of a position of the source of light relative to the lens;

using the value to identify an expected orientation for a half-red eye defect; and

identifying defect candidates in the image based, at least in part, on the expected orientation.

17. The portable digital acquisition device of claim 16 wherein the logic includes one or more processors executing software instructions.

18. One or more non-transitory processor-readable media having embedded code therein for programming a processor to perform a method comprising:

acquiring a digital image at a time;

storing image acquisition data describing a condition at the time

determining an eye gaze angle in the digital image; and

determining a course of action based, at least in part, on the image acquisition data and the eye gaze angle; and

determining whether the eye gaze angle is greater than a value, and

wherein the course of action comprises performing at least one of the following operations responsive to determining that the eye gaze angle is greater than the value;

analyzing the image to identify yellow-eye defect candidates;

or

analyzing the image to identify golden-eye defect candidates.

19. The one or more media of claim 18, wherein:

the image acquisition data comprises a distance from the portable image acquisition device to a subject, and a separation between a source of light and a lens; and

the value is determined based, at least in part, on the distance and the separation.

20. One or more non-transitory processor-readable media having embedded code therein for programming a processor to perform a method comprising:

acquiring a digital image at a time;

storing image acquisition data describing a condition at the time;

determining an eye gaze angle in the digital image; and

determining a course of action based, at least in part, on the image acquisition data and the eye gaze angle;

identifying a pair of eyes in the image, the pair of eyes including a first eye and a second eye;

determining that the eye gaze angle of the first eye indicates that it is likely that a first type of defect exists;

determining that the eye gaze angle of the second eye indicates that it is likely that a second type of defect exists;

analyzing the image to determine whether the image contains the first type of defect; and

analyzing the image to determine whether the image contains the second type of defect.

21. One or more non-transitory processor-readable media having embedded code therein for programming a processor to perform a method comprising:

acquiring a digital image at a time;

storing image acquisition data describing a condition at the time including detecting a first value indicative of ambient light at the time and storing the first value;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data, the first value, and the eye gaze angle;

determining a second value indicative of a distance between an image capture apparatus and a subject;

storing the second value;

using the value to determine an on-subject pupil size;

using the on-subject pupil size and the second value to determine a critical distance; and

determining whether to perform a corrective action on the image based, at least in part, on the critical distance.

22. The one or more media of claim 21, wherein the method further comprises:

determining whether the eye gaze angle is less than a value, wherein the course of action comprises analyzing the image to identify red-eye defect candidates responsive to determining that the eye gaze angle is less than the value.

23. One or more non-transitory processor-readable media having embedded code therein for programming a processor to perform a method comprising:

acquiring a digital image at a time;

storing image acquisition data describing a condition at the time including detecting a first value indicative of ambient light at the time and storing the first value;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data, the first value, and the eye gaze angle;

determining a second value indicative of a distance between an image capture apparatus and a subject;

determining a third value indicative of a lens focal length;

storing the second value and the third value;

using the value, the second value, and the third value to determine an in-image pupil size; and

identifying defects in the image based at least in part on the in-image pupil size.

24. One or more non-transitory processor-readable media having embedded code therein for programming a processor perform a method comprising:

acquiring a digital image at a time;

storing image acquisition data describing a condition at the time;

determining an eye gaze angle in the digital image;

determining a course of action based, at least in part, on the image acquisition data and the eye gaze angle;

storing a value indicative of a position of a source of light relative to a lens;

using the value to identify an expected orientation for a half-red eye defect; and

identifying defect candidates in the image based, at least in part, on the expected orientation.