Method for automatically locating eyes in an image

• US 20030016846A1
• Filed: 06/19/2001
• Published: 01/23/2003
• Est. Priority Date: 06/19/2001
• Status: Active Grant

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Eastman Kodak Company
• Inventors: Luo, Jiebo, Chen, Shoupu
• Granted Patent: US 6,895,103 B2
• Time in Patent Office: Days
• US Class Current: 382/117
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation

Abstract

A digital image processing method for locating human eyes in a digital image, includes the steps of detecting a skin colored region in the image; detecting human iris color pixels in the skin colored region; forming initial estimates of eye positions using the locations of the detected iris color pixels in the skin colored region; estimating the size of each eye based on the distance between the estimated initial eye positions; forming a first search window for one eye, the center of the window being the estimated initial position for the one eye and the size of the window being proportional to the estimated size of the one eye; and employing a template to locate an eye in the first search window.

Claims

1. A digital image processing method for locating human eyes in a digital image, comprising the steps of:

a) detecting a skin colored region in the image;

b) detecting human iris color pixels in the skin colored region;

c) forming initial estimates of eye positions using the locations of the detected iris color pixels in the skin colored region;

d) estimating the size of each eye based on the distance between the estimated initial eye positions;

e) forming a first search window for one eye, the center of the window being the estimated initial position for the one eye and the size of the window being proportional to the estimated size of the one eye; and

f) employing a template to locate an eye in the first search window.

2. The method claimed in claim 1, further comprising:

g) forming a second search window for another eye;

the center of the window being the estimated initial position for the other eye and the size of the window being proportional to the estimated size of the other eye; and

h) employing a template to locate another eye in the second search window.

3. The method claimed in claim 1, further comprising the step of finding an oval shaped skin color region, and locating eyes in only the oval shaped skin color region.

4. The method claimed in claim 2, wherein the step of forming initial estimates of eye positions comprises the steps of:

a) grouping the detected iris color pixels into clusters;

b) finding the center of each iris color pixel cluster;

c) dividing the oval region into a left-half and a right-half along a major axis of the oval region; and

d) forming the initial estimates of eye positions based on the location of the centers of the clusters in relation to the left and right halves of the oval region.

5. The method claimed in claim 1, wherein the step of detecting human iris color pixels, comprises the steps of:

c1) deriving probability distributions of iris and noniris colored pixels from a number of sample images, and

c2) using the derived probability distributions in a Bayes model to produce a look up table indicating the probability that a given pixel is an iris colored pixel.

6. The method as claimed in claim 2, wherein the step of employing a template to locate an eye in a search window comprises determining a plurality of eye locations in the search window that give a desired matching response to the template.

7. The method as claimed in claim 6 further comprising the step of finding a best pair of eye locations, one eye location from each window.

8. The method as claimed in claim 7, wherein the step of finding the best pair of eye locations includes computing a plurality of figures of merit for each pair of eye locations and summing the figures of merit for each pair of eye locations.

9. The method as claimed in claim 8, wherein the step of computing a plurality of figures of merit selected from the group comprising:

orientation, proximity, combined matching score, proportion, profile, and evidence of mouth.

10. The method as claimed in claim 9, wherein the step of computing a proximity figure of merit includes measuring the proximity of the located eyes to the estimated initial eye positions.

11. The method as claimed in claim 9, wherein the step of employing a template to locate an eye in a search window comprises determining a plurality of eye locations in the search window that give a desired matching response to the template, and wherein the step of computing a combined matching score includes summing up individual matching scores.

12. The method as claimed in claim 9, wherein the step of computing a proportion figure of merit includes providing an anthropological eye distance model, and computing a value representing the match between a distance between the located eyes with the anthropological eye distance model.

13. The method as claimed in claim 9, wherein the step of computing a profile figure of merit includes:

providing a pre-determined model of an eye-to-eye profile;

determining an actual eye to eye profile; and

computing a goodness-of-fit between the actual eye to eye profile to the eye to eye model profile.

14. The method as claimed in claim 9, wherein the step of computing an evidence of mouth figure of merit includes:

computing values representing strength and orientation of edges within a mouth window determined by a pair of eye locations.

15. The method as claimed in claim 6 wherein the desired matching response is a local maximum matching score.