Eye open/close detection through correlation

• US 6,571,002 B1
• Filed: 11/09/1999
• Issued: 05/27/2003
• Est. Priority Date: 05/13/1999
• Status: Expired due to Fees

• Current Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Inventors: Ogawa, Kenji
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): SUKHAPHADHANA, CHRISTOPHER T
• Application Number:
  US09/437,110
• Time in Patent Office: 1,295 Days
• Field of Search: 382/117, 382/118, 382/289, 382/293, 382/296, 382/298, 382/209, 382/278, 340/575, 340/576, 351/206, 351/209, 351/210
• US Class Current: 382/117
• CPC Class Codes: G06F 17/153 Multidimensional correlation or convolution
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris

Abstract

A region of the eyes in an image of the face photographed by a camera 1 and input to an image input means 2 is specified by an eye-region determining means 8. The image of the eyes in the eye region is binarized by an eye-image binarizing means 9. The coordinates of the binarized image are rotated by a coordinate rotating means 10 to obtain an adequate correlation coefficient. The image of the eyes, the coordinates of which have been rotated, is used in a calculation which is performed by a correlation calculating means 11. In accordance with an obtained correlation coefficient, an opening/closing determining means 12 determines whether the eyes are opened or closed.

Claims

1. A face-image processing apparatus comprising:

image input means to which an image of the face photographed by a camera is input;

eye-image extracting means for extracting a binarized image of an eye from the image of the face input by said image input means;

coordinate rotating means for rotating coordinates of the image of the eye extracted by said eye-image extracting means for a predetermined angle;

correlation calculating means for calculating correlation by using the image of the eye rotated by said coordinate rotating means; and

opening/closing determining means for determining opening/closing of the eye in accordance with a correlation coefficient obtained by the calculation performed by said correlation calculating means.

2. The face-image processing apparatus according to claim 1, wherein said eye-image extracting means comprises:

eye-region determining means for specifying an eye region of the image of the face input by said image input means, and

binarizing means for binarizing the image of the eye contained in the eye region.

3. The face-image processing apparatus according to claim 1, further comprising:

length-and-breadth enlarging means for enlarging the length and breadth of the image of the eye binarized by said eye-image extracting means.

4. The face-image processing apparatus according to claim 3, further comprising:

means for controlling enlargement of the length and breadth of the image of the eye which is performed by said length-and-breadth enlarging means so that a mean value of the correlation coefficient satisfies a predetermined range.

5. The face-image processing apparatus according to claim 1, further comprising:

inclination correction means for correcting an inclination of the image of the eye binarized by said eye-image extracting means, wherein

said coordinate rotating means rotates the image of the eye corrected by said inclination correction means.

6. The face-image processing apparatus according to claim 5, wherein

said inclination correction means performs correction so that the correlation coefficient satisfies a predetermined range.

7. The face-image processing apparatus according to claim 5, further comprising:

inclination estimating means for estimating the inclination of the image of the face from the image of the face input by said image input means, wherein

said inclination correction means uses the inclination of the image of the face estimated by said inclination estimating means to correct the image of the eye.

8. The face-image processing apparatus according to claim 6, further comprising:

inclination estimating means for estimating the inclination of the image of the face input by said image input means, wherein

the inclination estimated by said inclination estimating means is used to limit the correction of the inclination of the image of the eye which is performed by said inclination correction means.

9. The face-image processing apparatus according to claim 7, wherein

said inclination estimating means estimates the inclination by using an image of the nostrils extracted from the image of the face.

10. The face-image processing apparatus according to claim 9, further comprising:

nostril-region determining means for specifying a nostril region, and

nostril extracting means for extracting the image of nostrils from the nostril region specified by said nostril-region determining means, wherein

extraction of the image of the nostrils is performed by said nostril-region determining means and said nostril extracting means.