Person identification apparatus and method using concentric templates and feature point candidates

• US 5,982,912 A
• Filed: 03/12/1997
• Issued: 11/09/1999
• Est. Priority Date: 03/18/1996
• Status: Expired due to Term

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Yamaguchi, Osamu, Fukui, Kazuhiro
• Primary Examiner(s): Au, Amelia
• Assistant Examiner(s): COOPERRIDER, FRED E
• Application Number:
  US08/815,135
• Time in Patent Office: 972 Days
• Field of Search: 434/155, 902/3-6, 902/25-29, 340/541, 340/825.3, 364/413.13, 382/100, 382/110, 382/115, 382/116, 382/118, 382/168, 382/170-175, 382/190, 382/192, 382/194.5, 382/197, 382/199, 382/204, 382/205, 382/206, 382/203, 382/209 , 382/215, 382/212, 382/213, 382/216, 382/218, 382/221, 382/217, 382/220, 382/224, 382/225, 382/241-243, 382/261, 382/264, 382/271, 382/272, 382/278 , 382/282-284, 382/117
• US Class Current: 382/118
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions

Abstract

In a person identification apparatus, a normalized face image is used to identify a person. When the face image of the person is input, a face area extraction section extracts the face area from the face image. A feature point extraction section extracts a plurality of candidates of feature points from the face area using a separation filter. A feature point set selection section selects sets of the candidates from the plurality of candidates of feature points according to face structure information. A feature point decision section extracts neighboring patterns of each candidate from the face area for the set of candidates, calculates a similarity value between the neighboring patterns of each candidate and the template pattern, and selects a subset of the candidates having the highest similarity values. A normalization section generates a normalized face image of the face area according to the selected subset of the candidates. A recognition section compares the normalized face image with the registered image to identify the person.

Claims

1. A person identification apparatus, comprising:

image input means for inputting an image of a person to be identified;

face area extraction means for extracting a face area from the inputted image of the person;

feature point extraction means for extracting a plurality of candidate of feature points from the extracted face area by superimposing a separation filter on the face area, the separation filter being a mask of concentric shapes including an outer ring and an inner ring to calculate a separability of feature value between the outer ring and the inner ring;

feature point set selection means for selecting n-sets of candidate feature points from all sets of candidate feature points according to face structure information;

feature point decision means for extracting a neighbor pattern including a position of each candidate feature point from the face area, a size of the neighbor pattern being based on a size of the separation filter, for calculating a similarity value between the neighbor pattern for each candidate feature point and a previously-registered template pattern, the template pattern being a standard image of the feature point, and for selecting one set of candidate feature points whose sum of the similarity values is highest among n-sets of the candidate feature points;

normalization means for generating a normalized face image of the face area according to the one set of candidate feature points; and

recognition means for comparing the normalized face image with previously-registered image to identify the person.

2. The person identification apparatus according to claim 1, wherein said image input means inputs an image including a nostril of the face of the person.

3. The person identification apparatus according to claim 1, wherein

a plurality of the separation filters having different sizes are superimposed on the face area to handle various sizes of the feature points.

4. The person identification apparatus according to claim 3, wherein said feature point extraction means includes means for respectively calculating the separability of a feature value between pixels included in the outer ring and pixels included in the inner ring according to a decision equation while the mask is superimposed on the face area.

5. The person identification apparatus according to claim 4, wherein said feature point extraction means includes means for extracting pixels area corresponding to a position of the mask from the face area as the candidate feature point when the separability corresponding to the position of the mask exceeds a threshold.

6. The person identification apparatus according to claim 1, wherein said face structure information includes a first distance between a pair of eyes, a second distance between a pair of nostrils, a third distance between a pair of edges of a mouth, a fourth distance between a center point of the first distance and a center point of the second distance, a first angle between a vector of the first distance and a vector of the second distance, and a second angle between a vector of the first distance and a vector of the fourth distance.

7. The person identification apparatus according to claim 6, wherein said feature point set selection means includes means for calculating an evaluation value for all sets of candidate feature points according to the face structure information, and means for selecting n-sets of the candidate feature points whose evaluation values have a high rank among all sets of candidate feature points.

8. The person identification apparatus according to claim 1, wherein said feature point decision means includes means for extracting a rectangular area corresponding to the position of the candidate feature point from the face area as the neighbor pattern.

9. The person identification apparatus according to claim 1, wherein said normalization means includes means for normalizing position and size of the one set of candidate feature points to generate the normalized face image.

10. A method for identifying a person corresponding to a face image, comprising the steps of:

inputting the face image of the person to be identified;

extracting a face area from the face image of the person;

extracting a plurality of candidate feature points from the face area by superimposing a separation filter on the face area, the separation filter being a mask of concentric circles including an outer ring and an inner ring to calculate a separability of feature value between the outer ring and the inner ring;

selecting n-sets of candidate feature points from all sets of candidate feature points according to face structure information;

extracting a neighbor pattern including a position of each candidate feature point from the face area, a size of the neighbor pattern being based on a size of the separation filter;

calculating a similarity value between the neighbor pattern of each candidate feature point and a previously-registered template pattern, the template pattern being a standard image of the feature point;

selecting one set of the candidate feature points whose sum of the similarity values is highest among n-sets of the candidate feature points;

generating a normalized face image of the face area according to the one set of candidate feature points; and

comparing the normalized face image with a previously registered image to identify the person.

11. A computer readable memory containing computer-readable instructions to identify a person, comprising:

instruction means for causing a computer to input a face image of the person to be identified;

instruction means for causing a computer to extract a face area from the face image of the person

instruction means for causing a computer to extract a plurality of candidate feature points from the face area by superimposing a separation filter on the face area, the separation filter being a mask of concentric shapes including an outer ring and an inner ring to calculate a separability of feature value between the outer ring and the inner ring;

instruction means for causing a computer to select n-sets of candidate feature points from all sets of candidate feature points according to face structure information;

instruction means for causing a computer to extract a neighbor pattern including a position of each candidate feature point from the face area, a size of the neighbor pattern being based on a size of the separation filter;

instruction means for causing a computer to calculate a similarity value between the neighbor pattern of each candidate feature point and a previously-registered template pattern, the template pattern being a standard image of the feature point;

instruction means for causing a computer to select one set of the candidate feature points whose sum of the similarity values is highest among n-sets of the candidate feature points;

instruction means for causing a computer to generate a normalized face image of the face area according to the one set of candidate feature points; and

instruction means for causing a computer to compare the normalized face image with a previously-registered image to identify the person.