Method, apparatus and computer readable recording medium for managing a reference face database to improve face recognition performance under a restricted memory environment

• US 9,298,976 B2
• Filed: 09/27/2012
• Issued: 03/29/2016
• Est. Priority Date: 09/27/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Je, Hong Mo, Lee, Hyung Soo, Ryu, Woo Ju
• Primary Examiner(s): Shah, Utpal
• Assistant Examiner(s): Duffy, Kate R
• Application Number:
  US14/129,628
• Publication Number:
  US 20140226877A1
• Time in Patent Office: 1,279 Days
• Field of Search: 382/112
• US Class Current: 1/1
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/50 Maintenance of biometric data or enrolment thereof

Abstract

Various embodiments of the present disclosure presents a method for managing a reference face database to improve face recognition performance under a restricted memory environment, said method comprising: acquiring a new input face image; determining a classification condition corresponding to the input face image with reference to classification conditions of existing registered face images of a reference face database used for face recognition; and if the classification condition corresponding to the input face image is a specific classification condition and the value of the face image corresponding to the specific classification condition in the reference face database is less than a preset threshold value, selecting the input face image as an image that can be additionally registered to the reference face database.

Claims

1. A method of managing a reference face database for improving performance of face recognition in a limited memory environment, the method comprising:

acquiring a new input facial image;

determining a classification condition relevant to the input facial image with reference to classification conditions of facial images previously registered in the reference face database used for face recognition;

if the classification condition relevant to the input facial image is a specific classification condition and a facial image relevant to the specific classification condition is less sufficient than a preset threshold value in the reference face database, selecting the input facial image as an image that can be additionally registered in the reference face database; and

deleting one or more of the facial images previously registered in the reference face database when the input facial image is additionally registered in the reference face database, including;

selecting an image having the smallest number of times used for the similarity matching among the facial images previously registered in the reference face database; and

deleting the selected facial image.

2. The method of claim 1, wherein the classification condition of the facial images previously registered in the reference face database includes at least one of a facial expression of the input facial image, an angle of photographing the facial image, a direction of a light cast on the facial image, and a type of a light source.

3. The method of claim 1, wherein whether the facial image relevant to the specific classification condition is less sufficient than the preset threshold value in the reference face database is determined based on an identity of a person included in the input facial image.

4. The method of claim 1, further comprising selecting one or more of the facial images previously registered in the reference face database when the input facial image is additionally registered in the reference face database.

5. The method of claim 1, wherein the step of deleting further comprises:

selecting the oldest facial image among the facial images previously registered in the reference face database; and

deleting the selected facial image.

6. The method of claim 1, wherein the step of deleting further comprises:

counting the number of times each of the facial images previously registered in the reference face database were used for similarity matching, from a preset time point until present, to recognize an identity of a face included in the newly input image.

7. The method of claim 1, wherein the step of deleting comprises:

determining similarity between the facial images previously registered in the reference face database;

selecting facial images having the closest similarity between the previously registered facial images in the reference database;

further selecting one of the selected facial images; and

deleting the further selected facial image.

8. A method of managing a reference face database for improving performance of face recognition in a limited memory environment, the method comprising:

acquiring a new input facial image;

determining a classification condition relevant to the input facial image with reference to classification conditions of facial images previously registered in the reference face database used for face recognition;

if the classification condition relevant to the input facial image is a specific classification condition and a facial image relevant to the specific classification condition is less sufficient than a preset threshold value in the reference face database, selecting the input facial image as an image that can be additionally registered in the reference face database; and

deleting one or more of the facial images previously registered in the reference face database when the input facial image is additionally registered in the reference face database, including;

calculating a variance in a class between the facial images previously registered in the reference face database by;

calculating an average of face recognition matching values of the previously registered facial images other than the selected facial image; and

calculating a difference between a face recognition matching value of the one selected previously registered facial image and the average of the other face recognition matching values;

selecting a facial image having the smallest variance value; and

deleting the selected facial image.

9. The method of claim 8, wherein the step of calculating a variance further comprises:

selecting one of the facial images previously registered in the reference face database.

10. A method of managing a reference face database for improving performance of face recognition in a limited memory environment, the method comprising:

acquiring a new input facial image;

determining a classification condition relevant to the input facial image with reference to classification conditions of facial images previously registered in the reference face database used for face recognition;

if the classification condition relevant to the input facial image is a specific classification condition and a facial imam relevant to the specific, classification condition is less sufficient than a preset threshold value in the reference face database, selecting the input facial image as an image that can be additionally registered in the reference face database; and

deleting one or more of the facial images previously registered in the reference face database when the input facial image is additionally registered in the reference face database, including;

calculating a variance in a class between the facial images previously registered in the reference face database by;

calculating an average of face recognition matching values of the facial images previously registered in the reference face database; and

calculating a difference between the average of the face recognition matching values and a face recognition matching value of each of the previously registered facial image;

selecting a facial image having the smallest variance value; and

deleting the selected facial image.

11. A reference face database managing apparatus for improving performance of face recognition in a limited memory environment, the apparatus comprising:

a reference face database configured to record a facial image used for face recognition; and

an additional registration face selection unit configured to determine a classification condition relevant to a new input facial image with reference to classification conditions of facial images previously registered in the reference face database, if the input facial image is acquired, to select the input facial image as an image that can be additionally registered in the reference face database, if the classification condition relevant to the input facial image is a specific classification condition and a facial image relevant to the specific classification condition is less sufficient than a preset threshold value in the reference face database and to delete one or more of the facial images previously registered in the reference face database when the input facial image is additionally registered in the reference face database, including selecting an image having the smallest number of times used for the similarity matching among the facial images previously registered in the reference face database and deleting the selected facial image.

12. The apparatus of claim 11, wherein the reference face database includes at least one of a facial expression of the input facial image, an angle of photographing the facial image, a direction of a light cast on the facial image, and a type of a light source, as the classification conditions of the previously registered facial images.

13. The apparatus of claim 11, wherein the additional registration face selection unit is configured to determine whether or not the facial image relevant to the specific classification condition is less sufficient than the preset threshold value in the reference face database based on an identity of a person included in the input facial image.

14. The apparatus of claim 11, further comprising a pre-registered face substitution unit configured to selecting some of the facial images previously registered in the reference face database when the input facial image is additionally registered in the reference face database.

15. The apparatus of claim 14, wherein the pre-registered face substitution unit is configured to select and delete the oldest facial image from among the facial images previously registered in the reference face database.

16. The apparatus of claim 14, wherein the pre-registered face substitution unit is configured to determine a similarity between the facial images previously registered in the reference face database, and select and delete facial images having the closest similarity between the previously registered facial images.

17. The apparatus of claim 16, wherein in determining the similarity, the pre-registered face substitution unit is configured to determine that similarity between two corresponding facial images is high as a difference between matching values is small, using the difference between the matching values for face recognition in the facial images previously registered in the reference face database.

18. The apparatus of claim 14, wherein the pre-registered face substitution unit is configured to calculate a variance in a class between the facial images previously registered in the reference face database, and select and delete a facial image having the smallest variance value.