Personal authentication apparatus and personal authentication method

• US 8,912,885 B2
• Filed: 03/04/2013
• Issued: 12/16/2014
• Est. Priority Date: 06/16/2008
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Hirai, Shinya
• Primary Examiner(s): BEE, ANDREW W.
• Application Number:
  US13/783,594
• Publication Number:
  US 20130177218A1
• Time in Patent Office: 652 Days
• Field of Search: 340/5.53, 340/5.83, 382/118
• US Class Current: 340/5.83
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/175 Static expression

Abstract

A personal authentication apparatus comprises an input unit configured to input image data; a face detection unit configured to detect a face region of a person included in the image data input by the input unit, and to detect feature data from the detected face region; a facial expression determination unit configured to determine a facial expression from the face region detected by the face detection unit; a storage unit configured to store feature data used to authenticate a person in correspondence with respective facial expressions of a plurality of faces; a selection unit configured to select feature data corresponding to the facial expression determined by the facial expression determination unit from the storage unit; and an authentication unit configured to authenticate a person by comparing the feature data of the face region detected by the face detection unit, and the feature data selected by the selection unit.

Claims

1. A personal identification apparatus comprising:

an input unit configured to input image data;

a facial expression determination unit configured to determine a facial expression from a face in the image data;

a selection unit configured to select first feature data corresponding to the facial expression of the face in the image data, the first feature data used to identify a person, in correspondence with respective facial expressions of a plurality of faces, are obtained from and stored in a database; and

an identification unit configured to identify a person by comparing second feature data of the face in the image data, and the first feature data selected by said selection unit.

2. The apparatus according to claim 1, further comprising an obtaining unit configured to obtain the second feature data from the image data.

3. The apparatus according to claim 2, wherein the obtaining unit detects the face in the image data and obtains the second feature data from the detected face in the image data.

4. The apparatus according to claim 3, wherein when the second feature data which is not stored in the database and corresponds to another facial expression of the face is detected from the detected face in the image data, based on which the person is identified by said identification unit, the second feature data is stored in the database as feature data corresponding to the other facial expression of the person.

5. The apparatus according to claim 3, wherein said facial expression determination unit calculates a change amount of the second feature data from a plurality of successive image data, and determines the facial expression of the face based on the change amount.

6. The apparatus according to claim 3, wherein said identification unit identifies a person for each of a plurality of image data, which are used by said facial expression determination unit in determination of facial expressions of faces, and determines a final identification result based on respective identification results.

7. The apparatus according to claim 3, wherein said facial expression determination unit determines the facial expression of the face based on sizes and positions of facial components including eyes and mouth.

8. The apparatus according to claim 1, further comprising a notification unit configured to notify that the first feature data corresponding to the facial expression selected by said selection unit is not stored in the database when the first feature data is not stored in the database.

9. The apparatus according to claim 1, wherein the second feature data is obtained from the image data which is rotated to remove a tilt of the face in the image data.

10. The apparatus according to claim 1, further comprising a face detection unit configured to detect the face in the image data.

11. A personal identification method to be executed by a personal identification apparatus which includes an input unit configured to input image data, the method comprising:

a determination step of determining a facial expression from a face in the image data;

a selection step of selecting first feature data corresponding to the facial expression of the face in the image data, the first feature data used to identify a person, in correspondence with respective facial expressions of a plurality of faces, are obtained from and stored in a database; and

an identification step of identifying a person by comparing second feature data of the face in the image data, and the first feature data selected in the selection step.