USER AUTHENTICATION METHOD, DEVICE FOR EXECUTING SAME, AND RECORDING MEDIUM FOR STORING SAME

• US 20170076078A1
• Filed: 04/22/2015
• Published: 03/16/2017
• Est. Priority Date: 05/12/2014
• Status: Abandoned Application

• Current Assignee: Kim Ho
• Original Assignee: Kim Ho
• Inventors: KIM, Ho
• Application Number:
  US15/309,278
• Publication Number:
  US 20170076078A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/2135 based on approximation criteria, e.g. principal component analysis
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06V 10/446 using Haar-like filters, e.g. using integral image techniques
• CPC Class Codes: G06V 10/52 Scale-space analysis, e.g. wavelet analysis multi-scale boundary representations G06V10/42
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/7715 Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

The present invention relates to a user authentication method, a device for executing the same, and a recording medium for storing the same. A user authentication method executed in a user authentication device according to an embodiment of the present invention comprises: a step of, when image data of a user is received from an image photographing device, detecting a facial area and a facial feature point using each frame image of the image data; a step of performing a face authentication by matching the facial area with a predetermined face template; a password authentication step of detecting an eye winking using an image of an eye area extracted using the facial feature point, recognizing a password according to a state of the eye winking on the basis of a preconfigured reference, and checking whether the recognized password matches with a preconfigured password; and a step of determining that the user authentication is successful, on the basis of the results obtained from the face authentication and the password authentication.

Claims

1. A user authentication method performed by a user authentication device, comprising:

when image data of a user is received from an imaging device, detecting a facial area and facial feature points using individual frame images in the image data;

performing face authentication by matching the facial area with a specific face template;

performing password authentication by detecting whether eye winking occurs using an image of an eye region extracted using the facial feature points, by recognizing a password depending on a state of eye winking based on preset criteria, and by determining whether the recognized password matches a preset password; and

determining that authentication of the user succeeds based on results of the face authentication and results of the password authentication.

2. The user authentication method of claim 1, wherein the detecting the facial area and facial feature points using individual frame images in the image data comprises:

detecting a facial area from a specific frame image among the frame images, and defining the specific frame image as a key frame image; and

extracting a change region from a normal frame image based on the key frame image, and detecting a facial area from the normal frame image using the change region.

3. The user authentication method of claim 2, wherein the detecting the facial area from the specific frame image among the frame images and defining the specific frame image as the key frame image comprises:

setting a value, obtained by linearly coupling brightness values of pixels neighboring each pixel in the specific frame image to filter coefficients, to a brightness value of a corresponding pixel, thus eliminating noise from the specific frame image.

4. The user authentication method of claim 2, wherein the detecting the facial area from the specific frame image among the frame images and defining the specific frame image as the key frame image comprises:

determining the specific frame image to be a key frame image if there is no remainder when a frame number of the specific frame image is divided by a specific number.

5. The user authentication method of claim 2, wherein the extracting the change region from the normal frame image based on the key frame image and detecting the facial area from the normal frame image using the change region comprises:

generating a difference frame image including information about a difference between the key frame image and the normal frame image by comparing the key frame image with the normal frame image;

generating a binary frame image for the difference frame image by performing thresholding on the difference frame image;

eliminating noise by applying a filter to the binary frame image;

determining a face detection region from the normal frame image using the binary frame image; and

detecting a facial area from the face detection region.

6. The user authentication method of claim 5, wherein the generating the binary frame image for the difference frame image by performing thresholding on the difference frame image comprises:

comparing brightness values of respective pixels in the difference frame image with a threshold value;

converting a corresponding pixel into a white color when a brightness value of the pixel is greater than the threshold value; and

converting the corresponding pixel into a black color when the brightness value of the pixel is less than the threshold value.

7. The user authentication method of claim 6, wherein the eliminating the noise by applying the filter to the binary frame image comprises:

transposing a brightness value of a pixel corresponding to noise in the binary frame image into a median value of brightness values of neighboring pixels.

8. The user authentication method of claim 6, wherein the determining the face detection region from the normal frame image using the binary frame image comprises:

extracting rectangular regions including a white pixel from the binary frame image; and

determining a final rectangular region including individual rectangular regions to be the face detection region.

9. The user authentication method of claim 5, wherein the detecting the facial area from the face detection region comprises:

generating multiple images having different sizes by down-scaling the face detection region;

detecting candidate facial areas from respective multiple images; and

detecting a facial area from the corresponding frame image using an area common to the candidate facial areas detected from respective multiple images.

10. The user authentication method of claim 9, wherein the detecting the facial area from the face detection region comprises:

detecting candidate facial areas from respective multiple images, defining rectangular features for the detected candidate facial areas, and detecting a facial area based on a learning material obtained by training the rectangular features using an AdaBoost learning algorithm; and

detecting facial feature points from the detected facial area based on an Active Shape Model (ASM) technique.

11. The user authentication method of claim 1, wherein the performing the face authentication comprises:

calculating a similarity by comparing a binary feature amount of the facial area with a binary feature amount of a pre-stored specific face template, and outputting the results of the face authentication based on the calculated similarity.

12. The user authentication method of claim 1, wherein the detecting whether eye winking occurs using the image of the eye region extracted using the facial feature points, the recognizing the password depending on the state of eye winking, and the determining whether the recognized password matches the preset password comprises:

extracting an eye region from the facial area using facial feature points;

generating a pixel vector having specific dimensions using pixel values of the eye region;

reducing a number of dimensions of the pixel vector using Principal Component Analysis (PCA); and

detecting whether eye winking occurs by applying a Support Vector Machine (SVM) to the pixel vector having the reduced number of dimensions.

13. The user authentication method of claim 1, wherein the preset criteria are based on at least one of a state of winking of a left eye, a state of winking of a right eye, and a state of simultaneous winking of both eyes, and the state of winking includes at least one of a sequence of winking, a number of winking actions, a duration during which the corresponding eye is maintained in a closed or open state, and a combination of winking of the left eye and the right eye.

14. A user authentication device, comprising:

a facial area detection unit for, when image data of a user is received from an imaging device, detecting a facial area and facial feature points using individual frame images in the image data;

a first authentication unit for performing face authentication by matching the facial area with a specific face template;

a second authentication unit for detecting whether eye winking occurs using an image of an eye region extracted using the facial feature points, recognizing a password depending on a state of the eye winking based on preset criteria, and determining whether the recognized password matches a preset password; and

a determination unit for determining that authentication of the user succeeds based on results of the authentication by the first authentication unit and results of the authentication by the second authentication unit.

15. A recording medium for storing a computer program for executing a user authentication method performed by a user authentication device, the computer program comprising:

a function of, when image data of a user is received from an imaging device, detecting a facial area and facial feature points using individual frame images in the image data;

a function of performing face authentication by matching the facial area with a specific face template;

a password authentication function of detecting whether eye winking occurs using an image of an eye region extracted using the facial feature points, recognizing a password depending on a state of the eye winking based on preset criteria, and determining whether the recognized password matches a preset password; and

a function of determining that authentication of the user succeeds based on results of the face authentication and results of the password authentication.