Method, Apparatus, and Computer-Readable Recording Medium for Authenticating a User

• US 20140165187A1
• Filed: 12/28/2012
• Published: 06/12/2014
• Est. Priority Date: 12/29/2011
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Cheon, Jihee, Daesung, Kim
• Application Number:
  US13/976,558
• Publication Number:
  US 20140165187A1
• Time in Patent Office: Days
• US Class Current: 726/19
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2221/2103 Challenge-response
• CPC Class Codes: G06F 2221/2105 Dual mode as a secondary aspect
• CPC Class Codes: G06F 2221/2117 User registration
• CPC Class Codes: G06F 2221/2147 Locking files
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/45 Detection of the body part being alive
• CPC Class Codes: H04L 63/0853 using an additional device, e.g. smartcard, SIM or a different communication terminal cryptographic mechanisms or cryptographic arrangements for entity authentication involving additional secure or trusted devices H04L9/3234
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231

Abstract

Provided are a method, apparatus, and computer-readable recording medium for authenticating a user. The user authentication method includes obtaining an image including a face and a face movement by driving a camera to extract feature information on a facial image and a movement pattern from the obtained image, and comparing the extracted feature information on the facial image with feature information on a facial image registered in a storage and, when the extracted feature information matches the registered feature information, comparing the extracted movement pattern with a movement pattern registered in the storage and, when the extracted movement pattern matches the registered movement pattern, unlocking a device.

Claims

1. A method of authenticating a user, comprising:

(a) obtaining an image comprising a face and a face movement by driving a camera to extract feature information on a facial image and a movement pattern from the obtained image; and

(b) comparing the extracted feature information on the facial image with feature information on a facial image registered in a storage and, when the extracted feature information matches the registered feature information, comparing the extracted movement pattern with a movement pattern registered in the storage and, when the extracted movement pattern matches the registered movement pattern, unlocking a device,

wherein,

the movement pattern is at least one of the number of blinks of eyes and a rotation direction of a head, and

the feature information comprises descriptors of feature points.

2. The method according to claim 1, wherein,

the step (a) comprises obtaining a certain number of facial images inputted for a predetermined time, extracting feature information on eyes from a certain number of the facial images, and detecting the number of blinks of eyes by tracking the feature information on the eyes, and

the step (b) comprises unlocking the device when the extracted feature information on the facial image matches the feature information on the registered facial image and the number of detected blinks of eyes matches the registered number of blinks of eyes.

3. The method according to claim 1, wherein,

the step (a) comprises obtaining a certain number of facial images inputted for a predetermined time, and detecting a rotation direction of the head by tracking feature information on a certain number of the facial images, and

the step (b) comprises unlocking the device when the extracted feature information on the facial image matches the feature information on the registered facial image and the detected rotation direction of the head matches the registered rotation direction of the head.

4. The method according to claim 1, wherein,

the step (a) comprises obtaining a certain number of facial images inputted for a predetermined time, extracting feature information on eyes from a certain number of the facial images, detecting the number of blinks of eyes by tracking the feature information on the eyes, and detecting a rotation direction of the head by tracking feature information on a certain number of the facial images, and

the step (b) comprises unlocking the device when the extracted feature information on the facial image matches the feature information on the registered facial image, the number of detected blinks of eyes matches the registered number of blinks of eyes, and the detected rotation direction of the head matches the registered rotation direction of the head.

5. The method according to claim 1, further comprising:

(c) comparing the extracted feature information on the facial image with the feature information on the facial image registered in the storage and the extracted movement pattern with the movement pattern registered in the storage and, when there is a mismatch therebetween, requesting a password or a pattern; and

(d) comparing the password or pattern with a password or pattern registered in the storage and, when the password or pattern matches the registered password or pattern, unlocking the device, and adding the extracted feature information on the facial image and the extracted movement pattern to the storage to effect an update,

wherein the step (d) comprises comparing the password or pattern with the password or pattern registered in the storage and, when the password or pattern matches the registered password or pattern, unlocking the device, and replacing the feature information on the facial image and the movement pattern, registered in the storage, with the extracted feature information on the facial image and the extracted movement pattern to effect an update.

6. The method according to claim 1, further comprising:

(c) comparing the extracted feature information on the facial image with the feature information on the facial image registered in the storage, and the extracted movement pattern with the movement pattern registered in the storage and, when there is a mismatch therebetween, requesting a password or a pattern; and

(d) comparing the password or pattern with a password or pattern registered in the storage and, when the password or pattern matches the registered password or pattern, unlocking the device, and adding the extracted feature information on the facial image and the extracted movement pattern to the storage to effect an update,

wherein the step (d) comprises comparing the password or pattern with the password or pattern registered in the storage and, when the password or pattern matches the registered password or pattern, unlocking the device, and adding the extracted feature information on the facial image and the extracted movement pattern to a group of facial images registered in the storage to effect an update.

7. The method according to claim 1, further comprising:

(c) comparing the extracted feature information on the facial image with the feature information on the facial image registered in the storage, and the extracted movement pattern with the movement pattern registered in the storage and, when there is a mismatch therebetween, requesting a password or a pattern; and

(d) comparing the password or pattern with a password or pattern registered in the storage and, when the password or pattern matches the registered password or pattern, unlocking the device, and adding the extracted feature information on the facial image and the extracted movement pattern to the storage to effect an update,

wherein the step (d) comprises;

(d1) comparing the password or pattern with the password or pattern registered in the storage and, when the password or pattern matches the registered password or pattern, unlocking the device;

(d2) requesting approval from the user as to whether to add the extracted feature information on the facial image to effect an update; and

(d3) adding, when the user approves the update, the extracted feature information on the facial image to the storage to effect an update.

8. The method according to claim 1, further comprising:

(c) comparing the extracted feature information on the facial image with the feature information on the facial image registered in the storage and the extracted movement pattern with the movement pattern registered in the storage and, when there is a mismatch therebetween, requesting a password or a pattern; and

(d) comparing the password or pattern with a password or pattern registered in the storage and, when the password or pattern matches the registered password or pattern, unlocking the device, and adding the extracted feature information on the facial image and the extracted movement pattern to the storage to effect an update, and

further comprising, before the step (a), registering the password or pattern and the face and face movement in the storage,

wherein registering the password or pattern and the face and face movement in the storage comprises inputting the password or pattern n times and inputting the face and face movement m times to register the password or pattern and the feature information on the facial image and the movement pattern.

9. The method according to claim 8, wherein registering the password or pattern and the face and face movement in the storage comprises extracting the feature information on the registered facial image, extracting feature information on eyes from the registered facial image, detecting the number of blinks of eyes by tracking the feature information on the eyes, and storing the feature information on the facial image and the number of blinks of eyes.

10. The method according to claim 8, wherein registering the password or pattern and the face and face movement in the storage comprises extracting the feature information on the registered facial image, obtaining a rotation direction of the head by tracking the feature information on the registered facial image, and storing the feature information on the facial image and the rotation direction of the head.

11. The method according to claim 8, wherein registering the password or pattern and the face and face movement in the storage comprises extracting the feature information on the registered facial image, extracting feature information on eyes from the registered facial image, detecting the number of blinks of eyes by tracking the feature information on the eyes, obtaining a rotation direction of the head by tracking the feature information on the registered facial image, and storing the feature information on the facial image, the number of blinks of eyes, and the rotation direction of the head.

12. An apparatus for authenticating a user, comprising:

a storage for storing a registered facial image and a registered movement pattern;

a camera for scanning a face;

a display unit for displaying a face authentication window; and

a control unit for providing the face authentication window to the display unit, obtaining an image comprising a face and a face movement by driving a camera for authenticating the face to extract feature information on a facial image and a movement pattern from the obtained image, comparing the extracted feature information on the facial image with feature information on the facial image registered in the storage and, when the extracted feature information matches the registered feature information, comparing the extracted movement pattern with the movement pattern registered in the storage and, when the extracted movement pattern matches the registered movement pattern, unlocking a device,

wherein,

the movement pattern is at least one of the number of blinks of eyes and a rotation direction of a head, and

the feature information comprises descriptors of feature points.

13. The apparatus according to claim 12, wherein the control unit obtains a certain number of facial images inputted for a predetermined time, extracts feature information on eyes from a certain number of the facial images, detects the number of blinks of eyes by tracking the feature information on the eyes, and unlocks the device when the extracted feature information on the facial image matches the feature information on the registered facial image and the number of detected blinks of eyes matches the registered number of blinks of eyes.

14. The apparatus according to claim 12, wherein the control unit obtains a certain number of facial images inputted for a predetermined time, detects a rotation direction of the head by tracking feature information on a certain number of the facial images, and unlocks the device when the extracted feature information on the facial image matches the feature information on the registered facial image and the detected rotation direction of the head matches the registered rotation direction of the head.

15. The apparatus according to claim 12, wherein the control unit obtains a certain number of facial images inputted for a predetermined time, extracts feature information on eyes from a certain number of the facial images, detects the number of blinks of eyes by tracking the feature information on the eyes, and detects a rotation direction of the head by tracking feature information on a certain number of the facial images, and unlocks the device when the extracted feature information on the facial image matches the feature information on the registered facial image, the number of detected blinks of eyes matches the registered number of blinks of eyes, and the detected rotation direction of the head matches the registered rotation direction of the head.

16. The apparatus according to claim 12, wherein,

the storage additionally stores a registered password or a registered pattern,

the display unit additionally displays a password or pattern authentication window, and a password or a pattern is additionally inputted through the password or pattern authentication window,

the control unit compares the inputted password or pattern with the registered password or pattern, and, when the inputted password or pattern matches the registered password or pattern, the control unit unlocks the device and adds the extracted feature information on the facial image and the extracted movement pattern to the storage to effect an update, and

the control unit compares the inputted password or pattern with the password or pattern registered in the storage and, when the inputted password or pattern matches the registered password or pattern, the control unit unlocks the device and replaces the feature information on the facial image and the movement pattern, registered in the storage, with the extracted feature information on the facial image and the extracted movement pattern to effect an update.

17. The apparatus according to claim 12, wherein,

the storage additionally stores a registered password or a registered pattern,

the display unit additionally displays a password or pattern authentication window, and a password or a pattern is additionally inputted through the password or pattern authentication window,

the control unit compares the inputted password or pattern with the registered password or pattern, and, when the inputted password or pattern matches the registered password or pattern, the control unit unlocks the device and adds the extracted feature information on the facial image and the extracted movement pattern to the storage to effect an update, and

the control unit compares the inputted password or pattern with the password or pattern registered in the storage and, when the inputted password or pattern matches the registered password or pattern, the control unit unlocks the device and adds the extracted feature information on the facial image and the extracted movement pattern to a group of facial images registered in the storage to effect an update.

18. The apparatus according to claim 12, wherein,

the storage additionally stores a registered password or a registered pattern,

the display unit additionally displays a password or pattern authentication window, and a password or a pattern is additionally inputted through the password or pattern authentication window,

the control unit compares the inputted password or pattern with the registered password or pattern, and, when the inputted password or pattern matches the registered password or pattern, the control unit unlocks the device and adds the extracted feature information on the facial image and the extracted movement pattern to the storage to effect an update, and

before adding feature information on the scanned facial image to the storage to effect an update, the control unit displays a message to request approval from the user as to whether to add the feature information on the scanned facial image to effect an update, and, when the user approves the update, the control unit adds the feature information on the scanned facial image to the storage to effect an update.

19. The apparatus according to claim 12, wherein,

the storage additionally stores a registered password or a registered pattern,

the display unit additionally displays a password or pattern authentication window, and a password or a pattern is additionally inputted through the password or pattern authentication window,

the control unit compares the inputted password or pattern with the registered password or pattern, and, when the inputted password or pattern matches the registered password or pattern, the control unit unlocks the device and adds the extracted feature information on the facial image and the extracted movement pattern to the storage to effect an update, and

the storage stores a user authentication application, and, when the user requests an approach to the user authentication apparatus, the control unit executes the user authentication application.

20. The apparatus according to claim 19, wherein,

the control unit executes the user authentication application to provide a user authentication setting window, and provides a function of registering the password or pattern and a function of registering the face through the user authentication setting window, and

the display unit displays the user authentication setting window, and displays the function of registering the password or pattern and the function of registering the face.

21. The apparatus according to claim 20, wherein,

when the function of registering the password or pattern is selected, the control unit successively provides a password or pattern input window to the display unit n times, and, when the same password or pattern is successively inputted through the password or pattern input window n times, the control unit stores the password or pattern as the registered password or pattern in the storage, and

when the function of registering the face is selected, the control unit drives the camera and successively provides a face input window to the display unit m times, and, when the same face and face movement are successively inputted through the face input window m times, the control unit extracts feature information on the face and a movement pattern of the face and stores the extracted feature information on the face and the extracted movement pattern of the face as the feature information on the registered facial image and the registered movement pattern in the storage.

22. The apparatus according to claim 12, further comprising a transceiver for accessing a user authentication application providing server for downloading the user authentication application from the user authentication application providing server.

23. The apparatus according to claim 12, wherein the control unit stores the feature information on the registered facial image and the registered movement pattern in the storage, extracts the feature information and the movement pattern from the obtained facial image, and compares the extracted feature information on the facial image and the extracted movement pattern with the feature information on the facial image and the movement pattern which are registered in the storage.

24. A computer readable recording medium having instructions thereon which, when executed by a processor, performs operations comprising:

(a) obtaining an image comprising a face and a face movement by driving a camera to extract feature information on a facial image and a movement pattern from the obtained image; and

(b) comparing the extracted feature information on the facial image with feature information on a facial image registered in a storage and, when the extracted feature information matches the registered feature information, comparing the extracted movement pattern with a movement pattern registered in the storage and, when the extracted movement pattern matches the registered movement pattern, unlocking a device,

wherein,

the movement pattern is at least one of the number of blinks of eyes and a rotation direction of a head, and

the feature information comprises descriptors of feature points.

25. The computer readable medium according to claim 24, wherein,

the step (a) comprises obtaining a certain number of facial images inputted for a predetermined time, extracting feature information on eyes from a certain number of the facial images, and detecting the number of blinks of eyes by tracking the feature information on the eyes, and

the step (b) comprises unlocking the device when the extracted feature information on the facial image matches the feature information on the registered facial image and the number of detected blinks of eyes matches the registered number of blinks of eyes.