Secure face authentication with liveness detection for mobile

• US 9,684,779 B2
• Filed: 11/26/2014
• Issued: 06/20/2017
• Est. Priority Date: 11/29/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Su, Zhong, Qian, Wei Hong, Li, Min, Bao, Sheng Hua
• Primary Examiner(s): SHAW, BRIAN F
• Application Number:
  US14/554,296
• Publication Number:
  US 20150154392A1
• Time in Patent Office: 937 Days
• Field of Search: 382118, 382124, 726 19, 726 2, 726 4, 726 5, 713186
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06Q 20/00 Payment architectures, schemes or protocols apparatus for performing or posting payment transactions G07F7/08, G07F19/00; electronic cash registers G07G1/12
• CPC Class Codes: G06Q 20/4014 Identity check for transactions

Abstract

An authentication method can include, a random expression prompt, recording of the user'"'"'s expression actions, and an authentication result. This is completed using a terminal device configured to display authentication information, record the user'"'"'s inputted information, and send an authentication result. The terminal device may be further configured to package an authentication result, and send it to an authentication server. Subsequent actions of the user are allowed or denied based on the authentication result.

Claims

1. A computer enabled authentication method, the authentication method comprising:

generating, during an authentication and by a processor device, a random sequence that includes at least one expression prompt and a random pattern prompt;

prompting a user to take an expression action that is provided in an expression prompt;

recording, via a camera, the expression action of the user based on the expression prompt;

prompting the user to write a random phrase that is provided in the random pattern prompt on the touch screen;

recording one or more finger movements of the user, wherein the one or more finger movements include the user touching the touch screen;

packaging authentication information, wherein the authentication information includes at least the expression prompt, the expression action distinct from the expression prompt, the random pattern prompt, the recorded expression action, and the recorded one or more finger movements;

sending the packaged authentication information to an authentication server; and

receiving, from the authentication server, a first authentication result, wherein the first authentication result is based on at least a comparison between facial features of the user recorded as the expression action and predetermined rules associated with the expression prompt, wherein the expression action is not matched to prerecorded pictures of the user, and wherein the first authentication result is further based on a comparison between the recorded finger movements of the user and the random phrase.

2. The authentication method according to claim 1, wherein the recording of the expression action further comprises:

locking, during the recording, a face of the user;

detecting the face of the user within a shooting range defined by a locking box;

determining whether the face of the user is out of the shooting range, and

failing an authentication in response to determining that the face of the user is out of the shooting range.

3. The authentication method of claim 1, further comprising:

generating a random statement prompt including one or more statements;

recording sounds and mouth movements of the user speaking the random statement prompt; and

receiving a second authentication result for the random statement prompt, wherein the second authentication result includes a comparison between the sound and mouth movements of the user for each statement.

4. The authentication method of claim 1, further comprising:

generating a random fingerprint prompt that requires the user to input fingerprint information on a touch screen in a sequence;

recording fingerprint information of the user on the touch screen; and

receiving a third authentication result for the random fingerprint prompt, wherein the third authentication result includes a comparison between the recorded fingerprint information of the user and the random fingerprint prompt.

5. The authentication method of claim 1, further comprising:

permitting access based on the first authentication result.

6. The authentication method of claim 1, wherein prompting the at least one expression action further comprises:

locking a face of the user during the expression prompt;

detecting the face of the user within a shooting range that is defined by a locking box,

determining whether the face of the user is within the locking box, and

instructing, in response to the face of the user being within the locking box, the user to perform the expression action.

7. The authentication method of claim 1, wherein the random pattern prompt further includes a random pattern, the method further comprising:

locking, during a locking period, a finger of the user such that the user is not permitted to remove his finger from the touch screen;

prompting the user to draw the random pattern on the touch screen; and

detecting, during the locking period, that the finger does not leave the touch screen,

wherein the prompting the user to draw the random pattern and the recording of the one or more finger movements occur during the locking period, and wherein the first authentication result is further based on a comparison between the one or more finger movements of the user and the random pattern.

8. The authentication method of claim 1, wherein the number of prompts in the sequence is random, wherein the authentication server is remote from a terminal device that includes the processor device, the authentication server being configured to provide authentication services to two or more terminal devices, and wherein the authentication server and the terminal device are communicatively coupled via a network.

9. An authentication apparatus, comprising:

a memory;

a processor device communicatively coupled to the memory, wherein the processor device is configured to perform a method comprising;

generating a random sequence that includes at least one expression prompt, wherein an expression prompt is used to prompt a user to take a corresponding expression action including an expression action that is provided in an expression prompt,

recording the expression action of the user based on the expression prompt,

generating a random pattern prompt that requires the user to write a random phrase on a touch screen;

prompting the user to write the random phrase on the touch screen;

recording one or more finger movements of the user, wherein the one or more finger movements include the user touching the touch screen;

packaging authentication information, wherein the authentication information includes at least the expression prompt, the expression action distinct from the expression prompt, the random pattern prompt, the recorded expression action, and the recorded one or more finger movements;

sending the packaged authentication information to an authentication server; and

receiving, from the authentication server, a first authentication result, wherein the first authentication result is based on at least a comparison between facial features of the user recorded as the expression action and predetermined rules associated with the expression prompt, wherein the expression action is not matched to prerecorded pictures of the user, and wherein the first authentication result is further based on a comparison between the recorded finger movements of the user and the random phrase.

10. The authentication apparatus according to claim 9, wherein the recording the expression action of the user comprises:

locking, during the recording, a face of the user by;

detecting the face of the user within a shooting range defined by a locking box,

determining whether the face of the user is out of the shooting range, and

failing an authentication in response to determining that the face of the user is out of the shooting range.

11. The authentication apparatus according to claim 9, wherein the method performed by the processor device further comprises:

generating a random statement prompt including one or more statements;

recording sounds and mouth movements of the user speaking the random statement prompt; and

receiving a second authentication result for the random statement prompt, wherein the second authentication result includes a comparison between the sound and mouth movements of the user for each statement.

12. The authentication apparatus according to claim 9, wherein the method performed by the processor device further comprises:

generating a random fingerprint prompt that requires the user to input fingerprint information on a touch screen in a sequence;

recording fingerprint information of the user on the touch screen; and

receiving a third authentication result for the random fingerprint prompt, wherein the third authentication result includes a comparison between a recorded fingerprint information of the user and the random fingerprint prompt.