Face-controlled liveness verification

• US 10,102,358 B2
• Filed: 12/29/2015
• Issued: 10/16/2018
• Est. Priority Date: 12/29/2015
• Status: Active Grant

• Current Assignee: Sensory Incorporated
• Original Assignee: Sensory Incorporated
• Inventors: Wilder, Matthew
• Primary Examiner(s): Arani, Taghi
• Assistant Examiner(s): Champakesan, Badri
• Application Number:
  US14/983,238
• Publication Number:
  US 20170185760A1
• Time in Patent Office: 1,022 Days
• Field of Search: 726 19
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/45 Detection of the body part being alive

Abstract

Techniques for implementing face-controlled liveness verification are provided. In one embodiment, a computing device can present, to a user, a sequential series of targets on a graphical user interface (GUI) of the computing device, where each target is a visual element designed to direct the user'"'"'s attention to a location in the GUI. The computing device can further determine whether the user has successfully hit each target, where the determining comprises tracking movement of a virtual pointer controlled by the user'"'"'s gaze or face pose and checking whether the user has moved the virtual pointer over each target. If the user has successfully hit each target, the computing device can conclude that the user is a live subject.

Claims

1. A method comprising:

receiving, by a computing device from a user, an indication that the user wishes to access a secured resource on the computing device;

attempting, by the computing device, to authenticate the user a first time based on first facial biometric data presented by the user to a face-based authentication system of the computing device; and

if the attempting to authenticate the user the first time is successful;

directing, by the computing device, the user to look at a reference point in a graphical user interface (GUI) of the computing device, the reference point corresponding to an initial location of a virtual pointer;

capturing, by the computing device, one or more images of a face of the user while the user is looking at the reference point;

determining, by the computing device based on the one or more images, a reference frame for the user indicating a first gaze or a first face pose of the user when looking at the reference point;

presenting, by the computing device to the user, a sequential series of pluralities of targets on the GUI, each target being a visual element designed to direct the user'"'"'s attention to a location in the GUI, wherein at each step in the sequential series the plurality of targets for the step includes a valid target and an invalid target, wherein the valid target corresponds to a secret known to the user, and wherein the number of steps in the sequential series is based upon one or more criteria pertaining to the secured resource;

determining, by the computing device, whether the user has successfully hit the valid targets in the sequential series by checking whether the user has moved the virtual pointer over the valid targets, the checking comprising;

capturing one or more further images tracking movement of the user'"'"'s face; and

comparing a gaze or a face pose of the user in each of the one or more further images against the first gaze or the first face pose in the reference frame in order to determine how far and in which direction the user has moved the virtual pointer from the reference point;

if the user has successfully hit the valid targets, attempting, by the computing device, to authenticate the user a second time based on second facial biometric data presented by the user to the face-based authentication system;

if the attempting to authenticate the user the second time fails, denying, by the computing device, the user access to the secured resource; and

if the attempting to authenticate the user the second time is successful, concluding, by the computing device, that the user is a live subject and granting the user access to the secured resource.

2. The method of claim 1 further comprising:

if the user is not able to successfully hit the valid targets, concluding that the user is not a live subject and denying the user access to the secured resource.

3. The method of claim 1 wherein the attempts to authenticate the user the first and second times are further based on first and second voice biometric data presented by the user to a voice-based authentication system of the computing device.

4. The method of claim 1 wherein the plurality of targets are presented at random locations in the GUI.

5. The method of claim 1 wherein determining whether the user has successfully hit the valid targets further comprises determining whether the user has hovered the virtual pointer over the valid targets for a predefined duration.

6. The method of claim 1 wherein determining whether the user has successfully hit the valid targets further comprises determining whether the user has followed a predefined trajectory to the valid targets.

7. The method of claim 1 wherein the number of targets in the sequential series is further based upon one or more criteria pertaining to the user or.

8. The method of claim 1 wherein the virtual pointer is not visible to the user.

9. The method of claim 1 wherein the presenting is performed during a face enrollment process for the user.

10. The method of claim 1 further comprising, while the user is attempting to hit the valid targets:

adding the one or more further images to a face template of the user.

11. The method of claim 1, wherein determining whether the user has successfully hit the valid targets comprises:

determining whether the user has successfully hit each valid target, without hitting any invalid targets.

12. A non-transitory computer readable medium having stored thereon program code executable by a processor of a computing device, the program code comprising:

code that causes the processor to receive, from a user, an indication that the user wishes to access a secured resource on the computing device;

code that causes the processor to attempt to authenticate the user a first time based on first facial biometric data presented by the user to a face-based authentication system of the computing device; and

if the attempt to authenticate the user the first time is successful;

code that causes the processor to direct the user to look at a reference point in a graphical user interface (GUI) of the computing device, the reference point corresponding to an initial location of a virtual pointer;

code that causes the processor to capture one or more images of a face of the user while the user is looking at the reference point;

code that causes the processor to determine, based on the one or more images, a reference frame for the user indicating a first gaze or a first face pose of the user when looking at the reference point;

code that causes the processor to present to the user, a sequential series of pluralities of targets on the GUI, each target being a visual element designed to direct the user'"'"'s attention to a location in the GUI, wherein at each step in the sequential series the plurality of targets for the step includes a valid target and an invalid target, wherein the valid target corresponds to a secret known to the user, and wherein the number of steps in the sequential series is based upon one or more criteria pertaining to the secured resource;

code that causes the processor to determine whether the user has successfully hit the valid targets in the sequential series by checking whether the user has moved the virtual pointer over the valid targets, the checking comprising;

capturing one or more further images tracking movement of the user'"'"'s face; and

comparing a gaze or a face pose of the user in each of the one or more further images against the first gaze or the first face pose in the reference frame in order to determine how far and in which direction the user has moved the virtual pointer from the reference point;

if the user has successfully hit the valid targets, code that causes the processor to attempt to authenticate the user a second time based on second facial biometric data presented by the user to the face-based authentication system;

if the attempt to authenticate the user the second time fails, code that causes the processor to deny the user access to the secured resource; and

if the attempt to authenticate the user the second time is successful, code that causes the processor to conclude that the user is a live subject and grant the user access to the secured resource.

13. A computing device comprising:

a camera;

a display;

a processor; and

a memory having stored thereon program code which, when executed by the processor, causes the processor to;

receive, from a user, an indication that the user wishes to access a secured resource on the computing device;

attempt to authenticate the user a first time based on first facial biometric data presented by the user to a face-based authentication system of the computing device; and

if the attempt to authenticate the user the first time is successful;

direct the user to look at a reference point in a graphical user interface (GUI) shown on the display, the reference point corresponding to an initial location of a virtual pointer;

capture one or more images of a face of the user via the camera while the user is looking at the reference point;

determine, based on the one or more images, a reference frame for the user indicating a first gaze or a first face pose of the user when looking at the reference point;

present, to the user, a sequential series of pluralities of targets on the GUI, each target being a visual element designed to direct the user'"'"'s attention to a location in the GUI, wherein at each step in the sequential series the plurality of targets for the step includes a valid target and an invalid target, wherein the valid target corresponds to a secret known to the user, and wherein the number of steps in the sequential series is based upon one or more criteria pertaining to the secured resource;

determine whether the user has successfully hit the valid targets in the sequential series by checking whether the user has moved the virtual pointer over the valid targets, the checking comprising;

capturing one or more further images tracking movement of the user'"'"'s face; and

comparing a gaze or a face pose of the user in each of the one or more further images against the first gaze or the first face pose in the reference frame in order to determine how far and in which direction the user has moved the virtual pointer from the reference point;

if the user has successfully hit the valid targets, attempt to authenticate the user a second time based on second facial biometric data presented by the user to the face-based authentication system;

if the attempt to authenticate the user the second time fails, deny the user access to the secured resource; and

if the attempt to authenticate the user the second time is successful, conclude that the user is a live subject and grant the user access to the secured resource.