Facial recognition authentication system including path parameters

• US 10,262,126 B2
• Filed: 03/23/2018
• Issued: 04/16/2019
• Est. Priority Date: 08/28/2014
• Status: Active Grant

• Current Assignee: FaceTec, Inc.
• Original Assignee: FaceTec, Inc.
• Inventors: Tussy, Kevin Alan
• Primary Examiner(s): Abedin, Shanto
• Application Number:
  US15/934,105
• Publication Number:
  US 20180218139A1
• Time in Patent Office: 389 Days
• Field of Search: 726 2- 6, 713182-186
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/34 involving the use of external additional devices, e.g. dongles or smart cards
• CPC Class Codes: G06Q 20/3276 using a pictured code, e.g. barcode or QR-code, being read by the M-device
• CPC Class Codes: G06Q 20/40145 Biometric identity checks
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/45 Detection of the body part being alive
• CPC Class Codes: G06V 40/50 Maintenance of biometric data or enrolment thereof
• CPC Class Codes: G06V 40/67 by interactive indications to the user
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/065 Continuous authentication
• CPC Class Codes: H04W 12/65 Environment-dependent, e.g. using captured environmental data
• CPC Class Codes: H04W 12/68 Gesture-dependent or behaviour-dependent
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

Systems and methods for enrolling and authenticating a user in an authentication system via a user'"'"'s camera of camera equipped mobile device include capturing and storing enrollment biometric information from at least one first image of the user taken via the camera of the mobile device, capturing authentication biometric information from at least one second image of the user, capturing, during imaging of the at least one second image, path parameters via at least one movement detecting sensor indicating an authentication movement of the mobile device, comparing the authentication biometric information to the stored enrollment biometric information, and comparing the authentication movement of the mobile device to an expected movement of the mobile device to determine whether the authentication movement sufficiently corresponds to the expected movement.

Claims

1. A method for enrolling a user and authenticating a user in an authentication system via a user'"'"'s mobile device comprising a camera and at least one movement detecting sensor, the method comprising:

capturing enrollment biometric information from at least one first image of the user;

storing the enrollment biometric information on a memory;

capturing at least one second image of the user, the second image recorded by the camera of the mobile device;

capturing authentication biometric information from the at least one second image of the user;

recording, during the authenticating the user, path parameter data from the at least one movement detecting sensor in the mobile device, the path parameter data representing an authentication movement of the mobile device by the user;

comparing the authentication biometric information to the stored enrollment biometric information to determine whether the authentication biometric information meets a predetermine similarity threshold as compared to the enrollment biometric information;

comparing the authentication movement of the mobile device, as moved by the user, to an expected movement of the mobile device to determine whether the authentication movement meets a predetermine similarity threshold as compared to the expected movement such that a face of the user appears on a display of the mobile device during the authentication movement; and

when the authentication biometric information sufficiently corresponds with the enrollment biometric information, and when the authentication movement a predetermine similarity threshold as compared to with the expected movement, authenticating the user.

2. The method according to claim 1, further comprising capturing enrollment path parameters with the at least one movement detecting sensor, the enrollment path parameters indicating an enrollment movement of the mobile device by the user, and defining the expected movement as the enrollment movement.

3. The method according to claim 1, wherein the at least one first image and the at least one second image of the user include an image of the user'"'"'s face, and the enrollment biometric information and the authentication biometric information comprise facial recognition information.

4. The method according to claim 1, further comprising:

capturing enrollment device information during imaging of the at least one first image;

storing the enrollment device information on the memory;

capturing authentication device information during imaging of the at least on second image; and

comparing the authentication device information with the enrollment device information to determine whether the authentication device information sufficiently corresponds to the enrollment device information.

5. The method according to claim 4, wherein the device information comprises at least one of the following:

a device manufacturer, model number, serial number, and mobile network information.

6. The method according to claim 1, wherein at least one movement detecting sensor comprises at least one of the following:

an accelerometer, a magnetometer, and a gyroscope.

7. The method of claim 1 wherein the at least one movement detecting sensor is the camera.

8. A facial authentication system utilizing a user'"'"'s mobile device, the mobile device comprising a camera and at least one movement detecting sensor, the authentication system comprising:

an authentication server comprising a processor, a memory, and at least one transceiver configured to transmit data from the authentication server and received data;

one or more memories configured to store one or more databases, the one or more databases configured to store authentication information profiles; and

machine readable instructions that are stored on the memory of the authentication server which when executed by the processor, cause the authentication server to;

receive enrollment biometrics from the mobile device, the enrollment biometrics comprising facial recognition data processed from at least one first image of the user'"'"'s face obtained via the camera of the mobile device;

store the enrollment biometrics in the one or more databases and associate the enrollment biometric data with the user authentication information profile;

receive authentication biometrics from the mobile device during an authentication attempt by the user, the authentication biometrics comprising facial recognition data processed from at least one second image of the user'"'"'s face, the image obtained from the camera of the mobile device;

receive authentication movement information from the mobile device, the authentication movement information comprising data regarding movement of the mobile device during imaging of the at least one second image as detected by the at least one movement detecting sensor in the mobile device;

compare the authentication biometrics and the authentication movement information with the enrollment biometrics and expected movement information stored in the database with the user authentication information profile; and

authenticate or not authenticate the user based on a comparison match rate of the authentication biometrics and the authentication movement with the enrollment biometrics and the expected movement.

9. The facial authentication system of claim 8, wherein

the mobile device displays a first prompt on a display screen to instruct the user to position a face of the user within a first display area of the display screen,

the mobile device display a second prompt on the display screen to instruct the user to position the face of the user within a second display area of the display screen, the second display area being a different size than the first display area, and

the expected movement is based on an anticipated path of the mobile device to place the face sequentially in the first display area and the second display area.

10. The facial authentication system of claim 8, wherein the authentication server detects the presence or absence of banding in the at least one second image.

11. The facial authentication system of claim 8, wherein the authentication server detect the present or absence of a screen edge in the at least one second image.

12. The facial authentication system of claim 8, wherein

the authentication server or mobile device estimates at least one of a gender, age, and ethnicity of a face imaged in the at least one first image,

the authentication server estimates at least one of a gender, age, and ethnicity of the face imaged in the at least one second image, and

the authentication server authenticates or does not authenticate the user based on a comparison match rate of at least one of a gender, age, and ethnicity detected in the at least one first image and the at least one second image in relation to a comparison match rate threshold.

13. The facial authentication system of claim 8, wherein the comparison match rate threshold required for authentication is variable.

14. The facial authentication system of claim 13, wherein the comparison match rate threshold increases based on a number of successful authentications.

15. The facial authentication system of claim 13, wherein the comparison match rate threshold increases over time.

16. The system of claim 8 wherein the at least one movement detecting sensor is the camera.

17. A method for authenticating a user in an authentication system via a user'"'"'s camera equipped computing device, the method comprising:

during enrollment;

capturing at least one enrollment image of the user taken with the camera of the computing device;

processing the at least one enrollment image to obtain enrollment biometric data from the at least one enrollment image;

during authentication;

capturing at least one first image of the user taken with the camera of the computing device at a first distance from the user;

requesting that the user perform a required path parameter movement to change the distance between the camera and the user from the first distance to a second distance by movement of the user closer to or further from the camera or movement of the camera closer to or further from the user;

verifying that the required path parameter has occurred;

capture at least one second image of the user taken with the camera of the computing device at the second distance from the user, the second distance being different than the first distance;

processing the at least one first image to obtain first biometric data based on facial recognition data from the at least one first image;

processing the at least one second image to obtain second biometric data based on facial recognition data from the at least on second image;

comparing the first biometric data or second biometric data to the enrollment biometric data;

comparing the first biometric data to the second biometric data to determine if the first biometric data is different than the second biometric data as a result of the change in distance between the camera and the user;

when the first biometric data does not match the second biometric data within a predetermined threshold, authenticating the user; and

when the first biometric data matches the second biometric data within a predetermined threshold, denying access to the user.

18. The method according to claim 17, further comprising:

capturing at least one second enrollment image of the user taken with the camera of the computing device at the second distance from the user;

processing the at least one second enrollment image to obtain second enrollment biometric data based on facial recognition data from the at least one second enrollment image;

comparing the second biometric data to the second enrollment biometric data; and

authenticating the user when the second biometric data matches the second enrollment biometric data within a predetermined threshold.

19. The method according to claim 17, wherein the computing device provides real time video feedback on a display of the computing device during imaging.

20. The method according to claim 17, further comprising distorting the at least one first image and the at least one second image prior to processing the at least one first image and the at least one second image.

21. The method according to claim 17, further comprising displaying a pattern on the display of the computing device during the imaging;

and

processing the at least one first image, the at least one second image, or both to detect a reflection of the pattern off of an eye or face of the user.

22. The method according to claim 21, wherein the pattern is a unique one-dimensional or two-dimensional barcode.