Facial recognition authentication system including path parameters

• US 9,953,149 B2
• Filed: 08/28/2015
• Issued: 04/24/2018
• Est. Priority Date: 08/28/2014
• Status: Active Grant

• Current Assignee: FaceTec, Inc.
• Original Assignee: FaceTec, Inc.
• Inventors: Tussy, Kevin Alan
• Primary Examiner(s): Abedin, Shanto M
• Application Number:
  US14/839,505
• Publication Number:
  US 20160063235A1
• Time in Patent Office: 970 Days
• Field of Search: 726 6- 7, 713168, 713182, 455410, 455411
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/34 involving the use of external additional devices, e.g. dongles or smart cards
• CPC Class Codes: G06Q 20/3276 using a pictured code, e.g. barcode or QR-code, being read by the M-device
• CPC Class Codes: G06Q 20/40145 Biometric identity checks
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/45 Detection of the body part being alive
• CPC Class Codes: G06V 40/50 Maintenance of biometric data or enrolment thereof
• CPC Class Codes: G06V 40/67 by interactive indications to the user
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/065 Continuous authentication
• CPC Class Codes: H04W 12/65 Environment-dependent, e.g. using captured environmental data
• CPC Class Codes: H04W 12/68 Gesture-dependent or behaviour-dependent
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

Systems and methods for enrolling and authenticating a user in an authentication system via a user'"'"'s camera of camera equipped mobile device include capturing and storing enrollment biometric information from at least one first image of the user taken via the camera of the mobile device, capturing authentication biometric information from at least one second image of the user, capturing, during imaging of the at least one second image, path parameters via at least one movement detecting sensor indicating an authentication movement of the mobile device, comparing the authentication biometric information to the stored enrollment biometric information, and comparing the authentication movement of the mobile device to an expected movement of the mobile device to determine whether the authentication movement sufficiently corresponds to the expected movement.

Claims

1. A method for enrolling and authenticating a user in an authentication system via the user'"'"'s a mobile device comprising a camera and at least one movement detecting sensor, the mobile device also having a display, the method comprising:

capturing enrollment biometric information from at least one first image of the user, the first image recorded by the camera of the mobile device;

storing the enrollment biometric information on a memory;

during an authentication session;

capturing authentication biometric information from at least one second image of the user, the second image recorded by the camera of the mobile device;

recording path parameter data from the at least one movement detecting sensor in the mobile device, the path parameter data generated by movement of the mobile device by the user and representing an authentication movement of the mobile device;

comparing the authentication biometric information to the stored enrollment biometric information to determine whether the authentication biometric information meets a predetermine similarity threshold as compared to the enrollment biometric information;

comparing the authentication movement of the mobile device to an expected movement of the mobile device to determine whether the authentication movement meets a predetermine similarity threshold as compared to the expected movement of the mobile device by the user, wherein the expected movement is based on a path of the mobile device that includes having a face of the user appear in a display area of the mobile device; and

when the authentication biometric information sufficiently corresponds with the enrollment biometric information, and when the authentication movement meets a predetermine similarity threshold as compared to the expected movement, authenticating the user.

2. The method according to claim 1, further comprising capturing, during imaging of the at least one first image, enrollment path parameters via the at least one movement detecting sensor, the enrollment path parameters indicating an enrollment movement of the mobile device, and defining the expected movement as the enrollment movement.

3. The method according to claim 1, wherein the at least one first image and the at least one second image of the user include an image of the user'"'"'s face, and the enrollment biometric information and the authentication biometric information comprise facial recognition information.

4. The method according to claim 1, further comprising:

capturing enrollment device information during imaging of the at least one first image;

storing the enrollment device information on the memory;

capturing authentication device information during imaging of the at least on second image; and

comparing the authentication device information with the enrollment device information to determine whether the authentication device information sufficiently corresponds to the enrollment device information.

5. The method according to claim 4, wherein the device information comprises at least one of the following:

a device manufacturer, model number, serial number, and mobile network information.

6. The method according to claim 1, wherein at least one movement detecting sensor comprises at least one of the following:

an accelerometer, a magnetometer, and a gyroscope.

7. A facial authentication system utilizing a user'"'"'s mobile device, the mobile device comprising a camera and at least one movement detecting sensor, the authentication system comprising:

an authentication server comprising a processor, a memory, and at least one transceiver configured to transmit data from the authentication server and received data;

one or more memories configured to store one or more databases, the one or more databases configured to store authentication information profiles; and

machine readable instructions that are stored on the memory of the authentication server which when executed by the processor, cause the authentication server to;

receive enrollment biometrics from the mobile device, the enrollment biometrics comprising facial recognition data processed from at least one first image of the user'"'"'s face obtained via the camera of the mobile device;

store the enrollment biometrics in the one or more databases and associate the enrollment biometrics with the user authentication information profile;

receive authentication biometrics from the mobile device during an authentication attempt by the user, the authentication biometrics comprising facial recognition data processed from at least one second image of the user'"'"'s face, the image obtained from the camera of the mobile device;

receive authentication movement information from the mobile device, the authentication movement information comprising data regarding movement of the mobile device by the user as detected by the at least one movement detecting sensor in the mobile device;

compare the authentication biometrics and the authentication movement information with the enrollment biometrics and expected movement information stored in the database with the user authentication information profile, wherein the expected movement is based on an anticipated path of the mobile device, due to movement of the mobile device by the user, to place the user'"'"'s face sequentially in a first display area and a second display area; and

authenticate or not authenticate the user based on a comparison match rate of the authentication biometrics and the authentication movement with the enrollment biometrics and the expected movement.

8. The facial authentication system of claim 7, wherein the mobile device displays a first prompt on a display screen to instruct the user to position the user'"'"'s face within the first display area of the display screen;

and

the mobile device displays a second prompt on the display screen to instruct the user to position the user'"'"'s face within the second display area of the display screen, the second display area being a different size than the first display area.

9. The facial authentication system of claim 7, wherein the authentication server detects the presence or absence of banding in the at least one second image.

10. The facial authentication system of claim 7, wherein the authentication server detects the present or absence of a screen edge in the at least one second image.

11. The facial authentication system of claim 7, wherein

the authentication server or mobile device estimates at least one of a gender, age, and ethnicity of a face imaged in the at least one first image,

the authentication server estimates at least one of a gender, age, and ethnicity of the face imaged in the at least one second image, and

the authentication server authenticates or does not authenticate the user based on a comparison match rate of at least one of a gender, age, and ethnicity detected in the at least one first image and the at least one second image in relation to a comparison match rate threshold.

12. The facial authentication system of claim 7, wherein the comparison match rate threshold required for authentication is variable.

13. The facial authentication system of claim 12, wherein the comparison match rate threshold increases based on a number of successful authentications.

14. The facial authentication system of claim 12, wherein the comparison match rate threshold increases over time.

15. A facial authentication system utilizing a user'"'"'s mobile device, the mobile device comprising a camera and at least one movement detecting sensor, the authentication system comprising:

a processor located in the mobile device configured to execute machine readable instructions;

one or more memories in the mobile device storing authentication information; and

non-transitory machine readable instructions, the machine readable instructions when executed by the processor cause the mobile device to;

receive enrollment biometrics, the enrollment biometrics comprising facial recognition data processed from at least one first image of the user'"'"'s face obtained via the camera of the mobile device;

store the enrollment biometrics in the memory of the mobile device and associate the enrollment biometrics with a user profile of the user;

receive authentication biometrics from the mobile device during an authentication attempt by the user, the authentication biometrics comprising facial recognition data processed from at least one second image of the user'"'"'s face, the image obtained from the camera of the mobile device during the authentication attempt;

receive authentication movement information from the mobile device, the authentication movement information comprising data generated during movement of the mobile device by the user during the authentication attempt as detected by the at least one movement detecting sensor in the mobile device;

compare the authentication biometrics and the authentication movement information with the enrollment biometrics and expected movement information stored in the mobile device, wherein the expected movement information is based on an anticipated path of the mobile device to place the user'"'"'s face sequentially in a first display area and a second display area; and

authenticate or not authenticate the user during the authentication attempt based on a comparison match rate of the authentication biometrics and the authentication movement information with the enrollment biometrics and the expected movement information.

16. The system of claim 15 wherein the first display area is a different size than the second display area.

17. The system of claim 15 wherein the compare also detects the presence or absence of banding in the at least one second image.

18. The system of claim 15 wherein the compare also detects the present or absence of a screen edge in the at least one second image.

19. The system of claim 15 wherein the anticipated path of the mobile device is a path of the mobile device between a first mobile device position and a second mobile device position, wherein the first position is a different distance from the user than the second distance.

20. The system of claim 15 wherein:

non-transitory machine readable instructions, stored on the one or more memory of the mobile device, which when executed by the processor also estimates at least one of a gender, age, and ethnicity of a face imaged in the at least one first image, and estimates at least one of a gender, age, and ethnicity of the face imaged in the at least one second image, and

authenticates or does not authenticate the user based on a comparison match rate of at least one of a gender, age, and ethnicity detected in the at least one first image and the at least one second image in relation to a comparison match rate threshold.