Analyzing facial recognition data and social network data for user authentication

• US 9,147,117 B1
• Filed: 06/11/2014
• Issued: 09/29/2015
• Est. Priority Date: 06/11/2014
• Status: Active Grant

• Current Assignee: Socure, Inc.
• Original Assignee: Socure, Inc.
• Inventors: Madhu, Sunil, Li, Xinyu, Kamerman, Justin
• Primary Examiner(s): Werner, Brian P
• Application Number:
  US14/301,866
• Time in Patent Office: 475 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06Q 40/02 Banking, e.g. interest calculation or account maintenance credit or loans G06Q40/03
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/179 metadata assisted face recognition
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/45 Detection of the body part being alive
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231

Abstract

Tools, strategies, and techniques are provided for evaluating the identities of different entities to protect business enterprises, consumers, and other entities from fraud by combining biometric activity data with facial recognition data for end users. Risks associated with various entities can be analyzed and assessed based on a combination of user liveliness check data, facial image data, social network data, and/or professional network data, among other data sources. In various embodiments, the risk assessment may include calculating an authorization score or authenticity score based on different portions or combinations of the collected and processed data.

Claims

1. A computer-implemented method for calculating an authenticity score for a user, the method comprising:

calculating, by a facial evaluation system operatively associated with an electronic processor, a liveliness check score in response to analysis of image data associated with at least one anatomical change associated with an interaction between the user and a facial recognition application;

calculating, by the facial evaluation system, a facial confirmation score by;

generating a facial vector map based on image data associated with the user,

collecting data derived from at least one access device associated with the user or at least one identity input associated with the user, and

comparing at least a portion of the facial vector map data, the access device data, or the identity input data against at least a portion of image data stored in at least one database;

calculating, by the facial evaluation system, an authorization score for the user in response to the calculated liveliness check score and the calculated facial confirmation score;

calculating, by a risk evaluation system operatively associated with an electronic processor, a user score in response to at least a portion of profile data associated with at least one social network or professional network associated with a user account of the user, wherein calculating the user score further comprises processing at least one activity feed of the user account by calculating a frequency of posting; and

,

combining the calculated user score, the calculated liveliness check score, and the calculated facial confirmation score to generate an overall authenticity score for the user.

2. The method of claim 1, further comprising collecting the image data associated with the user with a camera-enabled and network connectable access device.

3. The method of claim 1, further comprising calculating at least one of the liveliness check score or the facial confirmation score in response to a user score calculated by a risk evaluation system.

4. The method of claim 1, further comprising factoring an opt-out action by the user into the authorization score.

5. The method of claim 1, wherein calculating the liveliness check score further comprises recording at least one facial feature of the user in response to recital of a phrase by the user.

6. The method of claim 1, further comprising calculating the liveliness check score in association with comparing at least one anatomical feature of the user shown in the image data to at least a portion of an expected set of anatomical features associated with the user.

7. The method of claim 6, wherein the anatomical feature includes at least one of eye blinking, eye movement, head motion, lip movement, arm gesture, hand gesture, or a combination thereof.

8. The method of claim 1, further comprising analyzing at least a portion of the identity input data to verify the user against a category of known users.

9. The method of claim 1, further comprising calculating a connections score in response to at least one connection formed between a first user account and at least a second user account through the social network or professional network.

10. The method of claim 1, further comprising calculating an affinity score in response to an overlap between at least a portion of the profile data of a first user account and at least a portion of profile data associated with at least a second user account.

11. The method of claim 1, wherein processing the activity feed includes identifying a baseline posting frequency and a burst usage pattern for at least the first user account.

12. The method of claim 1, further comprising checking an identity of one or more user accounts making a post to distinguish between a post by a first user account and a post by at least a second user account connected to the first user account.

13. The method of claim 1, further comprising collecting metadata associated with at least one post including a location accessed by the user account.

14. The method of claim 13, further comprising using the collected location metadata to track one or more frequently traveled locations of the user account.

15. A computer-implemented system for calculating an authenticity score for a user, the system comprising:

a facial evaluation system operatively associated with an electronic processor;

the facial evaluation system programmed for;

calculating a liveliness check score in response to analysis of image data associated with at least one anatomical change associated with an interaction between the user and a facial recognition application;

calculating a facial confirmation score by;

generating a facial vector map based on image data associated with the user,

collecting data derived from at least one access device associated with the user or at least one identity input associated with the user, and

comparing at least a portion of the facial vector map data, the access device data, or the identity input data against at least a portion of image data stored in at least one database;

the facial evaluation system programmed for calculating an authorization score for the user in response to the calculated liveliness check score and the calculated facial confirmation score;

calculating, by a risk evaluation system operatively associated with an electronic processor, a user score in response to at least a portion of profile data associated with at least one social network or professional network associated with a user account of the user, wherein calculating the user score further comprises processing at least one activity feed of the user account by calculating a frequency of posting; and

,

combining the calculated user score, the calculated liveliness check score, and the calculated facial confirmation score to generate an overall authenticity score for the user.

16. A non-transitory computer-readable medium including instructions for directing an electronic processor of a computer system to perform a method for calculating an authenticity score for a user, the medium comprising:

instructions for calculating a liveliness check score in response to analysis of image data associated with at least one anatomical change associated with an interaction between the user and a facial recognition application;

instructions for calculating a facial confirmation score by;

generating a facial vector map based on image data associated with the user,

collecting data derived from at least one access device associated with the user or at least one identity input associated with the user, and

comparing at least a portion of the facial vector map data, the access device data, or the identity input data against at least a portion of image data stored in at least one database;

instructions for calculating an authorization score for the user in response to the calculated liveliness check score and the calculated facial confirmation score;

calculating, by a risk evaluation system operatively associated with an electronic processor, a user score in response to at least a portion of profile data associated with at least one social network or professional network associated with a user account of the user, wherein calculating the user score further comprises processing at least one activity feed of the user account by calculating a frequency of posting; and

,

combining the calculated user score, the calculated liveliness check score, and the calculated facial confirmation score to generate an overall authenticity score for the user.

17. A computer-implemented method for calculating an authenticity score for a user, the method comprising:

calculating, by a facial evaluation system operatively associated with an electronic processor, a liveliness check score in response to analysis of image data associated with at least one anatomical change associated with an interaction between the user and a facial recognition application;

calculating, by the facial evaluation system, a facial confirmation score by;

generating a facial vector map based on image data associated with the user,

collecting data derived from at least one access device associated with the user or at least one identity input associated with the user, and

comparing at least a portion of the facial vector map data, the access device data, or the identity input data against at least a portion of image data stored in at least one database;

calculating, by the facial evaluation system, an authorization score for the user in response to the calculated liveliness check score and the calculated facial confirmation score;

calculating, by a risk evaluation system operatively associated with an electronic processor, a user score in response to at least a portion of profile data associated with at least one social network or professional network associated with a user account of the user, wherein calculating the user score further comprises comparing at least a portion of the data of the user account to at least one fake profile model associated with at least one social network or professional network; and

,

combining the calculated user score, the calculated liveliness check score, and the calculated facial confirmation score to generate an overall authenticity score for the user.

18. The method of claim 17, further comprising collecting the image data associated with the user with a camera-enabled and network connectable access device.

19. The method of claim 17, further comprising calculating at least one of the liveliness check score or the facial confirmation score in response to a user score calculated by a risk evaluation system.

20. The method of claim 17, further comprising factoring an opt-out action by the user into the authorization score.

21. The method of claim 17, wherein calculating the liveliness check score further comprises recording at least one facial feature of the user in response to recital of a phrase by the user.

22. The method of claim 17, further comprising calculating the liveliness check score in association with comparing at least one anatomical feature of the user shown in the image data to at least a portion of an expected set of anatomical features associated with the user.

23. The method of claim 22, wherein the anatomical feature includes at least one of eye blinking, eye movement, head motion, lip movement, arm gesture, hand gesture, or a combination thereof.

24. The method of claim 17, further comprising analyzing at least a portion of the identity input data to verify the user against a category of known users.

25. The method of claim 17, further comprising calculating a connections score in response to at least one connection formed between a first user account and at least a second user account through the social network or professional network.

26. The method of claim 17, further comprising calculating an affinity score in response to an overlap between at least a portion of the profile data of a first user account and at least a portion of profile data associated with at least a second user account.

27. The method of claim 17, wherein processing the activity feed includes identifying a baseline posting frequency and a burst usage pattern for at least the first user account.

28. The method of claim 17, further comprising checking an identity of one or more user accounts making a post to distinguish between a post by a first user account and a post by at least a second user account connected to the first user account.

29. The method of claim 17, further comprising collecting metadata associated with at least one post including a location accessed by the user account.

30. The method of claim 29, further comprising using the collected location metadata to track one or more frequently traveled locations of the user account.

31. A computer-implemented system for calculating an authenticity score for a user, the system comprising:

a facial evaluation system operatively associated with an electronic processor;

the facial evaluation system programmed for;

calculating a liveliness check score in response to analysis of image data associated with at least one anatomical change associated with an interaction between the user and a facial recognition application;

calculating a facial confirmation score by;

generating a facial vector map based on image data associated with the user,

collecting data derived from at least one access device associated with the user or at least one identity input associated with the user, and

comparing at least a portion of the facial vector map data, the access device data, or the identity input data against at least a portion of image data stored in at least one database;

the facial evaluation system programmed for calculating an authorization score for the user in response to the calculated liveliness check score and the calculated facial confirmation score;

calculating, by a risk evaluation system operatively associated with an electronic processor, a user score in response to at least a portion of profile data associated with at least one social network or professional network associated with a user account of the user, wherein calculating the user score further comprises comparing at least a portion of the data of the user account to at least one fake profile model associated with at least one social network or professional network; and

,

combining the calculated user score, the calculated liveliness check score, and the calculated facial confirmation score to generate an overall authenticity score for the user.

32. A non-transitory computer-readable medium including instructions for directing an electronic processor of a computer system to perform a method for calculating an authenticity score for a user, the medium comprising:

instructions for calculating a liveliness check score in response to analysis of image data associated with at least one anatomical change associated with an interaction between the user and a facial recognition application;

instructions for calculating a facial confirmation score by;

generating a facial vector map based on image data associated with the user,

collecting data derived from at least one access device associated with the user or at least one identity input associated with the user, and

comparing at least a portion of the facial vector map data, the access device data, or the identity input data against at least a portion of image data stored in at least one database;

instructions for calculating an authorization score for the user in response to the calculated liveliness check score and the calculated facial confirmation score;

calculating, by a risk evaluation system operatively associated with an electronic processor, a user score in response to at least a portion of profile data associated with at least one social network or professional network associated with a user account of the user, wherein calculating the user score further comprises comparing at least a portion of the data of the user account to at least one fake profile model associated with at least one social network or professional network; and

,

combining the calculated user score, the calculated liveliness check score, and the calculated facial confirmation score to generate an overall authenticity score for the user.