Sensor-assisted user authentication

• US 9,813,907 B2
• Filed: 06/29/2016
• Issued: 11/07/2017
• Est. Priority Date: 05/14/2014
• Status: Active Grant

• Current Assignee: Regents of the University of California (University of California)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: Chen, Shaxun, Pande, Amit, Mohapatra, Prasant
• Primary Examiner(s): NGUYEN, KHAI MINH
• Application Number:
  US15/197,481
• Publication Number:
  US 20160309329A1
• Time in Patent Office: 496 Days
• Field of Search: 455411, 455418, 455419, 455420, 4555501
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2221/2133 Verifying human interaction, e.g., Captcha
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/68 Gesture-dependent or behaviour-dependent

Abstract

Systems and techniques for user authentication are described. A portable electronic device can include an imaging sensor and a motion sensor. Multiple images of a face of a user can be acquired by using an imaging sensor. Motion information can be obtained by using a motion sensor. Next, a first motion vector can be determined based on the multiple images, and a second motion vector can be determined based on the motion information. The user can then be authenticated based on (1) determining a similarity measure between the first motion vector and the second motion vector, and (2) performing facial recognition on at least one of the multiple images. Note that the similarity measure can be used to detect a virtual-camera attack. Specifically, authentication can fail if the similarity measure is less than a threshold.

Claims

1. A portable electronic device, comprising:

an imaging sensor;

a motion sensor;

a processor; and

a memory storing instructions that, when executed by the processor, cause the portable electronic device to authenticate a user, the instructions comprising;

instructions to acquire multiple images of a face of the user by using the imaging sensor,

instructions to obtain motion information by using the motion sensor,

instructions to determine a first motion vector based on the multiple images,

instructions to determine a second motion vector based on the motion information, and

instructions to authenticate the user based on (1) determining a similarity measure between the first motion vector and the second motion vector, and (2) performing facial recognition on at least one of the multiple images.

2. The portable electronic device of claim 1, wherein the instructions further comprise instructions to prompt the user to move the portable electronic device relative to the face of the user.

3. The portable electronic device of claim 1, wherein the similarity measure is a correlation coefficient.

4. The portable electronic device of claim 1, wherein the multiple images are frames of a video.

5. The portable electronic device of claim 1, wherein the motion sensor includes one or more of:

an accelerometer, a gyroscope, a compass, an inertial motion sensor, and a magnetometer.

6. The portable electronic device of claim 1, wherein the motion information includes vibrations and rotations of the portable electronic device.

7. The portable electronic device of claim 1, wherein authentication fails if the similarity measure is less than a threshold.

8. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform a method for authenticating a user, the method comprising:

acquiring multiple images of a face of the user by using an imaging sensor;

obtaining motion information by using a motion sensor;

determining a first motion vector based on the multiple images;

determining a second motion vector based on the motion information; and

authenticating the user based on (1) determining a similarity measure between the first motion vector and the second motion vector, and (2) performing facial recognition on at least one of the multiple images.

9. The non-transitory computer-readable storage medium of claim 8, wherein the method further comprises prompting the user to move a portable electronic device that includes the imaging sensor and the motion sensor relative to a face of the user.

10. The non-transitory computer-readable storage medium of claim 8, wherein the similarity measure is a correlation coefficient.

11. The non-transitory computer-readable storage medium of claim 8, wherein the multiple images are frames of a video.

12. The non-transitory computer-readable storage medium of claim 8, wherein the motion sensor includes one or more of:

an accelerometer, a gyroscope, a compass, an inertial motion sensor, and a magnetometer.

13. The non-transitory computer-readable storage medium of claim 8, wherein the motion information includes vibrations and rotations of the portable electronic device.

14. The non-transitory computer-readable storage medium of claim 8, wherein authentication fails if the similarity measure is less than a threshold.

15. A method for authenticating a user, comprising:

acquiring multiple images of a face of the user by using an imaging sensor;

obtaining motion information by using a motion sensor;

determining a first motion vector based on the multiple images;

determining a second motion vector based on the motion information; and

authenticating the user based on (1) determining a similarity measure between the first motion vector and the second motion vector, and (2) performing facial recognition on at least one of the multiple images.

16. The method of claim 15, further comprising prompting the user to move a portable electronic device that includes the imaging sensor and the motion sensor relative to a face of the user.

17. The method of claim 15, wherein the similarity measure is a correlation coefficient.

18. The method of claim 15, wherein the multiple images are frames of a video.

19. The method of claim 15, wherein the motion sensor includes one or more of:

an accelerometer, a gyroscope, a compass, an inertial motion sensor, and a magnetometer.

20. The method of claim 15, wherein authentication fails if the similarity measure is less than a threshold.