THREE-DIMENSIONAL FACE RECOGNITION FOR MOBILE DEVICES

• US 20130286161A1
• Filed: 04/25/2012
• Published: 10/31/2013
• Est. Priority Date: 04/25/2012
• Status: Abandoned Application

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Lv, Fengjun, Kalker, Antontius
• Application Number:
  US13/456,074
• Publication Number:
  US 20130286161A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/55 from multiple images
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 20/653 by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/67 by interactive indications to the user

Abstract

A mobile device can generate a three-dimensional model of a person'"'"'s face by capturing and processing a plurality of two-dimensional images. During operation, the mobile device uses an image-capture device to capture a set of images of the person from various orientations as the person or any other user sweeps the mobile device in front of the person'"'"'s face from one side of his/her face to the opposing side. The device determines orientation information for the captured images, and detects a plurality of features of the person'"'"'s face from the captured images. The device then generates a three-dimensional model of the person'"'"'s face from the detected features and their orientation information. The three-dimensional model of the person'"'"'s face facilitates identifying and/or authenticating the person'"'"'s identity.

Claims

1. A computer-implemented method, comprising:

capturing, by an image-capture device on a mobile device, a set of images of a person from various orientations;

determining orientation information for a respective captured image;

detecting a plurality of features of the person'"'"'s face from the respective captured image;

generating a three-dimensional model of the person'"'"'s face from the detected features and orientation information for their corresponding images; and

authenticating the person'"'"'s identity based on the three-dimensional model.

2. The method of claim 1, wherein capturing the set of images comprises:

monitoring a change in orientation of the image-capture device;

determining that the orientation has changed by at least a minimum amount from an orientation of a previous captured image;

capturing an image in response to determining that the image-capture device is stabilized; and

storing the captured image in response to determining that the image is suitable for detecting facial features.

3. The method of claim 1, wherein capturing the set of images further comprises providing a notification in response to:

determining that the image-capture device is not stabilized;

determining that the person'"'"'s face is not in the image frame;

determining that the current orientation of the device is not suitable for detecting features of the person'"'"'s face;

or

determining that no more images need to be captured.

4. The method of claim 3, wherein the notification includes one or more of:

a sound;

a vibration pattern;

a flashing pattern from a light source of the image-capture device; and

an image displayed on a screen of the image-capture device.

5. The method of claim 1, wherein capturing the set of images is performed in response to receiving a request to register the person as a user;

and

wherein the method further comprises storing the three-dimensional model in association with a user profile for the person.

6. The method of claim 1, wherein capturing the set of images is performed in response to receiving a request to authenticate the person.

7. The method of claim 6, further comprising:

authenticating the person by determining whether the generated three-dimensional model of the person matches a stored three-dimensional model of a registered user.

8. The method of claim 6, further comprising authenticating the person, which involves:

sending the generated three-dimensional model of the person to a remote authentication system; and

receiving an authentication response which indicates whether the person is a registered user.

9. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method, the method comprising:

capturing a set of images of a person from various orientations using an image-capture device on a mobile device;

determining orientation information for a respective captured image;

detecting a plurality of features of the person'"'"'s face from the respective captured image;

generating a three-dimensional model of the person'"'"'s face from the detected features and orientation information for their corresponding images; and

authenticating the person'"'"'s identity based on the three-dimensional model.

10. The storage medium of claim 9, wherein capturing the set of images comprises:

monitoring a change in orientation of the image-capture device;

determining that the orientation has changed by at least a minimum amount from an orientation of a previous captured image;

capturing an image in response to determining that the image-capture device is stabilized; and

storing the captured image in response to determining that the image is suitable for detecting facial features.

11. The storage medium of claim 9, wherein capturing the set of images further comprises providing a notification in response to:

determining that the image-capture device is not stabilized;

determining that the person'"'"'s face is not in the image frame;

determining that the current orientation of the device is not suitable for detecting features of the person'"'"'s face;

or

determining that no more images need to be captured.

12. The storage medium of claim 11, wherein the notification includes one or more of:

a sound;

a vibration pattern;

a flashing pattern from a light source of the image-capture device; and

an image displayed on a screen of the image-capture device.

13. The storage medium of claim 9, wherein capturing the set of images is performed in response to receiving a request to register the person as a user;

and

wherein the method further comprises storing the three-dimensional model in association with a user profile for the person.

14. The storage medium of claim 9, wherein capturing the set of images is performed in response to receiving a request to authenticate the person.

15. The storage medium of claim 14, wherein the method further comprises authenticating the person by determining whether the generated three-dimensional model of the person matches a stored three-dimensional model of a registered user.

16. The storage medium of claim 14, wherein the method further comprises authenticating the person, which involves:

sending the generated three-dimensional model of the person to a remote authentication system; and

receiving an authentication response which indicates whether the person is a registered user.

17. A mobile device, comprising:

an image-capture module configured to capture a set of images of a person from various orientations;

a motion sensor configured to determine orientation information for a respective captured image;

a feature-detecting module configured to detect a plurality of features of the person'"'"'s face from the respective captured image;

a model-generating module configured to generate a three-dimensional model of the person'"'"'s face from the detected features and orientation information for their corresponding images; and

an authentication module configured to authenticate the person'"'"'s identity based on the three-dimensional mode.

18. The mobile device of claim 17, wherein while capturing the set of images, the image-capture module is further configured to:

monitor a change in orientation;

determine that the orientation has changed by at least a minimum amount from an orientation of a previous captured image;

capture an image in response to determining that the image-capture device is stabilized; and

store the captured image in response to determining that the image is suitable for detecting facial features.

19. The mobile device of claim 17, further comprising an interface module configured to provide a notification in response to:

determining that the image-capture device is not stabilized;

determining that the person'"'"'s face is not in the image frame;

determining that the current orientation of the device is not suitable for detecting features of the person'"'"'s face;

or

determining that no more images need to be captured.

20. The mobile device of claim 19, wherein the notification includes one or more of:

a sound;

a vibration pattern;

a flashing pattern from a light source of the image-capture device; and

an image displayed on a screen of the image-capture device.

21. The mobile device of claim 17, further comprising an interface module configured to receive a request to register the person as a user;

wherein the image-capture module is configured to capture the set of images in response to the request to register the person as a user; and

wherein the apparatus further comprises a profile-managing module to store the three-dimensional model in association with a user profile for the person.

22. The mobile device of claim 17, further comprising an interface module configured to receive a request to authenticate the person;

wherein the image-capture module is configured to capture the set of images in response to the request to authenticate the person.

23. The mobile device of claim 22, further comprising an authentication module configured to authenticate the person by determining whether the generated three-dimensional model of the person matches a stored three-dimensional model of a registered user.

24. The mobile device of claim 22, further comprising an authentication module configured to authenticate the person, wherein authenticating the person involves:

sending the generated three-dimensional model of the person to a remote authentication system; and

receiving an authentication response which indicates whether the person is a registered user.