Method and apparatus for facial recognition

• US 9,183,429 B2
• Filed: 01/18/2013
• Issued: 11/10/2015
• Est. Priority Date: 08/15/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Qi, Yingyong, Bi, Ning, Guo, Feng
• Primary Examiner(s): Harandi, Siamak
• Application Number:
  US13/744,906
• Publication Number:
  US 20140050372A1
• Time in Patent Office: 1,026 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 18/213 Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
• CPC Class Codes: G06F 18/28 Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries
• CPC Class Codes: G06V 10/467 Encoded features or binary features, e.g. local binary patterns [LBP]
• CPC Class Codes: G06V 10/7715 Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
• CPC Class Codes: G06V 10/772 Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

Apparatus and methods for facial detection are disclosed. A plurality of images of an observed face is received for identification. Based at least on two or more selected images of the plurality of images, a template of the observed face is generated. In some embodiments, the template is a subspace generated based on feature vectors of the plurality of received images. A database of identities and corresponding facial data of known persons is searched based at least on the template of the observed face and the facial data of the known persons. One or more identities of the known persons are selected based at least on the search.

Claims

1. A computer-implemented method of facial recognition, comprising:

receiving a plurality of images of an observed face to be recognized during a recognition process;

generating a template of the observed face based at least on two or more selected images of the plurality of images of the observed face at least as a part of the recognition process, wherein generating the template of the observed face includes generating a subspace of the observed face based at least on feature vectors of the two or more selected images of the plurality of images;

searching a database of identities and corresponding facial data of known persons, the searching being based at least on the template of the observed face and the facial data of the known persons; and

selecting one or more identities of the known persons based at least on the search.

2. The computer-implemented method of claim 1, wherein each identity of the database is associated with data that is based on one reference image.

3. The computer-implemented method of claim 1, further comprising capturing the plurality of images of the observed face with an image sensor.

4. The computer-implemented method of claim 1, wherein the feature vectors are based at least on linear binary pattern histograms of the selected images.

5. The computer-implemented method of claim 1, wherein the feature vectors are based at least on a cascade of filtered image blocks.

6. The computer-implemented method of claim 1, wherein the subspace is associated with a mean and a variance of the feature vectors of the two or more selected images of the plurality of images.

7. The computer-implemented method of claim 1, wherein searching the database comprises determining an error measure between the template of the observed face and each of one or more of the corresponding facial data of the known persons.

8. The computer-implemented method of claim 7, wherein the error measure is based on a Chi-square distance.

9. The computer-implemented method of claim 7, wherein the selection of the one or more identities is based on a threshold of the error measure.

10. The computer-implemented method of claim 1, further comprising selecting the two or more images of the plurality of images based on orientation of the observed face.

11. The computer-implemented method of claim 10, wherein the selection of the two or more images of the plurality of images is further based on a facial feature of interest.

12. The computer-implemented method of claim 10, wherein the selection of the two or more images of the plurality of images is further based on facial orientation of the facial data of the database.

13. The computer-implemented method of claim 10, further comprising displaying on a graphical display data indicative of the one or more selected identities.

14. The computer-implemented method of claim 13, further comprising

prompting a user to confirm the selection of the two or more selected identities;

and

updating the database in response to the confirmation of the user.

15. A facial recognition apparatus, comprising:

a processor configured to;

receive a plurality of images of an observed face to be recognized during a recognition process;

generate a template of the observed face based at least on two or more selected images of the plurality of images of the observed face at least as a part of the recognition process, wherein generating the template of the observed face includes generating a subspace of the observed face based at least on feature vectors of the two or more selected images of the plurality of images;

search a database of identities and corresponding facial data of known persons, the searching being based at least on the template of the observed face and the facial data of the known persons; and

select one or more identities of the known persons based at least on the search.

16. The facial recognition apparatus of claim 15, wherein the processor is further configured to transfer data indicative of the selected one or more identities of the known persons, wherein each identity of the database is associated with data that is based on one reference image.

17. The facial recognition apparatus of claim 15, further comprising an image sensor, wherein the processor is further configured to capture multiple images of the observed face from the image sensor.

18. A non-transitory, computer-readable medium storing instructions that, when executed, cause a processor to perform a method comprising of:

receiving a plurality of images of an observed face to be recognized during a recognition process;

generating a template of the observed face based at least on two or more selected images of the plurality of images of the observed face at least as a part of the recognition process;

searching a database of identities and corresponding facial data of known persons, the searching being based at least on the template of the observed face and the facial data of the known persons;

selecting one or more identities of the known persons based at least on the search; and

displaying on a graphical display data indicative of the two or more selected identities.

19. The non-transitory, computer readable medium of claim 18, wherein each identity of the database is associated with data that is based on one reference image, and wherein the one or more selected identities are associated with feature vectors within a threshold distance of the template of the observed face.

20. A computer-implemented method of facial recognition, comprising:

receiving a plurality of images of an observed face to be recognized during a recognition process;

selecting two or more images of the plurality of images, the selection of the two or more images based on orientation of the observed face, the selection of the two or more images based on a facial feature of interest;

generating a template of the observed face based at least on the two or more selected images at least as a part of the recognition process;

searching a database of identities and corresponding facial data of known persons, the searching being based at least on the template of the observed face and the facial data of the known persons; and

selecting one or more identities of the known persons based at least on the search.

21. A computer-implemented method of facial recognition, comprising:

receiving a plurality of images of an observed face to be recognized during a recognition process;

selecting two or more images of the plurality of images, the selection of the two or more images based on orientation of the observed face, the selection of the two or more images based on a facial orientation of the facial data of the database;

generating a template of the observed face based at least on the two or more selected images at least as a part of the recognition process;

searching a database of identities and corresponding facial data of known persons, the searching being based at least on the template of the observed face and the facial data of the known persons; and

selecting one or more identities of the known persons based at least on the search.