Face Recognition Performance Using Additional Image Features

• US 20130142391A1
• Filed: 01/29/2013
• Published: 06/06/2013
• Est. Priority Date: 10/02/2009
• Status: Abandoned Application

• Current Assignee: FotoNation Limited (Adeia, Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia, Inc.)
• Inventors: Bigioi, Petronel, Costache, Gabriel, Drimbarean, Alexandru, Corcoran, Peter
• Application Number:
  US13/753,426
• Publication Number:
  US 20130142391A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks

Abstract

A technique is provided for recognizing faces in an image stream using a digital image acquisition device. A first acquired image is received from an image stream. A first face region is detected within the first acquired image having a given size and a respective location within the first acquired image. First faceprint data uniquely identifying the first face region are extracted along with first peripheral region data around the first face region. The first faceprint and peripheral region data are stored, and the first peripheral region data are associated with the first face region. The first face region is tracked until a face lock is lost. A second face region is detected within a second acquired image from the image stream. Second peripheral region data around the second face region are extracted. The second face region is identified upon matching the first and second peripheral region data.

Claims

1. A method of recognizing a face in an acquired digital image, comprising:

using a processor;

receiving a first acquired image;

detecting a first face region within the first acquired image having a given size and a respective location within the first acquired image;

extracting first faceprint data uniquely identifying the first face region along with first peripheral region data around the first face region;

storing the first faceprint and peripheral region data, including associating the first peripheral region data with the first face region;

receiving a second acquired image;

detecting a second face region within the second acquired image;

extracting second peripheral region data around the second face region;

comparing the first and second peripheral region data;

identifying the second face region as the same identity as the first face region when the first peripheral region data matches the second peripheral region data; and

confirming the second face region as said same identify as the first face region when the first and second face regions match.

2. The method of claim 1, wherein the storing of peripheral region data occurs only within volatile memory.

3. The method of claim 1, further comprising providing a database comprising an identifier and associated parameters for each of a number of one or more faces to be recognized;

and selectively applying face recognition using said database to said first face region to provide an identifier for the first face region.

4. The method of claim 1, further comprising extracting second faceprint data uniquely identifying the second face region, and matching the first and second faceprint data, thereby confirming the identifying of the second face region.

5. The method of claim 1, wherein the identifying of the second face region as the same identity as the first face region comprises matching texture information from the first and second peripheral region data.

6. The method of claim 1, wherein the detecting and identifying of the second face region occur within two second or less.

7. The method of claim 1, wherein the detecting and identifying of the second face region occur within one second or less.

8. The method of claim 1, further comprising displaying a same identifier with the first and second face regions.

9. The method of claim 8, wherein the identifier comprises a nickname of a person associated with the first and second face regions.

10. The method of claim 1, further comprising receiving a third acquired image from the image stream that has a higher resolution than the first and second acquired images, and identifying a third face region detected therein based upon matching the first faceprint with a third faceprint extracted from the third acquired image.

11. One or more non-transitory processor-readable storage media having code embedded therein for programming a processor to perform a method of recognizing a face in an acquired digital image, wherein the method comprises:

receiving a first acquired image;

detecting a first face region within the first acquired image having a given size and a respective location within the first acquired image;

extracting first faceprint data uniquely identifying the first face region along with first peripheral region data around the first face region;

storing the first faceprint and peripheral region data, including associating the first peripheral region data with the first face region;

receiving a second acquired image;

detecting a second face region within the second acquired image;

extracting second peripheral region data around the second face region;

comparing the first and second peripheral region data;

identifying the second face region as the same identity as the first face region when the first peripheral region data matches the second peripheral region data; and

confirming the second face region as said same identify as the first face region when the first and second face regions match.

12. The one or more processor-readable media of claim 11, wherein the storing of peripheral region data occurs only within volatile memory.

13. The one or more processor-readable media of claim 11, wherein the method further comprises providing a database comprising an identifier and associated parameters for each of a number of one or more faces to be recognized;

and selectively applying face recognition using said database to said first face region to provide an identifier for the first face region.

14. The one or more processor-readable media of claim 11, wherein the method further comprises extracting second faceprint data uniquely identifying the second face region, and matching the first and second faceprint data, thereby confirming the identifying of the second face region.

15. The one or more processor-readable media of claim 11, wherein the identifying of the second face region as the same identity as the first face region comprises matching texture information from the first and second peripheral region data.

16. The one or more processor-readable media of claim 11, wherein the detecting and identifying of the second face region occur within two second or less.

17. The one or more processor-readable media of claim 11, wherein the detecting and identifying of the second face region occur within one second or less.

18. The one or more processor-readable media of claim 11, wherein the method further comprises displaying a same identifier with the first and second face regions.

19. The one or more processor-readable media of claim 18, wherein the identifier comprises a nickname of a person associated with the first and second face regions.

20. The one or more processor-readable media of claim 11, wherein the method further comprises receiving a third acquired image from the image stream that has a higher resolution than the first and second acquired images, and identifying a third face region detected therein based upon matching the first faceprint with a third faceprint extracted from the third acquired image.

21. A portable, digital image acquisition device, comprising a lens and image sensor for acquiring digital images, a processor, and a processor-readable medium having code embedded therein for programming the processor to perform a method of recognizing a face in an acquired digital image, wherein the method comprises:

receiving a first acquired image;

detecting a first face region within the first acquired image having a given size and a respective location within the first acquired image;

extracting first faceprint data uniquely identifying the first face region along with first peripheral region data around the first face region;

storing the first faceprint and peripheral region data, including associating the first peripheral region data with the first face region;

receiving a second acquired image;

detecting a second face region within the second acquired image;

extracting second peripheral region data around the second face region;

comparing the first and second peripheral region data;

identifying the second face region as the same identity as the first face region when the first peripheral region data matches the second peripheral region data; and

confirming the second face region as said same identify as the first face region when the first and second face regions match.

22. The device of claim 21, wherein the storing of peripheral region data occurs only within volatile memory.

23. The device of claim 21, further comprising providing a database comprising an identifier and associated parameters for each of a number of one or more faces to be recognized;

and selectively applying face recognition using said database to said first face region to provide an identifier for the first face region.

24. The device of claim 21, further comprising extracting second faceprint data uniquely identifying the second face region, and matching the first and second faceprint data, thereby confirming the identifying of the second face region.

25. The device of claim 21, wherein the identifying of the second face region as the same identity as the first face region comprises matching texture information from the first and second peripheral region data.

26. The device of claim 21, wherein the detecting and identifying of the second face region occur within two second or less.

27. The device of claim 21, wherein the detecting and identifying of the second face region occur within one second or less.

28. The device of claim 21, further comprising displaying a same identifier with the first and second face regions.

29. The device of claim 28, wherein the identifier comprises a nickname of a person associated with the first and second face regions.

30. The device of claim 21, wherein the method further comprises receiving a third acquired image from the image stream that has a higher resolution than the first and second acquired images, and identifying a third face region detected therein based upon matching the first faceprint with a third faceprint extracted from the third acquired image.

31. A method of recognizing a face in an acquired digital image, comprising:

using a processor;

receiving a first acquired image;

detecting a first face region within the first acquired image having a given size and a respective location within the first acquired image;

extracting first faceprint data uniquely identifying the first face region along with first peripheral region data around the first face region; and

storing the first faceprint and peripheral region data, including associating the first peripheral region data with the first face region;

identifying a second face region within a second acquired image as the same identity as said first face region upon matching the first and second peripheral region data; and

confirming the identity of the second face region as the same identity as the first face region when the first and second face regions match.

32. The method of claim 31, further comprising providing a database comprising an identifier and associated parameters for each of a number of one or more faces to be recognized;

and selectively applying face recognition using said database to said first face region combination to provide an identifier for the first face region combination.

33. The method of claim 32, further comprising retrieving and matching texture information from the first peripheral region data for comparing with texture information from a stored peripheral region.

34. The method of claim 31, wherein the method further comprises receiving a third acquired image from the image stream that has a higher resolution than the first and second acquired images, and identifying a third face region detected therein based upon matching the first faceprint with a third faceprint extracted from the third acquired image.

35. One or more non-transitory processor-readable storage media having code embedded therein for programming a processor to perform a method of recognizing a face in an acquired digital image, wherein the method comprises:

receiving a first acquired image;

detecting a first face region within the first acquired image having a given size and a respective location within the first acquired image;

extracting first faceprint data uniquely identifying the first face region along with first peripheral region data around the first face region;

storing the first faceprint and peripheral region data, including associating the first peripheral region data with the first face region;

identifying a second face region within a second acquired image as the same identity as said first face region upon matching the first and second peripheral region data; and

confirming the identity of the second face region as the same identity as the first face region when the first and second face regions match.

36. The one or more processor-readable media of claim 35, wherein the method further comprises providing a database comprising an identifier and associated parameters for each of a number of one or more faces to be recognized;

and selectively applying face recognition using said database to said first face region combination to provide an identifier for the first face region combination.

37. The one or more processor-readable media of claim 36, wherein the method further comprises retrieving and matching texture information from the first peripheral region data for comparing with texture information from a stored peripheral region.

38. The one or more processor-readable media of claim 35, wherein the method further comprises receiving a third acquired image from the image stream that has a higher resolution than the first and second acquired images, and identifying a third face region detected therein based upon matching the first faceprint with a third faceprint extracted from the third acquired image.

39. A portable, digital image acquisition device, comprising a lens and image sensor for acquiring digital images, a processor, and a processor-readable medium having code embedded therein for programming the processor to perform a method of recognizing a face in an acquired digital image, wherein the method comprises:

acquiring a first acquired image;

detecting a first face region within the first acquired image having a given size and a respective location within the first acquired image;

extracting first faceprint data uniquely identifying the first face region along with first peripheral region data around the first face region; and

storing the first faceprint and peripheral region data, including associating the first peripheral region data with the first face region;

identifying a second face region within a second acquired image as the same identity as said first face region upon matching the first and second peripheral region data; and

confirming the identity of the second face region as the same identity as the first face region when the first and second face regions match.

40. The device of claim 39, wherein the method further comprises providing a database comprising an identifier and associated parameters for each of a number of one or more faces to be recognized;

and selectively applying face recognition using said database to said first face region combination to provide an identifier for the first face region combination.

41. The device of claim 40, wherein the method further comprises retrieving and matching texture information from the first peripheral region data for comparing with texture information from a stored peripheral region.

42. The device of claim 39, wherein the method further comprises receiving a third acquired image from the image stream that has a higher resolution than the first and second acquired images, and identifying a third face region detected therein based upon matching the first faceprint with a third faceprint extracted from the third acquired image.