SYSTEM AND METHOD FOR AUTOMATIC TAGGING OF A DIGITAL IMAGE

• US 20110013810A1
• Filed: 07/17/2009
• Published: 01/20/2011
• Est. Priority Date: 07/17/2009
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Larsson, Bo, Engström, Jimmy
• Application Number:
  US12/504,749
• Publication Number:
  US 20110013810A1
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/179 metadata assisted face recognition

Abstract

A system for automatically tagging a digital image includes an electronic device having a face detector for receiving a digital image and determining whether the digital image contains at least one face. A faceprint generator generates a faceprint representing a face detected in the digital image. A matching operation attempts to match the faceprint to a reference data item to identify the face represented by the faceprint. If a match is found, a tag generator generates a text tag corresponding to the identity of the face represented by the faceprint, and may associate the tag with the digital image. If a match is not found, the faceprint may be transmitted with an identification request to an external electronic device, which performs the matching operation. Upon matching the faceprint to a reference data item, identification data identifying the face represented by the faceprint may be transmitted from the external electronic device to the originating electronic device. A text tag may then be generated based on the identification data.

Claims

1. An electronic device comprising:

a face detector for receiving a digital image and determining whether the digital image contains at least one face;

a faceprint generator for generating a faceprint representing a face detected in the digital image; and

a tag generator for generating a tag corresponding to an identity of the face represented by the faceprint and for associating the tag with the digital image.

2. The electronic device of claim 1, further comprising:

a memory storing a plurality of reference data items; and

a controller configured to match the faceprint to at least one of the plurality of reference data items to identify the face represented by the faceprint;

wherein the tag generator generates a tag corresponding to the identified face.

3. The electronic device of claim 2, wherein the reference data items are reference digital images.

4. The electronic device of claim 2, wherein the reference data items are reference faceprints.

5. The electronic device of claim 1 further comprising:

a controller configured to generate an identification request for the faceprint; and

an external interface for transmitting the faceprint and identification request to an external electronic device, and for receiving identification data for the face represented by the faceprint from the external electronic device in response to the identification request;

wherein the tag generator generates a tag corresponding to the received identification data.

6. The electronic device of claim 1, wherein the electronic device is a mobile telephone.

11. The electronic device of claim 1, wherein the tag generator associates the tag with the digital image by incorporating the tag into metadata of the digital image.

7. An electronic device comprising:

a network interface for receiving a faceprint representing a face in a digital image from an external electronic device;

a memory storing a plurality of reference data items;

a controller configured to match the faceprint to one of the plurality of data items to identify the face represented by the faceprint, and to generate identification data for the face represented by the faceprint;

wherein the network interface transmits identification data for the face represented by the faceprint to the external electronic device.

8. The electronic device of claim 7, wherein the reference data items are reference digital images.

9. The electronic device of claim 7, wherein the reference data items are reference faceprints.

10. The electronic device of claim 7, wherein the external electronic device is a first external electronic device, and if the controller cannot match the faceprint, the controller is configured to generate an identification request for the unmatched faceprint;

wherein the faceprint and identification request are transmitted via the network interface to a second external electronic device, and identification data is received via the network interface for the face represented by the faceprint from the second external electronic device in response to the identification request; and

wherein the identification data is transmitted via the network interface to the first external electronic device.

12. A method for generating a tag for a digital image with an electronic device comprising the steps of:

receiving a digital image in the electronic device;

determining whether the digital image contains at least one face;

generating a faceprint representing a face detected in the digital image;

generating a tag corresponding to an identity of the face represented by the faceprint; and

associating the tag with the digital image.

13. The method of generating a tag of claim 12, further comprising:

storing a plurality of reference data items in a memory in the electronic device; and

matching the faceprint to at least one of the plurality of reference data items to identify the face represented by the faceprint;

wherein the tag generator generates a tag corresponding to the identified face.

14. The method of generating a tag of claim 13, wherein the reference data items are reference digital images.

15. The method of generating a tag of claim 13, wherein the reference data items are reference faceprints.

16. The method of generating a tag of claim 12, further comprising:

generating an identification request for the faceprint;

transmitting the faceprint and identification request to an external electronic device;

receiving identification data for the face represented by the faceprint from the external electronic device in response to the identification request; and

generating a tag corresponding to the received identification data.

17. The method of generating a tag of claim 13, further comprising:

if the matching step does not result in identification of the face represented by the faceprint, generating an identification request for the unmatched faceprint;

transmitting the faceprint and identification request to an external electronic device;

receiving identification data for the face represented by the faceprint from the external electronic device in response to the identification request; and

generating a tag corresponding to the received identification data.

18. The method for generating a tag of claim 12, further comprising:

detecting a plurality of faces within the digital image;

generating a plurality of faceprints representing respectively each of the plurality of faces detected in the digital image;

storing a plurality of reference data items in a memory in the electronic device;

matching a first faceprint from among the plurality of faceprints to at least one of the plurality of reference data items to identify a respective a face represented by the first faceprint;

generating a tag corresponding to an identity of the face represented by the first faceprint; and

associating the tag with the digital image.

19. The method of generating a tag of claim 18, further comprising:

generating an identification request respectively for each unmatched faceprint from among the plurality of faceprints;

transmitting each unmatched faceprint and each respective identification request to a first external electronic device;

storing a plurality of reference data items in a memory in the first external electronic device;

matching a second faceprint from among the plurality of faceprints to at least one of the plurality of reference data items stored in the first external electronic device to identify a respective face represented by the second faceprint;

generating identification data for the face represented by the second faceprint;

transmitting the identification data for the face represented by the second faceprint from the first external electronic device to the electronic device; and

generating a tag corresponding to the received identification data for the second faceprint and associating the tag with the digital image.

20. The method of generating a tag of claim 19, further comprising:

transmitting each unmatched faceprint and each respective identification request from the first external electronic device to a second external electronic device;

storing a plurality of reference data items in a memory in the second external electronic device;

matching a third faceprint from among the plurality of faceprints to at least one of the plurality of reference data items stored in the second external electronic device to identify a respective a face represented by the third faceprint;

generating identification data for the face represented by the third faceprint;

transmitting the identification data for the face represented by the third faceprint from the second external electronic device to the first external electronic device;

transmitting the identification data for the face represented by the third faceprint from the first external electronic device to the electronic device; and

generating a tag corresponding to the received identification data for the third faceprint and associating the tag with the digital image.