Method, system, and computer program for identification and sharing of digital images with face signatures

• US 9,152,849 B2
• Filed: 08/20/2013
• Issued: 10/06/2015
• Est. Priority Date: 12/31/2007
• Status: Active Grant

• Current Assignee: 11967134 Canada Limited
• Original Assignee: Applied Recognition Inc.
• Inventors: Ro, Yong Man, Ganong, Ray, Waugh, Donald Craig, Studholme, Chris, Plataniotis, Kostas
• Primary Examiner(s): Thirugnanam, Gandhi
• Application Number:
  US13/970,933
• Publication Number:
  US 20140161326A1
• Time in Patent Office: 777 Days
• Field of Search: 382/118
• US Class Current: 1/1
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06V 10/32 Normalisation of the pattern dimensions
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

Methods and systems are provided for sharing a digital image depicting one or more faces. The method may include linking a plurality of computer terminals to a computer network, each computer terminal associated with an individual; receiving a digital image at at least one of the computer terminals; executing a face recognition routine on the digital image, the face recognition routine detecting at least one face in the digital image, each detected face corresponding to a person, the face recognition routine recognizing at least one of the persons as being one of the individuals; and for each individual recognized in the digital image by the face recognition routine, initiating dissemination of the digital image to the computer terminal associated with respective individual whose face is recognized in the digital image.

Claims

1. A method for sharing a digital image depicting one or more faces, the method comprising:

(a) linking a plurality of computer systems to a computer network, each computer system associated with an individual;

(b) receiving a digital image at a first computer system of the computer systems;

(c) the first computer system executing a face recognition routine on the digital image, the face recognition routine detecting at least one face in the digital image, each detected face corresponding to a person, the face recognition routine recognizing at least one of the persons as being one of the individuals; and

(d) from the first computer system, for each individual recognized in the digital image by the face recognition routine, automatically and selectively disseminating of the digital image to the computer system associated with the respective individual whose face is recognized in the digital image,

wherein the face recognition routine includes;

comparing a face to all the faces associated with a known person and calculating a distance value for each comparison, wherein the comparing and the calculating steps are computed for each known person;

compute the geometric mean of the distance values for each known person

determine the closest match between the face and each known person using the geometric mean and choosing the minimum distance;

compare the closest match minimum distance against a dynamically determined threshold, wherein the dynamically determined threshold is determined using the inverse cumulative normal distribution function.

2. The method of claim 1, wherein the first computer system is linked to a processing engine, wherein the processing engine is configured to:

(a) scan at least one file folder stored on the respective computer system to determine whether the digital image is linked to the at least one file folder;

(b) in accordance with the digital image linking determination, initiate the face recognition routine executing; and

(c) link a result of the face recognition routine to a database.

3. The method of claim 2, wherein the first computer system is also linked to a user interface enabling the individual to link the digital image to the at least one file folder.

4. The method of claim 3, wherein the user interface is accessible from a mobile device.

5. The method of claim 3, wherein the user interface enables a user to create at least one digital image album, each digital image album linking a plurality of digital images, at least one of the plurality of digital images having been processed by the face recognition routine.

6. The method claimed in claim 1, wherein:

(a) at the first computer system defining at least one peer group, each of the at least one peer group linking at least a subset of the individuals; and

(b) the digital image disseminating comprising transmitting the digital image to the respective computer system where (i) the respective computer system is associated with the respective individual whose face is recognized in the digital image; and

(ii) the individual associated with the respective computer system is one of the subset of the individuals.

8. The method of claim 5, wherein the processing engine is further configured to receive an input specifying at least one person, and generate the at least one digital image album from digital images featuring the at least one specified person stored at the at least one computer system.

9. The method of claim 8, wherein the input specifying at least one person comprises a boolean search query identifying a plurality of specified persons.

10. The method of claim 1, wherein the execution of the face recognition routine generates metadata identifying at least one person whose face was detected in the digital image by the face recognition routine.

11. The method of claim 10, wherein the dissemination comprises transmitting the generated metadata together with the digital image.

12. The method of claim 1, wherein the dissemination comprises transmitting a confirmation request to the computer system associated with the respective individual, the confirmation request comprising a request to transmit the digital image to the individual'"'"'s computer system.

13. The method of claim 12, wherein the digital image is resized prior to transmission.

14. The method of claim 1, wherein a computer server is linked to the computer network;

the dissemination comprises the first computer system transmitting the digital image to the computer server;

the computer server granting access to the digital image to the computer system associated with the respective individual whose face is recognized in the digital image.

15. The method of claim 14, wherein the execution of the face recognition routine generates metadata identifying at least one person whose face was detected in the digital image by the face recognition routine;

the dissemination comprising transmitting the generated metadata to the computer server.

16. The method of claim 14, comprising the first computer system receiving a list of known persons from the computer server, the face recognition routine recognizing comprising identifying the at least one detected face as one of the known persons.

17. The method of claim 1, wherein the face recognition executing comprises the first computer system transmitting the digital image to a remote computer, the remote computer executing the face recognition routine on the digital image.

18. The method of claim 17, wherein the dissemination comprises the remote computer making available the digital image to at least one user whose face was recognized in the digital image through the face recognition executing.

19. The method of claim 12, wherein the digital image is reduced prior to transmission.

37. The method of claim 1, further comprising queuing the digital image at the first computer system for transmission from the first computer system to the respective computer system.

38. The method of claim 37, wherein the dissemination comprises transmitting a confirmation request from the first computer system to the respective computer system to request confirmation to transmit the digital image from the first computer systems to the respective computer system.

39. The method of claim 1, wherein a computer server is linked to the computer network;

the dissemination comprises the first computer system transmitting the digital image to the computer server for transmission to the respective computer system.

42. The method of claim 1, wherein at least one of the plurality of computer systems comprises a mobile device.

43. The method of claim 16, wherein the list of known persons are loaded from a social network account.

44. The method of claim 1, the first computer system executing a face detection routine and a face recognition routine on the digital image, the face detection routine detecting at least one face region in the digital image, each detected face region corresponding to a person, the face recognition routine recognizing at least one of the persons as being one of the individuals by, for each detected face region, creating a face signature, comparing the face signature to known face signatures to match the face signature to a known face signature within a similarity threshold.

45. The method of claim 44, wherein the face detection routine further comprises at least one of initiating a texture-based detection routine to detect candidate faces, applying a skin color detection test to eliminate one or more of the candidate faces that fail the skin color detection test, and initiating a face orientation compensation by rotating a portion of the digital image associated with the candidate faces.

7. A system for sharing a digital image depicting one or more faces, the system comprising:

(a) a plurality of computer systems linked to a computer network, each computer system associated with an individual;

(b) a digital image operable to be linked to a first computer system of the computer systems;

(c) the first computer system operable to execute a face recognition routine to detect at least one face in the digital image, each detected face corresponding to a person, the face recognition routine recognizing at least one of the persons as being one of the individuals; and

(d) at the first computer system, a sharing routine operable to automatically selectively disseminate, for each individual recognized in the digital image by the face recognition routine, the digital image to the computer system associated with the respective individual whose face is recognized in the digital image,

wherein the face recognition routine includes;

comparing a face to all the faces associated with a known person and calculating a distance value for each comparison, wherein the comparing and the calculating steps are computed for each known person;

compute the geometric mean of the distance values for each known person

determine the closest match between the face and each known person using the geometric mean and choosing the minimum distance;

compare the closest match minimum distance against a dynamically determined threshold, wherein the dynamically determined threshold is determined using the inverse cumulative normal distribution function.

20. The system of claim 7, wherein the first computer system is linked to a processing engine, wherein the processing engine is configured to:

(a) scan at least one file folder stored on the respective computer system to determine whether the digital image is linked to the at least one file folder;

(b) in accordance with the digital image linking determination, initiate the face recognition routine executing; and

(c) link a result of the face recognition routine to a database.

21. The system of claim 20, wherein the first computer system is also linked to a user interface enabling the individual to link the digital image to the at least one file folder.

22. The system of claim 21, wherein the user interface is accessible from a mobile device.

23. The system of claim 21, wherein the user interface enables a user to create at least one digital image album, each digital image album linking a plurality of digital images, at least one of the plurality of digital images having been processed by the face recognition routine.

24. The system of claim 23, wherein the processing engine is further configured to receive an input specifying at least one person, and generate the at least one digital image album from digital images featuring the at least one specified person stored at the first computer system.

25. The system of claim 24, wherein the input specifying at least one person comprises a boolean search query identifying a plurality of specified persons.

26. The system claimed in claim 7, wherein:

(a) at respective computer systems defining at least one peer group, each of the at least one peer group linking at least a subset of the individuals; and

(b) the digital image disseminating comprising transmitting the digital image to the respective computer system where (i) the respective computer system is associated with the respective individual whose face is recognized in the digital image; and

(ii) the individual associated with the respective computer system is one of the subset of the individuals.

27. The system of claim 7, wherein the execution of the face recognition routine generates metadata identifying at least one person whose face was detected in the digital image by the face recognition routine.

28. The system of claim 27, wherein the dissemination comprises transmitting the generated metadata together with the digital image.

29. The system of claim 7, wherein the dissemination comprises transmitting a confirmation request to the computer system associated with the respective individual, the confirmation request comprising a request to transmit the digital image to the individual'"'"'s computer system.

30. The system of claim 29, wherein the digital image is resized in prior to transmission.

31. The system claimed in claim 7, comprising a computer server linked to the computer network;

the dissemination comprising the first computer system transmitting the digital image to the computer server;

the computer server granting access to the digital image to the computer terminal associated with the respective individual whose face is recognized in the digital image.

32. The system of claim 31, wherein the execution of the face recognition routine generates metadata identifying at least one person whose face was detected in the digital image by the face recognition routine;

the dissemination comprising transmitting the generated metadata to the computer server.

33. The system of claim 31, comprising the at least one computer system receiving a list of known persons from the computer server, the face recognition routine recognizing comprising identifying the at least one detected face as one of the known persons.

34. The system of claim 7, wherein the face recognition executing comprises the first computer system transmitting the digital image to a remote computer, the remote computer executing the face recognition routine on the digital image.

35. The system of claim 34, wherein the dissemination comprises the remote computer making available the digital image to at least one user whose face was recognized in the digital image through the face recognition executing.

36. The system of claim 29, wherein the digital image is reduced prior to transmission.

40. The system of claim 7, further comprising queuing the digital image to the first computer system for transmission from the first computer system to the respective computer system.

41. The system of claim 40, wherein the dissemination comprises transmitting a confirmation request from the first computer system to the respective computer system to request confirmation to transmit the queued digital image from the first computer system to the respective computer system.