Indexing, storage and retrieval of digital images

• US 20020039447A1
• Filed: 08/28/2001
• Published: 04/04/2002
• Est. Priority Date: 08/29/2000
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: ImageID Ltd. (Panasonic Holdings Corporation)
• Inventors: Nemet, Yaron, Shniberg, Moti
• Granted Patent: US 7,203,367 B2
• Time in Patent Office: Days
• US Class Current: 382/224
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation

Abstract

A method and a system for archiving, indexing and retrieving images of persons including the steps of providing image data relating to the images of persons to a suitably programmed computer, employing a first suitably programmed computer functionality to provide face recognition of the images, employing a second suitably programmed computer functionality to group the images according to faces recognized therein and employing a third suitably programmed computer functionality to provide an index of groups of the images organized according to faces recognized therein.

Claims

1. A method for indexing images of persons comprising:

providing image data relating to said images of persons to a suitably programmed computer;

employing a first suitably programmed computer functionality to provide face recognition of said images;

employing a second suitably programmed computer functionality to group said images according to faces recognized therein; and

employing a third suitably programmed computer functionality to provide an index of groups of said images organized according to faces recognized therein.

2. A method according to claim 1 employing said index for retrieving images of an individual person.

3. A method according to claim 1 and wherein at least two of said first, second and third suitably programmed computer functionalities are performed by said suitably programmed computer.

4. A method according to claim 1 and wherein all of said first, second and third suitably programmed computer functionalities are performed by said suitably programmed computer.

5. A method according to claim 2 and wherein at least two of said first, second and third suitably programmed computer functionalities are performed by said suitably programmed computer.

6. A method according to claim 2 and wherein all of said first, second and third suitably programmed computer functionalities are performed by said suitably programmed computer.

7. A method according to claim 1 and wherein said index employs a recognized face as an index icon.

8. A method according to claim 1 and wherein said providing image data is carried out via the Internet.

9. A method according to claim 2 and wherein said retrieving is carried out via the Internet.

10. A method according to claim 1 and wherein said providing image data employs a film camera and a scanner.

11. A method according to claim 2 and wherein said index employs a recognized face as an index icon.

12. A method according to claim 2 and wherein said providing image data is carried out via the Internet.

13. A method according to claim 2 and wherein said providing image data employs a film camera and a scanner.

14. A method according to claim 1 and wherein said providing image data employs a digital camera .

15. A method according to claim 2 and wherein said providing image data employs a digital camera.

16. A method according to claim 2 and also comprising downloading at least one image.

18. A system according to claim 17 and also comprising an image retriever, employing said index for retrieving images of an individual person.

19. A system according to claim 17 and wherein at least two of said first, second and third suitably programmed computer functionalities are embodied in said suitably programmed computer.

20. A system according to claim 17 and wherein all of said first, second and third suitably programmed computer functionalities are performed by said suitably programmed computer.

21. A system according to claim 18 and wherein at least two of said first, second and third suitably programmed computer functionalities are performed by said suitably programmed computer.

22. A system according to claim 18 and wherein all of said first, second and third suitably programmed computer functionalities are performed by said suitably programmed computer.

23. A system according to claim 17 and wherein said index employs a recognized face as an index icon.

24. A system according to claim 17 and wherein said image data source transmits said image data to said suitably programmed computer via the Internet.

25. A system according to claim 18 and wherein said retriever operates via the Internet.

26. A system according to claim 17 and wherein said image data source employs a film camera and a scanner.

27. A system according to claim 18 and wherein said index employs a recognized face as an index icon.

28. A system according to claim 18 and wherein said image data source transmits said image data to said suitably programmed computer via the Internet.

29. A system according to claim 18 and wherein said image data source employs a film camera and a scanner.

30. A system according to claim 17 and wherein said image data source employs a digital camera.

31. A system according to claim 18 and wherein said image data source employs a digital camera.

32. A system according to claim 18 and wherein said image retriever comprises a downloader for downloading at least one image.

17. A system for indexing images of persons comprising:

an image data source providing image data relating to said images of persons to a suitably programmed computer;

a first suitably programmed computer functionality providing face recognition of said images;

a second suitably programmed computer functionality grouping said images according to faces recognized therein; and

a third suitably programmed computer functionality providing an index of groups of said images organized according to faces recognized therein.

33. A method for classifying images of persons in photographs comprising:

photographing a plurality of persons in a plurality of scenes, wherein not all of the persons appear in all of the scenes, to provide a plurality of photographs;

computer analyzing the plurality of photographs to detect at least the faces of persons in each of the scenes; and

automatically grouping the photographs according to at least the faces of the persons appearing therein.

34. A method for classifying images according to claim 33 and also comprising indexing said plurality of photographs at least partially in accordance with the faces of the persons appearing therein.

35. A method for classifying images according to claim 33 and wherein:

said photographing comprises photographing said plurality of persons while they are bearing unique identification indications; and

said computer analyzing comprises;

face recognition of the faces of the persons appearing in said photographs;

recognition of said unique identification indications; and

correlation of said faces with said unique identification indications.

36. A method for classifying images according to claim 34 and wherein:

said photographing comprises photographing said plurality of persons while they are bearing unique identification indications; and

said computer analyzing comprises;

face recognition of the faces of the persons appearing in said photographs;

recognition of said unique identification indications; and

correlation of said faces with said unique identification indications.

37. A method for classifying images according to claim 33 and wherein said computer analyzing comprises image indication assisted face recognition.

38. A method for classifying images according to claim 34 and wherein said computer analyzing comprises image indication assisted face recognition.

39. A method for classifying images according to claim 35 and wherein said face recognition comprises image indication assisted face recognition.

40. A method for classifying images according to claim 36 and wherein said face recognition comprises image indication assisted face recognition.

41. A method for classifying images according to claim 35 and wherein said grouping employs said correlation.

42. A method for classifying images according to claim 36 and wherein said grouping and said indexing employ said correlation.

43. A system for classifying images of persons in photographs comprising:

a photography subsystem, photographing a plurality of persons in a plurality of scenes, wherein not all of the persons appear in all of the scenes, to provide a plurality of photographs; and

a computer analysis and photograph grouping subsystem, computer analyzing the plurality of photographs to detect at least the faces of persons in each of the scenes and automatically grouping the photographs according to at least the faces of the persons appearing therein.

44. A system for classifying images according to claim 43 and wherein said computer analysis and photograph grouping subsystem also provides indexing said plurality of photographs at least partially in accordance with the faces of the persons appearing therein.

45. A system for classifying images according to claim 43 and wherein:

said photography subsystem is operative to photograph said plurality of persons while they are bearing unique identification indications; and

said computer analysis and photograph grouping subsystem provides the following functionalities;

face recognition of the faces of the persons appearing in said photographs;

recognition of said unique identification indications; and

correlation of said faces with said unique identification indications.

46. A system for classifying images according to claim 44 and wherein:

said photography subsystem is operative to photograph said plurality of persons while they are bearing unique identification indications; and

said computer analysis and photograph grouping subsystem provides the following functionalities;

face recognition of the faces of the persons appearing in said photographs;

recognition of said unique identification indications; and

correlation of said faces with said unique identification indications.

47. A system for classifying images according to claim 43 and wherein said computer analysis subsystem provides image indication assisted face recognition.

48. A system for classifying images according to claim 44 and wherein said computer analysis subsystem provides image indication assisted face recognition.

49. A system for classifying images according to claim 45 and wherein said face recognition comprises image indication assisted face recognition.

50. A system for classifying images according to claim 46 and wherein said face recognition comprises image indication assisted face recognition.

51. A system for classifying images according to claim 45 and wherein said grouping employs said correlation.

52. A system for classifying images according to claim 46 and wherein said grouping and said indexing employ said correlation.