Method, apparatus and system for outputting a group of images

• US 9,373,021 B2
• Filed: 03/25/2011
• Issued: 06/21/2016
• Est. Priority Date: 03/25/2011
• Status: Expired due to Fees

• Current Assignee: Sony Europe BV (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Europe Limited (Sony Group Corp.)
• Inventors: De Vos, Kurt, Marivoet, Philip, Schelkens, Vanessa, Clarke, Daniel
• Primary Examiner(s): Lefkowitz, Sumati
• Assistant Examiner(s): Potts, Ryan P
• Application Number:
  US13/072,041
• Publication Number:
  US 20120243750A1
• Time in Patent Office: 1,915 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06V 10/762 using clustering, e.g. of similar faces in social networks
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks
• CPC Class Codes: G06V 40/178 estimating age from face image; using age information for improving recognition

Abstract

There is described an apparatus for outputting a group of images for display, the group being taken from a plurality of images, each image in the plurality of images having a face located therein, the apparatus comprising a processor configured to: retrieve a set of images from a storage medium, the set of images containing at least the plurality of images from which the group of images to be displayed is selected; identify the face in each of the plurality of images; identify variable features on the face in each of the plurality of images; establish the group of images in accordance with a measure of the dissimilarity between the variable features in the plurality of images; and output the group of images for display.

Claims

1. A method of outputting images, the method comprising:

retrieving a plurality of images from a storage medium, the plurality of images including a group of images and a specific face of a same person is included within each image of the plurality of images;

identifying, by circuitry, the specific face of the same person within each of the plurality of images;

segmenting the specific face in each of the plurality of images, by the circuitry after the identifying and when the specific face is successfully identified in each of the plurality of images, into a plurality of variable features and non-variable features, the variable features of the specific face being features of the same person that change over time and the non-variable features of the specific face being features of the same person that do not change over time;

identifying a specific variable feature of the plurality of variable features, the specific variable feature designated by a user;

measuring, by the circuitry for each particular image of the plurality of images, a degree of similarity between the specific variable feature in the particular image and the specific variable feature in each of the other plurality of images;

ordering the plurality of images according to the measured degree of similarity for each of the plurality of images;

identifying the group of images, from the plurality of images ordered in the ordering, according to the ordering and the specific variable feature identified in each of the plurality of images; and

outputting the group of images.

2. The method according to claim 1, further comprising:

generating metadata for each image of the plurality of images, the metadata uniquely identifying each particular image within the plurality of images.

3. The method according to claim 2, further comprising:

generating a database for identifying the specific face; and

associating the metadata of each image with the specific face to uniquely identify the specific face.

4. The method according to claim 1, further comprising:

determining, by the circuitry, a facial metric for the specific face in each of the plurality of images, the facial metric defining unique characteristic features of the specific face;

comparing the determined facial metric with other stored facial metrics; and

identifying the specific face based on results of said comparison.

5. The method according to claim 4, wherein the facial metric is based on a ratio of distances between different facial features.

6. The method according to claim 1, further comprising displaying each image of the group of images on a timeline, wherein

each image is positioned on the timeline according to a time/date that the image was captured.

7. The method according to claim 6, further comprising:

selecting an event from a plurality of user defined events; and

displaying the event on the timeline, wherein

the event is selected based on a difference between the time/date of the event and the time/date that the images of the group of images were captured.

8. The method according to claim 1, further comprising cropping an image, of the group of images, around the specific face, wherein

the specific face is identified from the cropped image.

9. The method according to claim 8, further comprising displaying the cropped image in the group of images.

10. A non-transitory computer readable medium comprising computer readable instructions that, when executed by a computer, cause the computer to carry out a method of outputting a group of images, the method comprising:

retrieving a plurality of images from a storage medium, the plurality of images including a group of images and a specific face of a same person is included within each image of the plurality of images;

identifying the specific face of the same person within each of the plurality of images;

segmenting the specific face in each of the plurality of images, after the identifying and when the specific face is successfully identified in each of the plurality of images, into a plurality of variable features and non-variable features, the variable features of the specific face being features of the same person that change over time and the non-variable features of the specific face being features of the same person that do not change over time;

identifying a specific variable feature of the plurality of variable features, the specific variable feature designated by a user;

measuring, for each particular image of the plurality of images, a degree of similarity between the specific variable feature in the particular image and the specific variable feature in each of the other plurality of images;

ordering the plurality of images according to the measured degree of similarity for each of the plurality of images;

identifying the group of images, from the plurality of images ordered in the ordering, according to the ordering and the specific variable feature identified in each of the plurality of images; and

outputting the group of images.

11. An apparatus, comprising:

processing circuitry configured to;

retrieve a plurality of images from a storage medium, the plurality of images including a group of images and a specific face of a same person is included within each of the plurality of images;

identify the specific face of the same person within each of the plurality of images;

segment the specific face in each of the plurality of images, after the identifying and when the specific face is successfully identified in each of the plurality of images, into a plurality of variable features and non-variable features, the variable features of the specific face being features of the same person that change over time and the non-variable features of the specific face being features of the same person that do not change over time;

identify a specific variable feature of the plurality of variable features, the specific variable feature designated by a user;

measure, for each particular image of the plurality of images, a degree of similarity between the specific variable feature in the particular image and the specific variable feature in each of the other plurality of images;

order the plurality of images according to the measured degree of similarity for each of the plurality of images; and

identify the group of images, from the plurality of images ordered in the ordering, according to the ordering and the specific variable feature identified in each of the plurality of images; and

output the group of images.

12. The apparatus according to claim 11, wherein the processing circuitry is further configured to generate metadata for each image of the plurality of images, the metadata uniquely identifying each particular image within the plurality of images.

13. The apparatus according to claim 12, further comprising a database for identifying the specific face, wherein

the processing circuitry is further configured to utilize the database to associate the metadata of the image with the specific face to uniquely identify the specific face.

14. The apparatus according to claim 13, wherein the processing circuitry is further configured to:

determine, for each image of the plurality of image, whether the image includes a timestamp; and

compare, for each image including a timestamp, the timestamp to information within the metadata, wherein

the plurality of images are further ordered according to the comparisons between each timestamp and the metadata.

15. The apparatus according to claim 11, wherein the processing circuitry is further configured to:

determine a facial metric for the specific face in each of the plurality of images, the facial metric defining unique characteristic features of the specific face;

compare the determined facial metric with other stored facial metrics; and

identify the specific face based on results of said comparison.

16. The apparatus according to claim 15, wherein the facial metric is based on a ratio of distances between different facial features.

17. The apparatus according to claim 11, wherein

the processing circuitry is further configured to output the group of images on a timeline, and

each image is positioned on the timeline according to a time/date that the image was captured.

18. The apparatus according to claim 17, wherein the processing circuitry is further configured to:

select an event from a plurality of user defined events; and

output, to the display, the event on the timeline, wherein

the event is selected based on a difference between the time/date of the event and the time/date that the images of the group of images were captured.

19. The apparatus according to claim 11, wherein the processing circuitry is further configured to crop an image, of the group of images, around the specific face, wherein

the specific face is identified from the cropped image.

20. The apparatus according to claim 19, wherein the processing circuitry is further configured to output the cropped image in the group of images.

21. The apparatus according to claim 20, wherein the processing circuitry is further configured to output the group of images as a mashup, a slideshow, a single file, a timeline or a collage.