CLUSTERING PHOTOGRAPHS FOR DISPLAY ON A DIGITAL PICTURE FRAME

• US 20180150986A1
• Filed: 11/28/2017
• Published: 05/31/2018
• Est. Priority Date: 10/10/2013
• Status: Active Grant

• Current Assignee: Aura Home, Inc. (Pushd, Inc.)
• Original Assignee: Pushd, Inc.
• Inventors: FRIEDER, Ophir, CHOWDHURY, Abdur, JENSEN, Eric, CHERRY, Ben, SANFORD, Richard, Kolcz, Alex
• Granted Patent: US 10,430,986 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/55 Clustering; Classification
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06F 18/2321 using statistics or function optimisation, e.g. modelling of probability density functions
• CPC Class Codes: G06F 18/24137 Distances to cluster centroïds
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 10/763 Non-hierarchical techniques, e.g. based on statistics of modelling distributions
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 20/35 Categorising the entire scene, e.g. birthday party or wedding scene
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: H04N 1/00129 with a display device, e.g. CRT or LCD monitor with a television apparatus H04N1/00283; arrangements for control of display devices G09G

Abstract

A digital picture frame including a camera integrated with the frame, and a network connection module allowing the frame for direct contact and upload of photos from electronic devices or from photo collections of community members. The integrated camera is used to automatically determine an identity of a frame viewer and can capture gesture-based feedback. The displayed photos are automatically shown and/or changed according to the detected viewers. Clustering photos by content is used to improve display and to respond to photo viewer desires. The photos can be filtered and cropped at the receiver side.

Claims

1. A method of displaying photos on a digital picture frame including a digital display mounted within a frame, a camera connected to the frame, and a network connection module, the method comprising:

automatically determining with the camera an identity of a viewer of the digital picture frame;

automatically clustering photos of a digital photo collection for display to the viewer; and

automatically displaying on the digital display the photos from the digital photo collection as a function of the clustering.

2. The method of claim 1, further comprising grouping clusters of photos to form photo collections of related content and displaying the photo collections.

3. The method of claim 1, further comprising clustering the photos according to a photo content.

4. The method of claim 3, further comprising comparing metadata of the photos to identify or confirm the content.

5. The method of claim 1, further comprising automatically clustering the photos of a preselected photographed person.

6. The method of claim 5, further comprising automatically identifying the photographed person and/or clustering the photos by facial features.

7. The method of claim 1, further comprising clustering photos taken over a multi-year timeframe to group photos by related photo content across the timeframe.

8. The method of claim 1, further comprising filtering clusters of photos as a function of quality and/or content, wherein photos of low quality or photos including predetermined people, activities, and/or locations are removed from the clusters.

9. The method of claim 1, further comprising:

extracting photo features within a cluster of photos to form a cluster representation;

comparing the cluster representation to further cluster representations to determine related clusters; and

linking or grouping related clusters for display.

10. The method of claim 9, wherein the cluster representation comprises a cluster centroid of averaged photo features, and further comprising:

comparing centroids of a plurality′

of additional cluster representations to determine related clusters; and

linking or grouping related clusters for display.

11. The method of claim 1, further comprising comparing clusters of photos across more than one digital photo collection over a network and sharing related clusters over the network for viewing on the digital picture frame.

12. The method of claim 11, further comprising determining whether a second digital photo collection includes a predetermined threshold of photos of an individual before displaying photos from the second digital photo collection.

13. The method of claim 1, further comprising forming classification models from clustered photos, and using the classification models to place unassigned photos into an existing cluster.

14. A method of displaying photos on a digital picture frame including a digital display mounted within a frame, a camera connected to the frame, and a network connection module, the method comprising:

automatically determining with the camera an identity of a viewer of the digital picture frame;

automatically clustering photos of a digital photo collection for display to the viewer, wherein the clustering is performed as a function of a common detected content in the photos selected from things, places, activities, or combinations thereof; and

automatically displaying a slideshow on the digital display of the photos from the digital photo collection as a function of the clustering.

15. The method of claim 14, automatically clustering photos of a digital photo collection of the viewer and of a second digital photo collection of a community member.

16. The method of claim 14, further comprising:

extracting photo features within a cluster of photos to form a cluster representation;

comparing the cluster representation to further cluster representations to determine related clusters; and

linking or grouping related clusters for display.

17. The method of claim 14, further comprising:

ranking the photos to be circulated in the slideshow; and

automatically determining an order of presentation, a number of display repetitions, and/or a time period of display for each of the photos as function of the ranking.

18. A method of displaying photos on a digital picture frame including a digital display mounted within a frame, a camera connected to the frame, and a network connection module, the method comprising:

automatically determining with the camera an identity of a viewer of the digital picture frame;

automatically clustering from a digital photo collection, via automated facial recognition, photos of a person of interest to the viewer to obtained clustered photos of the person of interest; and

automatically displaying on the digital display the clustered photos from the digital photo collection as a function of the clustering.

19. The method of claim 18, further comprising automatically identifying the photographed person and clustering the photos by facial features.

20. The digital picture frame of claim 19, wherein the digital photo collection is determined from a viewer profile of the viewer and the digital picture frame automatically changes the display as a function of the viewer profile upon detection of the viewer through the camera.