Arranging Images Into Pages Using Content-based Filtering And Theme-based Clustering

• US 20110205399A1
• Filed: 02/26/2009
• Published: 08/25/2011
• Est. Priority Date: 10/26/2008
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Gao, Yuli, Cheatle, Stephen Philip
• Application Number:
  US13/125,968
• Publication Number:
  US 20110205399A1
• Time in Patent Office: Days
• US Class Current: 348/231.99
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/775 between a recording apparatus and a television receiver
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence

Abstract

To arrange images into pages, images captured by at least one imaging device are received. Content-based filtering is applied for removing at least one of the received images to produce a collection of the images. Theme-based clustering is then performed on the images in the collection to produce plural clusters of images, where the plural clusters of images are associated with respective themes that are based on time and at least one other attribute that provides an indication of thematic similarity between the images. The plural clusters of images are mapped to respective pages of an output representation.

Claims

1. A method executed by a computer of arranging images into pages, comprising:

receiving images captured by at least one imaging device;

applying content-based filtering for removing at least one of the received images if at least one filtering criterion is satisfied to produce a collection of the images;

performing theme-based clustering of the images in the collection to produce plural clusters of images, wherein the plural clusters of images are associated with respective themes that are based on time and at least one other attribute that provides an indication of thematic similarity between the images; and

mapping the plural clusters of images to respective pages of an output representation.

2. The method of claim 1, wherein applying the content-based filtering comprises identifying duplicate images and removing duplicate images.

3. The method of claim 1, wherein applying the content-based filtering comprises removing the at least one of the received images if the at least one criterion relating to sharpness of the received images is satisfied.

4. The method of claim 1, wherein applying the content-based filtering comprises removing the at least one of the received images if the at least one criterion indicating interestingness of the received images is satisfied.

5. The method of claim 1, wherein the at least one other attribute comprises an attribute relating to similarity of color between the images of the collection.

6. The method of claim 5, wherein the at least one other attribute further includes another attribute relating to a number of faces of people or identity of people in each of the images in the collection.

7. The method of claim 5, wherein the at least one other attribute further includes another attribute relating to locations depicted by the images in the collection.

8. The method of claim 1, claims, wherein mapping the clusters of images to respective pages of the output representation comprises mapping the clusters of images to respective pages of a photoalbum.

9. The method of claim 1, further comprising laying out the images of the clusters in respective pages, wherein laying out the images comprises assigning weights to multiple images within a particular one of the clusters, and wherein the weights indicate respective sizes of the multiple images in the page corresponding to the particular cluster.

10. The method of claim 9, further comprising assigning a number of pages to the particular cluster based on the weights of the images in the particular cluster.

11. The method of claim 9, wherein the weights are determined based on at least one criterion selected from among:

color variation, number of faces, face sizes, and a user specification.

12. An article comprising at least one computer-readable storage medium containing instructions that upon execution cause a computer to perform the method of claim 1.

13. A computer system comprising:

a storage to store images; and

a processor to;

produce a set of images by applying content-based filtering to the stored images such that at least one of the stored images is removed from the set if at least one filtering criterion is satisfied;

generate plural clusters, wherein each cluster includes at least one of the images in the set, wherein the plural clusters are generated based on a time attribute of the images in the set and further based on at least one other attribute that provides an indication of thematic similarity between the images in the set; and

output the images of the clusters to corresponding pages of an output representation.

14. The computer system of claim 13, wherein the content-based filtering is based on one or more of the following filtering criteria:

a duplication criterion, a sharpness criterion, and an interestingness criterion.

15. The computer system of claim 13, wherein the at least one other attribute comprises an attribute selected from among:

an attribute relating to similarity of color between the images of the set, an attribute relating to a number of faces of people in each of the images in the set, an attribute relating to identity of faces in each of the images in the set, a type of object attribute, a type of activity attribute, and an attribute relating to a location of the images in the set.

16. The computer system of claim 13, wherein the processor is to further identify candidate cover images for the output representation, and to present the candidate cover images to a user for selection as the cover image for the output representation.