Automatic image piling

• US 9,542,619 B2
• Filed: 03/11/2013
• Issued: 01/10/2017
• Est. Priority Date: 03/11/2013
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Culpepper, Benjamin Jackson, Garrigues, Pierre, Janoch, Allison, Nguyen, Huy X.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US13/793,890
• Publication Number:
  US 20140254946A1
• Time in Patent Office: 1,401 Days
• Field of Search: 382/224
• US Class Current: 1/1
• CPC Class Codes: G06F 18/231 Hierarchical techniques, i.e. dividing or merging pattern sets so as to obtain a dendrogram
• CPC Class Codes: G06V 10/7625 Hierarchical techniques, i.e. dividing or merging patterns to obtain a tree-like representation; Dendograms
• CPC Class Codes: G06V 20/35 Categorising the entire scene, e.g. birthday party or wedding scene

Abstract

A system for determining piles comprises an interface and a processor. The interface is configured to receive an image. The processor is configured to determine one or more attributes of the image; to determine whether the image is a member of a top of a hierarchy based at least in part on the attributes. In the event it is determined that the image is a member of the top of the hierarchy: determine a set of elements of the hierarchy the image is a member of, based at least in part on the attributes and determine which of the set of entities are piles.

Claims

1. A system, comprising:

an interface configured to receive an image;

a processor and a memory, at least one of the processor or the memory being configured to;

determine one or more attributes of the image;

classify the image by determining a set of elements of a hierarchy of which the image is a member based at least in part on the attributes;

adding the image to one or more piles associated with the set of elements of the hierarchy of which the image is a member; and

providing at least one pile associated with the hierarchy for presentation via a display, the pile including one or more images.

2. The system of claim 1, wherein at least one of the processor or the memory is further configured to determine features of the image, wherein the attributes are determined based at least in part on the features.

3. The system of claim 1, wherein the hierarchy is one of a plurality of hierarchies.

4. The system of claim 3, wherein the plurality of hierarchies comprises an initial set of hierarchies.

5. The system of claim 1, wherein the set of elements of the hierarchy comprise element member functions, wherein each of the element member functions determines whether the image is a member of the corresponding one of the set of elements.

6. The system of claim 1, wherein at least one of the processor or the memory is further configured to add a new element to the hierarchy.

7. The system of claim 1, wherein the at least one of the processor of the memory is further configured to create a new hierarchy in the event that the image is determined to not be a member of a top element of the hierarchy.

8. The system of claim 1, wherein the set of elements of the hierarchy the image is a member of is determined by checking elements of the hierarchy in top down order.

9. The system of claim 8, wherein at least one of the processor or the memory is further configured to determine whether the image is a member of a child of an element in the hierarchy of which the image is a member.

10. The system of claim 1, wherein it is determined which of the elements of the set of elements of the hierarchy are piles based at least in part on the number of images associated with each element.

11. The system of claim 1, wherein it is determined which of the elements of the set of elements the image is a member of are piles based at least in part on an element position in the hierarchy.

12. The system of claim 11, wherein an element the image is a member of furthest down in the hierarchy is determined to be a pile to which the image is added.

16. The system of claim 1, wherein the pile comprises a plurality of images sharing a set of attributes.

17. The system of claim 1, wherein the attributes of the image comprise at least one of a location at which the image was taken, a predominant color of the image, an object that is featured in the image, or a type of object that is featured in the image.

18. The system of claim 1, wherein the hierarchy is represented via a graph comprising a plurality of nodes connected by edges that indicate relationships among the plurality of nodes.

13. A method, comprising:

determining, using a processor, attributes of an image;

classifying the image by determining a set of elements of a hierarchy of which the image is a member based at least in part on the attributes;

adding the image to one or more piles associated with the set of elements of the hierarchy of which the image is a member; and

providing at least one pile associated with the hierarchy for presentation via a display, the pile including one or more images.

15. The method of claim 13, further comprising:

determining important portions of the images in the pile;

wherein the pile is provided such that at least a subset of the important portions of the images in the pile are visible.

19. The method of claim 13, wherein determining a set of elements of a hierarchy of which the image is a member based at least in part on the attributes comprises:

automatically determining a set of piles associated with the image based at least in part on the attributes of the image;

wherein adding the image to one or more piles includes adding the image to the set of piles.

20. The method of claim 13, wherein the set of elements comprises one or more classes.

14. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

determining attributes of an image;

classifying the image by determining a set of elements of a hierarchy of which the image is a member based at least in part on the attributes;

adding the image to one or more piles associated with the set of elements of the hierarchy of which the image is a member; and

providing at least one pile associated with the hierarchy for presentation via a display, the pile including one or more images.