Summarization of media object collections

• US 9,507,778 B2
• Filed: 05/19/2006
• Issued: 11/29/2016
• Est. Priority Date: 05/19/2006
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Jaffe, Alexander B., Naaman, Mor, Davis, Marc E.
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): MINA, FATIMA P
• Application Number:
  US11/437,344
• Publication Number:
  US 20070271297A1
• Time in Patent Office: 3,847 Days
• Field of Search: 707/725, 707/736
• US Class Current: 1/1
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 18/231 Hierarchical techniques, i.e. dividing or merging pattern sets so as to obtain a dendrogram
• CPC Class Codes: G06V 10/7625 Hierarchical techniques, i.e. dividing or merging patterns to obtain a tree-like representation; Dendograms
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G11B 27/105 of operating discs

Abstract

In one example, an apparatus and method are provided for summarizing (or selecting a representative subset from) a collection of media objects. A method includes selecting a subset of media objects from a collection of geographically-referenced (e.g., via GPS coordinates) media objects based on a pattern of the media objects within a spatial region. The media objects may further be selected based on (or be biased by) various social aspects, temporal aspects, spatial aspects, or combinations thereof relating to the media objects and/or a user. Another method includes clustering a collection of media objects in a cluster structure having a plurality of subclusters, ranking the media objects of the plurality of subclusters, and selection logic for selecting a subset of the media objects based on the ranking of the media objects.

Claims

1. An apparatus comprising:

a processor; and

a storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising;

receiving logic executed by the processor for receiving, from a client device operated by a user, a query for a summary of media objects;

determining logic, executed by the processor, for determining metadata associated with each of the media objects;

summarization logic executed by the processor for summarizing a subset of the media objects into a collection based on both a pattern of the media objects within a spatial region and based on a social network of the user, the summarizing logic comprising heuristics associated with the patterns and the metadata for use with the summarizing, the summarization logic further comprising selection logic for selecting the subset based upon an identity of the user and a characteristic associated with the user; and

generating logic executed by the processor for generating a visualization for the collection based on textual tags that are associated with the metadata, where a textual tag deemed relevant is displayed in the visualization in a size that corresponds to an importance of the relevant textual tag, the importance of the relevant textual tag based on attributes of the collection.

2. The apparatus of claim 1, wherein the pattern relates to a density of the media objects within the spatial region.

3. The apparatus of claim 1, further comprising selection logic for selecting the subset based upon a temporal aspect of the media objects.

4. The apparatus of claim 3, wherein the temporal aspect relates to recency of the media objects.

5. The apparatus of claim 1, further comprising selection logic for selecting the subset based on a visual feature of the media objects.

6. The apparatus of claim 1, further comprising selection logic for selecting the subset based on text associated with the media objects.

7. The apparatus of claim 1, further comprising selection logic for selecting the subset based on data associated with the media objects.

8. The apparatus of claim 7, wherein the data comprises a user generated tag.

9. The apparatus of claim 1, wherein the query comprises a search query, the search query on an object having a spatial aspect.

10. A method comprising:

receiving, by a computing device from a client device operated by a user, a query for a summary of media objects;

determining, by the computing device, metadata associated with each of the media objects;

summarizing, by the computing device, a subset of the media objects into a collection based on both a pattern of the media objects within a spatial region and based on a social network of the user, the summarizing logic comprising heuristics associated with the patterns and the metadata for use with the summarizing, the summarization logic further comprising selection logic for selecting the subset based upon an identity of the user and a characteristic associated with the user; and

generating, by the computing device, a visualization for the collection based on textual tags that are associated with the metadata, where a textual tag deemed relevant is displayed in the visualization in a size that corresponds to an importance of the relevant textual tag, the importance of the relevant textual tag based on attributes of the collection.

11. The method of claim 10, wherein the pattern relates to a density of the media objects within the spatial region.

12. The method of claim 10, wherein the summarizing further comprises selecting the subset based upon a temporal aspect of the media objects.

13. The method of claim 10, wherein the summarizing further comprises selecting the subset based on a visual feature of the media objects.

14. The method of claim 10, wherein the summarizing further comprises selecting the subset based on text associated with the media objects.

15. The method of claim 10, wherein the summarizing further comprises selecting the subset based on data associated with the media objects.

16. The method of claim 15, wherein the data comprises a user generated tag.

17. The method of claim 10, wherein the query comprises a search query, the search query on an object having a spatial aspect.

18. A non-transitory computer readable storage medium comprising computer-executable instructions executed by a processor for summarizing a collection of media objects, the instructions for:

receiving, by the processor from a client device operated by a user, a query for a summary of media objects;

determining, by the processor, metadata associated with each of the media objects;

summarizing, by the processor, a subset of the media objects into a collection based on both a pattern of the media objects within a spatial region and based on a social network of the user, the summarizing logic comprising heuristics associated with the patterns and the metadata for use with the summarizing, the summarizing further comprising selecting, by the processor, the subset based upon an identity of the user and a characteristic associated with the user; and

generating, by the processor, a visualization for the collection based on textual tags that are associated with the metadata, where a textual tag deemed relevant is displayed in the visualization in a size that corresponds to an importance of the relevant textual tag, the importance of the relevant textual tag based on attributes of the collection.

19. The non-transitory computer readable storage medium of claim 18, wherein the pattern relates to a density of the media objects within the spatial region.

20. The non-transitory computer readable storage medium of claim 18, wherein the summarizing further comprises selecting the subset based upon a temporal aspect of the media objects.

21. The non-transitory computer readable storage medium of claim 18, wherein the summarizing further comprises selecting the subset based on a visual feature of the media objects.

22. The non-transitory computer readable storage medium of claim 18, wherein the summarizing further comprises selecting the subset based on data associated with the media objects.

23. The non-transitory computer readable storage medium of claim 22, wherein the data comprises a user generated tag.

24. The non-transitory computer readable storage medium of claim 18, wherein the query comprises a search query, the search query on an object having a spatial aspect.