Presenting a collection of media objects

• US 7,149,755 B2
• Filed: 07/29/2002
• Issued: 12/12/2006
• Est. Priority Date: 07/29/2002
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Obrador, Pere
• Primary Examiner(s): Le, Debbie M.
• Application Number:
  US10/207,279
• Publication Number:
  US 20040019608A1
• Time in Patent Office: 1,597 Days
• Field of Search: 707100-1041, 715/723, 715/838, 715/501.1, 715/730
• US Class Current: 1/1
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

Systems and methods of presenting media objects are described. In one aspect, a group of media objects is selected from the collection based upon media object relevance to one or more data structures of a selected media file of indexed, temporally-ordered data structures. The selected media file and the media objects of the selected group are presented contemporaneously. In another aspect, media objects in the collection are grouped into multiple clusters based upon one or more media object relevance criteria. The media object clusters are arranged into a hierarchy of two or more levels. A selected media object cluster is presented contemporaneously. Systems for implementing these media object presentation methods also are described.

Claims

1. A method, comprising:

accessing a video file, media objects, and links, wherein the video file contains a sequence of full-motion video frames, each of the media objects comprises respective content corresponding to at least one of visual content and audio content, and each of the links connects a respective index value associated with a respective one of the video frames with an address of a corresponding one of the media objects;

rendering the video frames of the video file in sequence in a region of a display; and

during the rendering of each of the video frames connected to a corresponding one of the media objects by a respective one of the links, automatically rendering the respective content of the corresponding media object contemporaneously with the rendering of the connected video frame, wherein the automatically rendering comprises rendering the visual content of respective ones of the corresponding media objects in regions of the display outside the region of the display where the video frames are being rendered.

2. The method of claim 1, wherein the automatically rendering comprises rendering the respective content of the corresponding media object contemporaneously with the rendering of the connected video frame without inducement by user input.

3. The method of claim 1, wherein the rendering comprises rendering each of the video frames of the video file within a respective presentation period and the automatically rendering comprises rendering the respective content of the corresponding media objects during respective media object presentation periods, wherein one or more of the media object presentation periods are longer than the presentation periods of respective ones of the video frames of the video file that are connected to the corresponding media objects.

4. The method of claim 1, wherein the automatically rendering comprises displaying one or more user-selectable links from one of the media objects whose content is being rendered to other media objects in a collection.

5. The method of claim 1, further comprising without inducement by user input automatically selecting one or more similar media objects from a collection of media objects based upon similarity of metadata respectively associated with the media objects in the collection to corresponding metadata associated with respective ones of the video frames of the video file.

6. The method of claim 5, wherein the automatically selecting comprises selecting the one or more similar media objects based on at least one metadata similarity selected from color similarity, motion activity similarity, texture content similarity, audio similarity, data similarity, and name similarity.

7. The method of claim 5, wherein the automatically selecting comprises determining similarity of objects appearing in ones of the media objects in the collection to objects appearing in respective ones of the video frames of the video file.

8. The method of claim 7, wherein the automatically selecting comprises determining similarity of persons and places appearing in ones of the media objects in the collection to persons and places appearing in respective ones of the video frames of the video file.

9. The method of claim 5, wherein the selecting comprises selecting from the collection ones of the similar media objects having highest metadata similarity to the one or more video frames of the video file.

10. The method of claim 9, wherein the selecting comprises selecting only a predetermined number of the similar media objects from the collection.

11. The method of claim 5, further comprising presenting the one or more selected similar media objects on the display simultaneously with the rendering of corresponding similar ones of the video frames of the video file.

12. The method of claim 11, wherein the presenting comprises displaying respective graphical representations of the one or more selected similar media objects in spatial regions of the display adjacent to the region of the display where the video frames of the video file are being rendered.

13. The method of claim 11, wherein the displaying comprises displaying a stack of the respective graphical representations of the one or more selected similar media objects.

14. The method of claim 5, further comprising grouping the media objects in the collection into one or more clusters based upon one or more metadata similarity criteria corresponding to respective measures of similarity between metadata respectively associated with the media objects in the collection.

15. The method of claim 14, wherein the grouping comprises grouping the media objects in the collection into clusters having an equal number of media objects.

16. The method of claim 14, wherein the grouping comprises assigning the media objects in the collection to respective clusters based upon degree of similarity of one or more metadata respectively associated with the media objects in the collection.

17. The method of claim 16, wherein the grouping further comprises arranging the media object clusters into a respective cluster hierarchy for each of the one or more metadata similarity criteria, wherein, in each cluster hierarchy, each cluster in a lower level of the hierarchy is represented by a respective media object in a cluster in a higher level of the hierarchy adjacent the lower level.

18. The method of claim 17, further comprising, for each cluster hierarchy, selecting ones of the media objects in clusters in a higher level of the cluster hierarchy as representatives of respective ones of the media object clusters in a lower level of the cluster hierarchy adjacent the higher level based upon an ordering of the media objects in the collection in accordance with one or more of the metadata similarity criteria.

19. The method of claim 18, further comprising presenting all the media objects of a given one of the represented media object clusters in response to user selection of the respective media object representing the given media object cluster.

20. The method of claim 1, wherein each of the links is browsable from a given one of the video frames of the video file to a connected one of the media objects and from the connected media object to the given video frame.

21. The method of claim 1, wherein each of the media objects comprises respective content corresponding to at least one of the following media object types:

text, audio, graphics, animated graphics, and full-motion video.

22. The method of claim 1, wherein the accessing comprises accessing the media objects across multiple computer networks.

23. A machine-readable medium storing machine-readable instructions causing a machine to perform operations comprising:

accessing a video file, media objects, and links, wherein the video file contains a sequence of full-motion video frames, each of the media objects comprises respective content corresponding to at least one of visual content and audio content, and each of the links connects a respective index value associated with a respective one of the video frames with an address of a corresponding one of the media objects;

rendering the video frames of the video file in sequence in a region of a display; and

during the rendering of each of the video frames connected to a corresponding one of the media objects by a respective one of the links, automatically rendering the respective content of the corresponding media object contemporaneously with the rendering of the connected video frame, wherein the media manager automatically renders the visual content of respective ones of the corresponding media objects in regions of the display outside the region of the display where the video frames are being rendered.

24. The machine-readable medium of claim 23, wherein the machine-readable instructions cause the machine to automatically select without inducement by user input one or more similar media objects from a collection of media objects based upon similarity of metadata respectively associated with the media objects in the collection to corresponding metadata associated with respective ones of the video frames of the video file.

25. A method, comprising:

grouping media objects in a collection into multiple clusters based upon one or more media object relevance criteria, wherein each of the media objects comprises respective content corresponding to at least one of visual content and audio content, and the grouping comprises assigning the media objects in the collection to respective clusters based upon degree of similarity of one or more metadata respectively associated with the media objects in the collection;

arranging the media object clusters into a cluster hierarchy of two or more levels, wherein each cluster in a lower level of the hierarchy is represented by a respective media object in a cluster in a higher level of the hierarchy adjacent the lower level, wherein the arranging comprises arranging the media object clusters into a respective cluster hierarchy for each of one or more metadata similarity criteria corresponding to respective measures of similarity between metadata respectively associated with the media objects in the collection; and

contemporaneously presenting all the media objects in a given one of the clusters in response to user selection of the respective media object representing the given media object cluster.

26. The method of claim 25, further comprising, for each cluster hierarchy, selecting ones of the media objects in clusters in a higher level of the cluster hierarchy as representatives of respective ones of the media object clusters in a lower level of the cluster hierarchy adjacent the higher level based upon an ordering of the media objects in the collection in accordance with one or more of the metadata similarity criteria.

27. A machine-readable medium storing machine-readable instructions causing a machine to perform operations comprising:

grouping media objects in a collection into multiple clusters based upon one or more media object relevance criteria, wherein each of the media objects comprises respective content corresponding to at least one of visual content and audio content, and the grouping comprises assigning the media objects in the collection to respective clusters based upon degree of similarity of one or more metadata respectively associated with the media objects in the collection;

arranging the media object clusters into a cluster hierarchy of two or more levels, wherein each cluster in a lower level of the hierarchy is represented by a respective media object in a cluster in a higher level of the hierarchy adjacent the lower level, wherein the arranging comprises arranging the media object clusters into a respective cluster hierarchy for each of one or more metadata similarity criteria corresponding to respective measures of similarity between metadata respectively associated with the media objects in the collection; and

contemporaneously presenting all the media objects in a given one of the clusters in response to user selection of the respective media object representing the given media object cluster.