Scalably presenting a collection of media objects

• US 7,131,059 B2
• Filed: 12/31/2002
• Issued: 10/31/2006
• Est. Priority Date: 12/31/2002
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Obrador, Pere
• Primary Examiner(s): Herndon, Heather R.
• Assistant Examiner(s): RUTLEDGE, AMELIA L
• Application Number:
  US10/334,769
• Publication Number:
  US 20040128308A1
• Time in Patent Office: 1,400 Days
• Field of Search: 715/501.1, 715/500.1
• US Class Current: 715/209
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06F 16/7857 using texture G06F16/7837 takes precedence
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier

Abstract

Systems and methods of presenting media objects are described. In one aspect, a group of media objects is selected from the collection based upon media object relevance to one or more data structures of a selected media file of indexed, temporally-ordered data structures. One or more of the selected media file and the media objects of the selected group are transmitted to a client for contemporaneous presentation at a selected summarization level. In another aspect, media objects in the collection are grouped into multiple clusters based upon one or more media object relevance criteria. The media object clusters are arranged into a hierarchy of two or more levels. A selected cluster is transmitted to a client for contemporaneous presentation at a selected summarization level.

Claims

1. A computer-implemented method of scalably presenting a collection of media objects including a video file that contains a sequence of full-motion video frames and an audio sequence synchronized with the video frames, and media objects that are free of any content contained in the video file, the method comprising:

selecting from the collection one or more of the media objects that are free of any content contained in the video file based upon one or more relevance criteria relating the selected media objects to one or more of the video frames of the video file;

generating a hierarchical sequence of summarization levels each comprising a respective representation of a different respective selection of temporally-ordered content of the video file and associated content of at least one of the selected media objects linked into the respective representation of the temporally-ordered content of the video file, the summarization levels in the hierarchical sequence being ordered in accordance with their different resource requirements, wherein each of the summarization levels above a lowest summarization level in the hierarchical sequence accommodates more resource constraints than a respective immediately preceding one of the summarization levels in the hierarchical sequence; and

in response to a request from a client to browse the collection of media objects, selecting one of the generated summarization levels based upon one or more identified resource constraints, and transmitting to the client the respective representation of the respective selection of temporally-ordered content of the video file and the associated content of the at least one of the selected media objects of the selected summarization level.

2. The method of claim 1, wherein the selecting of one of the summarization levels is based upon at least one resource constraint selected from a communication channel resource constraint and a client resource constraint.

3. The method of claim 2, wherein the communication channel resource constraint corresponds to one or more of a bandwidth constraint, a transmission constraint, and a client reception constraint.

4. The method of claim 2, wherein the client resource constraint corresponds to at least one of a processing constraint and a display constraint.

5. The method of claim 2, wherein the client resource constraint corresponds to a preference indication received from the client.

6. The method of claim 1, wherein the selecting of media objects from the collection is based at least in part on existence of browsable links between the selected media objects and respective ones of the video frames of the video file.

7. The method of claim 6, wherein the transmitting comprises transmitting in accordance with the lowest summarization level all of the video frames of the video file in sequence and transmitting each of the selected media objects in timed relationship with a respective one of the video frames of the video file linked to the respective media objects.

8. The method of claim 7, wherein the transmitting in accordance with the lowest summarization level comprises synchronously transmitting the full-motion video frames and the audio sequence compressed to a first audio compression level.

9. The method of claim 7, further comprising transmitting in accordance with a second summarization level a first subset of the video frames of the video file and each of the selected media objects in timed relationship with respective ones of the video frames in the first subset.

10. The method of claim 9, wherein the transmitting in accordance with the second summarization level comprises synchronously transmitting key sequences of full-motion video frames and the audio sequence compressed to a second audio compression level higher than the first audio compression level.

11. The method of claim 9, further comprising transmitting in accordance with a third summarization level a second subset of video frames of the video file smaller than the first subset and graphical representations of each of the selected media objects in timed relationship with respective ones of the video frames in the second subset.

12. The method of claim 11, wherein ones of the video frames of the video file are designated as key frames, and the transmitting in accordance with the third summarization level comprises synchronously transmitting the designated key frames and the audio sequence compressed to a third audio compression level higher than the second audio compression level.

13. The method of claim 11, further comprising transmitting in accordance with a fourth summarization level a single key frame of the video file.

14. The method of claim 13, wherein the transmitting in accordance with the fourth summarization level comprises synchronously transmitting the single key frame and one or more key sentences that are representative of the audio sequence and are compressed to a fourth audio compression level higher than the third audio compression level.

15. The method of claim 1, wherein the selecting of media objects from the collection is based at least in part on a selected context similarity between the selected media objects and respective ones of the video frames of the video file.

16. The method of claim 15, wherein the selecting of media objects from the collection is based at least in part on at least one context similarity selected from color similarity, motion activity similarity, texture content similarity, audio similarity, data similarity, name similarity, inclusion of similar objects, inclusion of similar persons, and inclusion of similar places.

17. The method of claim 15, wherein the transmitting comprises transmitting in accordance with the lowest summarization level all of the video frames of the video file in sequence and transmitting each of the selected media objects.

18. The method of claim 17, further comprising transmitting in accordance with a second summarization level a first subset of the video frames of the video file and each of the selected media objects.

19. The method of claim 18, further comprising transmitting in accordance with a third summarization level a second subset of the video frames of the video file smaller than the first subset and graphical representations of each of the selected media objects.

20. The method of claim 19, further comprising transmitting in accordance with a fourth summarization level a single video frame representative of the selected video file.

21. The method of claim 1, wherein the selecting of one of the summarization levels is based upon a time constraint specifying a time limit for presenting the video file and the selected media objects.

22. The method of claim 21, wherein the transmitting comprises transmitting representative portions of the video file selected to accommodate the time constraint.

23. The method of claim 1, wherein the selecting of one of the summarization levels is based upon a time constraint specifying a time limit for presenting the video file and the selected media objects and a resource constraint specifying at least one parameter affecting an ability of the client to present ones of the media objects in the collection.

24. A system for presenting a collection of media objects including a video file that contains a sequence of full-motion video frames and an audio sequence synchronized with the video frames, and media objects that are free of any content contained in the video file, the system comprising a media manager operable to perform operations comprising:

selecting from the collection ones of the media objects that are free of any content contained in the video file based upon one or more relevance criteria relating the selected media objects to one or more of the video frames of the video file;

generating a hierarchical sequence of summarization levels each comprising a respective representation of a different respective selection of temporally-ordered content of the video file and associated content of at least one of the selected media objects linked into the respective representation of the temporally-ordered content of the video file, the summarization levels in the hierarchical sequence being ordered in accordance with their different resource requirements, wherein each of the summarization levels above a lowest summarization level in the hierarchical sequence accommodates more resource constraints than a respective immediately preceding one of the summarization levels in the hierarchical sequence; and

in response to a request from a client to browse the collection of media objects, selecting one of the generated summarization levels based upon one or more identified resource constraints, and transmitting to the client content the respective representation of the respective selection of temporally-ordered of the video file and the associated content of the at least one of the selected media objects of the selected summarization level.

25. The system of claim 24, wherein the selecting of media objects from the collection is based at least in part on existence of browsable links between the selected media objects and respective ones of the video frames of the video file.

26. The system of claim 24, wherein the selecting of media objects from the collection is based at least in part on a selected context similarity between the selected media objects and respective ones of the video frames of the video file.

27. A computer-implemented method of scalably presenting a collection of media objects, comprising:

grouping respective ones of the media objects in the collection into multiple media object clusters based upon one or more relevance criteria interrelating respective ones of the media objects in each of the media object clusters;

selecting one of the media object clusters that includes at least two media objects of different content type;

generating from the selected media object cluster a respective hierarchy of two or more summarization levels each comprising a -respective representation of a different respective selection of content of each of the media objects in the selected cluster, the summarization levels in the hierarchy being ordered in accordance with their different resource requirements. wherein each of the summarization levels above a lowest summarization level in the hierarchy accommodates more resource constraints than a respective immediately preceding one of the summarization levels in the hierarchy; and

in response to a request from a client to browse the collection of media objects, selecting one of the generated summarization levels based upon one or more identified resource constraints, and transmitting to the client the respective representation of the respective selection of content of the selected summarization level.

28. A system for scalably presenting a collection of media objects, comprising a media manager operable to perform operations comprising:

grouping selected ones of the media objects in the collection into multiple media object clusters based upon one or more relevance criteria interrelating respective ones of the media objects in each of the media object clusters;

selecting one of the media object clusters that includes at least two media objects of different content type;

generating from the selected media object cluster a respective hierarchy of two or more summarization levels each comprising a respective representation of a different respective selection of content of each of the media objects in the selected cluster, the summarization levels in the hierarchy being ordered in accordance with their different resource requirements, wherein each of the summarization levels above a lowest summarization level in the hierarchy accommodates more resource constraints than a respective immediately preceding one of the summarization levels in the hierarchy; and

in response to a request from a client to browse the collection of media objects, selecting one of the generated summarization levels based upon one or more identified resource constraints, and transmitting to the client the respective representation of the respective selection of content of the selected summarization level.