Seamless playback of composite media

• US 8,683,337 B2
• Filed: 06/09/2010
• Issued: 03/25/2014
• Est. Priority Date: 06/09/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Sood, Vishal, Freelander, Jack E., Suess, Jason R., Liu, Lin
• Primary Examiner(s): Abdul-Ali, Omar
• Assistant Examiner(s): TANK, ANDREW L
• Application Number:
  US12/796,677
• Publication Number:
  US 20110307781A1
• Time in Patent Office: 1,385 Days
• Field of Search: 715201-203, 715/704, 715716-726, 715730-732, 715/748, 715/501
• US Class Current: 715/723
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/26258 for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

A streaming composition system is described herein that provides easy workflow and playback capabilities for content producers to create composite media assets from existing and on-going media content and for streaming clients to seamlessly playback composite multimedia streams provided from different sources. These assets provide broadcasters an option to quickly turn around highlights for an on-going event. The streaming composition system allows a producer to identify clips within existing media assets and compose the clips into a new unified streaming presentation. For producers that already have smooth streaming media assets, the system leverages these assets to provide seamless playback across clip boundaries including advanced playback support for advertisement insertion, fast forward, rewind, and so on.

Claims

1. A computer-implemented method for seamlessly playing a composite media presentation, the method comprising:

receiving an identification of a source of the composite media presentation;

retrieving from the identified source a composite manifest that describes the composite media presentation, wherein the composite manifest describes a plurality of chunks of media content forming the composite media presentation and an order for playback of the chucks based on a sequence of clips, each chunk being an individually addressable portion of media content that is cacheable by a network infrastructure, wherein each clip defines a start time and an end time of media content within a chunk that is to be played;

parsing the retrieved manifest to identify one or more clips associated with the composite manifest;

generating a virtual timeline that spans multiple clips associated with the composite manifest, wherein the virtual timeline has a total duration determined by adding up the length of all of the clips that make up the composite media presentation;

selecting an identified clip from the parsed manifest;

retrieving one or more chunks associated with the selected clip; and

playing the one or more retrieved chunks in the order described by the composite manifest,

wherein the preceding steps are performed by at least one processor.

2. The method of claim 1 wherein receiving the identification comprises receiving an indication that an application invoked by a user through a web browser invoked a client application-programming interface (API) and specified a Uniform Resource Locator (URL) that identifies the composite media presentation.

3. The method of claim 1 wherein retrieving the composite manifest comprises retrieving the manifest by issuing a Hypertext Transfer Protocol (HTTP) GET request specifying a domain, virtual directory, and file name of the manifest.

4. The method of claim 1 wherein parsing the retrieved manifest comprises navigating a hierarchical arrangement of elements within the composite manifest to identify one or more clip elements that describe clips.

5. The method of claim 1 wherein generating the virtual timeline comprises determining an overall duration of the composite media presentation based on a duration associated with each clip.

6. The method of claim 1 wherein generating the virtual timeline comprises identifying one or more clips from still ongoing live events and contributing an estimated amount of time to the virtual timeline.

7. The method of claim 1 wherein generating the virtual timeline comprises generating information that allows a user to seek within the composite media presentation across clip boundaries.

8. The method of claim 1 wherein selecting an identified clip comprises retrieving clip information from the composite manifest and identifying one or more chunks associated with the clip.

9. The method of claim 8 wherein each chunk includes information for retrieving and playing the chunk.

10. The method of claim 1 wherein each chunk includes a Moving Picture Experts Group (MPEG) Group of Pictures (GOP) that can be independently played.

11. The method of claim 1 further comprising repeating the steps of retrieving and playing chunks until each clip specified in the composite manifest has been played, wherein at least one chunk is received from a cache server storing the chunk following an earlier request for the chunk.

12. A computer system for seamless playback of composite media, the system comprising:

a processor and memory configured to execute software instructions, the instructions comprising the following components;

a user interface component configured to provide an interface through which a content producer can select clips for inclusion in a composite media stream;

a clip identification component configured to receive start and stop information about each of multiple clips to be included in the composite media stream;

a composite manifest component configured to create a composite manifest that describes the composite media stream, including an identification of each clip that comprises the composite media stream, each clip defines a start time and an end time of media content within a chunk that is to be played, each chunk being an individually addressable portion of media content that is cacheable by a network infrastructure, the composite manifest describes a plurality of chunks of media content forming the composite media presentation and an order for playback of the chucks based on a sequence of clips;

and

a manifest upload component configured to upload the created composite manifest to a server from which clients can retrieve the composite manifest.

13. The system of claim 12 wherein the user interface component is further configured to allow the content producer to identify clips within a media presentation while an event is still in progress to create highlights or other relevant portions of the media presentation.

14. The system of claim 12 wherein the composite manifest component is further configured to store an extensible markup language (XML) file that hierarchically describes the clips that comprise the composite media stream.

15. The system of claim 12 wherein the composite manifest component is further configured to include one or more clip specifications at a frame level of accuracy.

16. The system of claim 12 further comprising,

a client component configured to provide a client-side interface for playing back composite media streams;

a source identification component configured to identify a source of the composite media stream, wherein the source provides the composite manifest;

a manifest parsing component configured to retrieve the composite manifest, identify one or more clips specified within the composite manifest, and prepare the clips for playback;

a virtual timeline component configured to build a virtual timeline that spans one or more clips specified by the composite manifest, wherein the virtual timeline has a total duration determined by adding up the length of all of the clips that make up the composite media stream; and

a playback component configured to play the composite media stream.

17. A computer-readable storage device comprising instructions for controlling a computer system to publish a composite media presentation, wherein the instructions, when executed, cause a processor to perform actions comprising:

providing an interface through which a content producer can identify media assets from which to compose clips from multiple different sources into a seamless composite media presentation;

receiving information identifying one or more clips for the composite media presentation;

identifying the one or more clips identified by the received information and storing information for playing each identified clip;

creating a composite manifest that specifies information about the composite media presentation and each clip associated with the composite media presentation, each clip defines a start time and an end time of media content within a chunk that is to be played, each chunk being an individually addressable portion of media content that is cacheable by a network infrastructure, the composite manifest describes a plurality of chunks of media content forming the composite media presentation and an order for playback of the chucks based on a sequence of clips; and

uploading the created composite manifest to one or more servers for access by clients.

18. The device of claim 17 wherein receiving information identifying one or more clips comprises receiving selections of one or more previous presentations and identify start and stop times of one or more locations within the previous presentations from which to create clips.

19. The device of claim 17 wherein creating the composite manifest comprises ordering clips so that a computer can play clip after clip as a single presentation to the user without asking the user to identify each subsequent item to play, wherein at least one clip is part of an on-demand presentation and another clip is part of a live presentation.

20. The device of claim 17 wherein uploading the created client manifest comprises copying the composite manifest to a web server from which clients can retrieve the manifest at a well-defined Uniform Resource Locator (URL).