File format for media distribution and presentation

• US 8,775,566 B2
• Filed: 06/21/2008
• Issued: 07/08/2014
• Est. Priority Date: 06/21/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Schnell, Patrik
• Primary Examiner(s): PEACH, POLINA G
• Application Number:
  US12/143,768
• Publication Number:
  US 20090319563A1
• Time in Patent Office: 2,208 Days
• Field of Search: None
• US Class Current: 709/219
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/4387 by the use of playlists
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip

Abstract

A file format supports distribution, presentation, and storage of media presentations (“MPs”). A sequence of a MP is composed of segments of media data referred to by segmentIDs. Segments are defined as movie fragments, pursuant to the “ISO base media file format”. Multiple instances of a segment, each having a unique instanceID, are created by encoding the media data based on different encoding characteristics, referred to as encodingIDs. A sequence map box (“SMB”) stores the arrangement of a sequence'"'"'s segmentIDs-to-instanceIDs, including encodingIDs. The SMB is distributed to a client-side media processing unit (“MPU”). Information regarding an instance selected for distribution to the MPU is encapsulated in an instance identifier box (“IIB”), along with the arrangement of instanceIDs for the segment, and distributed to the MPU. At the time of distribution and/or playback of the MP, the MPU interchange instances based on the contents of the SMB and/or the IIB.

Claims

1. A method for presenting a digital media presentation including at least one sequence of digital media content, wherein each sequence is arranged in accordance with a predetermined file format and comprises a plurality of segments for sequential presentation by a digital media processing unit, each segment including a respective different predetermined amount of the digital media content to be presented, the method comprising:

providing a sequence having plural segments each comprising at least a first segment instance created by encoding the digital media content of the segment based on a first set of encoding characteristics and a second segment instance created by encoding the digital media content of the segment based on a second set of encoding characteristics different from the first set of encoding characteristics,

wherein the segments are independently distributable and storable, each sequence having a sequence ID associated therewith, each segment having a segment ID associated therewith and each segment instance having an instance ID associated therewith;

receiving at the media processing unit segment instances of plural segments to be presented and a plurality of data structures,

a first of the data structures including a map of the instance IDs, and a logical arrangement of the segments IDs to the instance IDs, a second data structure storing a replacement instance ID associated with a replacement segment instance requested by the media processing unit and a third data structure storing the replacement segment instance;

storing at least the first data structure;

arranging for sequential presentation of the respective digital media content of the received segments; and

identifying a particular segment requiring replacement of one segment instance with another segment instance sharing a common encoding ID based on predetermined instance selection criteria applied by the media processing unit,

wherein the media processing unit uses the plurality of data structures to dynamically select for presentation the replacement segment instance based on the instance selection criteria while arranging for presentation of the respective digital media content of the received segment instances, wherein using the plurality of data structures includes accessing the first data structure from storage,

wherein the replacing includes forming a valid file by concatenating together and interchanging the replacement segments at distribution or playback at the media processing unit without being connected to a server.

2. The method according to claim 1, wherein:

the media processing unit comprises a client-side media processing unit; and

the arranging step includes presentation of the sequence by the client-side media processing unit, with distribution of the replacement segment instance to the client-side media processing unit being dynamically requested via a communication network during the presentation and being presented in the sequence.

3. The method according to claim 2, wherein the distribution is accomplished via a distribution technique selected from the group comprising:

synchronous;

asynchronous;

live;

on-demand;

streaming; and

downloading.

4. The method according to claim 2, wherein the instance selection criteria are based on one or more characteristics of the client-side media processing unit or the communication network or both, the instance selection criteria selected from the group comprising:

availability of the communication network;

speed of the communication network;

available bandwidth of the communication network;

cost of the communication network; and

available computing resources of the client-side media processing unit.

5. The method according to claim 2, further comprising:

prior to the arranging step, receiving a data structure associated with the file format, the data structure storing metadata used for identifying a received segment instance and selecting the replacement segment instance.

6. The method according to claim 5, wherein the data structure comprises a map of instance identifiers and locations thereof.

7. The method according to claim 6, wherein the data structure is stored within a movie extends box specified by the base media file format established by the International Organization for Standardization (“

ISO”

).

8. The method according to claim 5, wherein:

the client-side media processing unit requests distribution of the selected replacement segment instance based on the data structure;

the client-side media processing unit receives the selected replacement segment instance pursuant to the request; and

in the arranging step the client-side media processing unit either stores or presents, or both, the received selected replacement segment instance.

9. The method according to claim 8, wherein:

the data structure stores a first segment instance identifier data structure associated with the predetermined file format and a second segment instance identifier data structure associated with the predetermined file format, the first and second segment instance identifier data structures being associated with a movie fragment box defined for the particular segment, the movie fragment box being specified by the base media file format established by the International Organization for Standardization (“

ISO”

);

the client-side media processing unit stores the instance identifier data structure associated with the received selected replacement segment instance; and

prior to or during presentation of the sequence the client-side media processing unit uses the stored replacement second instance identifier data structure to request distribution of the replacement segment instance to the client-side media processing unit, with the replacement segment instance replacing another segment instance during presentation of the sequence by the client-side media processing unit.

10. The method according to claim 9, wherein the client-side media processing unit stores the instance identifier data structure in a client-side data structure that forms a record of individual instance identifier data structures stored for each of the plurality of segments of the sequence.

11. The method according to claim 9, wherein the instance identifier data structure associated with the received selected segment is stored in a track fragments header box associated with the movie fragment box for the particular segment.

12. A method for distributing a digital media presentation, the method comprising:

providing at least one sequence of digital media data content, each sequence being arranged in accordance with a predetermined file format, wherein each sequence comprises a plurality of segments for sequential presentation by a digital media processing unit, each segment including a respective different predetermined amount of the digital media content to be presented, each sequence having a sequence identifier associated therewith, each segment having a segment identifier associated therewith and each segment instance having an instance identifier associated therewith;

for each segment, producing at least a first segment instance by encoding the predetermined amount of digital media content based on a first set of encoding characteristics and a second segment instance of each of the plural segments created by encoding the digital media content of the segment based on a second set of encoding characteristics different from the first set of encoding characteristics, wherein the segments are independently distributable and storable;

generating instance identifiers that individually reference the segment instances of a segment;

encapsulating the instance identifiers of a segment within a first data structure associated with the predetermined file format, the first data structure including a map of the instance identifiers and a logical arrangement of the segment identifiers to the instance identifiers;

distributing a plurality of the first data structures to the media processing unit, the first data structures being usable by the media processing unit to request distribution of a particular instance of a segment in the sequence to form a requested segment instance of the segment and a non-requested segment instance comprising another instance of the same segment;

encapsulating each instance identifier within an associated second data structure associated with the predetermined file format, the second data structure storing a replacement instance identifier associated with a replacement segment instance requested by the media processing unit;

encapsulating the digital media content of each segment instance of a segment within an associated third data structure associated with the second data structure;

distributing to the media processing unit the second data structure and the third data structure associated with the requested segment instance, the third data structure storing the replacement segment instance; and

identifying a particular segment of the plurality of segments requiring replacement of one segment instance with another segment instance of the particular segment sharing a common encoding identifier,

wherein the second data structure associated with the non-requested segment instance is usable by the media processing unit in conjunction with the first and third data structures to request distribution of the non-requested segment instance for replacement of the requested segment instance during presentation of the respective different digital media content of the segments in the sequence by the media processing unit, wherein using the first data structure includes accessing the first data structure from storage, wherein the replacement is performed by forming a valid file by concatenating together and interchanging the replacement segments at distribution or playback at the media processing unit without being connected to a server.

13. The method according to claim 12, wherein:

the second data structure comprises a movie fragment box specified by the base media file format established by the International Organization for Standardization (“

ISO”

); and

the third data structure comprises a movie data box specified by the base media file format established by the ISO.

14. The method according to claim 12, wherein the media processing unit is selected from the group comprising:

a server-side media processing unit and a client-side media processing unit.

15. The method according to claim 12, wherein the first and second sets of encoding characteristics are selected from the group comprising:

media data sizes;

compression ratios;

encoding rates;

encoding formats;

encryption formats;

media data presentation rates;

media data source identities; and

media data source locations.

16. The method according to claim 12, wherein the first and second instance identifiers are selected from the group comprising:

vectors, pointers, and URLs.

17. The method according to claim 12, wherein the first data structure stores a reference to a map of instance identifiers and locations thereof.

18. The method according to claim 12, wherein the media data content is selected from the group comprising:

audio data;

video data;

image data;

graphics data;

text data; and

combinations thereof, and wherein the predetermined amount of media data represented by each of the plurality of segments is selected based on criteria from the group comprising;

time-based criteria; and

quantity-based criteria; and

combinations thereof.

19. A media processor for presenting or storing, or both, at least one sequence of digital media content, wherein each sequence is arranged in accordance with a predetermined file format and comprises a plurality of segments for sequential presentation by the digital media presentation unit, each segment including a respective different predetermined amount of the digital media content, the unit comprising:

a processor responsive to computer program, wherein the computer program, when loaded into the processor, is operable to perform a method comprising;

arranging for sequential presentation of the segments in the sequence,

wherein each of the plural segments to be presented comprise at least a first segment instance created by encoding the digital media content of a segment based on a first set of encoding characteristics and a second segment instance created by encoding the digital media content of the segment based on a second set of encoding characteristics different from the first set of encoding characteristics,

wherein the segments are independently distributable and storable, each sequence having a sequence ID associated therewith, each segment having a segment ID associated therewith and each segment instance having an instance ID associated therewith;

identifying a particular segment requiring replacement of one segment instance with another segment instance sharing a common encoding ID based on predetermined instance selection criteria applied by the media processing unit,

wherein the media processing unit uses a plurality of data structures to dynamically select for presentation the replacement segment instance based on the instance selection criteria while presenting or storing the respective digital media content of the plurality of segments in the sequence,

wherein the replacement is performed by forming a valid file by concatenating together and interchanging the replacement segments at distribution, playback or storage at the media processing unit without being connected to a server, a first of the data structures including a map of the instance IDs, and a logical arrangement of the segments IDs to the instance IDs, a second of the data structures storing a replacement instance ID associated with a replacement segment instance requested by the media processing unit and a third of the data structures storing the replacement segment instance.

20. The media processing unit according to claim 19, wherein the media processing unit comprises a client-side device or a server-side device.