Active stream format for holding multiple media streams

• US 7,206,822 B2
• Filed: 02/28/2003
• Issued: 04/17/2007
• Est. Priority Date: 03/08/1996
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Knowlton, Chadd B., VanAntwerp, Mark D., Levi, Steven P., Dowell, Craig M.
• Primary Examiner(s): VU, THONG H
• Application Number:
  US10/377,378
• Publication Number:
  US 20030140116A1
• Time in Patent Office: 1,509 Days
• Field of Search: 709/217, 709/213, 709/236, 709/246, 709/203, 709/243, 709/251, 707/1, 707/203, 375/240, 370/477, 370/241, 386/95, 386/68, 715/500, 348/14, 348/170, 725/131, 725/137, 434/307, 714/152, 712/11
• US Class Current: 709/217
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 69/324 in the data link layer [OSI layer 2], e.g. HDLC
• CPC Class Codes: H04L 69/326 in the transport layer [OSI layer 4] H04L69/16 takes precedence
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

An active stream format is defined and adopted for a logical structure that encapsulates multiple data streams. The data streams may be of different media. The data of the data streams is partitioned into packets that are suitable for transmission over a transport medium. The packets may include error correcting information. The packets may also include clock licenses for dictating the advancement of a clock when the data streams are rendered. The format of ASF facilitates flexibility and choice of packet size and in specifying maximum bit rate at which data may be rendered. Error concealment strategies may be employed in the packetization of data to distribute portions of samples to multiple packets. Property information may be replicated and stored in separate packets to enhance its error tolerance. The format facilitates dynamic definition of media types and the packetization of data in such dynamically defined data types within the format.

Claims

1. A method comprising:

providing a stream format for encapsulating multiple data streams;

dynamically defining a new media type;

storing in a logical structure;

an identifier of the new media type that adopts the stream format;

packets of data of the new media type; and

error correcting data in the at least some of the packets that identifies an error correcting method selected from a plurality of error correcting methods; and

transmitting the packets.

2. The method as defined in claim 1, wherein:

the storing in a logical structure comprises

storing replicas of information in at least some of the packets; and

the method further comprises;

setting a flag in the packets that hold the replicas to indicate that the packets hold replicas; and

encapsulating the packets into the logical structure, wherein at least some of the packets hold the replicas.

3. The method as defined in claim 2, wherein the replicas of information hold property information regarding the samples of data.

4. The method as defined in claim 3, wherein:

portions of a sample are stored in selected packets; and

a replica of property information regarding the sample is stored in each packet in which a portion of the sample is stored.

5. The method as defined in claim 2, wherein:

the logical structure includes a header section and a data section; and

the error correcting data is stored in multiple packets in the data section.

6. The method as defined in claim 5, wherein information in the header section of the logical structure indicates what error correcting methodology is used with the error correcting data stored in the multiple packets in the data section.

7. The method as defined in claim 5, wherein the header section holds information regarding multiple error correcting methods.

8. The method as defined in claim 2, wherein the error correcting data holds parity bits.

9. The method as defined in claim 2, further comprising transmitting the packets of the logical structure on a packet-by-packet basis over a packet switched network from a source computer to a destination computer.

10. The method as defined in claim 9, further comprising examining one of the replicas of information at the destination computer when one of the packets is lost during the transmitting.

11. The method as defined in claim 9, further comprising using the error correcting data in the at least some of the packets to correct an error when the transmitted logical structure is received at the destination computer.

12. The method as defined in claim 9, wherein:

the destination computer has a clock that regulates timing of activities at the destination computer;

the method further comprises;

prior to the transmitting the packets of the logical structure, storing clock licenses that dictate advancement of a clock in multiple ones of the packets;

receiving one or more said packets at the destination computer; and

for each packet that holds a clock license, advancing the clock at the destination computer as dictated by the clock license in response to receiving the packet at the destination computer.

13. The method as defined in claim 12, wherein each clock license includes a time value to which the clock at the destination computer is to be advanced.

14. The method as defined in claim 13, wherein each clock license includes an expiration time after which the clock license is invalid.

15. A computer readable medium containing instruction that, when executed by a computer, performs the method of claim 1.

16. A method comprising:

providing a stream format for encapsulating multiple data streams;

dynamically defining a new media type;

storing in a logical structure;

an identifier of the new media type that adopts the stream format;

packets of data of the new media type; and

replicas of information in at least some of the packets;

setting a flag in the packets that hold the replicas to indicate that the packets hold replicas; and

sending the logical structure over a transport medium to a destination computer.

17. The method as defined in claim 16, wherein:

the storing in a logical structure comprises;

storing samples of data from multiple data streams in the packets; and

storing error correcting data in the at least some of the packets; and

the method further comprises

encapsulating the packets into the logical structure, wherein at least some of the packets hold the replicas.

18. The method as defined in claim 17, wherein:

the destination computer has a clock that regulates timing of activities at the destination computer; and

the method further comprises;

prior to the transmitting the packets of the logical structure, storing clock licenses that dictate advancement of a clock in multiple ones of the packets;

receiving one or more of the packets at the destination computer; and

for each packet that holds a clock license, advancing the clock at the destination computer as dictated by the clock license in response to receiving the packet at the destination computer.

19. The method as defined in claim 18, wherein each clock license includes a time value to which the clock at the destination computer is to be advanced.

20. The method as defined in claim 19, wherein each clock license includes an expiration time after which the clock license is invalid.

21. The method as defined in claim 16, wherein the sending the logical structure over the transport medium to the destination computer further comprising transmitting the packets of the logical structure on a packet-by-packet basis over a packet switched network from a source computer to the destination computer.

22. The method as defined in claim 16, wherein the replicas of information hold property information regarding the samples of data.

23. The method as defined in claim 22, wherein:

portions of a sample are stored in selected packets; and

a replica of property information regarding the sample is stored in each packet in which a portion of the sample is stored.

24. The method as defined in claim 23, further comprising examining one of the replicas of information at the destination computer when one of the packets is lost during the transmitting.

25. The method as defined in claim 23, further comprising using the error correcting data in the at least some of the packets to correct an error when the transmitted logical structure is received at the destination computer.

26. The method as defined in claim 25, wherein information in the header section of the logical structure indicates what error correcting methodology is used with the error correcting data stored in the multiple packets in the data section.

27. The method as defined in claim 16, wherein:

the logical structure includes a header section and a data section; and

the error correcting data is stored in multiple packets in the data section.

28. The method as defined in claim 27, wherein the header section holds information regarding multiple error correcting methods.

29. The method as defined in claim 16, wherein the error correcting data identifies one of a plurality of error correcting methods.

30. The method as defined in claim 16, wherein the error correcting data holds parity bits.

31. A computer readable medium containing instruction that, when executed by a computer, performs the method of claim 16.

32. A method comprising:

providing a stream format for encapsulating multiple data streams;

dynamically defining a new media type to be;

stored at a destination computer; and

rendered by a renderer at the destination computer;

storing in a logical structure;

an identifier of the new media type that adopts the stream format;

a field that identifies the renderer at the destination computer; and

packets of data of the new media type;

sending the logical structure over a transport medium to the destination computer; and

accessing the field in the logical structure that identifies the renderer at the destination computer to determine what renderer to use to render data of new media type.

33. The method as defined in claim 32, wherein:

the storing in a logical structure further comprises;

storing samples of data from multiple data streams in the packets;

storing replicas of information in at least some of the packets; and

storing error correcting data in the at least some of the packets;

the error correcting data identifies an error correcting method for the at least some of the packets;

the method further comprises;

setting a flag in the packets that hold the replicas to indicate that the packets hold replicas; and

encapsulating the packets into the logical structure, wherein at least some of the packets hold the replicas.

34. The method as defined in claim 33, wherein the sending the logical structure over the transport medium to the destination computer further comprising transmitting the packets of the logical structure on a packet-by-packet basis over a packet switched network from a source computer to the destination computer.

35. The method as defined in claim 34, wherein:

the destination computer has a clock that regulates timing of activities at the destination computer; and

the method further comprises;

prior to the transmitting the packets of the logical structure, storing clock licenses that dictate advancement of a clock in multiple ones of the packets;

receiving one or more of the packets at the destination computer; and

for each packet that holds a clock license, advancing the clock at the destination on computer as dictated by the clock license in response to receiving the packet at the destination computer.

36. The method as defined in claim 33, wherein the replicas of information hold property information regarding the samples of data.

37. The method as defined in claim 36, wherein:

portions of a sample are stored in selected packets; and

a replica of property information regarding the sample is stored in each packet in which a portion of the sample is stored.

38. The method as defined in claim 37, further comprising examining one of the replicas of information at the destination computer when one of the packets is lost during the transmitting.

39. The method as defined in claim 37, further comprising using the error correcting data in the at least some of the packets to correct an error when the transmitted logical structure is received at the destination computer.

40. The method as defined in claim 33, wherein:

the logical structure includes a header section and a data section; and

the error correcting data is stored in multiple packets in the data section.

41. The method as defined in claim 40, wherein information in the header section of the logical structure indicates what error correcting methodology is used with the error correcting data stored in the multiple packets in the data section.

42. The method as defined in claim 40, wherein the header section holds information regarding multiple error correcting methods.

43. The method as defined in claim 33, wherein the error correcting data identifies one of a plurality of error correcting methods.

44. The method as defined in claim 33, wherein the error correcting data holds parity bits.

45. The method as defined in claim 44, wherein each clock license includes a time value to which the clock at the destination computer is to be advanced.

46. The method as defined in claim 45, wherein each clock license includes an expiration time after which the clock license is invalid.

47. The method as defined in claim 33, wherein the multiple streams of data in the logical structure are Active Stream Format (ASF) data streams.

48. The method as defined in claim 33, wherein the one error correcting method can be employed in the ASF data streams.

49. A computer readable medium containing instruction that, when executed by a computer, performs the method of claim 32.