System and method of XML based content fragmentation for rich media streaming

• US 20080040498A1
• Filed: 08/10/2006
• Published: 02/14/2008
• Est. Priority Date: 08/10/2006
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Setlur, Vidya, Vedantham, Ramakrishna
• Application Number:
  US11/503,031
• Publication Number:
  US 20080040498A1
• Time in Patent Office: Days
• US Class Current: 709/231
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80

Abstract

A system and method for partitioning XML-based content into fragments, where transport packets are generated for encapsulating the fragments and streaming the encapsulated fragments to a receiver, such as a mobile device. Fragmentation of the XML-based content can be performed either with or without regard for any underlying XML syntax or structure. In either case, certain relevant fragmentation information is encapsulated with the fragmented XML-based content in the transport packets that allow for various reconstruction, error concealment, and retransmission schemes for presenting the streamed XML-based content on/to the receiver.

Claims

1. A method of streaming content to a receiver, comprising:

partitioning at least one XML-based content sample into at least two fragments;

generating a transport packet for each of the at least two fragments;

encapsulating each of the at least two fragments in a payload field within their respective transport packets, wherein each of the respective transport packets also contains a fragmentation type field; and

transporting the respective transport packets for reassembly of the at least one XML-based content sample at the receiver using the at least two fragments.

2. The method of claim 1, wherein the transport packet further comprises a sample type field indicating a type of content that is contained in the payload field.

3. The method of claim 1, wherein the fragmentation type field indicates a type of partitioning performed on the at least one XML-based content sample.

4. The method of claim 3, wherein the type of partitioning performed on the at least one XML-based content sample comprises partitioning the at least one XML-based content sample into fragments regardless of any underlying syntactic structure associated with the at least one XML-based content sample.

5. The method of claim 4, wherein the transport packet further comprises at least a header syntax identifier, a start flag set in a first one of the at least two fragments, and an end flag set in a last one of the at least two fragments.

6. The method of claim 4, wherein the transport packet further comprises at least a header syntax identifier and a single shared identifier associated with all of the fragments of the at least one XML-based content sample.

7. The method of claim 4, wherein the transport packet further comprises at least a header syntax identifier and a value indicating a total number of fragments that the at least one XML-based content sample was partitioned into.

8. The method of claim 3, wherein the type of partitioning performed on the at least one XML-based content sample comprises partitioning the at least one content sample into fragments to preserve any underlying syntactic structure associated with the at least one content sample.

9. The method of claim 8, wherein the transport packet further comprises at least a header syntax identifier and a nesting identifier, the nesting identifier denoting one of either a level of nesting from a parent XML element and an end tag of the parent XML element.

10. The method of claim 8, wherein the transport packet further comprises at least a header syntax identifier, a nesting identifier, the nesting identifier denoting one of either a level of nesting from a parent XML element and an end tag of the parent XML element, and a total number of fragments that the at least one XML-based content sample was partitioned into.

11. An apparatus configured to stream content to a receiver, comprising:

a processor; and

a memory operatively connected to the processor and including;

computer code for partitioning at least one XML-based content sample into at least two fragments;

computer code for generating a transport packet for each of the at least two fragments;

computer code for encapsulating each of the at least two fragments in a payload field within their respective transport packets, wherein each of the respective transport packets also contains a fragmentation type field; and

computer code for transporting the respective transport packets for reassembly of the at least one XML-based content sample at the receiver using the at least two fragments.

12. The apparatus of claim 11, wherein the transport packet further comprises a sample type field indicating a type of content that is contained in the payload field.

13. The apparatus of claim 11, wherein the fragmentation type field indicates a type of partitioning performed on the at least one XML-based content sample.

14. The apparatus of claim 13, wherein the type of partitioning performed on the at least one content sample comprises partitioning the at least one XML-based content sample into fragments regardless of any underlying syntactic structure associated with the at least one XML-based content sample.

15. The apparatus of claim 14, wherein the transport packet further comprises at least a header syntax identifier, a start flag set in a first one of the at least two fragments, and an end flag set in a last one of the at least two fragments.

16. The apparatus of claim 14, wherein the transport packet further comprises at least a header syntax identifier and a single shared identifier associated with all of the fragments of the at least one XML-based content sample.

17. The apparatus of claim 14, wherein the transport packet further comprises at least a header syntax identifier and a value indicating a total number of fragments that the at least one XML-based content sample was partitioned into.

18. The apparatus of claim 13, wherein the type of partitioning performed on the at least one XML-based content sample comprises partitioning the at least one XML-based content sample into fragments to preserve any underlying syntactic structure associated with the at least one content sample.

19. The apparatus of claim 18, wherein the transport packet further comprises at least a header syntax identifier and a nesting identifier, the nesting identifier denoting one of either a level of nesting from a parent XML element and an end tag of the parent XML element.

20. The apparatus of claim 18, wherein the transport packet further comprises at least a header syntax identifier, a nesting identifier, the nesting identifier denoting one of either a level of nesting from a parent XML element and an end tag of the parent XML element, and a total number of fragments that the at least one XML-based content sample was partitioned into.

21. A computer program product, embodied on a computer-readable medium, for streaming content to a receiver, comprising:

computer code for partitioning at least one XML-based content sample into at least two fragments;

computer code for generating a transport packet for each of the at least two fragments;

computer code for encapsulating each of the at least two fragments in a payload field within their respective transport packets, wherein each of the respective transport packets also contains at least a fragmentation type field; and

computer code for transporting the respective transport packets for reassembly of the at least one XML-based content sample at the receiver using the at least two fragment.

22. A method for receiving streamed content, comprising:

receiving at least two transport packets, wherein each of the at least two transport packets contains a fragmentation type field and a payload field containing a fragment of at least one XML-based content sample; and

reassembling the at least one XML-based content sample using the at least two fragments

23. The method of claim 22, wherein the computer code for the reassembly of the at least one XML-based content sample further comprises computer code for performing one of a plurality of actions including:

reassembling the at least one XML-based content sample completely if all of the at least two fragments have been received by the receiver;

requesting retransmission of any of the at least two fragments that were not received by the receiver; and

performing error concealment by continuing reassembly of the at least one XML-based content sample despite missing any of the at least two fragments that were not received by the receiver.

24. The method of claim 23, wherein the transport packet further comprises at least a header syntax identifier and a value indicating a total number of fragments that the at least one XML-based content sample was partitioned into.

25. The method of claim 24, wherein each of the at least two fragments is associated with a sequence number and a priority value, which in conjunction with the total number of fragments, is used to determine if any of the at least two fragments are missing and are candidates for retransmission and error concealment.

26. The method of claim 23, wherein the fragmentation type field indicates a type of partitioning performed on the at least one XML-based content sample, the type of partitioning further comprising, partitioning the at least one XML-based content sample into fragments to preserve any underlying syntactic structure associated with the at least one XML-based content sample.

27. The method of claim 26, wherein the transport packet further comprises at least a header syntax identifier and a nesting identifier, the nesting identifier denoting one of either a level of nesting from a parent XML element and an end tag of the parent XML element.

28. The method of claim 27, wherein each of the at least two fragments is associated with a sequence number, which in conjunction with the nesting identifier, is used to determine if any of the at least two fragments are missing, are candidates for retransmission and error concealment, and if so, where in a transport sequence of fragments any of the at least two fragments that are missing belong for proper reassembly of the least one XML-based content sample.

29. The method of claim 26, wherein the transport packet further comprises at least a header syntax identifier, a nesting identifier, the nesting identifier denoting one of either a level of nesting from a parent XML element and an end tag of the parent XML element, and a total number of fragments that the at least one XML-based content sample was partitioned into.

30. The method of claim 29, wherein each of the at least two fragments is associated with a sequence number, which in conjunction with the nesting identifier and the total number of fragments that the at least one XML-based content sample was partitioned into, is used to determine if any of the at least two fragments are missing, are candidates for retransmission and error concealment, and if so, where in a transport sequence of fragments any of the at least two fragments that are missing belong for proper reassembly of the least one XML-based content sample.

31. An apparatus configured to receive streamed content, comprising:

a processor; and

a memory operatively connected to the processor and including;

computer code for receiving at least two transport packets, wherein each of the at least two transport packets contains a fragmentation type field and a payload field containing a fragment of at least one XML-based content sample; and

computer code for reassembling the at least one XML-based content sample using the at least two fragments.

32. The apparatus of claim 31, wherein the computer code for the reassembly of the at least one XML-based content sample further comprises computer code for performing one of a plurality of actions including:

reassembling the at least one XML-based content sample completely if all of the at least two fragments have been received by the receiver;

requesting retransmission of any of the at least two fragments that were not received by the receiver; and

performing error concealment by continuing reassembly of the at least one XML-based content despite missing any of the at least two fragments that were not received by the receiver.

33. The apparatus of claim 32, wherein the fragmentation type field indicates a type of partitioning performed on the at least one XML-based content sample, the type of partitioning further comprising, partitioning the at least one XML-based content sample into fragments regardless of any underlying syntactic structure associated with the at least one XML-based content sample.

34. The apparatus of claim 33, wherein the transport packet further comprises at least a header syntax identifier and a value indicating a total number of fragments that the at least one XML-based content sample was partitioned into.

35. The apparatus of claim 33, wherein each of the at least two fragments is associated with a sequence number and a priority value, which in conjunction with the total number of fragments, is used to determine if any of the at least two fragments are missing and are candidates for retransmission and error concealment.

36. The apparatus of claim 32, wherein the fragmentation type field indicates a type of partitioning performed on the at least one XML-based content sample, the type of partitioning further comprising, partitioning the at least one XML-based content sample into fragments to preserve any underlying syntactic structure associated with the at least one XML-based content sample.

37. The apparatus of claim 36, wherein the transport packet further comprises at least a header syntax identifier and a nesting identifier, the nesting identifier denoting one of either a level of nesting from a parent XML element and an end tag of the parent XML element.

38. The apparatus of claim 37, wherein each of the at least two fragments is associated with a sequence number, which in conjunction with the nesting identifier, is used to determine if any of the at least two fragments are missing, are candidates for retransmission and error concealment, and if so, where in a transport sequence of fragments any of the at least two fragments that are missing belong for proper reassembly of the least one XML-based content sample.

39. The apparatus of claim 36, wherein the transport packet further comprises at least a header syntax identifier, a nesting identifier, the nesting identifier denoting one of either a level of nesting from a parent XML element and an end tag of the parent XML element, and a total number of fragments that the at least one XML-based content sample was partitioned into.

40. The apparatus of claim 39 wherein each of the at least two fragments is associated with a sequence number, which in conjunction with the nesting identifier and the total number of fragments that the at least one XML-based content sample was partitioned into, can be used to determine if any of the at least two fragments are missing, are candidates for retransmission and error concealment, and if so, where in a transport sequence of fragments, any of the at least two fragments that are missing belong for proper reassembly of the least one XML-based content sample.

41. A computer program product, embodied on a computer-readable medium, for receiving streamed content, comprising:

computer code for receiving at least two transport packets, wherein each of the at least two transport packets contains a fragmentation type field and a payload field containing a fragment of at least one XML-based content sample; and

computer code for reassembling the at least one XML-based content sample using the at least two fragments.