System and method for multiplexed streaming of multimedia content

• US 9,918,112 B2
• Filed: 12/20/2012
• Issued: 03/13/2018
• Est. Priority Date: 12/29/2011
• Status: Expired due to Fees

• Current Assignee: Magnolia Licensing LLC (IP Edge LLC)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Bichot, Guillaume, Legallais, Yvon, Gouache, Stephane
• Primary Examiner(s): Dailey, Thomas
• Application Number:
  US14/368,837
• Publication Number:
  US 20140359157A1
• Time in Patent Office: 1,909 Days
• Field of Search: None
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

This invention relates to a system, server and client for multiplexed streaming of multimedia content comprising at least one server being capable of transmitting multimedia content in a streaming environment through one or more data paths to a client, wherein the multimedia content is de-multiplexed by the server into a plurality of sub-streams with each sub-stream comprising a unique mark such that the client is capable of multiplexing said sub-streaming into a continuous stream. Furthermore, the invention relates to a method for multiplexed streaming of multimedia content.

Claims

1. A system comprising:

a server being configured for demultiplexing an original packet of a multimedia content, said original packet containing two or more Network Abstraction Layer Units, into a plurality of sub-streams, wherein the server is configured for arranging a packet included within each sub-stream to include at least one payload datum of said original packet and a clock mark, said clock mark comprising a bit sequence adapted for identifying said packet included within its associated sub-stream, said clock mark being different from a clock mark for a different packet included within any sub-stream of said plurality of sub-streams, wherein the bit sequence for said packet, relative to a bit sequence for a different packet in any of said sub-streams, is indicative of an order of the payload datum for the packet relative to the payload datum for the different packet within the original packet, a value for the bit sequence of a packet of a sub-stream containing one of said Network Abstraction Layer Units being obtained by incrementing a time stamp value of the original packet by its ordering number minus 1, inside said original packet, of the Network Abstraction Layer Unit contained in said packet of said sub-stream; and

a client device configured for multiplexing the payload datum from said plurality of sub-streams into a continuous stream, said multiplexing comprising ordering the payload datum of said packets of said sub-streams into at least one packet of said continuous stream, wherein the ordering is performed in accordance with the bit sequence for each said packet received in said plurality of sub-streams.

2. A system according to claim 1, wherein said bit sequence is defined with a time resolution exceeding the resolution of a frame rate of said multimedia content.

3. The system of claim 1 wherein each sub-stream are adapted to be transmitted through one or more data paths, in a streaming environment using a real-time streaming protocol.

4. The system according to claim 1, wherein the clock mark includes an original sequence number in a header extension.

5. The system according to claim 4, wherein the clock mark includes an original sequence number in a payload part of each sub-stream.

6. The system according to claim 3, wherein the streaming environment is a RTP/RTSP streaming environment.

18. The system according to claim 3, wherein the streaming environment is a MPEG2-TS streaming environment.

7. A method performed in at least one server and comprising:

demultiplexing an original packet of a multimedia content, said original packet containing two or more Network Abstraction Layer Units, into a plurality of sub-streams, and

arranging a packet included within each sub-stream to include at least a payload datum of said original packet and a clock mark, said clock mark comprising a bit sequence adapted for identifying said packet included within its associated sub-stream, said clock mark being different from a clock mark for a different packet included within any sub-stream of said plurality of sub-streams, wherein the bit sequence for said packet, relative to a bit sequence for a different packet in any of said sub-streams, is indicative of an order of the payload datum for the packet relative to the payload datum for the different packet within the original packet, wherein a value for the bit sequence of a packet of a sub-stream containing one of said Network Abstraction Layer Units is obtained by incrementing a time stamp value of the original packet by its ordering number minus 1, inside said original packet, of the Network Abstraction Layer Unit contained in said packet of said sub-stream.

8. The method according to claim 7, wherein the bit sequence is defined with a time resolution exceeding the resolution of a frame rate of said multimedia content.

9. The method according to claim 7, wherein the clock mark of each packet of each sub-stream includes a sequence number of said original packet in a header extension or in a payload part of said packet of each said sub-stream.

13. The method according to claim 7 wherein a value for said bit sequence values is based, at least in part, on the timestamp of the original packet in said multimedia content.

10. A streaming server comprising:

a memory that stores a plurality of instructions; and

a processor coupled to the memory and configured to execute the instructions to;

demultiplex an original packet of a multimedia content, said original packet containing two or more Network Abstraction Layer Units, into a plurality of sub-streams;

arranging a packet included within each sub-stream to include at least a payload datum of said original packet and a clock mark, said clock mark comprising a bit sequence adapted for identifying said packet included within its associated sub-stream, said clock mark being different from a clock mark for a packet included within any other sub-stream of said plurality of sub-streams, wherein the bit sequence for said packet, relative to a bit sequence for a different packet in any of said sub-streams, is indicative of an order of the payload datum for the packet relative to the payload datum for the different packet within the original packet, wherein a value for the bit sequence of a packet of a sub-stream containing one of said Network Abstraction Layer Units is obtained by incrementing a time stamp value of the original packet by its ordering number minus 1, inside said original packet, of the Network Abstraction Layer Unit contained in said packet of said sub-stream.

14. A streaming server according to claim 10, wherein said bit sequences are defined with a time resolution exceeding the resolution of a frame rate of said multimedia content.

11. A streaming client device comprising a memory that stores a plurality of instructions and a processor coupled to the memory and configured to execute the instructions for:

multiplexing in a continuous stream, a plurality of sub-streams of multimedia content,

a packet of each sub-stream comprising a clock mark, said clock mark comprising a bit sequence adapted for identifying said packet within its associated sub-stream, said clock mark being different from a clock mark of any other packet included within any other sub-stream of said plurality of sub-streams, wherein the bit sequence for said packet, relative to a bit sequence for a different packet in any of said sub-streams, is indicative of an order of the payload datum for the packet relative to the payload datum for the different packet within an original packet of the multimedia content, said packet containing two or more Network Abstraction Layer Units, wherein a value for the bit sequence of a packet of a sub-stream containing one of said Network Abstraction Layer Units is obtained by incrementing a time stamp value of the original packet by its ordering number minus 1, inside said original packet, of the Network Abstraction Layer Unit contained in said packet of said sub-stream;

said multiplexing comprising ordering contents of said packets of said sub-streams in at least one packet of said continuous stream according to their bit sequences.

12. A streaming client device according to claim 11, wherein said bit sequence is defined with a time resolution exceeding the resolution of a frame rate of said multimedia content.

15. A method, to be performed in at least one client device, comprising:

multiplexing, in a continuous stream, a plurality of sub-streams of multimedia content,

a packet of each sub-stream comprising a clock mark, said clock mark comprising a bit sequence adapted for identifying said packet within its associated sub-stream, said clock mark being different from a clock mark of any other packet included within any other sub-stream of said plurality of sub-streams, wherein the bit sequence for said packet, relative to a bit sequence for a different packet in any of said sub-streams, is indicative of an order of the payload datum for the packet relative to the payload datum for the different packet within an original packet of the multimedia content, said packet containing two or more Network Abstraction Layer Units, wherein a value for the bit sequence of a packet of a sub-stream containing one of said Network Abstraction Layer Units is obtained by incrementing a time stamp value of the original packet by its ordering number minus 1, inside said original packet, of the Network Abstraction Layer Unit contained in said packet of said sub-stream;

said multiplexing comprising ordering contents of said packets of said sub-streams in at least one packet of said continuous stream according to their bit sequences.

16. The method according to claim 15 wherein said multiplexing comprises placing said packets of said sub-streams in a buffer according to an increasing order of their bit sequences.

17. The method according to claim 16 wherein adjacent packets placed in said buffer having not contiguous bit-sequences are used to build different packets of said continuous stream.