Real-time priority-based media communication

• US 9,083,773 B2
• Filed: 11/19/2013
• Issued: 07/14/2015
• Est. Priority Date: 02/13/2003
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Edelman, Bradley A., Gay, Jonathan, Lozben, Slavik, Shetty, Pritham
• Primary Examiner(s): SHAW, PELING ANDREW
• Application Number:
  US14/084,160
• Publication Number:
  US 20140082210A1
• Time in Patent Office: 602 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/2433 Allocation of priorities to traffic types
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2389 Multiplex stream processing, e.g. multiplex stream encrypting
• CPC Class Codes: H04N 21/262 Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

Representative embodiments are disclosed of a real-time priority-based communication system and method for communicating media streams made up of multiple media message sub-streams, the communication system comprising a chunk configurator for dividing media message sub-streams into chunks, a state machine configured to translate between information regarding the media message sub-streams and the chunks and state associations to the information, the state associations written into a header for each of the chunks, a queue for holding the chunks waiting to be transmitted, and a processor for executing a scheduling algorithm, wherein the scheduling algorithm determines ones of the chunks in the queue to transmit next.

Claims

1. A system comprising:

a storage device; and

one or more computer systems communicatively coupled with the storage device and operable to interact with a user device, the one or more computer systems being configured to perform operations including;

obtaining one or more media streams;

dividing each of the one or more media streams into a plurality of messages;

dividing each of the plurality of messages into one or more chunks, wherein each chunk of the one or more chunks comprises a chunk type, a data payload, and a variable-length header, wherein the variable-length header comprises state variables;

omitting or assigning, depending on the chunk type, one or more state variables from the variable-length headers of corresponding chunks; and

outputting the chunks as one or more chunk streams, which further correspond to one or more message streams.

2. The system of claim 1, wherein the state variables comprise:

a message stream ID, a message length, and a time delta.

3. The system of claim 2, wherein the chunk types comprise:

a first chunk type identifying whether the chunk is associated with the message stream of the previous chunk, and may therefore omit the message stream ID from the variable-length header,

a second chunk type identifying whether the chunk is associated with the message stream of the previous chunk and has the same length of the previous chunk, and may therefore omit the message stream ID and the message length from the variable-length header, and

a third chunk type identifying whether the chunk is associated with the chunk stream of the previous chunk and has the same length of the previous chunk, and may therefore omit the message stream ID, the message length, and the time delta from the variable-length header.

4. The system of claim 1, wherein the outputting comprises:

streaming the one or more chunks of the processed one or more streams to a computing device.

5. The system of claim 4, wherein the streaming comprises:

reading, from a chunk from among the one or more chunks, state variables associated with the chunk and one or more subsequent chunks; and

controlling the state of a media player based on the state variables read from the chunk for playing the chunk and one or more subsequent chunks.

6. The system of claim 2, wherein the outputting comprises:

streaming the one or more chunks of the processed one or more streams from a media streaming server computer.

7. The system of claim 6, wherein the streaming comprises:

queuing the one or more chunks for transmission based on a media type of each of the one or more chunks; and

transmitting a chunk of the queued one or more chunks based on a scheduling algorithm.

8. The system of claim 7, wherein the queuing comprises:

staging the one or more chunks according to a media type of the chunk, wherein the media type comprises one of an audio data format, a video data format, and a pure data format.

9. The system of claim 7, wherein the queuing comprises:

assigning a priority to each of the one or more streams;

totaling a priority for each stream;

calculating a desired transmission rate for each of the one or more streams using the assigned priority and the totaled priority;

counting a sub-total of the plurality of associated chunks transmitted per the one or more streams during a preset period;

counting a total number of the plurality of associated chunks transmitted during the preset period;

calculating an actual transmission rate for each stream of the one or more streams using the sub-total and the total; and

calculating a ratio between the desired transmission rate and the actual transmission rate.

10. A method comprising:

obtaining one or more media streams;

dividing each of the one or more media streams into a plurality of messages;

dividing each of the plurality of messages into one or more chunks, wherein each chunk of the one or more chunks comprises a chunk type, a data payload, and a variable-length header, wherein the variable-length header comprises state variables;

omitting or assigning, depending on the chunk type, one or more state variables from the variable-length headers of corresponding chunks; and

outputting the chunks as one or more chunk streams, which further correspond to one or more message streams.

11. The method of claim 10, wherein the state variables comprise:

a message stream ID, a message length, and a time delta.

12. The method of claim 11, wherein the chunk types comprise:

a first chunk type identifying whether the chunk is associated with the message stream of the previous chunk, and may therefore omit the message stream ID from the variable-length header,

a second chunk type identifying whether the chunk is associated with the message stream of the previous chunk and has the same length of the previous chunk, and may therefore omit the message stream ID and the message length from the variable-length header, and

a third chunk type identifying whether the chunk is associated with the chunk stream of the previous chunk and has the same length of the previous chunk, and may therefore omit the message stream ID, the message length, and the time delta from the variable-length header.

13. The method of claim 10, wherein each chunk further comprises an indication of whether the associated data payload comprises low-level protocol instructions or media content.

14. The method of claim 10, wherein the outputting comprises:

storing the one or more chunks of the processed one or more streams to a storage device.

15. The method of claim 10, wherein the outputting comprises:

streaming the one or more chunks of the processed one or more streams to a computing device.

16. The method of claim 15, wherein the streaming comprises:

reading, from a chunk from among the one or more chunks, state variables associated with the chunk and one or more subsequent chunks; and

controlling the state of a media player based on the state variables read from the chunk for playing the chunk and one or more subsequent chunks.

17. The method of claim 10, wherein the outputting comprises:

streaming the one or more chunks of the processed one or more streams from a media streaming server computer.

18. The method of claim 17, wherein the streaming comprises:

queuing the one or more chunks for transmission based on a media type of each of the one or more chunks; and

transmitting a chunk of the queued one or more chunks based on a scheduling algorithm.

19. The method of claim 18, wherein the queuing comprises:

staging the one or more chunks according to a media type of the chunk, wherein the media type comprises one of an audio data format, a video data format, and a pure data format.

20. The method of claim 19, wherein the queuing comprises:

assigning a priority to each of the one or more streams;

totaling a priority for each stream;

calculating a desired transmission rate for each of the one or more streams using the assigned priority and the totaled priority;

counting a sub-total of the plurality of associated chunks transmitted per the one or more streams during a preset period;

counting a total number of the plurality of associated chunks transmitted during the preset period;

calculating an actual transmission rate for each stream of the one or more streams using the sub-total and the total; and

calculating a ratio between the desired transmission rate and the actual transmission rate.