Real-time priority-based media communication

• US 8,301,796 B2
• Filed: 09/30/2011
• Issued: 10/30/2012
• Est. Priority Date: 02/13/2003
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Edelman, Bradley A., Gay, Jonathan, Lozben, Slavik, Shetty, Pritham
• Primary Examiner(s): SHAW, PELING ANDREW
• Application Number:
  US13/250,199
• Publication Number:
  US 20120023255A1
• Time in Patent Office: 396 Days
• Field of Search: None
• US Class Current: 709/231
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/2433 Allocation of priorities to traffic types
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2389 Multiplex stream processing, e.g. multiplex stream encrypting
• CPC Class Codes: H04N 21/262 Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

Representative embodiments are disclosed of a real-time priority-based communication system and method for communicating media streams made up of multiple media message sub-streams, the communication system comprising a chunk configurator for dividing media message sub-streams into chunks, a state machine configured to translate between information regarding the media message sub-streams and the chunks and state associations to the information, the state associations written into a header for each of the chunks, a queue for holding the chunks waiting to be transmitted, and a processor for executing a scheduling algorithm, wherein the scheduling algorithm determines ones of the chunks in the queue to transmit next.

Claims

1. A computer storage medium comprising program instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

at a client system, establishing a communication session to receive a media stream from a server system;

receiving through the communication session, as part of the media stream, values of parameters relating to a sub media stream, the values included in a header portion of a first real-time, priority-based network communication of the communication session;

storing the values of the parameters at the client system;

receiving through the communication session, as part of the media stream from the server system, state information and a data payload, the state information being included in a control portion of a second real-time, priority-based network communication of the communication session, and the data payload being included in the second real-time, priority-based network communication;

determining, from the state information, a purpose of the second real-time, priority-based network communication in relation to the media stream from the server system in accordance with whether a header portion of the second real-time, priority-based network communication includes, either, only one or more new values corresponding to one or more of the parameters, or no values corresponding to the parameters;

updating, when the second header portion includes the one or more new values, one or more of the stored values based, at least in part, on the one or more new values; and

processing the data payload based at least in part on the determined purpose and the stored values of the parameters.

2. The computer storage medium of claim 1, wherein the operation of determining the purpose comprises identifying the purpose from a set of possible purposes including:

beginning a new sub media stream, the second header portion including the one or more new values comprising sub media stream values corresponding to the parameters, and

indicating a new media type, the second header portion including the one or more new values comprising values corresponding to fewer than all of the parameters.

3. The computer storage medium of claim 2, wherein the operation of determining the purpose comprises identifying the purpose from the set of possible purposes including:

providing a new time, the second header portion including the one or more new values being one new value corresponding to one of the parameters, and

continuing the sub media stream, the second header portion having no values corresponding to the parameters.

4. The computer storage medium of claim 1, wherein the parameters include one or more of a sub media stream identifier parameter, a length parameter, a media type parameter, and a time delta parameter.

5. The computer storage medium of claim 1, wherein

the sub media stream comprises a first sub media stream, and

the operations further comprise

receiving through the communication session, as part of the media stream, real-time, priority-based network communications associated with a second sub media stream, wherein the real-time, priority-based network communications include state information and data payloads, and

assembling a playable portion of the second sub media stream based at least in part on state information and the data payloads.

6. The computer storage medium of claim 5, wherein the operations further comprise playing the assembled portion of the second sub media stream relative to a media type indicated by at least one of the stored values of the parameters.

7. The computer storage medium of claim 6, wherein the operation of playing the assembled playable portion of the second sub media stream comprises controlling a state machine in accordance with the at least one of the stored values of the parameters.

8. The computer storage medium of claim 5, wherein the operations further comprise storing the assembled playable portion of the second sub media stream.

9. A system comprising:

one or more hardware processors; and

a storage system communicatively coupled with the one or more hardware processors and encoding instructions that, when executed by the one or more hardware processors, cause the system to perform operations comprising;

establishing a communication session to receive a media stream from a server system;

receiving through the communication session, as part of the media stream, values of parameters relating to a sub media stream, the values included in a header portion of a first real-time, priority-based network communication of the communication session;

storing the values of the parameters on the storage system;

receiving through the communication session, as part of the media stream from the server system, state information and a data payload, the state information being included in a control portion of a second real-time, priority-based network communication of the communication session, and the data payload being included in the second real-time, priority-based network communication;

determining, from the state information, a purpose of the second real-time, priority-based network communication in relation to the media stream from the server system in accordance with whether a header portion of the second real-time, priority-based network communication includes, either, only one or more new values corresponding to one or more of the parameters, or no values corresponding to the parameters;

updating, when the second header portion includes the one or more new values, one or more of the stored values based, at least in part, on the one or more new values; and

processing the data payload based at least in part on the determined purpose and the stored values of the parameters.

10. The system of claim 9, wherein the operation of determining the purpose comprises identifying the purpose from a set of possible purposes including:

beginning a new sub media stream, the second header portion including the one or more new values comprising sub media stream values corresponding to the parameters, and

indicating a new media type, the second header portion including the one or more new values comprising values corresponding to fewer than all of the parameters.

11. The system of claim 10, wherein the operation of determining the purpose comprises identifying the purpose from the set of possible purposes including:

providing a new time, the second header portion including the one or more new values being one new value corresponding to one of the parameters, and

continuing the sub media stream, the second header portion having no values corresponding to the parameters.

12. The system of claim 9, wherein the parameters include one or more of a sub media stream identifier parameter, a length parameter, a media type parameter, and a time delta parameter.

13. The system of claim 9, wherein

the sub media stream comprises a first sub media stream, and

the operations further comprise

receiving through the communication session, as part of the media stream, real-time, priority-based network communications associated with a second sub media stream, wherein the real-time, priority-based network communications include state information and data payloads, and

assembling a playable portion of the second sub media stream based at least in part on state information and the data payloads.

14. The system of claim 13, wherein the operations further comprise playing the assembled portion of the second sub media stream relative to a media type indicated by at least one of the stored values of the parameters.

15. The system of claim 14, wherein the operation of playing the assembled playable portion of the second sub media stream comprises controlling a state machine in accordance with the at least one of the stored values of the parameters.

16. The system of claim 13, wherein the operations further comprise storing the assembled playable portion of the second sub media stream.

17. A method comprising:

at a client system, establishing a communication session to receive a media stream from a server system;

receiving through the communication session, as part of the media stream, values of parameters relating to a sub media stream, the values included in a header portion of a first real-time, priority-based network communication of the communication session;

storing the values of the parameters on the client system;

receiving through the communication session, as part of the media stream from the server system, state information and a data payload, the state information being included in a control portion of a second real-time, priority-based network communication of the communication session, and the data payload being included in the second real-time, priority-based network communication;

determining, by the client system from the received state information, a purpose of the second real-time, priority-based network communication in relation to the media stream from the server system in accordance with whether a header portion of the second real-time, priority-based network communication includes, either, only one or more new values corresponding to one or more of the parameters, or no values corresponding to the parameters;

updating, when the second header portion includes the one or more new values, one or more of the stored values based, at least in part, on the one or more new values; and

processing, by the client system, the data payload based at least in part on the determined purpose and the stored values of the parameters.

18. The method of claim 17, wherein determining the purpose comprises identifying the purpose from a set of possible purposes including:

beginning a new sub media stream, the second header portion including the one or more new values comprising sub media stream values corresponding to the parameters, and

indicating a new media type, the second header portion including the one or more new values comprising values corresponding to fewer than all of the parameters.

19. The method of claim 18, wherein determining the purpose comprises identifying the purpose from the set of possible purposes including:

providing a new time, the second header portion including the one or more new values being one new value corresponding to one of the parameters, and

continuing the sub media stream, the second header portion having no values corresponding to the parameters.

20. The method of claim 17, wherein the parameters include one or more of a sub media stream identifier parameter, a length parameter, a media type parameter, and a time delta parameter.

21. The method of claim 17, wherein

the sub media stream comprises a first sub media stream, and

the method further comprises

receiving through the communication session, as part of the media stream, real-time, priority-based network communications associated with a second sub media stream, wherein the real-time, priority-based network communications include state information and data payloads, and

assembling, by the client system, a playable portion of the second sub media stream based at least in part on state information and the data payloads.

22. The method of claim 21, further comprising playing, by the client system, the assembled portion of the second sub media stream relative to a media type indicated by at least one of the stored values of the parameters.

23. The method of claim 22, wherein playing the assembled playable portion of the second sub media stream comprises controlling a state machine in accordance with the at least one of the stored values of the parameters.

24. The method of claim 21, further comprising storing the assembled playable portion of the second sub media stream.