Imparting real-time priority-based network communications in an encrypted communication session

• US 8,245,033 B1
• Filed: 10/25/2011
• Issued: 08/14/2012
• Est. Priority Date: 10/15/2008
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Shetty, Pritham, Whillock, Asa, Chan, Edward, Manapragada, Srinivas, Kaufman, Matthew, Thornburgh, Michael
• Primary Examiner(s): Reza, Mohammad W
• Application Number:
  US13/281,317
• Time in Patent Office: 294 Days
• Field of Search: 713/150, 713/153, 713/160, 713/168, 713/187, 726/2, 726/13, 726/27
• US Class Current: 713/160
• CPC Class Codes: H04L 63/06 for supporting key management in a packet data network cryptographic mechanisms or cryptographic arrangements for key management H04L9/08
• CPC Class Codes: H04L 63/0869 for achieving mutual authentication cryptographic mechanisms or cryptographic arrangements for mutual authentication H04L9/3273
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70
• CPC Class Codes: H04L 9/3242 involving keyed hash functions, e.g. message authentication codes [MACs], CBC-MAC or HMAC
• CPC Class Codes: H04L 9/3271 using challenge-response

Abstract

This specification describes technologies relating to imparting real-time priority-based network communications in an encrypted session. In general, aspects of the subject matter described can be embodied in methods that include establishing, based on cryptographic information in a reserved, random-data portion of a handshake communication, a session, receiving parameter values relating to a sub media stream, included in a header of a network communication, storing the parameter values, obtaining state information and a data payload included in a second network communication, identifying, from the state information, a purpose of the second network communication, and whether a header of the second network communication includes one or more new values corresponding to one or more of the parameters, updating one or more of the stored values based on the one or more new values, and processing the data payload based on the identified purpose and the stored parameter values.

Claims

1. A computer program product comprising a memory storing instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

at a client system, receiving an incoming data portion of a handshake network communication, the incoming data portion of the handshake network communication comprising a pre-defined portion reserved for random data and including cryptographic information;

accessing multiple different portions of the pre-defined portion reserved for random data;

determining multiple indices into the pre-defined portion of the incoming data portion of the handshake network communication based on the accessed multiple different portions of the pre-defined portion reserved for random data;

locating the cryptographic information within the pre-defined portion using at least one of the determined multiple indices;

establishing, based at least in part on the located cryptographic information, a communication session with a server system to receive one or more media streams;

receiving, from the server system via the established communication session, a plurality of network communications associated with the one or more media streams, wherein each network communication of the plurality of network communications has an associated data payload and an associated header including rendering information relating to a media rendering state associated with one network communication and one or more subsequent network communications, such that a portion of the rendering information that remains unchanged from the one network communication to a subsequent network communication is included in the header of the one network communication but is missing from a header of the subsequent network communication;

for each network communication of the plurality of network communications, determining playback information associated with the network communication at least in part by

using the rendering information from the associated header as the playback information associated with the network communication,

determining that a portion of the rendering information from the associated header is missing, and

in response to said determining that the portion of the rendering information from the associated header is missing, adding to the playback information associated with the network communication a corresponding portion of rendering information read from a header of a preceding network communication;

reassembling the one or more media streams based on respective playback information associated with each of the plurality of network communications; and

playing the reassembled one or more media streams by a media player of the client system.

2. The computer program product of claim 1, wherein the operation of establishing the communication session comprises:

obtaining a cryptographic key based at least in part on the located cryptographic information; and

initiating the communication session as an encrypted communication session based at least in part on the cryptographic key.

3. The computer program product of claim 2, wherein the operations further comprise decrypting, based at least in part on the located cryptographic information and prior to said reassembling the one or more media streams, data payloads of the plurality of network communications received via the encrypted communication session.

4. The computer program product of claim 1, wherein the operation of establishing the communication session comprises:

generating, using the incoming data portion from the handshake network communication, a responsive handshake network communication, including an outgoing data portion wherein the outgoing data portion comprises random data and cryptographic information;

transmitting, to the server system, the generated responsive handshake network communication;

receiving, from the server system, a second handshake network communication in response to the communicated responsive handshake network communication; and

authenticating the second handshake network communication based on the outgoing data portion in the communicated responsive handshake network communication.

5. The computer program product of claim 4, wherein the operations further comprise, in response to said authenticating of the second handshake communication, turning on or off a feature of the media player associated with the client system.

6. The computer program product of claim 1, wherein each network communication of the plurality of network communications comprises an associated network communication type identifier, and

the operation of determining the playback information associated with the network communication comprises:

if the associated network communication type identifier is a new stream network communication type identifier,

associating the network communication with a new stream from among the one or more streams, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new stream network communication, the new stream network communication rendering information comprising a new plurality of parameter values, wherein the media rendering state corresponding to the new stream network communication uses no parameter values from a previous network communication of the one or more streams;

if the associated network communication type identifier is a new media network communication type identifier,

associating the network communication with a new media of the new stream, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new media network communication, the new media network communication rendering information comprising a new plurality of parameter values, wherein the media rendering state corresponding to the new media network communication uses at least one other parameter value from a previous network communication of the new stream;

if the associated network communication type identifier is a new time network communication type identifier,

associating the network communication with a new time of the new stream, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new time network communication, the new time network communication rendering information comprising at least one parameter value that is new, wherein the media rendering state corresponding to the new time network communication uses a plurality of other parameters from a previous network communication of the new stream; and

else if the associated network communication type identifier is a continuation network communication type identifier, associating the network communication with the new stream, wherein a media rendering state corresponding to a continuation network communication uses a plurality of parameter values from one or more previous network communications of the new stream,

wherein the parameters include one or more of a stream identifier parameter, a length parameter, a media type parameter, or a time delta parameter.

7. The computer program product of claim 6, wherein the operation of reassembling the one or more streams comprises selecting, at least in part by using a network communication type identifier associated with a network communication of the new stream, parameter values from the previous one or more network communications of the new stream for use with respect to one or more subsequent network communications of the new stream.

8. The computer program product of claim 7, wherein the operation of playing the reassembled one or more media streams comprises controlling a state machine to set the selected parameter values for use by the one or more subsequent network communications of the new stream.

9. The computer program product of claim 1, wherein the operation of determining the playback information associated with the network communication comprises determining, at least in part by using the associated network communication type identifier, whether the network communication is a low-level protocol message or a media content message.

10. The computer program product of claim 1, wherein the operation of determining the playback information associated with the network communication comprises determining, at least in part by using the associated network communication type identifier, a quantity of bytes of the associated header used to identify a stream with which the network communication is associated.

11. A system comprising:

one or more hardware processors; and

non-transitory computer storage medium storing instructions that when executed by the one or more hardware processors cause the system to perform operations comprising;

receiving an incoming data portion of a handshake network communication, the incoming data portion of the handshake network communication comprising a pre-defined portion reserved for random data and including cryptographic information;

accessing multiple different portions of the pre-defined portion reserved for random data;

determining multiple indices into the pre-defined portion of the incoming data portion of the handshake network communication based on the accessed multiple different portions of the pre-defined portion reserved for random data;

locating the cryptographic information within the pre-defined portion using at least one of the determined multiple indices;

establishing, based at least in part on the located cryptographic information, a communication session with a server system to receive one or more media streams;

receiving, from the server system via the established communication session, a plurality of network communications associated with the one or more media streams, wherein each network communication of the plurality of network communications has an associated data payload and an associated header including rendering information relating to a media rendering state associated with one network communication and one or more subsequent network communications, such that a portion of the rendering information that remains unchanged from the one network communication to a subsequent network communication is included in the header of the one network communication but is missing from a header of the subsequent network communication;

for each network communication of the plurality of network communications, determining playback information associated with the network communication at least in part by

using the rendering information from the associated header as the playback information associated with the network communication,

determining that a portion of the rendering information from the associated header is missing, and

in response to the operation of determining that the portion of the rendering information from the associated header is missing, adding to the playback information associated with the network communication a corresponding portion of rendering information read from a header of a preceding network communication;

reassembling the one or more media streams based on respective playback information associated with each of the plurality of network communications; and

playing the reassembled one or more media streams by a media player of the system.

12. The system of claim 11, wherein the operation of establishing the communication session comprises:

obtaining a cryptographic key based at least in part on the located cryptographic information; and

initiating the communication session as an encrypted communication session based at least in part on the cryptographic key.

13. The system of claim 12, wherein the operations further comprise decrypting, based at least in part on the located cryptographic information and prior to the operation of reassembling the one or more media streams, data payloads of the plurality of network communications received via the encrypted communication session.

14. The system of claim 11, wherein the operation of establishing the communication session comprises:

generating, using the incoming data portion from the handshake network communication, a responsive handshake network communication, including an outgoing data portion wherein the outgoing data portion comprises random data and cryptographic information;

transmitting, to the server system, the generated responsive handshake network communication;

receiving, from the server system, a second handshake network communication in response to the communicated responsive handshake network communication; and

authenticating the second handshake network communication based on the outgoing data portion in the communicated responsive handshake network communication.

15. The system of claim 14, wherein the operations further comprise, in response to the operation of authenticating of the second handshake communication, turning on or off a feature of the media player associated with the system.

16. The system of claim 11, wherein

each network communication of the plurality of network communications comprises an associated network communication type identifier, and

the operation of determining the playback information associated with the network communication comprises:

if the associated network communication type identifier is a new stream network communication type identifier,

associating the network communication with a new stream from among the one or more streams, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new stream network communication, the new stream network communication rendering information comprising a new plurality of parameter values, wherein the media rendering state corresponding to the new stream network communication uses no parameter values from a previous network communication of the one or more streams;

if the associated network communication type identifier is a new media network communication type identifier,

associating the network communication with a new media of the new stream, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new media network communication, the new media network communication rendering information comprising a new plurality of parameter values, wherein the media rendering state corresponding to the new media network communication uses at least one other parameter value from a previous network communication of the new stream;

if the associated network communication type identifier is a new time network communication type identifier,

associating the network communication with a new time of the new stream, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new time network communication, the new time network communication rendering information comprising at least one parameter value that is new, wherein the media rendering state corresponding to the new time network communication uses a plurality of other parameters from a previous network communication of the new stream; and

else if the associated network communication type identifier is a continuation network communication type identifier, associating the network communication with the new stream, wherein a media rendering state corresponding to a continuation network communication uses a plurality of parameter values from one or more previous network communications of the new stream,

wherein the parameters include one or more of a stream identifier parameter, a length parameter, a media type parameter, or a time delta parameter.

17. The system of claim 16, wherein the operation of reassembling the one or more streams comprises selecting, at least in part by using a network communication type identifier associated with a network communication of the new stream, parameter values from the previous one or more network communications of the new stream for use with respect to one or more subsequent network communications of the new stream.

18. The system of claim 17, wherein the operation of playing the reassembled one or more media streams comprises controlling a state machine to set the selected parameter values for use by the one or more subsequent network communications of the new stream.

19. The system of claim 11, wherein the operation of determining the playback information associated with the network communication comprises determining, at least in part by using the associated network communication type identifier, whether the network communication is a low-level protocol message or a media content message.

20. The system of claim 11, wherein the operation of determining the playback information associated with the network communication comprises determining, at least in part by using the associated network communication type identifier, a quantity of bytes of the associated header used to identify a stream with which the network communication is associated.

21. A method comprising:

at a client system, receiving an incoming data portion of a handshake network communication, the incoming data portion of the handshake network communication comprising a pre-defined portion reserved for random data and including cryptographic information;

accessing multiple different portions of the pre-defined portion reserved for random data;

determining multiple indices into the pre-defined portion of the incoming data portion of the handshake network communication based on the accessed multiple different portions of the pre-defined portion reserved for random data;

locating the cryptographic information within the pre-defined portion using at least one of the determined multiple indices;

establishing, based at least in part on the located cryptographic information, a communication session with a server system to receive one or more media streams;

receiving, from the server system via the established communication session, a plurality of network communications associated with the one or more media streams, wherein each network communication of the plurality of network communications has an associated data payload and an associated header including rendering information relating to a media rendering state associated with one network communication and one or more subsequent network communications, such that a portion of the rendering information that remains unchanged from the one network communication to a subsequent network communication is included in the header of the one network communication but is missing from a header of the subsequent network communication;

for each network communication of the plurality of network communications, determining playback information associated with the network communication at least in part by

using the rendering information from the associated header as the playback information associated with the network communication,

determining that a portion of the rendering information from the associated header is missing, and

in response to said determining that the portion of the rendering information from the associated header is missing, adding to the playback information associated with the network communication a corresponding portion of rendering information read from a header of a preceding network communication;

reassembling the one or more media streams based on respective playback information associated with each of the plurality of network communications; and

playing the reassembled one or more media streams by a media player of the client system.

22. The method of claim 21, wherein said establishing the communication session comprises:

obtaining a cryptographic key based at least in part on the located cryptographic information; and

initiating the communication session as an encrypted communication session based at least in part on the cryptographic key.

23. The method of claim 22, further comprising decrypting, based at least in part on the located cryptographic information and prior to said reassembling the one or more media streams, data payloads of the plurality of network communications received via the encrypted communication session.

24. The method of claim 21, wherein said establishing the communication session comprises:

generating, using the incoming data portion from the handshake network communication, a responsive handshake network communication, including an outgoing data portion wherein the outgoing data portion comprises random data and cryptographic information;

transmitting, to the server system, the generated responsive handshake network communication;

receiving, from the server system, a second handshake network communication in response to the communicated responsive handshake network communication; and

authenticating the second handshake network communication based on the outgoing data portion in the communicated responsive handshake network communication.

25. The method of claim 24, further comprising, in response to said authenticating of the second handshake communication, turning on or off a feature of the media player associated with the client system.

26. The method of claim 21, wherein

each network communication of the plurality of network communications comprises an associated network communication type identifier, and

said determining the playback information associated with the network communication comprises:

if the associated network communication type identifier is a new stream network communication type identifier,

associating the network communication with a new stream from among the one or more streams, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new stream network communication, the new stream network communication rendering information comprising a new plurality of parameter values, wherein the media rendering state corresponding to the new stream network communication uses no parameter values from a previous network communication of the one or more streams;

if the associated network communication type identifier is a new media network communication type identifier,

associating the network communication with a new media of the new stream, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new media network communication, the new media network communication rendering information comprising a new plurality of parameter values, wherein the media rendering state corresponding to the new media network communication uses at least one other parameter value from a previous network communication of the new stream;

if the associated network communication type identifier is a new time network communication type identifier,

associating the network communication with a new time of the new stream, and

reading from the associated header rendering information relating to a media rendering state corresponding to a new time network communication, the new time network communication rendering information comprising at least one parameter value that is new, wherein the media rendering state corresponding to the new time network communication uses a plurality of other parameters from a previous network communication of the new stream; and

else if the associated network communication type identifier is a continuation network communication type identifier, associating the network communication with the new stream, wherein a media rendering state corresponding to a continuation network communication uses a plurality of parameter values from one or more previous network communications of the new stream,

wherein the parameters include one or more of a stream identifier parameter, a length parameter, a media type parameter, or a time delta parameter.

27. The method of claim 26, wherein said reassembling the one or more streams comprises selecting, at least in part by using a network communication type identifier associated with a network communication of the new stream, parameter values from the previous one or more network communications of the new stream for use with respect to one or more subsequent network communications of the new stream.

28. The method of claim 27, wherein said playing the reassembled one or more media streams comprises controlling a state machine to set the selected parameter values for use by the one or more subsequent network communications of the new stream.

29. The method of claim 21, wherein said determining the playback information associated with the network communication comprises determining, at least in part by using the associated network communication type identifier, whether the network communication is a low-level protocol message or a media content message.

30. The method of claim 21, wherein said determining the playback information associated with the network communication comprises determining, at least in part by using the associated network communication type identifier, a quantity of bytes of the associated header used to identify a stream with which the network communication is associated.