METHOD AND SYSTEM FOR SECURE AND RELIABLE VIDEO STREAMING WITH RATE ADAPTATION

• US 20120265892A1
• Filed: 05/30/2012
• Published: 10/18/2012
• Est. Priority Date: 12/01/2009
• Status: Abandoned Application

• Current Assignee: Ericsson AB (Telefonaktiebolaget LM Ericsson)
• Original Assignee: Azuki Systems, Inc (Telefonaktiebolaget LM Ericsson)
• Inventors: Ma, Kevin J., Bartos, Radim, Xu, Jianguo, Nair, Raj, Hickey, Robert, Lin, IChang
• Application Number:
  US13/483,812
• Publication Number:
  US 20120265892A1
• Time in Patent Office: Days
• US Class Current: 709/231
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/64322 IP

Abstract

A system for media delivery includes a server-side proxy for aggregating and encrypting stream data for efficient HTTP-based distribution over an unsecured network. A client-side proxy decrypts and distributes the encapsulated stream data to client devices. A multicast-based infrastructure may be used for increased scalability. The encoded rate of the media delivered over the persistent HTTP proxy connections may be dynamically adapted. The client-side proxy may be integrated within a mobile device for maximum network security and reliability.

Claims

1. A method of operating a server-side proxy in a streaming data delivery system, comprising:

connecting to a streaming server to receive streaming data;

aggregating the streaming data into file segments and storing the file segments on one or more storage devices; and

transferring the file segments from the storage devices to a client-side proxy for delivery to a client device.

2. A method according to claim 1, wherein connecting to the streaming server comprises creating one or more real-time streaming connections.

3. A method according to claim 2, wherein the real-time streaming connections include a plurality of connections to the streaming server, the connections carrying the streaming data at respective distinct bit rates.

4. A method according to claim 2, wherein the streaming server is realized as a selected one of Real-Time Streaming Protocol (RTSP) server, an HTTP Live Streaming (HLS) server, a Real-Time Messaging Protocol (RTMP) server, a Microsoft Media Server (MMS) server, and an Internet Information Services (IIS) Smooth Streaming server.

5. A method according to claim 1, wherein the streaming data includes audio/video data encapsulated as a selected one of Real-Time Protocol/Real-Time Control Protocol (RTP/RTCP) data, MPEG Transport Stream (MPEG-TS) data, Real-Time Messaging Protocol (RTMP) data, Advanced Systems Format (ASF) data, and MPEG-4 (MP4) fragment data.

6. A method according to claim 1, wherein the streaming server is one of a plurality of streaming servers, and connecting to the streaming server is part of establishing respective connections to each of the plurality of streaming servers.

7. A method according to claim 6, wherein the connections to different streaming servers carry respective distinct media.

8. A method according to claim 7, further including splicing media from distinct ones of the connections to create a single output stream to be delivered to the client device.

9. A method according to claim 1, wherein transferring the file segments includes encrypting the file segments from the storage devices to form encrypted file segments and transferring the encrypted file segments to the client-side proxy.

10. A method according to claim 1, wherein aggregating the file segments includes transcoding the file segments into transcoded file segments and aggregating the transcoded file segments for storing on the storage devices and transferring to the client-side proxy.

11. A method according to claim 1, wherein the file segments contain data of distinct types differentiated through use of custom frame headers each including media information, length information and an end-of-stream delimiter.

12. A method according to claim 1, wherein transferring includes use of a secure connection between the server-side proxy and the client-side proxy to securely transfer the file segments to the client-side proxy.

13. A server-side proxy for use in a streaming data delivery system, comprising:

memory;

a processor;

input/output circuitry for connecting the server-side proxy to a streaming server, one or more storage devices, and a client-side proxy; and

one or more data buses by which the memory, processor and input/output circuitry are coupled together,

the memory and processor being configured to store and execute program instructions to enable the server-side proxy to perform the method of claim 1.

14. A method of operating a client-side proxy in a streaming data delivery system, comprising:

connecting to a server-side proxy to receive file segments of a data stream originated by a streaming server to which the server-side proxy is connected;

parsing the file segments to generate native live stream data; and

serving the native live stream data to one or more clients for live media playback.

15. A method according to claim 14, wherein serving the native live stream data to the clients comprises creating a respective real-time streaming connection to the respective client.

16. A method according to claim 15, wherein the real-time streaming connection is selected from a Real-Time Streaming Protocol (RTSP) connection and an HTTP Live Streaming (HLS) connection.

17. A method according to claim 14, wherein connecting to the server-side proxy includes establishing a persistent hypertext transport protocol (HTTP) connection with the server-side proxy.

18. A method according to claim 14, wherein the file segments are encrypted as received from the server-side proxy and parsing the file segments includes decrypting the file segments to form decrypted file segments, and serving the native live stream data includes streaming data from the decrypted file segments to the clients.

19. A method according to claim 14, further including monitoring for a need for a rate switch to change a rate at which the data of the file segments is received from the server-side proxy, and upon detecting the need for a rate switch then closing an existing connection to the server-side proxy and establishing a new connection to the server-side proxy for receiving the file segments at a new rate.

20. A method according to claim 14, wherein connecting to the server-side proxy includes use of non-persistent hypertext transport protocol (HTTP) connections with the server-side proxy, each non-persistent HTTP connection used for receiving a respective one of the file segments.

21. A method according to claim 14, further including establishing a multicast distribution tree to which the clients can connect, and wherein serving the native live stream data includes transmitting the native live stream data to the multicast distribution tree for delivery to the clients.

22. A method according to claim 14, wherein each file segment is requested from a plurality of content delivery networks coupled to the server-side proxy, and a requested file segment is received from a first one of the content delivery networks to deliver the requested file segment.

23. A method according to claim 22, further including:

monitoring for delivery of the requested file segment via one of the content delivery networks, and receiving the requested file segment from the one content delivery network if delivered thereby; and

in the event that the requested file segment is not delivered by the one content delivery network, then requesting the file segment from another content delivery network.

24. A method according to claim 22, wherein:

multiple parallel requests for the requested file segment are submitted to different ones of the content delivery networks;

the requested file segment is received from the content delivery network having the fastest response; and

the requests to the other content delivery networks are.

25. A client-side proxy for use in a streaming data delivery system, comprising:

memory;

a processor;

input/output circuitry for connecting the client-side proxy to one or more client media players and a server-side proxy; and

one or more data buses by which the memory, processor and input/output circuitry are coupled together,

the memory and processor being configured to store and execute program instructions to enable the client-side proxy to perform the method of claim 14.

26. A method for distributing live streaming data to clients, comprising:

connecting to a streaming server from a first proxy;

aggregating streaming data into file segments at the first proxy;

writing the file segments to a plurality of storage devices;

transferring the file segments from the storage devices to a second proxy;

decoding and parsing the file segments at the second proxy to generate native live stream data; and

serving the native live stream data to clients for live media playback.

27. A live streaming system for distributing live streaming data to clients, comprising:

a first proxy configured and operative to (1) connect to a streaming server, (2) aggregate streaming data into file segments, (3) write the file segments to a plurality of storage devices, and (4) transfer the file segments from the storage devices to a second proxy; and

a second proxy configured and operative to (1) receive the file segments from the first proxy, (2) decode and parse the file segments to generate native live stream data, and (3) serve the native live stream data to clients for live media playback.