Peer-assisted fractional-storage streaming servers

• US 8,832,295 B2
• Filed: 11/10/2010
• Issued: 09/09/2014
• Est. Priority Date: 10/15/2008
• Status: Active Grant

• Current Assignee: Xenogenic Development Limited Liability Company (Intellectual Ventures LLC)
• Original Assignee: Aster RISK Management LLC (Intellectual Ventures LLC)
• Inventors: Zuckerman, Gal, Thieberger, Gil
• Primary Examiner(s): Jaroenchonwanit, Bunjob
• Application Number:
  US12/943,782
• Publication Number:
  US 20110055420A1
• Time in Patent Office: 1,399 Days
• Field of Search: None
• US Class Current: 709/231
• CPC Class Codes: G06F 16/1834 implemented based on peer-to-peer networks, e.g. gnutella p2p communication protocols H04L67/104
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: H03M 13/37 Decoding methods or techniques, not specific to the particular type of coding provided for in groups H03M13/03 - H03M13/35
• CPC Class Codes: H03M 13/3761 using code combining, i.e. using combining of codeword portions which may have been transmitted separately, e.g. Digital Fountain codes, Raptor codes or Luby Transform [LT] codes
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1091 Interfacing with client-server systems or between P2P systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A system including a plurality of fractional-storage servers and a plurality of peer-to-peer devices. Substantially each of the servers and peer-to-peer devices stores less than a minimum amount of erasure-coded fragments needed to decode segments of streaming content. The system delivers at least the minimum amount of erasure-coded fragments needed to decode the segments of streaming content, from any group of the servers, or group of the servers plus peer-to-peer devices, that together store at least the minimum amount of erasure-coded fragments needed to decode the segments of streaming content. Optionally, the system supplements streaming capabilities of the servers during peak traffic periods by sending erasure-coded fragments stored on the peer-to-peer devices during the peak traffic periods.

Claims

1. A system comprising:

a control server configured to;

allocate a plurality of peer-to-peer devices to a plurality of fractional-storage CDN servers, wherein the plurality of fractional-storage CDN servers are communicatively connected to the Internet via fixed bandwidth lines and the plurality of peer-to-peer devices are communicatively connected to the Internet via Internet Service Providers (ISPs);

manage at least one of the fractional-storage CDN serves and at least one of the peer-to-peer devices to store less than a minimum amount of erasure-coded fragments needed to decode segments of streaming content;

manage delivery of at least the minimum amount of erasure-coded fragments needed to decode the segments of streaming content from various combinations of the fractional-storage CDN servers and the peer-to-peer devices; and

indicate at least one of the peer-to-peer devices allocated to one of the fractional-storage CDN servers during periods that fragment delivery bandwidth demand is higher than the total fragment delivery bandwidth of the fixed bandwidth lines, to use bandwidth of the ISP to supplement the fragment delivery bandwidth of the fixed bandwidth lines by delivery of erasure-coded fragments in addition to erasure-coded fragments delivered by the one of the fractional-storage CDN servers.

2. The system of claim 1, wherein the erasure-coding is rateless-coding.

3. The system of claim 1, wherein the bandwidth utilized to obtain the erasure-coded fragments associated with a content file approaches the aggregated fragment delivery bandwidth of the fractional-storage CDN servers and the peer-to-peer devices on which the erasure-coded fragments associated with the content file are stored.

4. The system of claim 1, further comprising assembling devices configured to request decodable sets of erasure-coded fragments from the fractional-storage CDN servers, and upon failure or an estimated failure to obtain requested erasure-coded fragments, obtain the additionally needed erasure-coded fragments from one or more of the peer-to-peer devices.

5. The system of claim 1, wherein the erasure-coding is rateless-coding, and the system further comprises assembling devices configured to receive an indication whether to use the peer-to-peer devices as additional fragment sources to the servers.

6. The system of claim 1, further comprising assembling devices configured to obtain the stored erasure-coded fragments using a fragment pull protocol.

7. The system of claim 1, wherein the erasure-coding is rateless-coding, and the system further comprises assembling devices configured to obtain stored erasure-coded fragments using a plurality of transmissions, each comprising a fraction of the erasure-coded fragments needed to decode the segments.

8. A distributed streaming system, comprising:

a control server configured to;

allocate a plurality of user-premises peer-to-peer devices to a plurality of fractional-storage CDN servers;

manage at least one of the fractional-storage CDN servers and the peer-to-peer devices to receive less than a minimum amount of erasure-coded fragments needed to decode segments of streaming content from which the erasure-coded fragments are generated; and

manage delivery of sets of the erasure-coded fragments usable to decode the segments, from combinations of the fractional-storage CDN servers and peer-to-peer devices allocated thereto by indication by the control server and storing erasure-coded fragments associated with the segments, shortly after the segments are made available by streaming source and while still receiving following erasure-coded fragments associated with the segments.

9. The distributed streaming system of claim 8, wherein a second portion is larger than a first portion, and the first portion comprises enough erasure-coded fragments to reconstruct the streaming content.

10. The distributed streaming system of claim 9, further comprising assembling devices configured to request the sets of erasure-coded fragments from the fractional-storage CDN servers, and upon failure or an estimated failure to obtain requested erasure-coded fragments, obtain the additionally needed erasure-coded fragments from one or more of the peer-to-peer devices;

wherein decodable sets of erasure-coded fragments associated with the segments are obtained from combinations of the fractional-storage CDN servers and the peer-to-peer devices storing erasure-coded fragments associated with the segments.

11. The distributed streaming system of claim 9,

wherein the erasure-coding is rateless-coding, decodable sets of erasure-coded fragments associated with the segments are obtained from combinations of the fractional-storage CDN servers and the peer-to-peer devices storing erasure-coded fragments associated with the segments, and further comprising assembling devices configured to receive an indication whether to use the peer-to-peer devices as additional fragment sources to the fractional-storage CDN servers.

12. The distributed streaming system of claim 8, wherein the erasure-coding is rateless-coding, and the first and the second portions comprise unique rateless-coded fragments encoded with a redundancy factor >

10 from the segments.

13. The distributed streaming system of claim 8, wherein the erasure-coding is rateless-coding, and a first and a second portions comprise unique rateless-coded fragments encoded with a redundancy factor that is determined according to the estimated popularity of the content being encoded, whereby the higher the popularity of the content, the higher the redundancy factor used to encode the content into erasure-coded fragments, and the larger the number of peer-to-peer devices that store the erasure-coded fragments associated with the content.

14. The distributed streaming system of claim 8, further comprising assembling devices configured to obtain the erasure-coded fragments using a fragment pull protocol, whereby the fragment pull protocol fragment requests are issued at a rate that enables real-time presentation of the segments.

15. A distributed system comprising:

a control server configured to manage aspects of a plurality of fractional-storage CDN servers and a plurality of peer-to-peer bandwidth amplification devices, including allocating the peer-to-peer bandwidth amplification devices to the fractional-storage CDN servers;

wherein the control server is configured to manage each of the fractional-storage CDN servers and peer-to-peer bandwidth amplification devices to store less than a minimum amount of erasure-coded fragments needed to decode the erasure-coded fragments; and

wherein when operated in high load, the management by the control server causes delivery to assembling devices sets of erasure-coded fragments belonging to first portions of the erasure-coded fragments obtained from fractional-storage CDN servers and second portions of the erasure-coded fragments obtained predominantly from peer-to-peer bandwidth amplification devices whose ISP'"'"'s communication lines are estimated not to be overloaded.

16. The distributed system of claim 15, wherein the erasure-coding is rateless-coding, and the second portion of the erasure-coded fragments are obtained predominantly from peer-to-peer bandwidth amplification devices located in time zones spanning at least three hours where the Internet traffic generated does not approach a local peak.

17. The distributed system of claim 16, wherein the assembling devices are configured to obtain the erasure-coded fragments from the peer-to-peer bandwidth amplification devices using a fragment pull protocol for high latency.

18. The distributed system of claim 16, wherein the erasure-coded fragments are encoded from segments of streaming contents;

and

wherein the assembling devices are configured to obtain the erasure-coded fragments associated with the initial segments of the streaming content before other segments.