Method and system for dynamic distributed data caching

• US 9,602,618 B2
• Filed: 06/10/2016
• Issued: 03/21/2017
• Est. Priority Date: 01/12/2001
• Status: Expired due to Fees

• Current Assignee: Parallel Networks, LLC (epicRealm Licensing LP)
• Original Assignee: Parallel Networks, LLC (epicRealm Licensing LP)
• Inventors: Lowery, Keith A, Chin, Bryan S, Consolver, David A, DeMasters, Gregg A
• Primary Examiner(s): ELMORE, STEPHEN C
• Application Number:
  US15/178,670
• Publication Number:
  US 20160285995A1
• Time in Patent Office: 284 Days
• Field of Search: 711/130, 711/151, 711/154, 711/156, 711/158, 709/214, 709/216, 709/223
• US Class Current: 1/1
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/1046 Joining mechanisms
• CPC Class Codes: H04L 67/1048 Departure or maintenance mechanisms
• CPC Class Codes: H04L 67/1068 Discovery involving direct consultation or announcement among potential requesting and potential source peers
• CPC Class Codes: H04L 67/108 characterised by resources being split in blocks or fragments
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

A method and system for dynamic distributed data caching is presented. The system includes one or more peer members and a master member. The master member and the one or more peer members form cache community for data storage. The master member is operable to select one of the one or more peer members to become a new master member. The master member is operable to update a peer list for the cache community by removing itself from the peer list. The master member is operable to send a nominate master message and an updated peer list to a peer member selected by the master member to become the new master member.

Claims

1. A method of distributing digital content delivery in a packet based network by allowing a client to obtain portions of the digital content from both a content delivery server and one or more peer clients that have already obtained and are able to share other portions of the digital content, the method comprising:

receiving a request, from a client, seeking to obtain digital content over a packet based network;

providing the client information, the information including a network location of one or more peer clients, at least one of the one or more peer clients having already obtained and able to share at least a portion of the digital content across the packet based network, wherein

each of the client and the one or more peer clients include a processor and memory,

each of the client and one or more peer clients are configured to execute and locally use the digital content once packets corresponding to the digital content have been obtained, and

each of the client and the one or more peer clients are configured to obtain portions of the digital content from both peer clients and a content delivery server;

using at least a portion of the information, allowing the client to obtain at least portions of the digital content from the one or more peer clients in addition to obtaining at least other portions of the digital content from the content delivery server; and

allowing the client to share portions of the digital content just obtained with the one or more peer clients or another peer client.

2. The method of claim 1, wherein

the client receives a plurality of packets for the portions of the digital content received from the content delivery server and the one or more peer clients,

the client sends the content delivery server an acknowledgement message for each packet corresponding to portions of the digital content received from the content delivery server, and

the client sends each of the one or more peer clients an acknowledgement message for each packet corresponding to portions of the digital content received from the respective one or more peer clients.

3. The method of claim 1, wherein the digital content is an application or a video.

4. The method of claim 1, further comprising:

reviewing prospective peer clients to determine which peer clients might provide delivery of the digital content to the client, the reviewing considering one or more of network latency between the client and the prospective peer clients, processing power of the prospective peer clients, and size of the portions of the digital content maintained by prospective peer clients; and

selecting prospective peer clients to provide to the client as the one or more client peers in the information to deliver the digital content over the packet based network.

5. The method of claim 1, further comprising:

gathering statistical information from the one or more peer clients in the sharing for use in determining a distribution of the digital content.

6. The method of claim 1, further comprising:

limiting the sharing by the client of portions of the digital content to peer clients by one or more of an amount of bandwidth, an amount of processor time, and amount of storage space.

7. The method of claim 1, further comprising:

limiting the one or more peer clients from which the client may obtain portions of the digital content to those within a local area network (LAN).

8. The method of claim 1, further comprising:

limiting an amount of time for sharing by the client of portions of the digital content.

9. The method of claim 1, further comprising:

encrypting portions of the digital content that are shared between peer clients.

10. The method of claim 1, wherein the information is provided by a tracker.

11. The method of claim 1, wherein the network location includes an internet protocol address (IP) and port.

12. The method of claim 1, wherein the one or more peer clients are at least two peer clients that each maintain a same particular portion of digital content, further comprising:

making a determination for the client to obtain the particular portion of the digital content from a selected one of the two peer clients over the other, the determination based on one or more of a network latency between the client and each of the two peer clients, a processing power of the two peer clients, and a size of the portions of the digital content maintained by the two peer clients.

13. The method of claim 1, wherein each of the one or more peer clients are configured to maintain all portions of the digital content and selectively share portions of the digital content requested.

14. The method of claim 1, wherein

the digital content is broken into defined portions that are identifiable by a sequence number, and

the allowing the client to obtain at least portions of the digital content from the one or more peer clients in addition to obtaining at least other portions of the digital content from the content delivery server is carried out by the client requesting a sequence number for each of the defined portions corresponding to the portion of digital content obtained from the one or more peer clients and the at least other portions of the digital content from the content delivery server.

15. A method for dynamic distributed data caching comprising:

providing a cache community on a first side of a point of presence, the cache community comprising at least one peer, the cache community being associated with content obtained from a second side of the point of presence, the content being cached by the at least one peer;

allowing a client to join the cache community;

updating a peer list associated with the cache community to include the client, the peer list indicating the peers in the cache community;

associating the content with the client based on joinder of the client;

in response to allowing the client to join the community, re-allocating the cache storage of the content among the peers in the cache community;

wherein when a plurality of peers are in the cache community, the same portions of the content are cached at more than one peer, and at least one peer is configured to cache all the content that is cacheable;

wherein one or more of the peers in the cache community are configured to obtain portions of the content from both peers in the community and the second side of the point of presence;

wherein each of the peers in the cache community include a processor and memory;

wherein portions of the content are transmitted in packets; and

wherein one or more one or more peers in the cache community are configured to execute and locally use the content once packets corresponding to the content have been obtained.

16. The method of claim 15, wherein the content is an application or a video.

17. The method of claim 15, wherein the one or more of the peers in the cache community are configured to obtain portions of the content from both peers in the community and the second side of the point of presence:

receive a plurality of packets for the portions of the content obtained from peers in the cache community and the second side of the point of presence,

send the second side of the point of presence an acknowledgement message for each packet corresponding to portions of the content received from the second side of the point of presence, and

send each of the peers in the cache community an acknowledgement message for each packet corresponding to portions of the content received from respective peers in the cache community.

18. The method of claim 15, further comprising:

reviewing prospective peers to determine which peer might provide a delivery of the content to a particular peer, the reviewing considering one or more of network latency between the particular peer and the prospective peers, processing power of the prospective peer, and size of the portions of the content maintained by prospective peers; and

selecting prospective peers to provide portions of content to the particular peer.

19. The method of claim 15, further comprising:

gathering statistical information from the peers in the cache community for use in determining a distribution of the content.

20. The method of claim 15, further comprising:

limiting the sharing by a particular peer of portions of the content by one or more of an amount of bandwidth, an amount of processor time, and amount of storage space.

21. The method of claim 15, further comprising:

limiting the peers in the cache community from which a particular peer may obtain portions of the content to those within a local area network (LAN).

22. The method of claim 15, further comprising:

limiting an amount of time for sharing by a particular peer of portions of the content.

23. The method of claim 15, further comprising:

encrypting portions of the content that are shared between peers in the cache community.

24. The method of claim 15, wherein the cache community includes one or more trackers that stores information on a delivery of the content between peers in the cache community.

25. The method of claim 15, wherein at least two peers in the cache community have a same particular portion of content, further comprising:

making a determination for a particular client to obtain the particular portion of the content from a selected one of the two peers over the other, the determination based on one or more of a network latency between the particular client and each of the two peers, a processing power of the two peers, and a size of the portions of the digital content maintained by the two peers.

26. The method of claim 15, wherein each of the peers in the cache community are configured to obtain all portions of the content and selectively share portions of the content requested by another peer.

27. The method of claim 15, wherein

the content is broken into defined portions that are identifiable by a sequence number, and

a peer requests a portion of content by requesting the sequence number.

28. The method of claim 15, wherein the re-allocating the cache storage of the content among the peers in the cache community has the client share at least a portion of the content when the client obtains such a portion.

29. The method of claim 15, wherein the re-allocating the cache storage of the content among the peers in the cache community has at least one peer cache different content.

30. The method of claim 15, further comprising:

re-allocating the cache storage of the content among the peers in the cache community in response to a peer leaving the cache community.

31. The method of claim 15, wherein the peer configured to cache all the content that is cacheable is set to an aggressive caching mode.

32. The method of claim 19, wherein the statistical information includes either processor usage or bandwidth usage.

33. A system for distributing digital content delivery in a packet based network by allowing a client to obtain portions of the digital content from both a content delivery server and one or more peer clients that have already obtained and are able to share other portions of the digital content, the system comprising logic stored in one or more computer readable mediums, the logic when executed by one or more processors configured to:

receive a request, from a client, seeking to obtain digital content over a packet based network;

provide the client information, the information including a network location of one or more peer clients, at least one of the one or more peer clients having already obtained and able to share at least a portion of the digital content across the packet based network, wherein

each of the client and the one or more peer clients include a processor and memory,

each of the client and one or more peer clients are configured to execute and locally use the digital content once packets corresponding to the digital content have been obtained, and

each of the client and the one or more peer clients are configured to obtain portions of the digital content from both peer clients and a content delivery server;

use at least a portion of the information, allowing the client to obtain at least portions of the digital content from the one or more peer clients in addition to obtaining at least other portions of the digital content from the content delivery server; and

allow the client to share portions of the digital content just obtained with the one or more peer clients or another peer client.

34. The system of claim 33, wherein logic when executed allows:

the client to receive a plurality of packets for the portions of the digital content received from the content delivery server and the one or more peer clients,

the client to send the content delivery server an acknowledgement message for each packet corresponding to portions of the digital content received from the content delivery server, and

the client to send each of the one or more peer clients an acknowledgement message for each packet corresponding to portions of the digital content received from the respective one or more peer clients.

35. The system of claim 33, wherein the digital content is an application or a video.

36. The system of claim 33, the logic when executed further configured to:

review prospective peer clients to determine which peer clients might provide delivery of the digital content to the client, the reviewing considering one or more of network latency between the client and the prospective peer clients, processing power of the prospective peer clients, and size of the portions of the digital content maintained by prospective peer clients; and

select prospective peer clients to provide to the client as the one or more client peers in the information to deliver the digital content over the packet based network.

37. The system of claim 33, the logic when executed further configured to:

gather statistical information from the one or more peer clients in the sharing for use in determining a distribution of the digital content.

38. The system of claim 33, the logic when executed further configured to:

limit the sharing by the client of portions of the digital content to peer clients by one or more of an amount of bandwidth, an amount of processor time, and amount of storage space.

39. The system of claim 33, the logic when executed further configured to:

limit the one or more peer clients from which the client may obtain portions of the digital content to those within a local area network (LAN).

40. The system of claim 33, the logic when executed further configured to:

limit an amount of time for sharing by the client of portions of the digital content.

41. The system of claim 33, the logic when executed further configured to:

encrypt portions of the digital content that are shared between peer clients.

42. The system of claim 33, wherein the information is provided by a tracker.

43. The system of claim 33, wherein the network location includes an internet protocol address (IP) and port.

44. The system of claim 33, wherein the one or more peer clients are at least two peer clients that each maintain a same particular portion of digital content, the logic when executed further configured to:

make a determination for the client to obtain the particular portion of the digital content from a selected one of the two peer clients over the other, the determination based on one or more of a network latency between the client and each of the two peer clients, a processing power of the two peer clients, and a size of the portions of the digital content maintained by the two peer clients.

45. The system of claim 33, wherein each of the one or more peer clients are configured to maintain all portions of the digital content and selectively share portions of the digital content requested.

46. The system of claim 33, wherein

the digital content is broken into defined portions that are identifiable by a sequence number, and

the allowing the client to obtain at least portions of the digital content from the one or more peer clients in addition to obtaining at least other portions of the digital content from the content delivery server is carried out by the client requesting a sequence number for each of the defined portions corresponding to the portion of digital content obtained from the one or more peer clients and the at least other portions of the digital content from the content delivery server.

47. The method of claim 37, wherein the statistical information includes either processor usage or bandwidth usage.