Method and apparatus for facilitating distributed delivery of content across a computer network

• US 7,398,301 B2
• Filed: 08/02/2002
• Issued: 07/08/2008
• Est. Priority Date: 08/04/2001
• Status: Active Grant

• Current Assignee: Kollective Technology Incorporated
• Original Assignee: Kontiki Incorporated (Kollective Technology Incorporated)
• Inventors: Wainwright, John B., Hennessey, Wade L
• Primary Examiner(s): PATEL, ASHOKKUMAR B
• Application Number:
  US10/211,602
• Publication Number:
  US 20030028623A1
• Time in Patent Office: 2,167 Days
• Field of Search: 725/4, 725/16, 725/24, 725/25, 725/48, 725/49, 725/50, 725/105, 370/412, 712/26, 715/733, 707/1, 707/2, 707/3, 707/5, 707/9, 707/10, 719/311, 719/312, 726/3, 726/12, 726/27
• US Class Current: 709/217
• CPC Class Codes: G06F 16/1834 implemented based on peer-to-peer networks, e.g. gnutella p2p communication protocols H04L67/104
• CPC Class Codes: H04L 2463/101 applying security measures for digital rights management data processing systems or methods, specially adapted for commerce, e.g. marketing, shopping, billing, auctions or e-commerce G06Q30/00
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 41/50 Network service management, e.g. ensuring proper service fulfilment according to agreements
• CPC Class Codes: H04L 41/5025 by proactively reacting to service quality change, e.g. by reconfiguration after service quality degradation or upgrade
• CPC Class Codes: H04L 41/5058 Service discovery by the service manager
• CPC Class Codes: H04L 41/509 wherein the managed service relates to media content delivery, e.g. audio, video or TV
• CPC Class Codes: H04L 43/50 Testing arrangements
• CPC Class Codes: H04L 61/4541 Directories for service discovery
• CPC Class Codes: H04L 63/029 Firewall traversal, e.g. tunnelling or, creating pinholes
• CPC Class Codes: H04L 63/04 for providing a confidential data exchange among entities communicating through data packet networks
• CPC Class Codes: H04L 63/0823 using certificates cryptographic mechanisms or cryptographic arrangements for entity authentication involving certificates H04L9/3263
• CPC Class Codes: H04L 63/12 Applying verification of the received information cryptographic mechanisms or cryptographic arrangements for data integrity or data verification H04L9/32
• CPC Class Codes: H04L 63/123 received data contents, e.g. message integrity
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/1031 : Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
• CPC Class Codes: H04L 67/1038 : Load balancing arrangements to avoid a single path through a load balancer
• CPC Class Codes: H04L 67/104 : Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/1063 : Discovery through centralising entities
• CPC Class Codes: H04L 67/1072 : Discovery involving ranked list compilation of candidate peers
• CPC Class Codes: H04L 67/108 : characterised by resources being split in blocks or fragments
• CPC Class Codes: H04L 67/1091 : Interfacing with client-server systems or between P2P systems
• CPC Class Codes: H04L 67/51 : Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04L 67/63 : Routing a service request depending on the request content or context
• CPC Class Codes: H04L 69/326 : in the transport layer [OSI layer 4] H04L69/16 takes precedence
• CPC Class Codes: H04L 69/329 : in the application layer [OSI layer 7]
• CPC Class Codes: Y10S 707/99931 : Database or file accessing
• CPC Class Codes: Y10S 707/99932 : Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 : Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 : Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99939 : Privileged access

Abstract

One embodiment of the present invention provides a system that facilitates receiving content at a client from one or more servers that can potentially provide the content. The client starts by sending a request for the content to a directory server. In response to the request, the client receives a list of candidate servers that can potentially provide the content from the directory server. Once the client has received the list of candidate servers, the client sends a request to one or more of the candidate servers for the content, and subsequently receives the content from one or more of the candidate servers.

Claims

1. A method for receiving content at a client from one or more candidate servers that can provide the content, comprising the client:

sending a request to a directory server, the request including a range set that identifies pieces of the content that have previously been received by the client;

in response to the request, receiving a response from the directory server that includes a list of the candidate servers that can potentially provide the content;

sending a request for the content to at least one candidate server from the list of candidate servers; and

receiving the content from at least one candidate server.

2. The method of claim 1, wherein receiving the content from at least one candidate server involves receiving portions of the content from multiple candidate servers and assembling the portions at the client.

3. The method of claim 1, further comprising sending feedback to the directory server, wherein the feedback can include a map of the content which can indicate:

which portions of the content have been received by the client;

which portions of the content are currently being received by the client; and

which portions of the content t have not been received by the client.

4. The method of claim 1, further comprising sending feedback to the directory server, wherein the feedback can include status information for candidate servers, which can indicate:

an availability of a given candidate server;

a performance indicator for the given candidate server; and

a trace of the path from the client to the given candidate server.

5. The method of claim 1, wherein sending the request to the directory server for the content further involves sending:

a map of the content that indicates what potions of the content the client already has; and

the local IP address of the client.

6. The method of claim 1, further comprising:

receiving a request at the client from a secondary client to send the content to the secondary client; and

in response to the request, sending the content to the secondary client.

7. The method of claim 6, wherein the process of sending the content to the secondary client takes place while the content is being received by the client.

8. The method of claim 1, wherein the list of candidate servers is a subset of a complete list of candidate servers.

9. The method of claim 1, further comprising sending a second request to the directory server when the client has identified a non-responsive candidate server that did not respond with the content, the second request including the non-responsive candidate server.

10. The method of claim 1, wherein the list of candidate servers includes an origin server containing the original source for the content.

11. The method of claim 1, wherein if the content was not available from a candidate server in the list of candidate servers, the method further comprises waiting a set period of time before again trying to receive the content from the candidate server.

12. The method of claim 11, wherein the set period of time increases each time the client is unsuccessful in receiving the content from a candidate server in the list of candidate servers.

13. The method of claim 11, wherein if the content was not available from a candidate server in the list of candidate servers in a certain amount of time, the method further comprises removing the candidate server from the list of candidate servers.

14. The method of claim 11, wherein if a candidate server in the list of candidate servers does not meet certain performance criteria, the method further comprises removing the candidate server from the list of candidate servers.

15. A method for enabling the sending of content to a client in a distributed manner, comprising:

receiving a request from the client at a directory server, the request including a range set that identifies pieces of the content that have previously been received by the client;

sending a response to the client that includes a list of candidate servers that can potentially provide the content; and

adding the client to the list of candidate servers for the content so that the client can act as a server for the content for subsequent requests from other clients for the content.

16. The method of claim 15, wherein the list of candidate servers is sorted by network criteria, wherein network criteria for a given client can include:

an external IP address that is identical to the external IP address of the given client;

an autonomous system (AS) that is identical to or topologically close to the AS of the given client; and

an IP/20 network that is identical to the IP/20 network of the given client.

17. The method of claim 16, further comprising receiving border gateway protocol (BGP) information to facilitate sorting the list of candidate servers, so that candidate servers that are closest topologically to the client will appear higher in the list of candidate servers.

18. The method of claim 15, wherein receiving the request for the content from the client further involves:

receiving a map of the content that indicates what potions of the content the client already has;

receiving the local IP address of the client which the client explicitly included in the request; and

receiving the external IP address of the client.

19. The method of claim 15, wherein the list of candidate servers is a subset of a complete list of candidate servers.

20. The method of claim 15, wherein the list of candidate servers includes an origin server for the content.

21. The method of claim 15, wherein if a candidate server from the list of candidate servers is behind a firewall, the method further involves sending a request to the candidate server which causes the candidate server to initiate a communications session through the firewall with the client.

22. The method of claim 15, wherein if a candidate server from the list of candidate servers and the client are behind firewalls, the method further involves sending requests to the candidate server and the client which cause the candidate server and the client to simultaneously send messages to each other through their respective firewalls to initiate a communication session between the candidate server and the client.

23. The method of claim 15, further comprising collecting feedback from the client at a reporting server for the directory.

24. The method of claim 15, further comprising:

receiving a second request from the client, the second request including a list of non-responsive candidate servers that did not provide the requested content; and

sending a second response to the client, the second response including an updated list of candidate servers, the updated list of candidate servers generated by filtering out the list of non-responsive candidate servers.

25. A computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for receiving content at a client from one or more candidate servers, the method comprising:

sending a request to a directory server that stores information on where the content is possibly located, the request including a range set that identifies pieces of the content that have previously been received by the client;

in response to the request, receiving a response from the directory server that includes a list of candidate servers;

sending a request to at least one candidate server from the list of candidate servers for the content; and

receiving the content from at least one candidate server.

26. The computer-readable storage medium of claim 25, wherein receiving the content from at least one candidate server involves receiving portions of the content from multiple candidate servers and assembling the portions at the client.

27. The computer-readable storage medium of claim 25, wherein the method further comprises sending feedback to the directory server, wherein the feedback can include a map of the content which can indicate:

which portions of the content have been received by the client;

which portions of the content are currently being received by the client; and

which portions of the content that have not been received by the client.

28. The computer-readable storage medium of claim 25, wherein the method further comprises sending feedback to the directory server, wherein the feedback can include status information for candidate servers, which can indicate:

an availability of a given candidate server;

a performance indicator of the given candidate server; and

a trace of the path from the client to the given candidate server.

29. The computer-readable storage medium of claim 25, further comprising:

receiving a request for content from a secondary client, the process of sending the content to the secondary client takes place while the content is being received by the client; and

in response to the request, sending the content to the secondary client.

30. The computer-readable storage medium of claim 25, wherein the list of candidate servers is a subset of a complete list of candidate servers.

31. The computer-readable storage medium of claim 25, wherein the method further comprises sending a sending a second request to the directory server when the client has identified a non-responsive candidate server that did not respond with the content, the second request including the non-responsive candidate server.

32. The computer-readable storage medium of claim 25, wherein the list of candidate servers includes an origin server containing the original source for the content.

33. The computer-readable storage medium of claim 25, wherein if the content was not available from a candidate server in the list of candidate servers, the method further comprises waiting a set period of time before again trying to receive the content from the candidate server.

34. The computer-readable storage medium of claim 33, wherein the set period of time increases each time the client is unsuccessful in receiving the content from any candidate server in the list of candidate servers.

35. The computer-readable storage medium of claim 33, wherein if the content was not available from a candidate server in the list of candidate servers in a certain amount of time, the method further comprises removing the candidate server from the list of candidate servers.

36. The computer-readable storage medium of claim 33, wherein if a candidate server in the list of candidate servers does not meet certain performance criteria, the method further comprises removing the candidate server from the list of candidate servers.

37. A computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for enabling sending of content to a client in a distributed manner, comprising:

receiving a request from the client at a directory server, the request including a range set that identifies pieces of the content that have previously been received by the client;

sending a response to the client that includes a list of candidate servers that can potentially provide the content; and

adding the client to the list of candidate servers for the content so that the client can act as a server for the content for subsequent requests from other clients for the content.

38. The computer-readable storage medium of claim 37, wherein the list of candidate servers is sorted by network criteria, wherein network criteria for a given client can include:

an external IP address that is identical to the external IP address of the given client;

an autonomous system (AS) that is identical to or topologically close to the AS of the given client; and

an IP/20 network that is identical to the IP/20 network of the given client.

39. The computer-readable storage medium of claim 38, wherein the method further comprises receiving border gateway protocol (BGP) information to facilitate sorting the list of candidate servers, so that candidate servers that are closest topologically to the client will appear higher in the list of candidate servers.

40. The computer-readable storage medium of claim 37, further comprising:

receiving a second request from the client, the second request including a list of non-responsive candidate servers that did not provide the requested content; and

sending a second response to the client, the second response including an updated list of candidate servers, the updated list of candidate servers generated by filtering out the list of non-responsive candidate servers.

41. The computer-readable storage medium of claim 37, wherein the list of candidate servers is a subset of a complete list of candidate servers.

42. The computer-readable storage medium of claim 37, wherein the list of candidate servers includes an origin server for the content.

43. The computer-readable storage medium of claim 37, wherein if a candidate server from the list of candidate servers is behind a firewall, the method further involves sending a request to the candidate server which causes the candidate server to initiate a communications session through the firewall with the client.

44. The computer-readable storage medium of claim 37, wherein if a candidate server from the list of candidate servers and the client are behind firewalls, the method further involves sending requests to the candidate server and the client which cause the candidate server and the client to simultaneously send messages to each other through their respective firewalls to initiate a communication session between the candidate server and the client.

45. The computer-readable storage medium of claim 37, wherein the method further comprises collecting feedback from the client at a reporting server for the directory server.

46. An apparatus for receiving content at a client from one or more content servers, comprising:

a requesting mechanism configured to send a request to a directory server, the request including a range set that identifies pieces of the content that have previously been received by the client;

a receiving mechanism configured to receive a response from the directory server that includes a list of candidate servers that can potentially provide the content;

a secondary requesting mechanism configured to send a request to at least one candidate server from the list of candidate servers for the content; and

a secondary receiving mechanism configured to receive the content from at least one candidate server.

47. The apparatus of claim 46, wherein the secondary receiving mechanism is further configured to receive portions of the content from multiple candidate servers and assembling the portions at the client.

48. The apparatus of claim 46, further comprising a feedback mechanism that is configured to send feedback to the directory server, wherein the feedback can include a map of the content which can indicate:

which portions of the content have been received by the client;

which portions of the content are currently being received by the client; and

which portions of the content have not been received by the client.

49. The apparatus of claim 46, further comprising a feedback mechanism that is configured to send feedback to the directory server, wherein the feedback can include status information for candidate servers, which can indicate:

an availability of a given candidate server;

a performance indicator for the given candidate server; and

a trace of the path from the client to the given candidate server.

50. The apparatus of claim 46, wherein the requesting mechanism is further configured to send to the directory server along with the request for the content:

a map of the content that indicates what potions of the content the client already has; and

the local IP address of the client.

51. The apparatus of claim 46, further comprising:

a sharing mechanism configured to receive a request at the client from a secondary client to send the content to the secondary client; and

a server mechanism configured to send the content to the secondary client, while the content is being received by the client.

52. The apparatus of claim 46, wherein the list of candidate servers is a subset of a complete list of candidate servers.

53. The apparatus of claim 46, wherein the requesting mechanism is further configured to send a second request to the directory server when the client has identified a non-responsive candidate server that did not respond with the content, requesting an updated list of candidate servers, the second request including the non-responsive candidate server.

54. The apparatus of claim 46, wherein the list of candidate servers includes an origin server containing the original source for the content.

55. The apparatus of claim 46, wherein if the content was not available from a candidate server in the list of candidate servers, the requesting mechanism is further configured to wait a set period of time before again trying to receive the content from the candidate server.

56. The apparatus of claim 55, wherein the set period of time increases each time the client is unsuccessful in receiving the content from any candidate server in the list of candidate servers.

57. The apparatus of claim 55, wherein the requesting mechanism is further configured to remove the candidate server from the list of candidate servers if the content was not available from the candidate in a certain amount of time.

58. The apparatus of claim 55, wherein the requesting mechanism is further configured to remove the candidate server from the list of candidate servers if the candidate server does not meet certain performance criteria.

59. An apparatus for enabling sending of content to a client in a distributed manner, comprising:

a receiving mechanism to receive a request from the client, the request including a range set that identifies pieces of the content that have previously been received by the client;

a sending mechanism to send a response to the client that includes a list of candidate servers that can potentially provide the content; and

a directory mechanism to add the client to the list of candidate servers for the content so that the client can act as a server for the content for subsequent requests from other clients for the content.

60. The apparatus of claim 59, further comprising a sorting mechanism configured to sort the list of candidate servers by network criteria, wherein network criteria for a given client can include:

an external IP address that is identical to the external IP address of the given client;

an autonomous system (AS) that is identical to or topologically close to the AS of the given client; and

an IP/20 network that is identical to the IP/20 network of the given client.

61. The apparatus of claim 60, wherein the sorting mechanism is further configured to receive border gateway protocol (BGP) information to facilitate sorting the list of candidate servers, so that candidate servers that are closest topologically to the client will appear higher in the list of candidate servers.

62. The apparatus of claim 59, wherein the receiving mechanism is further configured to:

receive a map of the content that indicates what potions of the content the client already has;

receive the local IP address of the client which the client explicitly included in the request; and

receive the external IP address of the client.

63. The apparatus of claim 59, wherein the list of candidate servers is a subset of a complete list of candidate servers.

64. The apparatus of claim 59, wherein the list of candidate servers includes an origin server for the content.

65. The apparatus of claim 59, wherein if a candidate server from the list of candidate servers is behind a firewall, the sending mechanism is further configured to send a request to the candidate server which causes the candidate server to initiate a communications session through the firewall with the client.

66. The apparatus of claim 59, wherein if a candidate server from the list of candidate servers and the client are behind firewalls, the sending mechanism is further configured to send requests to the candidate server and the client which cause the candidate server and the client to simultaneously send messages to each other through their respective firewalls to initiate a communication session between the candidate server and the client.

67. The apparatus of claim 59, further comprising a logging server that is configured to collect the feedback from the client for the directory server.

68. The apparatus of claim 59, further comprising:

the receiving mechanism further to receive a second request from the client, the second request including a list of non-responsive candidate servers that did not provide the requested content; and

a sorting mechanism to generate an updated list of candidate servers by filtering out the list of non-responsive candidate servers.

69. A means for receiving content at a client from one or more candidate servers, comprising:

a sending means for sending a request for a list of candidate servers to a directory server, the request including a range set that identifies pieces of the content that have previously been received by the client;

a receiving means for receiving a response from the directory server that includes the list of candidate servers that can potentially provide the content;

a secondary sending means for sending a request to at least one candidate server from the list of candidate servers for the content; and

a secondary receiving means for receiving the content from at least one candidate server.

70. A means for enabling the sending of content to a client in a distributed manner, comprising:

a receiving means for receiving a request from the client at a directory server, the request including a range set that identifies pieces of the content that have previously been received by the client;

a sending means for sending a response to the client that includes a list of candidate servers that can potentially provide the content; and

an adding means for adding the client to the list of candidate servers for the content so that the client can act as a server for the content for subsequent requests from other clients for the content.