Locality based content distribution

• US 8,438,263 B2
• Filed: 09/13/2012
• Issued: 05/07/2013
• Est. Priority Date: 03/31/2008
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Sivasubramanian, Swaminathan, Richardson, David R., Marshall, Bradley E.
• Primary Examiner(s): Jacobs, Lashonda
• Application Number:
  US13/614,714
• Publication Number:
  US 20130007117A1
• Time in Patent Office: 236 Days
• Field of Search: 709/231, 709/223, 709/224, 709/229, 709/203, 709/217, 709/219
• US Class Current: 709/223
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1082 involving incentive schemes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/53 using third party service providers
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/562 Brokering proxy services

Abstract

A system and method for content distribution are provided. A content provider generates a network topology having one or more subnetworks made up of content sources. The content provider segments content, such as applications, into segments for distribution. The content provider then distributes the content such that for each identified subnetwork, each content segment is distributed to a content source. Subsequent, client computing device requests for content can be serviced by selecting a content source in a particular subnetwork selected for delivering the requested content to the client computing device to minimize traffic flow of the requested content through the nodes of the distribution network.

Claims

1. A system for managing content, the system comprising:

at least one computing device for receiving a request for content from a client computing device, wherein the at least one computing device is associated with a distribution network, wherein the distribution network includes a plurality of subnetworks, and wherein each subnetwork in the distribution network includes a source of the requested content within the subnetwork, the at least one computing device configured to;

identify a subnetwork in the distribution network for providing the requested content based on a network locality of the client computing device relative to subnetworks in the distribution network;

identify a content source in the identified subnetwork corresponding to a registered content provider for providing the requested content; and

provide identification information responsive to the request for content from the client computing device, wherein the identification information includes network address information of the identified content source.

2. The system as recited in claim 1, wherein the at least one computing device is further configured to distribute the requested content so that the requested content is distributed among one or more content sources in each subnetwork in the distribution network.

3. The system as recited in claim 2, wherein distributing the requested content comprises distributing the requested content to one or more content sources in each subnetwork.

4. The system as recited in claim 2, wherein distributing the requested content comprises distributing the requested content to each subnetwork that does not already have one or more content sources including the requested content.

5. The system as recited in claim 1, wherein the identification information further includes reconciliation information to be provided to the identified content source in the identified subnetwork.

6. The system as recited in claim 5, wherein the at least one computing device is further configured to obtain from the identified source a reconciliation request, wherein the reconciliation request includes reconciliation information received by the identified content source from client computing devices.

7. The system as recited in claim 6, wherein the at least one computing device is further configured to reconcile the reconciliation request from the identified content source.

8. A system for managing content at a content provider, the system comprising:

at least one computing device associated with a distribution network for receiving a request for content from a client computing device, wherein the distribution network includes a plurality of subnetworks, wherein each subnetwork corresponds to two or more logically grouped nodes within the distribution network, and wherein each subnetwork includes a source of the requested content within the subnetwork, the at least one computing device configured to;

determine a content source from a subnetwork for providing at least a portion of the requested content to the client computing device such that the determined content source will minimize distribution node traffic between one or more parent nodes to the client computing device and the content source; and

provide identification information identifying the determined content source for providing at least a portion of the requested content, wherein the identification information includes network address information corresponding to the determined content source.

9. The system as recited in claim 8, wherein determining a content source for providing at least a portion of the content includes identifying at least one peer computing device for providing at least a portion of the requested content.

10. The system as recited in claim 9, wherein the at least one computing device is further operable to:

obtain reconciliation requests from the peer computing device, wherein the reconciliation requests include reconciliation tokens received from client computing devices; and

reconcile the reconciliation requests from the peer computing devices.

11. The system as recited in claim 8, wherein the at least one computing device is further configured to distribute the requested content so that the content is distributed among one or more content sources in each subnetwork in the distribution network.

12. The system as recited in claim 11, wherein distributing the requested content comprises distributing the requested content to one or more content sources in each subnetwork.

13. The system as recited in claim 11, wherein distributing the requested content comprises distributing the requested content to each subnetwork that does not have already have one or more content sources including the requested content.

14. A method for managing content, the method comprising:

obtaining, at a computing device corresponding to a distribution network, a request for content from a client computing device, wherein the distribution network includes a plurality of subnetworks, and wherein each subnetwork in the distribution network includes a source of the requested content within the subnetwork;

identifying a subnetwork in the distribution network for providing the requested content based on a network locality of the client computing device relative to subnetworks in the distribution network;

identifying a content source in the identified subnetwork corresponding to a registered content provider for providing the requested content; and

providing identification information responsive to the request for content from the client computing device, wherein the identification information includes network address information of the identified content source.

15. The method as recited in claim 14 further comprising distributing the requested content so that the requested content is distributed among one or more content sources in each subnetwork in the distribution network.

16. The method as recited in claim 15, wherein distributing the requested content comprises distributing the requested content to one or more content sources in each subnetwork.

17. The method as recited in claim 15, wherein distributing the requested content comprises distributing the requested content to each subnetwork that does not already have one or more content sources including the requested content.

18. The method as recited in claim 14, wherein the identification information further includes reconciliation information to be provided to the identified content source in the identified subnetwork.

19. The method as recited in claim 18 further comprising obtaining from the identified source a reconciliation request, wherein the reconciliation request includes reconciliation information received by the identified content source from client computing devices.

20. The method as recited in claim 19 further comprising reconciling the reconciliation request from the identified content source.

21. A method for managing content, the method comprising:

obtaining, at a computing device corresponding to a distribution network, a request for content from a client computing device, wherein the distribution network includes a plurality of subnetworks, wherein each subnetwork corresponds to two or more logically grouped nodes within the distribution network, and wherein each subnetwork includes a source of the requested content within the subnetwork;

determining a content source from a subnetwork for providing at least a portion of the requested content to the client computing device such that the determined content source will minimize distribution node traffic between one or more parent nodes to the client computing device and the content source; and

providing identification information identifying the determined content source for providing at least a portion of the requested content, wherein the identification information includes network address information corresponding to the determined content source.

22. The method as recited in claim 21, wherein determining a content source for providing at least a portion of the content includes identifying at least one peer computing device for providing at least a portion of the requested content.

23. The method as recited in claim 22 further comprising:

obtaining reconciliation requests from the peer computing device, wherein the reconciliation requests includes reconciliation tokens received from client computing devices; and

reconciling the reconciliation requests from the peer computing devices.

24. The method as recited in claim 21 further comprising distributing the requested content so that the content is distributed among one or more content sources in each subnetwork in the distribution network.

25. The method as recited in claim 24, wherein distributing the requested content comprises distributing the requested content to one or more content sources in each subnetwork.

26. The method as recited in claim 24, wherein distributing the requested content comprises distributing the requested content to each subnetwork that does not have already have one or more content sources including the requested content.