Locality based content distribution

• US 9,009,286 B2
• Filed: 05/06/2013
• Issued: 04/14/2015
• Est. Priority Date: 03/31/2008
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Sivasubramanian, Swaminathan, Richardson, David R., Marshall, Bradley E.
• Primary Examiner(s): JACOBS, LASHONDA T
• Application Number:
  US13/888,283
• Publication Number:
  US 20130318153A1
• Time in Patent Office: 708 Days
• Field of Search: 709/223, 709/203, 709/217, 709/219, 709/224, 709/229
• US Class Current: 709/223
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1082 involving incentive schemes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/53 using third party service providers
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/562 Brokering proxy services

Abstract

A system and method for content distribution are provided. A content provider generates a network topology having one or more subnetworks made up of content sources. The content provider segments content, such as applications, into segments for distribution. The content provider then distributes the content such that for each identified subnetwork, each content segment is distributed to a content source. Subsequent, client computing device requests for content can be serviced by selecting a content source in a particular subnetwork selected for delivering the requested content to the client computing device to minimize traffic flow of the requested content through the nodes of the distribution network.

Claims

1. A system for managing content, the system comprising:

at least one computing device for receiving a request for content from a client computing device, wherein the at least one computing device is associated with a distribution network, wherein the distribution network includes a plurality of subnetworks, and wherein individual subnetworks in the distribution network include a source of the requested content within the subnetwork, the at least one computing device configured, responsive to the request for content from the client computing device, to;

identify a subnetwork in the distribution network for providing the requested content based on a network locality of the client computing device relative to subnetworks in the distribution network; and

provide identification information for the source of the requested content in the identified subnetwork.

2. The system as recited in claim 1, wherein the at least one computing device is further configured to distribute the requested content so that the requested content is distributed among one or more content sources in each subnetwork in the distribution network.

3. The system as recited in claim 2, wherein distributing the requested content comprises distributing the requested content to one or more content sources in each subnetwork.

4. The system as recited in claim 2, wherein distributing the requested content comprises distributing the requested content to each subnetwork that does not already have one or more content sources including the requested content.

5. The system as recited in claim 1, wherein the identification information includes network address information for the source of the requested content in the identified subnetwork.

6. The system as recited in claim 1, wherein the identification information includes reconciliation information to be provided to the source of the requested content in the identified subnetwork.

7. A system for managing content at a content provider, the system comprising:

at least one computing device associated with a distribution network for receiving a request for content from a client computing device, wherein the distribution network includes a plurality of subnetworks, wherein individual subnetworks correspond to two or more logically grouped nodes within the distribution network, and wherein individual subnetworks include a source of the requested content within the subnetwork, the at least one computing device configured to;

determine a content source from a subnetwork for providing at least a portion of the requested content to the client computing device such that the determined content source will minimize distribution node traffic between one or more parent nodes to the client computing device and the content source; and

responsive to the request for content from the client computing device, provide identification information identifying the determined content source for providing at least a portion of the requested content.

8. The system as recited in claim 7, wherein the identification information includes network address information corresponding to the determined content source.

9. The system as recited in claim 7, wherein determining a content source for providing at least a portion of the content includes identifying at least one peer computing device for providing at least a portion of the requested content.

10. The system as recited in claim 9, wherein the at least one computing device is further configured to:

obtain reconciliation requests from the peer computing device, wherein the reconciliation requests include reconciliation tokens received from client computing devices; and

reconcile the reconciliation requests from the peer computing devices.

11. A computer-implemented method for managing content, the method comprising:

obtaining, at a computing device corresponding to a distribution network, a request for content from a client computing device, wherein the distribution network includes a plurality of subnetworks, and wherein individual subnetworks in the distribution network include a source of the requested content within the subnetwork; and

responsive to the request for content from the client computing device;

identifying a subnetwork in the distribution network for providing the requested content based on a network locality of the client computing device relative to subnetworks in the distribution network; and

providing identification information for the source of the requested content in the identified subnetwork.

12. The method as recited in claim 11 further comprising distributing the requested content so that the requested content is distributed among one or more content sources in each subnetwork in the distribution network.

13. The method as recited in claim 12, wherein distributing the requested content comprises distributing the requested content to one or more content sources in each subnetwork.

14. The method as recited in claim 12, wherein distributing the requested content comprises distributing the requested content to each subnetwork that does not already have one or more content sources including the requested content.

15. The method as recited in claim 11, wherein the identification information includes network address information for the source of the requested content in the identified subnetwork.

16. The method as recited in claim 11, wherein the identification information includes reconciliation information to be provided to the source of the requested content in the identified subnetwork.

17. A computer-implemented method for managing content, the method comprising:

obtaining, at a computing device corresponding to a distribution network, a request for content from a client computing device, wherein the distribution network includes a plurality of subnetworks, wherein individual subnetworks correspond to two or more logically grouped nodes within the distribution network, and wherein individual subnetworks include a source of the requested content within the subnetwork;

determining a content source from a subnetwork for providing at least a portion of the requested content to the client computing device such that the determined content source will minimize distribution node traffic between one or more parent nodes to the client computing device and the content source; and

responsive to the request for content from the client computing device, providing identification information identifying the determined content source for providing at least a portion of the requested content.

18. The method as recited in claim 17, wherein the identification information includes network address information corresponding to the determined content source.

19. The method as recited in claim 17, wherein determining a content source for providing at least a portion of the content includes identifying at least one peer computing device for providing at least a portion of the requested content.

20. The method as recited in claim 19 further comprising:

obtaining reconciliation requests from the peer computing device, wherein the reconciliation requests includes reconciliation tokens received from client computing devices; and

reconciling the reconciliation requests from the peer computing devices.