Locality based content distribution

• US 9,332,078 B2
• Filed: 03/05/2015
• Issued: 05/03/2016
• Est. Priority Date: 03/31/2008
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Sivasubramanian, Swaminathan, Richardson, David R., Marshall, Bradley Eugene
• Primary Examiner(s): Jacobs, Lashonda
• Application Number:
  US14/639,933
• Publication Number:
  US 20150180988A1
• Time in Patent Office: 425 Days
• Field of Search: 709/223, 709/203, 709/217, 709/219, 709/224, 709/229
• US Class Current: 1/1
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1082 involving incentive schemes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/53 using third party service providers
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/562 Brokering proxy services

Abstract

A system and method for content distribution are provided. A content provider generates a network topology having one or more subnetworks made up of content sources. The content provider segments content, such as applications, into segments for distribution. The content provider then distributes the content such that for each identified subnetwork, each content segment is distributed to a content source. Subsequent, client computing device requests for content can be serviced by selecting a content source in a particular subnetwork selected for delivering the requested content to the client computing device to minimize traffic flow of the requested content through the nodes of the distribution network.

Claims

1. A computer-implemented method comprising:

associating, by a content provider, content into a set of content segments;

associating a distribution network into a set of subnetworks, wherein each subnetwork includes one or more content sources;

obtaining, by the content provider, registration requests from third party computing devices;

associating the third party computing devices as registered content providers;

identifying a subnetwork in the distribution network corresponding to each registered content provider;

identifying, by the content provider, content previously downloaded by the third party content providers; and

distributing the content so that the set of content segments is hosted by the one or more content sources in each subnetwork in the distribution network.

2. The method as recited in claim 1 further comprising:

obtaining a request for the content from a client computing device;

identifying a subnetwork in the distribution network for providing the requested content based on a network locality of the client computing device relative to subnetworks in the distribution network;

for each content segment in the set of content segments, identifying at least one or more content sources in the identified subnetwork corresponding to a registered content provider for providing the content segment; and

providing identification information responsive to the request for the content from the client computing device, wherein the identification information includes, for each content segment, network addresses of the identified registered content provider.

3. The method as recited in claim 1, wherein the distribution network includes two or more levels defined by nodes in the network and wherein associating a distribution network into a set of subnetworks includes:

identifying a node in the distribution network as a parent node;

identifying all children registered content providers to the parent node; and

defining the subnetwork to include all the identified children registered content providers.

4. The method as recited in claim 3, wherein at least one level in the distribution network corresponds to a datacenter.

5. The method as recited in claim 3, wherein the nodes correspond to a network router and wherein identifying a subnetwork in the distribution network for providing the requested content includes identifying a subnetwork such that content responsive to content requests between the client computing device and a content source does not pass through the network router more than one time.

6. The method as recited in claim 1, wherein the set of content segments corresponds to equal sized content segments.

7. The method as recited in claim 1, wherein the set of content segments corresponds to varied sized content segments.

8. The method as recited in claim 1, wherein the set of network addresses is prioritized in an order of a preferred provider of the requested content segment.

9. A system comprising:

at least one computing device configured to;

associate, by a content provider, content into a set of content segments;

associate a distribution network into a set of subnetworks, wherein each subnetwork includes one or more content sources;

obtain, by the content provider, registration requests from third party computing devices;

associate the third party computing devices as registered content providers;

identify a subnetwork in the distribution network corresponding to each registered content provider;

identify, by the content provider, content previously downloaded by the third party content providers; and

distribute the content so that the set of content segments is hosted by the one or more content sources in each subnetwork in the distribution network.

10. The system as recited in claim 9, wherein the at least one computing device is further configured to:

obtain a request for the content from a client computing device;

identify a subnetwork in the distribution network for providing the requested content based on a network locality of the client computing device relative to subnetworks in the distribution network;

for each content segment in the set of content segments, identify at least one or more content sources in the identified subnetwork corresponding to a registered content provider for providing the content segment; and

provide identification information responsive to the request for the content from the client computing device, wherein the identification information includes, for each content segment, network addresses of the identified registered content provider.

11. The system as recited in claim 9, wherein the distribution network includes two or more levels defined by nodes in the network and wherein associating a distribution network into a set of subnetworks includes:

identifying a node in the distribution network as a parent node;

identifying all children registered content providers to the parent node; and

defining the subnetwork to include all the identified children registered content providers.

12. The system as recited in claim 11, wherein at least one level in the distribution network corresponds to a datacenter.

13. The system as recited in claim 11, wherein the nodes correspond to a network router and wherein identifying a subnetwork in the distribution network for providing the requested content includes identifying a subnetwork such that content responsive to content requests between the client computing device and a content source does not pass through the network router more than one time.

14. The system as recited in claim 9, wherein the set of content segments corresponds to equal sized content segments.

15. The system as recited in claim 9, wherein the set of content segments corresponds to varied sized content segments.

16. The system as recited in claim 9, wherein the set of network addresses is prioritized in an order of a preferred provider of the requested content segment.

17. A non-transitory computer readable storage medium storing computer executable instructions that when executed by a processor perform operations comprising:

associating, by a content provider, content into a set of content segments;

associating a distribution network into a set of subnetworks, wherein each subnetwork includes one or more content sources;

obtaining, by the content provider, registration requests from third party computing devices;

associating the third party computing devices as registered content providers;

identifying a subnetwork in the distribution network corresponding to each registered content provider;

identifying, by the content provider, content previously downloaded by the third party content providers; and

distributing the content so that the set of content segments is hosted by the one or more content sources in each subnetwork in the distribution network.

18. The non-transitory computer readable storage medium as recited in claim 17, wherein the operations further comprise:

obtaining a request for the content from a client computing device;

identifying a subnetwork in the distribution network for providing the requested content based on a network locality of the client computing device relative to subnetworks in the distribution network;

for each content segment in the set of content segments, identifying at least one or more content sources in the identified subnetwork corresponding to a registered content provider for providing the content segment; and

providing identification information responsive to the request for the content from the client computing device, wherein the identification information includes, for each content segment, network addresses of the identified registered content provider.

19. The non-transitory computer readable storage medium as recited in claim 17, wherein the distribution network includes two or more levels defined by nodes in the network and wherein associating a distribution network into a set of subnetworks includes:

identifying a node in the distribution network as a parent node;

identifying all children registered content providers to the parent node; and

defining the subnetwork to include all the identified children registered content providers.

20. The non-transitory computer readable storage medium as recited in claim 19, wherein at least one level in the distribution network corresponds to a datacenter.

21. The non-transitory computer readable storage medium as recited in claim 19, wherein the nodes correspond to a network router and wherein identifying a subnetwork in the distribution network for providing the requested content includes identifying a subnetwork such that content responsive to content requests between the client computing device and a content source does not pass through the network router more than one time.