Automatic migration of data via a distributed computer network

• US 7,930,402 B2
• Filed: 07/25/2008
• Issued: 04/19/2011
• Est. Priority Date: 04/30/2003
• Status: Active Grant

• Current Assignee: Akamai Technologies, Inc.
• Original Assignee: Akamai Technologies, Inc.
• Inventors: Chavarkar, Amol D., Cinquini, Maurice, Agarwal, Anshu, Swildens, Eric Sven-Johan
• Primary Examiner(s): VU, VIET DUY
• Application Number:
  US12/180,064
• Publication Number:
  US 20080281946A1
• Time in Patent Office: 998 Days
• Field of Search: 709/201, 709/202, 709/203, 709/217, 709/219, 709/223, 709/225, 709/226
• US Class Current: 709/226
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1038 Load balancing arrangements to avoid a single path through a load balancer
• CPC Class Codes: H04L 67/53 using third party service providers
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A method and apparatus for the automatic migration of data via a distributed computer network allows a customer to select content files that are to be transferred to a group of edge servers. Origin sites store all of a customer'"'"'s available content files. An edge server maintains a dynamic number of popular files in its memory for the customer. The files are ranked from most popular to least popular and when a file has been requested from an edge server a sufficient number of times to become more popular than the lowest popular stored file, the file is obtained from an origin site. The edge servers are grouped into two service levels: regional and global. The customer is charged a higher fee to store its popular files on the global edge servers compared to a regional set of edge servers because of greater coverage.

Claims

1. A method implemented by a service provider on behalf of one or more content provider customers, comprising:

providing a plurality of edge servers from which end users obtain content provider content files;

providing a plurality of storage servers that store at least one content library associated with a content provider customer;

in association with a first location, locating at least a first storage server of the plurality of storage servers in association with at least a first edge server of the plurality of edge servers so that one or more content provider content files may be exchanged within the first location between the first storage server and the first edge server without those content provider content files having to traverse a wide area network (WAN);

in association with a second location distinct from the first location, and wherein the first and second locations are connected to one another over the WAN, locating at least a second storage server of the plurality of storage servers in association with at least a second edge server of the plurality of edge servers so that one or more content provider content files may be exchanged within the second location between the second storage server and the second edge server without those content provider content files having to traverse the WAN;

wherein a content provider customer'"'"'s most frequently-requested content files are cached and served from the plurality of edge servers while the content provider customer'"'"'s less frequently-requested content files are stored on the plurality of storage servers;

tracking popularity of a given content provider content file on at least one edge server; and

providing the content provider customer with at least one report identifying relative popularity of content provider content files in the content library.

2. The method as described in claim 1 wherein the first storage server is connected to the first edge server over a local area network (LAN).

3. The method as described in claim 2 wherein a given content provider content file is transferred from the first storage server to the first edge server as popularity of the given content provider content file increases.

4. The method as described in claim 1 wherein the content provider customer is charged a fee for storage and delivery of content in the content library.

5. The method as described in claim 1 wherein an end user is directed to a given edge server using a domain name server.

6. The method as described in claim 1 further including collecting data from the edge servers identifying relative popularity of content provider content files.

7. A method implemented by a service provider on behalf of one or more content provider customers, comprising:

providing a plurality of edge servers from which end users obtain content provider content files;

providing a plurality of storage servers that store at least one content library associated with a content provider customer;

in association with a location, locating a given storage server of the plurality of storage servers in association with at least a given edge server of the plurality of edge servers so that one or more content provider content files may be exchanged between the given storage server and the given edge server within the location over a local dedicated communications channel;

wherein a content provider customer'"'"'s most frequently-requested content files are cached and served from the plurality of edge servers while the content provider customer'"'"'s less frequently-requested content files are stored on the plurality of storage servers;

tracking popularity of a given content provider content file on at least one edge server;

providing the content provider customer with a report identifying relative popularity of content files in the content library; and

charging the content provider customer a given fee.

8. The method as described in claim 7 wherein the given storage server is intermediate the given edge server and a server associated with the content provider customer.

9. The method as described in claim 7 wherein a given content provider content file is transferred over the local dedicated communications channel from the given storage server to the given edge server as popularity of the given content provider content file, as measured by a number of requests received at one or more edge servers, increases.