Managing tracking information entries in resource cache components

• US 8,412,823 B1
• Filed: 03/27/2009
• Issued: 04/02/2013
• Est. Priority Date: 03/27/2009
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Richardson, David R., Marshall, Bradley E., Sivasubramanian, Swaminathan
• Primary Examiner(s): Harrell, Robert B
• Application Number:
  US12/412,443
• Time in Patent Office: 1,467 Days
• Field of Search: 709/225, 709/230
• US Class Current: 709/225
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data

Abstract

A system, method, and computer readable medium for managing resources maintained in resource cache components are provided. A network storage provider storing one or more resources on behalf of a content provider obtains client computing device requests for content. The network storage provider provides resources that are received and maintained on resource cache components. The network storage provider either processes requests or provides notifications to the resource cache components to facilitate the management of resources that need to be updated or are otherwise treated as invalid.

Claims

1. A computer-implemented method for managing resources comprising:

obtaining a request for a resource from a requesting computing device;

determining the requested resource is not available;

transmitting a request for the resource to an identified source;

obtaining the requested resource from the identified source;

causing the storage of the requested resource;

associating the requested resource with an entry in tracking information, the entry identifying the requested resource;

prior to termination of an expiration criteria associated with the requested resource, determining the entry in the tracking information associated with the requested resource is invalid based on at least one of processing consistency check information received from an origin source responsive to a request thereto or processing tracking information entry invalidity information from the origin source responsive to a request thereto;

determining a stored resource is not valid based on the invalid entry in the tracking information; and

processing the determined not valid resource;

wherein the method is implemented on one or more computing devices of a content delivery service provider that at least one of hosts or processes content on behalf of the origin source.

2. The method as recited in claim 1, wherein the tracking information corresponds to an inode data structure.

3. The method as recited in claim 2, wherein the entries in the inode data structure are arranged in a tree structure.

4. The method as recited in claim 3, wherein the tracking information entry invalidity information corresponds to update information.

5. The method as recited in claim 4, wherein processing the tracking information invalidation information includes:

obtaining the update information from the origin source; and

identifying invalid entries in the tracking information based on the update information.

6. The method as recited in claim 1 further comprising:

associating expiration criteria with the entry in the tracking information corresponding to the resource; and

determining satisfaction of the expiration criteria.

7. The method as recited in claim 6 further comprising

transmitting a consistency check request to the origin source associated with the resource based on the determined satisfaction of the expiration criteria.

8. The method as recited in claim 1 further comprising transmitting invalid entry notification to at least one additional cache server component of the content delivery service provider, the at least one cache server component identified in the tracking information.

9. The method as recited in claim 1, wherein processing the determined not valid resource includes identifying the resource as unavailable for distribution.

10. The method as recited in claim 1, wherein processing the determined not valid resource includes transmitting a request to the origin source for an updated resource.

11. A computer-implemented method for managing resources comprising:

associating requested resources with entries in tracking information, the entries identifying the requested resources;

determining one or more entries in the tracking information is invalid prior to termination of expiration criteria associated with the one or more resources corresponding to the one or more entries, wherein the determination is based on processing information identifying invalid tracking information entries received from at least one of an origin source or a third party source;

determining at least one stored resource is not valid based on the one or more invalid entries in the tracking information;

processing the determined not valid resource; and

transmitting a notification to one or more resource cache components, the notification identifying at least one of an invalid tracking information entry or an invalid resource,

wherein the method is implemented on one or more computing devices of a content delivery service provider that hosts or processes content on behalf of the origin source.

12. The method as recited in claim 11, wherein the tracking information corresponds to an inode data structure.

13. The method as recited in claim 12, wherein the entries in the inode data structure are arranged in a tree structure.

14. The method as recited in claim 13, wherein the tracking information entry invalidity information corresponds to update information.

15. The method as recited in claim 14, wherein processing the tracking information invalidation information includes:

obtaining the update information from the origin source; and

identifying invalid entries in the tracking information based on the update information.

16. The method as recited in claim 11 further comprising obtaining the processing information identifying invalid tracking information from the origin source.

17. The method as recited in claim 11 further comprising obtaining the processing information identifying invalid tracking information from the third party source.

18. A computer-implemented method for managing resources comprising:

associating requested resources with entries in tracking information, the entries identifying the requested resources;

determining one or more entries in the tracking information are invalid prior to termination of expiration criteria associated with the one or more resources corresponding to the one or more entries, wherein the determination is based on processing consistency check information received from an origin source;

determining at least one stored resource is not valid based on the one or more invalid entries in the tracking information; and

processing the determined not valid resource; and

transmitting a notification to one or more resource cache components, the notification identifying at least one of an invalid tracking information entry or an invalid resource,

wherein the method is implemented on one or more computing devices of a content delivery service provider that hosts or processes content on behalf of the origin source.

19. The method as recited in claim 18, wherein the tracking information corresponds to an inode data structure.

20. The method as recited in claim 19 further comprising:

associating the expiration criteria with entries in the tracking information; and

determining satisfaction of the expiration criteria.

21. The method as recited in claim 20 further comprising:

transmitting a consistency check request to the origin source associated with the resource.

22. The method as recited in claim 19, wherein the entries in the Mode data structure are arranged in a tree structure.

23. A system for managing content requests comprising:

a storage service including one or more storage service providers for maintaining resources via a communication network;

a content delivery service provider having one or more points of presence on the communication network, wherein the content delivery service provider is different from the one or more storage service providers, each of the points of presence of the content delivery service provider including;

one or more data stores for maintaining resources obtained from the storage service;

tracking information including entries corresponding to resources maintained in the one or more data stores of the point of presence of the content delivery service provider; and

a resource management component operative to;

associate resources obtained from the storage service with an entry in the tracking information;

determine an entry in the tracking information is invalid prior to termination of an expiration criteria associated with the resource corresponding to the entry, wherein the determination is based on at least one of processing consistency check information provided by one of the one or more storage service providers and receipt of information from one of the one or more storage service providers identifying invalid tracking information entries;

process the resource corresponding to the entry in the tracking information; and

transmit notification regarding the invalid entry to at least one additional point of presence of the content delivery service provider.

24. The system as recited in claim 23, wherein the tracking information corresponds to an inode data structure.

25. The system as recited in claim 24, wherein the entries in the inode data structure are arranged in a tree structure.

26. The system as recited in claim 25, wherein the resource management component determines an invalid entry by receipt of update information corresponding to the tree structure.

27. The system as recited in claim 23, wherein the resource management component is further operative to:

associate expiration criteria associated with each resource obtained from the storage service with each corresponding entry in the tracking information; and

determine satisfaction of the expiration criteria associated with at least one entry in the tracking information.

28. The system as recited in claim 27, wherein, responsive to a determination that the expiration criteria has not been met, the resource management component is further operative to:

transmit a consistency check request to one of the one or more storage service providers of the storage service; and

process responsive consistency check information to determine whether entries in the tracking information are invalid.

29. The system as recited in claim 23, wherein the resource management component is further operative to request an updated resource from the one or more storage service providers based on the determination of invalid tracking information entries.

30. A system for managing content requests comprising:

one or more data stores for maintaining resources obtained from an origin source;

tracking information including entries corresponding to resources maintained in the one or more data stores; and

at least one processor executing instructions corresponding to a resource management component, wherein the at least one processor corresponds to a content delivery service provider operable to at least one of host or process content on behalf of the origin source, the resource management component operative to;

associate resources obtained from the origin source with entries in the tracking information;

determine whether entries in the tracking information are invalid prior to termination of expiration criteria associated with the resources corresponding to the entries, wherein the determination is based on at least one of processing of consistency check information received from the origin source or a third party component responsive to a request thereto and receipt of information from the origin source identifying invalid tracking information entries; and

process the resource corresponding to the entry in the tracking information.

31. The system as recited in claim 30, wherein the tracking information corresponds to an inode data structure.

32. The system as recited in claim 31, wherein the entries in the inode data structure are arranged in a tree structure.

33. The system as recited in claim 30, wherein the resource management component is further operative to:

transmit a consistency check request to the origin source based on satisfaction of expiration criteria; and

process responsive consistency check information to determine whether entries in the tracking information are invalid.

34. The system as recited in claim 30, wherein the resource management component is further operative to request an updated resource based on the determination of invalid tracking information entries.