Managing resources using resource expiration data

• US 8,543,702 B1
• Filed: 09/15/2012
• Issued: 09/24/2013
• Est. Priority Date: 06/16/2009
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Marshall, Bradley E., Sivasubramanian, Swaminathan, Richardson, David R.
• Primary Examiner(s): SALL, EL HADJI MALICK
• Application Number:
  US13/620,868
• Time in Patent Office: 374 Days
• Field of Search: 709/203, 709/226, 709/219, 711/122
• US Class Current: 709/226
• CPC Class Codes: G06F 12/0808 with cache invalidating means G06F12/0815 takes precedence
• CPC Class Codes: G06F 12/0811 with multilevel cache hierarchies
• CPC Class Codes: G06F 12/12 Replacement control
• CPC Class Codes: G06F 2212/163 Server or database system
• CPC Class Codes: G06F 2212/464 Multimedia object, e.g. image, video
• CPC Class Codes: H04L 67/2885 Hierarchically arranged intermediate devices, e.g. for hierarchical caching
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data

Abstract

Resource management techniques, such as cache optimization, are employed to organize resources within caches such that the most requested content (e.g., the most popular content) is more readily available. A service provider utilizes content expiration data as indicative of resource popularity. As resources are requested, the resources propagate through a cache server hierarchy associated with the service provider. More frequently requested resources are maintained at edge cache servers based on shorter expiration data that is reset with each repeated request. Less frequently requested resources are maintained at higher levels of a cache server hierarchy based on longer expiration data associated with cache servers higher on the hierarchy.

Claims

1. A computer implemented storage system, comprising:

a service provider that receives requests from a client computing device for a resource; and

a set of cache server components associated with the service provider, the set of cache server components having a first cache server component and a second cache server component, wherein the first cache server component and the second cache server component are hierarchically arranged such that the second cache server component corresponds to a level of a resource cache component hierarchy higher than the first cache server component;

the set of cache server components operative to;

upon receipt of a request for a resource at the first cache server component of the set of cache server components, store the resource at the first cache server component according to initial first expiration data and at the second cache server component according to initial second expiration data, the initial first expiration data less than the initial second expiration data;

upon expiration of the initial first expiration data, transmit a request for the resource from the first cache server component to the second cache server component; and

associate updated first expiration data based on at least one of a total number of requests for the resource transmitted by the first cache server component to the second cache server component and time elapsed from the receipt of the transmission of the request from the first cache server component,

wherein the updated first expiration data is based on the relationship of the first cache server component relative to other cache server components in the resource cache component hierarchy, and

wherein associating the updated first expiration data comprises assigning shorter expiration data of the resource at the first cache server component than at cache server components at successively higher levels of the resource cache component hierarchy.

2. The computer implemented storage system of claim 1, wherein the initial first and second expiration data correspond to a specification of time.

3. The computer implemented storage system of claim 1, wherein the updated first expiration data corresponds to an increase in the expiration data.

4. The computer implemented storage system of claim 1, wherein the updated first expiration data corresponds to a decrease in the expiration data.

5. The computer implemented storage system of claim 1, wherein the updated first expiration data corresponds to a modification of the expiration data within a range of values.

6. The computer implemented storage system of claim 5, wherein the range of values corresponds to the level of the resource cache component hierarchy associated with the first resource cache component.

7. The computer implemented storage system of claim 1, wherein the service provider is a content delivery network service provider.

8. The computer implemented storage system of claim 6, wherein the range of values is shorter at the lowest levels of the resource cache component hierarchy.

9. A computer implemented method for managing resources, comprising:

as implemented by one or more computing devices configured with specific executable instructions,

receiving a request from a client computing device for a resource; and

upon receipt of the request for the resource at a first cache server component of a set of cache server components, storing the resource at the first cache server component according to initial first expiration data and at a second cache server component of the set of cache server components according to initial second expiration data, wherein the first cache server component and second cache server components are hierarchically arranged such that the second cache server component corresponds to a level of a resource cache component hierarchy higher than the first cache server component and wherein the initial first expiration data less than the initial second expiration data;

upon expiration of the initial first expiration data, transmitting a request for the resource from the first cache server component to the second cache server component; and

associating updated first expiration data based on at least one of a total number of requests for the resource transmitted by the first cache server component to the second cache server component and time elapsed from the receipt of the transmission of the request from the first cache server component,

wherein the updated first expiration data is based on the relationship of the first cache server component relative to other cache server components in the resource cache component hierarchy, and

wherein associating the updated first expiration data comprises assigning shorter expiration data of the resource at the first cache server component than at cache server components at successively higher levels of the resource cache component hierarchy.

10. The computer implemented method of claim 9, wherein the initial first and second expiration data correspond to a specification of time.

11. The computer implemented method of claim 9, wherein the updated first expiration data corresponds to an increase in the expiration data.

12. The computer implemented method of claim 9, wherein the updated first expiration data corresponds to a decrease in the expiration data.

13. The computer implemented method of claim 9, wherein the updated first expiration data corresponds to a modification of the expiration data within a range of values.

14. The computer implemented method of claim 13, wherein the range of values corresponds to the level of the resource cache component hierarchy associated with the first cache server component.

15. The computer implemented method of claim 9, wherein the service provider is a content delivery network service provider.

16. The computer implemented method of claim 14, wherein the range of values is shorter at the lowest levels of the resource cache component hierarchy.