Cache optimization

• US 10,157,135 B2
• Filed: 10/19/2015
• Issued: 12/18/2018
• Est. Priority Date: 03/31/2008
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Richardson, David R., Scofield, Christopher L.
• Primary Examiner(s): Dudek, Jr., Edward J
• Application Number:
  US14/886,937
• Publication Number:
  US 20160041910A1
• Time in Patent Office: 1,156 Days
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0833 in combination with broadcast means (e.g. for invalidation or updating)
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 12/128 adapted to multidimensional cache systems, e.g. set-associative, multicache, multiset or multilevel
• CPC Class Codes: G06F 2212/62 Details of cache specific to multiprocessor cache arrangements
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

A system and method for management and processing of resource requests at cache server computing devices is provided. Cache server computing devices segment content into an initialization fragment for storage in memory and one or more remaining fragments for storage in a media having higher latency than the memory. Upon receipt of a request for the content, a cache server computing device transmits the initialization fragment from the memory, retrieves the one or more remaining fragments, and transmits the one or more remaining fragments without retaining the one or more remaining fragments in the memory for subsequent processing.

Claims

1. A computer-implemented method comprising:

receiving, at a cache component, an object for storage;

segmenting the object into an initialization fragment for storage in memory and two or more remaining fragments for storage in a media having higher latency than the memory, wherein the segmenting of the object into the initialization fragment and each of the two or more remaining fragments is performed based at least in part on one or more of a fragment retrieval latency, cost, or service criterion;

receiving a request for the object at a cache component;

causing transmission of the initialization fragment from the memory;

retrieving the two or more remaining fragments from the media having higher latency than the memory; and

causing transmission of the two or more remaining fragments without retaining the two or more remaining fragments in the memory.

2. The computer-implemented method of claim 1, wherein segmenting the object comprises segmenting the object by the cache component.

3. The computer-implemented method of claim 1 further comprising:

determining a file size for the initialization fragment; and

if a determination is made that the file size of the initialization fragment should be updated, replacing the initialization fragment in the memory by a new initialization fragment of the determined file size.

4. The computer-implemented method of claim 3, wherein determining if the file size of the initialization fragment should be updated is based on a determination of latency associated with retrieval of the two or more remaining fragments.

5. The computer-implemented method of claim 1 further comprising:

determining a file size for the initialization fragment; and

if a determination is made that the file size of the initialization fragment should be updated, separately storing an incremental fragment in the memory to supplement the initialization fragment, wherein a total size of the incremental fragment and the initialization fragment together corresponds to the determined file size.

6. The computer-implemented method of claim 5, wherein determining if the file size of the initialization fragment should be updated is based on a determination of latency associated with retrieval of the two or more remaining fragments.

7. The computer-implemented method of claim 5, wherein determining if the file size of the initialization fragment should be updated is based on a frequency of a request for the object, such that a change in the size of the incremental fragment is based on a change in request frequency.

8. The computer-implemented method of claim 1, wherein the size of the initialization fragment is based on a latency associated with retrieval of the two or more remaining fragments.

9. The computer-implemented method of claim 1, wherein the size of the initialization fragment is based on a frequency of a request for the object.

10. A system comprising:

a memory for storing initialization fragments of objects; and

one or more computing devices configured with specific executable instructions and operative to;

receive an object for storage;

segment the object into an initialization fragment for storage in the memory and two or more remaining fragments for storage in a media having higher latency than the memory, wherein the segmenting of the object into the initialization fragment and each of the two or more remaining fragments is performed based at least in part on one or more of a fragment retrieval latency, cost, or service criterion;

receive a request for the object;

cause transmission of the initialization fragment from the memory;

retrieve the two or more remaining fragments from the media having higher latency than the memory; and

cause transmission of the two or more remaining fragments without retaining the two or more remaining fragments in the memory.

11. The system of claim 10, wherein the one or more computing devices comprise a cache component.

12. The system of claim 10, wherein the one or more computing devices are further operative to:

determine a file size for the initialization fragment; and

if a determination is made that the file size of the initialization fragment should be updated, replace the initialization fragment in the memory by a new initialization fragment of the determined file size.

13. The system of claim 12, wherein determining if the file size of the initialization fragment should be updated is based on a determination of latency associated with retrieval of the two or more remaining fragments.

14. The system of claim 10, wherein the one or more computing devices are further operative to:

determine a file size for the initialization fragment; and

if a determination is made that the file size of the initialization fragment should be updated, separately store an incremental fragment in the memory to supplement the initialization fragment, wherein a total size of the incremental fragment and the initialization fragment together corresponds to the determined file size.

15. The system of claim 14, wherein determining if the file size of the initialization fragment should be updated is based on a determination of latency associated with retrieval of the two or more remaining fragments.

16. The system of claim 14, wherein determining if the file size of the initialization fragment should be updated is based on a frequency of a request for the object, such that a change in the size of the incremental fragment is based on a change in request frequency.

17. The system of claim 10, wherein the size of the initialization fragment is based on a latency associated with retrieval of the two or more remaining fragments.

18. The system of claim 10, wherein the size of the initialization fragment is based on a frequency of a request for the object.