System and method for selectively caching hot content in a content distribution network

• US 9,787,790 B2
• Filed: 08/23/2016
• Issued: 10/10/2017
• Est. Priority Date: 11/13/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Reeser, Paul K.
• Primary Examiner(s): Bayard, Djenane
• Application Number:
  US15/244,540
• Publication Number:
  US 20160359995A1
• Time in Patent Office: 413 Days
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data
• CPC Class Codes: H04L 69/28 Timers or timing mechanisms used in protocols

Abstract

A method includes altering a request interval threshold when a cache-hit ratio falling below a target, receiving a request for content, providing the content when the content is in the cache, when the content is not in the cache and the time since a previous request for the content is less than the request interval threshold, retrieving and storing the content, and providing the content to the client, when the elapsed time is greater than the request interval threshold, and when another elapsed time since another previous request for the content is less than another request interval threshold, retrieving and storing the content, and providing the content to the client, and when the other elapsed time is greater than the other request interval threshold, rerouting the request to the content server without caching the content.

Claims

1. A system, comprising:

a memory that stores instructions;

a processor that executes the instructions to perform operations, the operations comprising;

determining, in response to a request for content, if content is in a cache and if a first elapsed time since a first previous request for the content is less than a first threshold;

determining a second threshold based on the content requested and based on the cache;

if the content is determined to not be in the cache, the first elapsed time is greater than or equal to the first threshold, and a second elapsed time since a second previous request for the content is less than the second threshold;

retrieving the content;

storing the content in the cache; and

providing the content to a client associated with the request for the content; and

if the content is determined to not be in the cache and the second elapsed time since the second previous request for the content is greater than the second threshold;

retrieving the content for the client without caching the content.

2. The system of claim 1, wherein, if the content is determined to not be in the cache and if the first elapsed time is less than the first threshold, the operations further comprise:

retrieving the content;

storing the content in the cache; and

providing the content to the client.

3. The system of claim 1, wherein the operations further comprise storing the first elapsed time in a table indexed by a content identifier.

4. The system of claim 1, wherein the operations further comprise receiving the request for the content from the client.

5. The system of claim 1, wherein the operations further comprise providing the content to the client if the content is determined to be in the cache.

6. The system of claim 1, wherein the operations further comprise altering the first threshold in response to a change in a cache-hit-ratio of the cache.

7. The system of claim 1, wherein the operations further comprise causing the first and second thresholds to be system-wide parameters for additional caches.

8. The system of claim 1, wherein the operations further comprise applying multiple threshold values to different subsets of caches.

9. The system of claim 1, wherein the operations further comprise classifying the content as hot content if the content is determined to not be in the cache and if the first elapsed time is less than the first threshold.

10. The system of claim 1, wherein the operations further comprise determining a cache-hit-ratio for the cache.

11. The system of claim 10, wherein the operations further comprise determining the cache-hit-ratio by determining a number of times the content is served from the cache as compared with a number of requests received for the content.

12. The system of claim 1, wherein the operations further comprise monitoring a cache-hit-ratio of the cache to determine if the cache-hit-ratio drops below a target cache-hit-ratio.

13. A method, comprising:

determining, in response to a request for content, if content is in a cache and if a first elapsed time since a first previous request for the content is less than a first threshold, wherein the determining is performed by utilizing instructions from a memory that are executed by a processor;

determining a second threshold based on the content requested and based on the cache;

if the content is determined to not be in the cache, the first elapsed time is greater than or equal to the first threshold, and a second elapsed time since a second previous request for the content is less than the second threshold;

retrieving the content;

storing the content in the cache; and

providing the content to a client associated with the request for the content; and

if the content is determined to not be in the cache and the second elapsed time since the second previous request for the content is greater than the second threshold;

retrieving the content for the client without caching the content.

14. The method of claim 13, further comprising classifying the content as hot content if the content is determined to not be in the cache and if the first elapsed time is less than the first threshold.

15. The method of claim 13, further comprising causing the first and second thresholds to be system-wide parameters for the cache and for additional caches.

16. The method of claim 13, further comprising determining the cache-hit-ratio by determining a number of times the content is served from the cache as compared with a number of requests received for the content.

17. The method of claim 13, further comprising applying multiple threshold values to different subsets of caches.

18. The method of claim 13, further comprising altering the second threshold in response to a change in a cache-hit-ratio of the cache.

19. The method of claim 13, further comprising providing the content to the client if the content is determined to be in the cache.

20. A computer-readable device comprising instructions, which when loaded and executed by a processor, cause the processor to perform operations comprising:

determining, in response to a request for content, if content is in a cache and if a first elapsed time since a first previous request for the content is less than a first threshold, wherein the determining is performed by utilizing instructions from a memory that are executed by a processor;

calculating a second threshold based on the content requested and based on the cache;

if the content is determined to not be in the cache, the first elapsed time is greater than or equal to the first threshold, and a second elapsed time since a second previous request for the content is less than the second threshold;

obtaining the content;

storing the content in the cache; and

transmitting the content to a client associated with the request for the content; and

if the content is determined to not be in the cache and the second elapsed time since the second previous request for the content is greater than the second threshold;

retrieving the content for the client without caching the content.