Edge caching using HTTP headers

• US 9,055,118 B2
• Filed: 07/13/2012
• Issued: 06/09/2015
• Est. Priority Date: 07/13/2012
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lobo, Alwyn R., Nadgir, Devaprasad K., Shenvi Kuncolienkar, Shirish T.
• Primary Examiner(s): Gillis, Brian J
• Assistant Examiner(s): GRIJALVA LOBOS, BORIS D
• Application Number:
  US13/548,584
• Publication Number:
  US 20140019576A1
• Time in Patent Office: 1,061 Days
• Field of Search: 709/201, 709/212, 709/213, 709217-219, 709/248, 709/249, 709/203, 709/226, 709/228, 709/229
• US Class Current: 1/1
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 67/5681 Pre-fetching or pre-delivering data based on network characteristics

Abstract

Disclosed is a program for pre-fetching resources. A computer, communicatively coupled to a plurality of client computers and a server computer, identifies a resource, through an examination of one or more HTTP server logs, that is cached on at least one of the plurality of client computers and has been validated by the server computer. The computer determines to pre-fetch the resource based on one or more predefined rules, at least one of the predefined rules including a threshold number of responses validating the resource that must be received by the computer. The computer pre-fetches and caches the resource from the server computer. The computer receives a request for the resource from a client computer that does not have the resource cached. The computer validates resource cached locally and sends the resource to the client computer from the local cache on the computer.

Claims

1. A computer program product for pre-fetching content, the computer program product comprising:

one or more computer-readable tangible storage devices and program instructions, stored on the one or more computer-readable tangible storage devices, which when executed;

identify at least one resource, through an examination of one or more HTTP server logs, that is cached on at least one of a plurality of client computers and has been validated by a server computer;

determine to pre-fetch the at least one resource based on one or more predefined rules, at least one of the predefined rules including a threshold number of responses validating the at least one resource;

pre-fetch the at least one resource from the server computer;

cache the at least one resource locally;

receive a request for the at least one resource from a client computer, of the plurality of client computers, that does not have the at least one resource cached on the client computer; and

send the at least one resource to the client computer from the local cache; and

prior to caching the at least one resource locally;

responsive to determining that an HTTP header includes a cache-control directive that dictates that the at least one resource should not be cached, set a flag associated with the at least one resource to indicate that the at least one resource is locally cacheable.

2. The computer program product of claim 1, wherein:

the program instructions to determine that the HTTP header that dictates that the at least one resource should not be cached comprises program instructions to determine that the HTTP header is a “

private”

cache-control directive.

3. The computer program product of claim 1, further comprising program instructions, stored on the one or more computer-readable tangible storage devices, which when executed:

prior to sending the at least one resource to the client computer from the local cache;

determine that the at least one resource cached locally is not cacheable absent a rule or policy overriding an HTTP caching directive; and

validate the at least one resource.

4. The computer program product of claim 1, wherein the one or more predefined rules further comprise one or more of:

a threshold number of client computers that have cached the at least one resource;

a threshold number of client computers that have requested validation of the at least one resource;

a threshold number of validation requests received; and

a threshold size of the at least one resource.

5. The computer program product of claim 3, wherein the program instructions, which when executed, validate the at least one resource comprise program instructions, which when executed:

send a conditional request to the server computer such that if the at least one resource on the server computer has been modified, the server computer sends a current version of the at least one resource, and if the at least one resource has not been modified, the server computer sends a response indicating that the at least one resource is current.

6. The computer program product of claim 1, wherein the at least one resource is a video.

7. The computer program product of claim 1, wherein the program instructions, which when executed, identify the at least one resource comprise program instructions, which when executed:

search the one or more HTTP server logs for “

if-modified-since”

request headers and “

not-modified”

response headers.

8. The computer program product of claim 1, further comprising program instructions, stored on the one or more computer-readable tangible storage devices, which when executed, query at least one peer caching computer in a hierarchical caching network for at least one of the one or more HTTP server logs.

9. A computer system for pre-fetching content, the computer system comprising:

one or more computer processors;

one or more computer-readable tangible storage devices;

program instructions, stored on the one or more computer-readable tangible storage devices for execution by at least one of the one or more computer processors, which when executed by the at least of the one or more computer processors;

identify at least one resource, through an examination of one or more HTTP server logs, that is cached on at least one of a plurality of client computers and has been validated by a server computer;

determine to pre-fetch the at least one resource based on one or more predefined rules, at least one of the predefined rules including a threshold number of responses validating the at least one resource;

pre-fetch the at least one resource from the server computer;

cache the at least one resource locally;

receive a request for the at least one resource from a client computer, of the plurality of client computers, that does not have the at least one resource cached on the client computer; and

send the at least one resource to the client computer from the local cache; and

prior to caching the at least one resource locally;

responsive to determining that an HTTP header includes a cache-control directive that dictates that the at least one resource should not be cached, set a flag associated with the at least one resource to indicate that the at least one resource is locally cacheable.

10. The computer system of claim 9, wherein:

the program instructions to determine that the HTTP header that dictates that the at least one resource should not be cached comprises program instructions to determine that the HTTP header is a “

private”

cache-control directive.

11. The computer system of claim 9, further comprising program instructions, stored on the one or more computer-readable tangible storage devices for execution by at least one of the one or more computer processors, which when executed by the at least one of the one or more computer processors:

prior to sending the at least one resource to the client computer from the local cache;

determine that the at least one resource cached locally is not cacheable absent a rule or policy overriding an HTTP caching directive; and

validate the at least one resource.

12. The computer system of claim 9, wherein the one or more predefined rules further comprise one or more of:

a threshold number of client computers that have cached the at least one resource;

a threshold number of client computers that have requested validation of the at least one resource;

a threshold number of validation requests received; and

a threshold size of the at least one resource.

13. The computer system of claim 11, wherein the program instructions, which when executed, validate the at least one resource, comprise program instructions, which when executed:

send a conditional request to the server computer such that if the at least one resource on the server computer has been modified, the server computer sends a current version of the at least one resource, and if the at least one resource has not been modified, the server computer sends a response indicating that the at least one resource is current.

14. The computer system of claim 9, wherein the at least one resource is a video.

15. The computer system of claim 9, wherein the program instructions, which when executed, identify the at least one resource, comprise program instructions, which when executed:

search the one or more HTTP server logs for “

if-modified-since”

request headers and “

not-modified”

response headers.

16. The computer system of claim 9, further comprising program instructions, stored on the one or more computer-readable tangible storage devices for execution by at least one of the one or more computer processors, which when executed by the at least one of the one or more computer processors, query at least one peer caching computer in a hierarchical caching network for at least one of the one or more HTTP server logs.