Custom responses for resource unavailable errors

• US 9,634,994 B2
• Filed: 04/01/2011
• Issued: 04/25/2017
• Est. Priority Date: 04/01/2010
• Status: Active Grant

• Current Assignee: CloudFlare Incorporated
• Original Assignee: CloudFlare Incorporated
• Inventors: Prince, Matthew Browning, Holloway, Lee Hahn, Zatlyn, Michelle Marie
• Primary Examiner(s): Keehn, Richard G
• Application Number:
  US13/078,899
• Publication Number:
  US 20110282997A1
• Time in Patent Office: 2,216 Days
• Field of Search: 709217, 709246
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 21/00 Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 21/552 involving long-term monitoring or reporting
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: H04L 47/745 Reaction in network
• CPC Class Codes: H04L 51/42 Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 61/5007 Internet protocol [IP] addresses
• CPC Class Codes: H04L 61/59 using proxies for addressing
• CPC Class Codes: H04L 63/0236 Filtering by address, protocol, port number or service, e.g. IP-address or URL
• CPC Class Codes: H04L 63/0245 Filtering by information in the payload
• CPC Class Codes: H04L 63/0254 Stateful filtering
• CPC Class Codes: H04L 63/0281 Proxies
• CPC Class Codes: H04L 63/083 : using passwords cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226
• CPC Class Codes: H04L 63/0861 : using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/102 : Entity profiles
• CPC Class Codes: H04L 63/126 : the source of the received data
• CPC Class Codes: H04L 63/1416 : Event detection, e.g. attack signature detection
• CPC Class Codes: H04L 63/1433 : Vulnerability analysis
• CPC Class Codes: H04L 63/1441 : Countermeasures against malicious traffic countermeasures against attacks on cryptographic mechanisms H04L9/002
• CPC Class Codes: H04L 63/1458 : Denial of Service
• CPC Class Codes: H04L 63/1466 : Active attacks involving interception, injection, modification, spoofing of data unit addresses, e.g. hijacking, packet injection or TCP sequence number attacks
• CPC Class Codes: H04L 67/02 : based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/146 : Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
• CPC Class Codes: H04L 67/56 : Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/561 : Adding application-functional data or data for application control, e.g. adding metadata
• CPC Class Codes: H04L 67/568 : Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 69/40 : for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection management of faults, events, alarms or notifications in data switching networks H04L41/06

Abstract

A proxy server receives from a client device a request for a network resource hosted at an origins server for a domain. The request is received at the proxy server as a result of a DNS request for the domain resolving to the proxy server. The origin server is one of multiple origin servers that belong to different domains and resolve to the proxy server and are owned by different entities. The proxy server requests the network resource from the origin server. The proxy server receives a response from the origin server that indicates that the network resource is unavailable. The proxy server transmits a custom error page to the client device that indicates that the requested resource is unavailable.

Claims

1. A method in a proxy server for responding to resource unavailable errors, comprising:

receiving, from a client device, a request for a network resource hosted at an origin server for a domain, wherein the request is received at the proxy server as a result of a DNS (Domain Name System) request for the domain resolving to the proxy server, and wherein the origin server is one of a plurality of origin servers that belong to different domains that resolve to the proxy server and are owned by different entities;

requesting the network resource from the origin server;

receiving a response from the origin server that includes a resource unavailable error that indicates that the requested network resource is unavailable to the origin server; and

responsive to receiving the response from the origin server that includes the resource unavailable error, the proxy server performing the following;

creating a custom error page that indicates that the requested network resource is unavailable, wherein the custom error page is different than the received response from the origin server, and

transmitting the custom error page to the client device that indicates that the requested resource is unavailable.

2. The method of claim 1, further comprising:

determining that the requested network resource has moved to a different location; and

including in the custom error page a link to the different location for the requested network resource.

3. The method of claim 2, wherein determining that the requested network resource has moved to a different location includes matching a hash of the requested network resource with one of a plurality of hashes of other network resources hosted by the origin server.

4. The method of claim 1, wherein the custom error page is customized based on a country of a visitor belonging to the request or a language of the visitor.

5. The method of claim 1, wherein the request includes a set of one or more terms, and wherein the custom error page is customized based on the set of terms.

6. The method of claim 1, wherein the custom error page includes a set of one or more links to other network resources available on the domain.

7. The method of claim 1, wherein the custom error page includes a set of one or more links to other network resources available on a set of one or more domains other than the domain that hosts the requested network resource.

8. The method of claim 1, wherein the resource unavailable error is an HTTP response status code 404 error.

9. A proxy server for responding to resource unavailable errors, the proxy server comprising:

a set of one or more processors;

a non-transitory machine-readable storage medium that stores instructions, that when executed by the set of processors, cause the set of processors to execute the following;

a request module configured to receive requests from client devices for network resources hosted at a plurality of origin servers for a plurality of domains and further configured to transmit each of those requests to the appropriate origin server, wherein DNS (Domain Name System) requests for each of the plurality of domains resolve to the proxy server;

a response and resource analyzer module configured to receive responses from the plurality of origin servers in response to the requests and perform the following for each response;

determine whether that response includes a resource unavailable error that indicates that the requested network resource is unavailable at the origin server that transmitted the response;

an unavailable resource module coupled with the response and resource analyzer module that is configured to create a customized error page for each response that includes a resource unavailable error, wherein the custom error page is different than the received responses from the plurality of origin servers; and

a response forming and transmission module coupled with the unavailable resource module that is configured to form and transmit the customized error pages to the client devices.

10. The proxy server of claim 9, wherein the unavailable resource module is configured to include in the customized error page a link to a current location of a requested network resource.

11. The proxy server of claim 9, wherein the unavailable resource module is configured to create the customized error page for each response that indicates a resource unavailable error based on a country of a visitor belonging to the corresponding request or a language of the visitor.

12. The proxy server of claim 9, wherein at least some of the requests include a set of one or more terms, and wherein the unavailable resource module is configured to base the customized error page for each of those responses whose corresponding request includes a set of one or more terms on those terms.

13. The proxy server of claim 9, wherein the unavailable resource module is configured to include in the customized error page for each of those responses a set of one or more links to other network resources.

14. The proxy server of claim 13, wherein the set of links to the other network resources are in a same one of the plurality of domains as the requested network resource.

15. The proxy server of claim 9, wherein the resource unavailable error is an HTTP response status code 404 error.

16. A non-transitory machine-readable storage medium that provides instructions that, when executed by a processor of a proxy server, cause said processor to perform operations comprising:

receiving, from a client device, a request for a network resource hosted at an origin server for a domain, wherein the request is received at the proxy server as a result of a DNS (Domain Name System) request for the domain resolving to the proxy server, and wherein the origin server is one of a plurality of origin servers that belong to different domains that resolve to the proxy server and are owned by different entities;

requesting the network resource from the origin server;

receiving a response from the origin server that includes a resource unavailable error that indicates that the requested network resource is unavailable to the origin server; and

responsive to receiving the response from the origin server that includes the resource unavailable error, the proxy server performing the following;

creating a custom error page that indicates that the requested network resource is unavailable, wherein the custom error page is different than the received response from the origin server, and

transmitting the custom error page to the client device that indicates that the requested resource is unavailable.

17. The non-transitory machine-readable storage medium of claim 16, wherein the operations further comprise:

determining that the requested network resource has moved to a different location; and

including in the custom error page a link to the different location for the requested network resource.

18. The non-transitory machine-readable storage medium of claim 17, wherein determining that the requested network resource has moved to a different location includes matching a hash of the requested network resource with one of a plurality of hashes of other network resources hosted by the origin server.

19. The non-transitory machine-readable storage medium of claim 16, wherein the custom error page is customized based on a country of a visitor belonging to the request or a language of the visitor.

20. The non-transitory machine-readable storage medium of claim 16, wherein the request includes a set of one or more terms, and wherein the custom error page is customized based on the set of terms.

21. The non-transitory machine-readable storage medium of claim 16, wherein the custom error page includes a set of one or more links to other network resources available on the domain.

22. The non-transitory machine-readable storage medium of claim 16, wherein the custom error page includes a set of one or more links to other network resources available on a set of one or more domains other than the domain that hosts the requested network resource.

23. The non-transitory machine-readable storage medium of claim 16, wherein the resource unavailable error is an HTTP response status code 404 error.