System and method for generalized URL-rewriting

• US 7,058,633 B1
• Filed: 09/09/2002
• Issued: 06/06/2006
• Est. Priority Date: 09/09/2002
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Aviani, James A., O'Toole, James W. Jr., Champagne, Jean-Philippe, Lueckenhoff, Bruce Arthur, Gnagy, Matthew R.
• Primary Examiner(s): Rones, Charles
• Assistant Examiner(s): Betit, Jacob F.
• Application Number:
  US10/237,339
• Time in Patent Office: 1,366 Days
• Field of Search: 709/224, 709/206, 709/201, 709/218, 709/230, 707/104.1, 370/465
• US Class Current: 1/1
• CPC Class Codes: G06F 16/9566 URL specific, e.g. using aliases, detecting broken or misspelled links
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation

Abstract

A URL re-writing system and method in a network examines and modifies HTML data and its embedded URLs. The re-writing system can be implemented in a router and can replace URLs found in the HTML data in order to accomplish more efficient routing for example to a close mirror site or for content routing. The re-writing system can also use URL replacement to insert important or emergency information to data received by users on a Web-based network.

Claims

1. A method for re-writing a received link with an alternative link in a computer network, comprising the steps of:

receiving data requested by a client;

examining said received data for links to additional data;

comparing said links to entries in a database, wherein said database stores advertiser URLs with corresponding arbitrary URLs, said comparing further comprising comparing said links to said advertiser URLs;

for each link matching an advertiser URL stored in said database, replacing said matched link in said received data with a corresponding arbitrary URL from said database; and

forwarding said received data with the arbitrary URL to said client,

wherein;

(i) the computer network is the worldwide web;

(ii) the received data is a first web page being returned from a server to the client in response to a first request from the client;

(iii) the client may include an ad blocker operative to block the advertiser URL but not operative to block the arbitrary URL; and

(iv) the received data forwarded to the client comprises an adjusted first web page created by adjusting the first web page with the arbitrary URL to avoid violating expectations and checks of the first web page at the client computer system;

and further comprising;

(v) intercepting a second request from the client for a second web page in response to activating the arbitrary URL in the adjusted first web page, the second request containing the arbitrary URL;

(vi) replacing the arbitrary URL in the second request with the advertiser URL from the matching entry of the database; and

(vii) forwarding the second request with the advertiser URL for servicing within the worldwide web.

2. The method of claim 1 further comprising the steps of:

from those links in said received data having no match in said database, selecting at least one link; and

replacing said at least one link with an alternative URL before forwarding said received data to said client.

3. The method of claim 2 wherein said at least one link is a URL to an image file.

4. The method of claim 1 wherein said database stores server URLs with corresponding priority data URLs and

said comparing step further comprises the step of comparing said links to said server URLs;

and

said replacing step further comprises the step of replacing each said matched link with a corresponding priority data URL.

5. The method of claim 1 wherein said received data is a Web page and forwarding step further comprises the steps of

checking said Web page having alternative links versus said Web page as originally received for length;

and

if the lengths are different, adjusting the length of said Web page having alternative links to match the length of said originally received Web page.

6. The method of claim 1 wherein said forwarding step further comprises the step of inserting data into data packets of said received data having alternative links before forwarding to said client to avoid an error condition at said client.

7. The method of claim 1 further comprising the step of

providing entries to said database such that each said alternative link satisfies a specified checksum test indicating whether a link to additional data is an alternative link;

and

wherein said examining step further comprises performing said specified checksum test on said links; and

wherein said comparing step further comprises comparing to entries in said database only links satisfying said specified checksum test.

8. The method of claim 1 further comprising the step of providing entries to said database wherein at least one alternative link includes a default code such that the alternative link can be used as a pointer to a real web site when a database entry having said at least one alternative is not found.

9. A method for re-writing a received URL with an alternative URL in a computer network having a plurality of re-writing systems, comprising the steps of:

a) receiving data requested by a client at a first re-writing system;

b) examining said received data for links to additional data;

c) comparing said links to entries in a first database in said first re-writing system, wherein said first database stores advertiser URLs with corresponding arbitrary URLs, said comparing further comprising comparing said links to said advertiser URLs;

d) for each link matching an advertiser URL stored in said first database, replacing said matched link in said received data with the corresponding arbitrary URL from said first database;

e) if a match is not found in said first database, comparing said links to entries in a second database in a second re-writing system, wherein said second database also stores advertiser URLs with corresponding arbitrary URLs, said comparing further comprising comparing said links to said advertiser URLs;

f) if no match is found in said second database, repeating step e) with the remaining re-writing systems until an end-of-procedure point is reached,

wherein;

(i) the computer network is the worldwide web;

(ii) the received data is a first web page being returned from a server to the client in response to a first request from the client; and

(iii) the client may include an ad blocker operative to block the advertiser URL but not operative to block the arbitrary URL;

and further comprising;

(iv) adjusting the first web page with the arbitrary URL to avoid violating expectations and checks of the first web page at the client computer system;

(v) forwarding the adjusted first web page to the client;

(vi) intercepting a second request from the client for a second web page in response to activating the arbitrary URL in the adjusted first web page, the second request containing the arbitrary URL;

(vii) replacing the arbitrary URL in the second request with the advertiser URL from a matching entry of the database; and

(viii) forwarding the second request with the advertiser URL for servicing within the worldwide web.

10. The method of claim 9 wherein said end-of-procedure point is a matching entry in one of said plurality of databases.

11. The method of claim 9 wherein said end-of-procedure point is a time-out period.

12. A URL re-writing system connected to a network, comprising:

a processor;

a memory connected to said processor; and

a database connected to said processor, wherein said database stores advertiser URLs with corresponding arbitrary URLs;

said processor being operative;

(1) to examine data received in response to a client request;

(2) to compare links in said received data to advertiser URLs stored in said database; and

(3) to re-write matched links in said received data with corresponding arbitrary URLs from said database, and to forward said received data with arbitrary URLs to said client,

wherein

(i) the computer network is the worldwide web;

(ii) the received data is a first web page being returned from a server to the client in response to a first request from the client;

(iii) the client may include an ad blocker operative to block the advertiser URL but not operative to block the arbitrary URL; and

(iv) the received data forwarded to the client comprises an adjusted first web page created by adjusting the first web page with the arbitrary URL to avoid violating expectations and checks of the first web page at the client computer system;

and wherein the processor is further operative to;

(v) intercept a second request from the client for a second web page in response to activating the arbitrary URL in the adjusted first web page, the second request containing the arbitrary URL;

(vi) replace the arbitrary URL in the second request with the advertiser URL from the matching entry of the database; and

(vii) forward the second request with the advertiser URL for servicing within the worldwide web.

13. A URL re-writing system, comprising:

means for receiving data requested by a client;

means for examining said received data for links to additional data;

means for comparing said links to entries in a database, wherein said database stores advertiser URLs with corresponding arbitrary URLs;

means for replacing each matched link in said received data with an arbitrary URL from said database if a match is found in said database; and

means for forwarding said received data with arbitrary URL to said client,

wherein;

(i) the computer network is the worldwide web;

(ii) the received data is a first web page being returned from a server to the client in response to a first request from the client;

(iii) the client may include an ad blocker operative to block the advertiser URL but not operative to block the arbitrary URL; and

(iv) the received data forwarded to the client comprises an adjusted first web page created by adjusting the first web page with the arbitrary URL to avoid violating expectations and checks of the first web page at the client computer system;

and further comprising;

(v) means for intercepting a second request from the client for a second web page in response to activating the arbitrary URL in the adjusted first web page, the second request containing the arbitrary URL;

(vi) means for replacing the arbitrary URL in the second request with the advertiser URL from the matching entry of the database; and

(vii) means for forwarding the second request with the advertiser URL for servicing within the worldwide web.

14. The URL re-writing system of claim 13 implemented in a NAT system.

15. The URL re-writing system of claim 14 implemented in a proxy server in the network.

16. The URL re-writing system of claim 13 implemented in a router in the network.

17. A computer program product having a computer-readable medium including computer program logic encoded thereon that, when performed on a computer system having a coupling of a memory, a processor, and at least one communications interface, provides a method for re-writing a received URL with an alternative URL in a computer network by performing the operations of:

receiving data requested by a client;

examining said received data for links to additional data;

comparing said links to entries in a database, wherein said database stores advertiser URLs with corresponding arbitrary URLs;

for each link matching a link stored in said database, replacing said matched link in said received data with an associated arbitrary URL from said database; and

forwarding said received data with the arbitrary URL to said client,

wherein;

(i) the computer network is the worldwide web;

(ii) the received data is a first web page being returned from a server to the client in response to a first request from the client; and

(iii) the client may include an ad blocker operative to block the advertiser URL but not operative to block the arbitrary URL;

and wherein the method provided by the computer program logic further includes the operations of;

(iv) adjusting the first web page with the arbitrary URL to avoid violating expectations and checks of the first web page at the client computer system;

(v) forwarding the adjusted first web page to the client;

(vi) intercepting a second request from the client for a second web page in response to activating the arbitrary URL in the adjusted first web page, the second request containing the arbitrary URL;

(vii) replacing the arbitrary URL in the second request with the advertiser URL from a matching entry of the database; and

(viii) forwarding the second request with the advertiser URL for servicing within the worldwide web.