Method for monitoring and/or modifying web browsing sessions

• US 6,052,730 A
• Filed: 01/09/1998
• Issued: 04/18/2000
• Est. Priority Date: 01/10/1997
• Status: Expired due to Fees

• Current Assignee: Board of Trustees of the Leland Stanford Junior University (Stanford University)
• Original Assignee: Board of Trustees of the Leland Stanford Junior University (Stanford University)
• Inventors: Felciano, Ramon M., Altman, Russ B.
• Primary Examiner(s): Maung, Zarni
• Assistant Examiner(s): Najjar, Saleh
• Application Number:
  US09/004,584
• Time in Patent Office: 830 Days
• Field of Search: 395/200.93, 395/200.47, 395/200.49, 395/200.54, 395/200.55, 395/200.59, 395/200.76, 709/203, 709/217, 709/219, 709/224, 709/225, 709/246
• US Class Current: 709/225
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/53 using third party service providers
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A method for transparently monitoring and/or modifying web browsing activities over an entire computer network does not require modification of client software and can be implemented on a single server. By rerouting HTTP requests through a centralized gateway server, the sequence and timing of URLs accessed by individual clients are recorded, providing the full information required to recreate a user session. The client HTTP requests are rerouted through the gateway server by modifying URLs within HTML documents. For each document sent to the client, any original URL which points to another server is modified so that it points to a CGI script program on the gateway. The gateway server then fetches the requested document from the other server, modifies the URLs within the document, and passes it on to the client. Thus, subsequent requests from the client will automatically be directed through the gateway server. The method permits tracking individual web sessions and provides valuable information about user behavior. This information can be used for general purpose evaluation of web-based user interfaces to information systems. The technique can also be used to modify a browsing experience by layering or stripping hypertext content or functionality.

Claims

1. A method implemented on a first HTTP server machine for processing HTTP requests from an HTTP client machine, the method comprising:

(a) receiving an HTTP request from the client;

(b) parsing the request to identify a URL parameter pointing to a second HTTP server machine, wherein the second HTTP server machine is distinct from the first HTTP server machine;

(c) retrieving from the second server machine an HTML document associated with the URL;

(d) modifying the HTML document such that original URLs within the document are changed to new URLs, wherein the new URLs point to the first HTTP server machine and include the original URLs as parameters; and

(e) sending the modified HTML document to the client.

2. The method of claim 1 further comprising the step of storing client HTTP request information in a database, wherein the HTTP request information comprises information chosen from the group consisting of a client identifier, the URL pointing to the second HTTP server machine, the date of the request, and the time of the request.

3. The method of claim 1 further comprising modifying the HTML document such that new content is added.

4. The method of claim 3 wherein the new content comprises a hyperlink, an applet, script, visible text, or an image.

5. The method of claim 3 wherein the new content is selected in dependence upon user profile information.

6. The method of claim 1 further comprising modifying the HTML document such that a portion of the document is removed.

7. The method of claim 6 wherein the portion comprises a hyperlink, an applet, script, visible text, or an image.

8. The method of claim 6 wherein the removed portion is selected in dependence upon user profile information.

9. The method of claim 2 further comprising the step of generating a user profile using information in the database.

10. The method of claim 2 further comprising performing an automated web search using information in the database.

11. The method of claim 1 further comprising tracking accesses of a user to a set of commercial web resources.

12. A method implemented on a first HTTP gateway server machine for processing HTTP requests from an HTTP client machine, the method comprising:

(a) receiving at the first gateway server machine an HTTP request from the client;

(b) parsing the request to identify a URL parameter pointing to a third HTTP server machine;

(c) retrieving from the third server machine an HTML document associated with the URL;

(d) modifying the HTML document such that original URLs within the document are changed to new URLs, wherein the new URLs point to a second HTTP server machine and include the original URLs as parameters; and

(e) sending the modified HTML document to the client.