Content collection

• US 7,143,193 B1
• Filed: 12/13/1999
• Issued: 11/28/2006
• Est. Priority Date: 05/29/1998
• Status: Expired due to Term

• Current Assignee: R2 Solutions LLC (Acacia Research Corporation)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Neogi, Depankar, Hardy, Geoff, Lara, Marco, Abbott, Freeland
• Primary Examiner(s): SALAD, ABDULLAHI ELMI
• Application Number:
  US09/532,483
• Time in Patent Office: 2,542 Days
• Field of Search: 709201-202, 709/226, 709/248, 709/219, 709/217, 709/205, 709/224, 707/203, 707/10, 707/201
• US Class Current: 709/248
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users

Abstract

In a web service system with one or more web servers, a system and method for distributing content directly from each web server to a single computer transfers files generated on web servers to a central location for access by a system operator. If files generated by multiple web servers are aggregated on a single computer, processing and analysis can be performed on all of the files. Generally, in one aspect, the invention relates to a system and method for transmitting content from one computer to another in a web service system. The web service system includes web servers that provide web pages in response to web page requests. First and second web server agents provide an interface between the web service system and first and second computers, respectively. The first web server agent runs on the first computer and identifies at least a portion of a file for transmission to the second web server agent running on the second computer in the web service system. At least a portion of the file from the first web server agent is transmitted to the second web server agent and then stored by the second web server agent.

Claims

1. A method of transmitting content, comprising the steps of

opening a socket to a manager, the opening being performed by a first web server agent running on a first computer in a web service system if the first web server agent is not able to open a socket to a second web server agent running on a second computer in the web service system;

sending a message from the first web server agent to the second web server agent via the manager, the message requesting that the second web server agent open a socket to the first web server agent;

using the socket opened by the second web server agent to send a further message from the first web server agent to the second web server agent;

identifying, by the first web server agent, a portion of a file for transmission to the second web server agent, the first and second web server agents each providing an interface between the web service system and the first and second computers respectively; and

transmitting the portion of the file from the first web server agent to the second web server agent; and

storing, by the second web server agent, the portion of the transmitted file.

2. The method of claim 1 further comprising the step of repeating the identifying, transmitting, and storing steps.

3. The method of claim 2 wherein the identifying step comprises the step of identifying a portion of the file that was not previously transmitted.

4. The method of claim 1 further comprising the step of repeating the identifying, transmitting, and storing steps, and wherein the identifying step comprises the step of identifying a portion of the file containing content added subsequent to any previous identifying step.

5. The method of claim 1, further comprising, before the identifying step, the step of executing a program that operates on the file.

6. The method of claim 5, wherein the program resolves an IP address into a domain name service name.

7. The method of claim 1, wherein the identifying step comprises identifying, by the first web server agent, a portion of the file, which comprises a log file about user requests to the web server.

8. The method of claim 1 wherein the identifying step comprises the step of identifying a portion of the file that was not previously transmitted.

9. A method of transmitting content, comprising the steps of:

determining, by a first web server agent running on a first computer in a web service system, that a first file with a first name was renamed to a second name such that the first file has the second name as a file name thereof, and a second file has the first name as a file name thereof, the web service system providing web pages in response to web page requests;

identifying the first file having the second name;

notifying a second web server agent running on a second computer in the web service system that the first file was renamed;

transmitting a portion of the first file from the first web server agent to a second web server agent, the portion of the first file being less than the whole first file;

identifying the second file having the first name;

transmitting a portion of the second file from the first web server agent to the second web server agent.

10. The method of claim 9 further comprising the step of repeating the identifying, transmitting, and storing steps, and wherein the identifying step comprises the step of identifying a portion of the file containing content added subsequent to any previous identifying step.

11. The method of claim 9, further comprising, before the identifying step, the step of executing a program that operates on the file.

12. The method of claim 9, wherein the identifying step comprises identifying, by the first web server agent, at least a portion of the file, which comprises a log file about user requests to the web server.

13. The method of claim 9, further comprising:

using the first file as an archive after the determining step;

applying continuous updates to the second file after the determining step.

14. The method of claim 9, wherein the notifying step includes instructing the second web server to rename the first file on the second web server.

15. A method of transmitting content, comprising the steps of:

opening a socket to a manager, the opening being performed by a first web server agent running on a first computer in a web service system if the first web server agent is not able to open a socket to a second web server agent running on a second computer in the web service system;

sending a message from the first web server agent to the second web server agent via the manager, the message requesting that the second web server agent open a socket to the first web server agent;

using the socket opened by the second web server agent to send a further message from the first web server agent to the second web server agent;

identifying, by the first web server agent, a portion of a file for transmission to a second web server agent, the first web server agent providing an interface between the web service system and the first computer;

transmitting the portion of the file from the first web server agent to the second web server agent; and

providing by the second web server agent, the received portion of transmitted file as input to a computer program.

16. The method of claim 15, further comprising storing the transmitted file on the second computer with a file name that includes a name of the first computer as a portion thereof.

17. The method of claim 15, wherein the identifying and transmitting steps are implemented using JAVA methods, and the second web server agent receives the portion of the transmitted file using a further JAVA method.

18. A method of transmitting content, comprising the steps of:

opening a socket to a manager, the opening being performed by a first web server agent running on a first computer in a web service system if the first web server agent is not able to open a socket to a second web server agent running on a second computer in the web service system;

sending a message from the first web server agent to the second web server agent via the manager, the message requesting that the second web server agent open a socket to the first web server agent;

using the socket opened by the second web server agent to send a further message from the first web server agent to the second web server agent;

identifying, by the first web server agent, a computer program, the first web server agent providing an interface between the web service system and the first computer;

running by the first web server agent the computer program;

transmitting the output of the computer program from the first web server agent to the second web server agent; and

providing by the second web server agent, the received transmitted output as input to a computer program.

19. The method of claim 18, wherein the identifying, running and transmitting steps are implemented using JAVA methods.

20. A computer program for transmitting content embodied on a computer-readable medium, comprising:

an identification code segment for identifying, by a first web server agent running on a first computer in a web service system, a portion of a file for transmission to a second web server agent running on a second computer in the web service system, the first and second web server agents each providing an interface between the web service system and the first and second computers respectively;

a transmitting code segment for transmitting the portion of the file from the first web server agent to the second web server agent;

a socket opening segment for opening a socket to a manager, the opening being performed by the first web server agent if the first web server agent is not able to open a socket to the second web server agent;

a message sending segment for sending a message from the first web server agent to the second web server agent via the manager, the message requesting that the second web server agent open a socket to the first web server agent; and

an additional message sending segment for using the socket opened by the second web server agent to send a further message from the first web server agent to the second web server agent.