Distributed-code, custom-generated dynamic internet inclusion agent

• US 20020120714A1
• Filed: 02/26/2001
• Published: 08/29/2002
• Est. Priority Date: 02/26/2001
• Status: Abandoned Application

• Current Assignee: Omni-Explorer Technologies, Inc. (Vroom, Inc.)
• Original Assignee: Omni-Explorer Technologies, Inc. (Vroom, Inc.)
• Inventors: Agapiev, Borislav
• Application Number:
  US09/794,817
• Publication Number:
  US 20020120714A1
• Time in Patent Office: Days
• US Class Current: 709/218
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

Preferred embodiments of the present invention comprise a system and method for enabling a novice computer user automatically to generate a customized search agent for conducting a content search on one or more remote network Web sites and aggregating the search results. The user has the ability to specify the Web sites that will be searched. The customized search agent then functions to aggregate content found on each of the sites the computer user specifies for the search. In a preferred embodiment of the present invention, the novice user employs a remote inclusion agent automatically to generate the search agent simply by using a standard network browser to interface the inclusion agent and surf Web sites that provide the desired content.

Claims

1. A method for enabling a client system coupled to the Internet to search for and aggregate content from a Web site on a content server coupled to the Internet, the method comprising the steps of:

providing an inclusion server coupled to the Internet;

routing communications between the client system and the content server through the inclusion server;

in the inclusion server, identifying a search methodology from the communications between the client system and the content server; and

generating a search agent to implement the identified search methodology.

2. The method of claim 1, wherein the search agent incorporates a content variable for instantiation by the client.

3. A method for enabling a client system coupled to the Internet to use a Web browser to generate a search agent to search for and aggregate content available on at least one of a plurality of Web sites, the at least one of a plurality of Web sites being hosted on a content server coupled to the Internet so as to provide the content to the client system, the method comprising the steps of:

coupling an inclusion server to the Internet;

establishing a first communication session between the client system and the inclusion server;

receiving, by the inclusion server, a first search request from the client containing a URL for the content server;

including the URL in a search agent hosted by the inclusion server;

establishing a second communication session between the inclusion server and the content server;

transmitting the first search request from the inclusion server to the content server as if the first search request came directly from the client system;

receiving, by the inclusion server, data from the content server defining a results Web page containing content satisfying the first search request, the content instantiating a content search variable; and

storing the content search variable in the search agent on the inclusion agent server.

4. The method of claim 3, further comprising the step of defining a Web page for evoking the search agent to send a second search request from the client system to the content server, the Web page including a form field to receive a value supplied by the client system to instantiate the content search variable.

5. A method for automating a search of a Web site comprising the steps of:

(a) receiving a start URL for a Web site to be searched;

(b) sending a request to a server hosting the Web site;

(c) receiving, from the server, data defining a Web page in response to the request;

(d) determining a search heuristic defined by the data; and

(e) emitting code to access the Web page according to the search heuristic.

6. The method of claim 5, wherein the step of emitting code includes parameterizing a search variable in the search heuristic for instantiation with a value specified for a subsequent search.

7. The method of claim 6, further comprising the step of analyzing the data defining the Web page to determine if the Web page contains a result satisfying the request.

8. The method of claim 7, wherein the analyzing step includes searching the data for a value representing the parameterized variable.

9. The method of claim 7, wherein the analyzing step includes searching the data for the absence of a markup language form tag.

10. The method of claim 7, wherein the analyzing step includes receiving interactive identification of the result from a client system user.

11. The method of claim 7, further comprising the step of, responsive to obtaining a plurality of results satisfying the request, aggregating the plurality of results into an aggregate result.

12. The method of claim 11, wherein the aggregate result includes a result URL.

13. The method of claim 5, wherein the start URL is provided by a client system user.

14. The method of claim 5, wherein the start URL is imported from an external source.

15. The method of claim 5, wherein the start URL is generated by a commercial Internet search engine in response to a key word search.

16. The method of claim 5, further comprising the steps of, prior to the step of receiving the start URL:

conducting an Internet search for a search-result Web page containing a predefined key word, the search-result Web page being identifiable by a reference URL; and

providing the reference URL identifying the search-result Web page as the start URL in the subsequent step of receiving the start URL.

17. The method of claim 16 wherein the search is a meta tag search.

19. A system of claim 18 further comprising an inclusion agent, hosted by the inclusion server, for emitting the code.

18. A system for generating code to enable a client system to search for content on at least one of a plurality of content servers, the system comprising:

a client system coupled to a network;

a content server coupled to the network, the content server providing searchable content available to the client system according to a predefined search methodology; and

an inclusion server, coupled to the network, for intercepting communications between the client system and the content server, deducing the predefined search methodology, and emitting code for automating a search of the searchable content according to the deduced, predefined search methodology.

20. A system for enabling an automatic search of one or more Web sites and aggregating one or more search results comprising:

an initial Web page for receiving information identifying the one or more Web sites to be learned;

an inclusion script for receiving information from the Web sites to be learned and determining a corresponding search methodology for each of the Web sites to be learned; and

a code script for implementing the search methodology determined by the inclusion script for each of the Web sites to be learned.

21. The system of claim 20, further comprising:

a search Web page for receiving a single search request; and

a results script for obtaining one ore more search results, parsing the one or more search results, and aggregating the one or more search results into an aggregate output.

22. The system of claim 21 wherein the aggregate output is chosen from a group consisting of a results Web page, a data table;

an e-mail communication, a computer file, a computer database, and a printout.

23. The system of claim 20 wherein the inclusion script includes the following:

a first routine to request, from each of the one or more Web sites, a first Web page for inputting a search parameter; and

a second routine to request, from each of the one or more Web sites, a subsequent Web page in response to inputting the search parameter, the second routine including an iteration subroutine to repeat the subsequent Web page request until the subsequent Web page presents a final result.

25. The system of claim 24 wherein the interactive results Web page provides the requested content in a table.

26. The system of claim 25 wherein the computer user can specify an order for data in the table.

27. The system of claim 24 wherein the interactive search Web page includes an option for the computer user to select which of the one or more Web sites to search.

24. A system for enabling a computer user having minimal computer experience to distributively generate a customized search agent, the system comprising:

a client system coupled to a network, the client having a network browser;

a set of graphical interfaces, operable with the network browser, including;

an interactive start Web page for receiving from the computer user an identification of one or more Web sites to be searched;

an interactive search Web page for receiving from the computer user an identification of a requested content available on the one or more Web sites; and

an interactive results Web page for providing the computer user with the requested content in an aggregated form; and

an inclusion agent server for hosting code-generating scripts to generate the customized search agent, the code-generating scripts being substantially hidden from the computer user and including;

an inclusion script to identify and record a search methodology for the one or more Web sites;

a code script containing the identified and recorded search methodology; and

a results script for aggregating the requested content and providing the requested content to the interactive results Web page.

28. A method for facilitating a B2B exchange among a first entity and a second entity having an online presence, the method comprising the steps of:

providing a server to monitor a methodology used by the first entity to search for content through the online presence of the second entity; and

enabling the first entity to use a Web browser to generate a search agent for searching for content according to the monitored methodology.

29. A method for enabling a novice computer user to generate an agent to automate an action conducted by the computer user on a network, the method comprising the steps of:

providing a gateway presence on the network, the gateway presence being accessible to the computer user with a network browser application;

receiving through the gateway presence a communication from the user exemplifying the action; and

providing a preprogrammed computer program to monitor the communication and automatically generate the agent for automating the action.