Method and system using information written in a wrapper description language to execute query on a network

• US 6,085,186 A
• Filed: 09/19/1997
• Issued: 07/04/2000
• Est. Priority Date: 09/20/1996
• Status: Expired due to Term

• Current Assignee: At Home Bondholders Liquidating Trust (At Home Corporation)
• Original Assignee: NetBot, Inc. (IAC, Inc.)
• Inventors: Christianson, David, Selberg, Erik, Lauckhart, Gregory, Kwok, Chung, Etzioni, Oren, Weld, Daniel S., Doorenbos, Robert B.
• Primary Examiner(s): Fetting, Anton W.
• Assistant Examiner(s): CHANNAVAJJALA, SRIRAMA T
• Application Number:
  US08/933,782
• Time in Patent Office: 1,019 Days
• Field of Search: 707/1-5, 707/9-10, 707/100-104, 707/501, 707/513, 707/200-201, 707/203-205, 395/335, 395/183.14, 395/200.33, 395/200.36, 395/200.37, 395/200.32
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9532 Query formulation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure

Abstract

This invention provides assistance to a user in accessing network attached information sources. In one aspect, the invention is a method for intelligently routing a user query to information sources relevant to that query, extracting relevant data fields from received responses, and intelligently presenting the extracted data in order of estimated relevance. The system of this invention implements one or more steps of the method in a centralized or distributed manner on one or more network attached computers. Further, this invention provides a novel language and implementation that facilitates easily written and maintained descriptions of information source query and response formats.

Claims

1. A method for assisting a user to query for information available from information sources attached to a network, the method comprising:

selecting the one or more information sources most relevant to a user query;

formatting the user query for each relevant information source according to a description of each relevant information source written in a wrapper description language that comprises facilities for specifying an entire regular expression in terms of component regular expressions such that, upon recognition of one component regular expression of the entire regular expression, actions can be executed with variables bound as of the time of recognition of the component regular expression, the actions actually being executed only if the entire regular expression is also recognized;

transmitting the formatted query to each of the relevant information sources;

extracting data fields relevant to the user query from responses returned from the relevant information sources, according to the description of the relevant information source returning each response; and

presenting the relevant data fields to the user.

2. The method of claim 1 further comprising, after extracting, estimating the relevance of the responses to the user query.

3. The method of claim 1 wherein selecting further comprises:

determining one or more concepts to which the user query relates; and

selecting an information source as relevant if the information source relates to the determined concepts.

4. The method of claim 1, wherein a description of an information resource includes:

an address of the information resource on the network;

a designation of one or more conceptual classes descriptive of the information resource;

a mapping of query arguments to selected fields of the user query as applied to the information source; and

a description of a format for presenting a response to the user query that can be parsed to extract data fields relevant to the user query.

5. The method of claim 1, wherein extracting data fields relevant to the user query from responses returned from the relevant information sources further comprises:

responsive to recognizing an entire regular expression defined in the description of a relevant information source, executing at least one action included in the entire regular expression upon the response returned from the relevant information source, using data from a relevant data field of the response to bind variables included in the action.

6. The method of claim 5, further comprising:

converting the entire regular expression into a finite state automata and executing the finite state automata to extract the data fields relevant to the user query.

7. A system for assisting a user to query for information available from information sources attached to a network, the system comprising:

a first processor means for selecting the one or more information sources most relevant to a user query;

a second processor means for formatting the user query for each relevant information source according to a description of each relevant information source written in a wrapper description language, and for transmitting the formatted query to each of the relevant information sources;

the wrapper description language comprising facilities for specifying an entire regular expression in terms of component regular expressions such that, upon recognition of one component regular expression of the entire regular expression, actions can be executed with variables bound as of the time of recognition of the component regular expression, the actions actually being executed only if the entire regular expression is also recognized;

a third processor means for extracting data fields relevant to the user query from responses returned from the relevant information sources, according to the description of the relevant information source returning each response; and

a fourth processor means for presenting the relevant data fields to the user.

8. The system of claim 7 wherein the first, the second, the third, and the fourth processor means reside in one network attached computer, the computer comprising a CPU and memory.

9. The system of claim 7 wherein the first, the second, the third, and the fourth processor means reside in separate network attached computers, each of the computers comprising a CPU and memory.

10. The system of claim 7 wherein the fourth processor means presents the relevant data fields by executing a World Wide Web browser.

11. The system of claim 7 further comprising a first network attached memory means for storing the descriptions of the information sources and for providing the descriptions upon request of the second or third processor means.

12. A computer readable medium containing instructions for causing one or more computers to assist a user to query for information available from information sources attached to a network by performing the operations of:

selecting the one or more information sources most relevant to a user query;

formatting the user query for each relevant information source according to a description of each relevant information source written in a wrapper description language that comprises facilities for specifying an entire regular expression in terms of component regular expressions such that, upon recognition of one component regular expression of the entire regular expression, actions can be executed with variables bound as of the time of recognition of the component regular expression, the actions actually being executed only if the entire regular expression is also recognized;

transmitting the formatted query to each of the relevant information sources;

extracting data fields relevant to the user query from responses returned from the relevant information sources, according to the description of the relevant information source returning each response; and

presenting the relevant data fields to the user.

13. A combination of computer program products, executable by one or more computers attached to a network, for assisting a user to query for information available from information sources attached to the network, the computer program product comprising:

a query router that receives the user query and selects the one or more information sources most relevant to the user query;

a wrapper description database containing a description of each of the information sources, each description written in a wrapper description language comprising facilities for specifying an entire regular expression in terms of component regular expressions such that, upon recognition of one component regular expression of the entire regular expression, actions can be executed with variables bound as of the time of recognition of the component regular expression, the actions actually being executed only if the entire regular expression is also recognized;

an aggregation engine that receives from the query router the relevant information sources, and formats the user query for each relevant information source according to the description of each relevant information source in the wrapper description database, and that extracts data fields relevant to the user query from responses returned from each of the relevant information sources according to the description of the relevant information source returning each response; and

an input/output manager that transmits the formatted query to each of the relevant information sources via the network, and provides the responses returned to the user query from the relevant information sources to the aggregation engine.

14. The combination of computer program products of claim 13, further comprising:

a user interface module that receives the user query and provides it to the query router, and that receives the extracted data fields from the aggregation engine and displays them to the user.