Methods, computer system, and computer program product for configuring a meta search engine

• US 6,721,736 B1
• Filed: 11/15/2000
• Issued: 04/13/2004
• Est. Priority Date: 11/15/2000
• Status: Expired due to Fees

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Krug, Adrian, Moll, Christoph
• Primary Examiner(s): Robinson, Greta
• Assistant Examiner(s): Black, Linh
• Application Number:
  US09/713,768
• Time in Patent Office: 1,245 Days
• Field of Search: 707/1-10, 707/100-104, 706/16, 706/20, 706/48
• US Class Current: 707/634
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

The invention is directed to a method performed by a meta search engine. In the method a search response provided from the primary search engine in a search response presentation is processed by the meta search engine. The method comprises that the meta search engine adapts itself to a new search response representation. The invention is also directed to a method performed by a computer system to configure an interface to at least one primary search engine. The interface has the function to extract search results from a search response from the primary search engine in a search response representation. The method comprises the automatically adapting of the interface to a new search response representation. The invention is also directed to a corresponding computer system and a corresponding computer program product.

Claims

1. A method automatically performed by a meta search engine, wherein a search response provided from a primary search engine in a search response representation including search result frames is processed by the meta search engine, the method comprising:

producing an at least two-dimensional syntax tree of at least a part of the search response representation;

searching repetitive equal or similar patterns of syntax elements within the syntax tree, and identifying, and thereby localizing, the search result frames within the search response representation by an equal or similar appearance of their patterns of syntax elements; and

adapting the meta search engine to the search response representation based on the localized search result frames, at least if it is a new search response representation.

2. The method of claim 1, wherein the meta search engine comprises an interface for extracting search results from the search response, and the adaptation of the meta search engine is performed by automatically configuring the interface to the new search response representation.

3. The method of claim 1, wherein the meta search engine automatically recognizes a new search response representation.

4. The method of claim 3, wherein a search response representation is considered as new if the meta search engine has not recognized it before.

5. The method of claim 1, wherein adapting the meta search engine further comprises detecting automatically at least one of:

i) those parts of a search response representation that contain no search result information, and

ii) result frames in a search response representation, wherein result frames are those parts of a search response representation that contain the search result information.

6. The method of claim 5, wherein detecting automatically those parts of a new search response representation that contain no search result information further comprises comparing at least two different search responses.

7. The method of claim 6, wherein detecting automatically said parts further comprises identifying the parts that contain no information as the parts whose content does not change in different search responses.

8. The method of claim 3 using components of a result frame, wherein the appearance of the different components of a result frame is used to identify the specific type of information that is contained in the corresponding component, wherein result frames are those parts of a search response representation that contain the search result information.

9. A method performed by a computer system of automatically configuring an interface to at least one primary search engine for extracting search results from a search response provided by the primary search engine in a search response representation including search result frames, the method comprising:

producing an at least two-dimensional syntax tree of at least a part of the search response representation;

searching repetitive equal or similar patterns of syntax elements within the syntax tree, and identifying, and thereby localizing, the search result frames within the search response representation by an equal or similar appearance of their patterns of syntax elements; and

adapting the interface automatically to the search response representation based on the localized search result frames, at least if it is a new search response representation.

10. The method of claim 9, wherein the interface is part of a meta search engine.

11. The method of claim 9, wherein a search response representation is considered as new if the interface has not recognized it before.

12. The method of claim 9, wherein automatically adapting the interface further comprises detecting automatically at least one of the following:

i) those parts of a search response representation that contain no search result information, and

ii) result frames in a search response representation.

13. The method of claim 12, wherein the detection of those parts of a new search response representation that contain no search result information further comprises comparing at least different search responses.

14. The method of claim 9, wherein the dimensions of the syntax tree refer to dimensions in a feature space, wherein the features are derived from the syntax structure of the search response representation.

15. The method of claim 9, wherein the search response representation is encoded using a markup language.

16. The method of claim 15, wherein the search response representation is encoded using at least one of HTML and XML.

17. The method of claim 9, wherein automatically adapting the interface further comprises automatically determining the meaning of the parts of the result frame.

18. The method of claim 17, wherein determining the meaning of the parts of the result frame further comprises assigning the syntax elements of the result frame to the corresponding search result information.

19. A computer system, comprising:

a meta search engine comprising an interface to at least one primary search engine arranged to provide search responses in a search response representation including search result frames; and

a configurator;

wherein the configurator is arranged to;

produce an at least two-dimensional syntax tree of at least a part of the search response representation,

search repetitive equal or similar patterns of syntax elements within the syntax tree, and identify, and thereby localize, the search result frames within the search response representation by an equal or similar appearance of their patterns of syntax elements; and

adapt the interface automatically to a new search response representation of the primary search engine.

20. The computer system of claim 19, wherein the configurator is part of the meta search engine.

21. The computer system of claim 19, wherein the meta search engine and the configurator are locally separated and connected via a network.

22. The computer system of claim 19, wherein the configurator is arranged to automatically extract search results contained within result frames from a search response with a new search response representation.

23. A computer program product including program code for carrying out a method, when executed on a computer system, of automatically configuring an interface to at least one primary search engine for extracting search results including search result frames from a search response from the primary search engine in a search response representation, the computer program comprising:

program code to produce an at least two-dimensional syntax tree of at least a part of the search response representation;

program code to search repetitive equal or similar patterns of syntax elements within the syntax tree, and identify, and thereby localize, the search result frames within the search response representation by an equal or similar appearance of their patterns of syntax elements; and

program code to adapt the interface automatically to the search response representation based on the localized search result frames, at least if it is a new search response representation.

24. The computer program product of claim 23, wherein the program code is stored on a computer-readable data carrier or is in the form of signals transmitted over a computer network.

25. The computer program product of claim 23, wherein one program component for configuring the interface automatically is arranged to recognizes new search response representations and stores these representations, while another program component is arranged to uses the stored representations to process known search response representations.

26. The computer program product of claim 23, wherein the program component that recognizes new search response representations comprises automatically determining the meaning of the parts of the result frame and assigning the corresponding search result information.