Distributed network search engine

• US 6,490,575 B1
• Filed: 12/06/1999
• Issued: 12/03/2002
• Est. Priority Date: 12/06/1999
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Berstis, Viktors
• Primary Examiner(s): RONES, CHARLES
• Application Number:
  US09/456,077
• Time in Patent Office: 1,093 Days
• Field of Search: 707/1, 707/3, 707/5, 707/100, 707/104, 707/10, 707/501.1, 707/511, 709/217
• US Class Current: 1/1
• CPC Class Codes: G06F 16/256 in federated or virtual databases
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

A method and system for facilitating a keyword search request initiated at a client station within a multilevel data network, wherein the multilevel data network includes multiple local sites each containing multiple data pages. Multiple keywords from each of the data pages within the local sites of the multilevel data network are stored locally and indexed such that each of the keywords points to one or more of the data pages in which the keywords are contained. The keywords and their index associations are locally updated. A central database is utilized to compile and index the locally indexed keywords from each of the local sites, such that each of the keywords in the central database points to one or more local sites from which those keywords came in response to a keyword search initiated at the client station.

Claims

1. A method for facilitating a keyword search request initiated at a client station within a multilevel data network, wherein said multilevel data network includes a plurality of local sites each containing a plurality of data pages, said method comprising the steps of:

within each of said plurality of local sites, indexing keywords from said plurality of data pages within a local database, such that within said local database, each of said keywords points to one or more of said plurality of data pages;

compiling and indexing said keywords from each local database within a central database, such that within said central database, each of said keywords points only to at least one of said local sites in response to a keyword search request initiated at said client station.

2. The method of claim 1, wherein said multilevel data network further comprises a collection of interlinked hypertext documents, and wherein said compiling and indexing steps are performed utilizing a hypertext transfer protocol.

3. The method of claim 1, wherein each of said plurality of local sites is served by a local server, and wherein said compiling and indexing step comprises the step of associating each of said keywords with one or more of said local servers.

4. The method of claim 1, wherein said compiling and indexing keywords from said plurality of data pages into a local database, further comprises the step of individually searching each of said local databases for occurrences of said keywords.

5. The method of claim 1, wherein said multilevel data network further comprises a global search engine accessible from a search graphic user interface (GUI) having a search executable and a search result window within said client station, said method further comprising the steps of:

receiving said keyword search request at said global search engine; and

retrieving and delivering data from said central database into said search result window in response to said receiving step.

6. The method of claim 5, wherein said global search engine is served by a network server, and wherein said retrieving step comprises the step of pointing to at least one of said local sites utilizing said network server.

7. The method of claim 5, wherein said search result window further comprises a local site search executable linked to said local search engines, said method further comprising the step of initiating a search by at least one of said local search engines of at least one of said local sites.

8. The method of claim 5, wherein said keyword search request includes the step of selecting a keyword search request from an application search button within said search GUI, said search executable including a HTTP pathname.

9. The method of claim 5, wherein said keyword search request comprises the step of converting said keyword search request into a data format readable by said multilevel data network.

10. The method of claim 1, further comprising locally updating said plurality of keywords within each of said local indices.

11. The method of claim 10, wherein said multilevel data network further comprises local search engines associated with each of said plurality of local sites, and wherein said step of updating said keywords contained within each of said local indices is performed utilizing said local search engines.

12. The method of claim 11, further comprising the step of installing said local search engines as HTML search files on at least one local server.

13. A method for facilitating a keyword search request initiated at a client station within a multilevel data network, wherein said multilevel data network includes a plurality of local sites each containing a plurality of data pages, said method comprising the steps of:

within each of said plurality of local sites, indexing keywords from said plurality of data pages within a local database, such that within said local database, each of said keywords points to one or more of said plurality of data pages;

compiling and indexing said keywords from each local database within a central database, such that within said central database, each of said keywords points only to at least one of said local sites;

responsive to receiving an initial keyword search request from a graphical user interface on said client station, searching said central database for local sites indexed in accordance with the contents of said initial keyword search request;

returning a list of one or more of said local sites indexed in accordance with the contents of said initial keyword search request to a search result window within said graphical user interface, wherein said search result window includes a keyword entry field and an independent search request selection option field associated with each entry of said returned one or more local sites; and

responsive to receiving a subsequent keyword search request issued in accordance with the contents of said search result window keyword entry field and selection of one or more of said independent search request selection fields, searching said local databases for data pages indexed in accordance with the contents of said subsequent keyword search request.

14. A system for facilitating a keyword search request initiated at a client station within a multilevel data network, wherein said multilevel data network includes a plurality of local sites each containing a plurality of data pages, said system comprising:

a plurality of local databases each uniquely associated with each of said local sites for indexing keywords from said plurality of data pages, such that within each of said local databases said keywords point to one or more of said plurality of data pages;

a central database for compiling and indexing said keywords from each of said local databases, such that within said central database, each of said keywords points only to at least one of said local sites; and

a global search engine for accessing said central database to point to at least one of said plurality of local sites in response to a keyword search request initiated at said client station, such that said global search engine may provide a comprehensive search response to said keyword search request.

15. The system of claim 14, wherein each of said local databases further comprises a local index for associating each of said keywords compiled from within each local site with one or more of said plurality of data pages contained within each respective local site.

16. The system of claim 14, wherein said central database further comprises a master index for associating each of said keywords with one or more sites among said plurality of local sites.

17. The system of claim 14, wherein said multilevel data network comprises a collection of interlinked hypertext documents.

18. The system of claim 17, wherein said plurality of data pages are Web pages.

19. The system of claim 14, wherein said global search engine and said local search engines utilize a hypertext data format.

20. The system of claim 14, wherein each of said local sites is served by a local server at which an associated local search engine resides as an off-loaded search engine application.

21. The system of claim 20, wherein said central database further comprises a master index for associating each of said keywords with one or more of said servers which serve said local sites.

22. The system of claim 20, wherein said local servers serving each of said local sites support and maintain said local databases.

23. The system of claim 14, wherein said global search engine comprises a search graphical user interface (GUI) which resides at said client station and which includes a keyword entry field and a search executable.

24. The system of claim 23, wherein said global search engine further comprises a search result window within said search GUI and linked to said central database, such that upon selection of the search executable, said global search engine retrieves and delivers data from said central database into said search result window.

25. The system of claim 24, wherein said search result window further comprises a local site search executable linked to at least one of said local search engines for initiating a search by said at least one local search engine of one or more of said local sites.

26. The system of claim 25, wherein said search result window further comprises a secondary search result window that is linked to said local database, wherein upon selection of said local site search executable, said local search engine retrieves and delivers data from said local database into said secondary search result window.

27. The system of claim 14, further comprising a local search engine associated with each of said local sites for updating said list of keywords contained within each of said local databases.

38. The program product of claim 27, further comprising instruction means for installing said local search engines as HTML search files on at least one of said local servers.

28. A system for facilitating a keyword search request initiated at a client station within a multilevel data network, wherein said multilevel data network includes a plurality of local sites each containing a plurality of data pages, said system comprising:

a plurality of local databases each uniquely associated with each of said local sites for indexing keywords from said plurality of data pages, such that each of said keywords points to one or more of said plurality of data pages;

a central database for compiling and indexing said keywords from each of said local databases, such that within said central database, each of said keywords points only to at least one of said local sites; and

a global search engine for;

responsive to receiving an initial keyword search request from a graphical user interface on said client station, searching said central database for local sites indexed in accordance with the contents of said initial keyword search request; and

returning a list of one or more of said local sites indexed in accordance with the contents of said keyword search request to a search result window within said graphical user interface, wherein said search result window includes a keyword entry field and an independent search request selection field associated with each entry of said returned one or more local sites; and

local search engines responsive to receiving a subsequent keyword search request issued in accordance with the contents of said search result window keyword entry field and selection of one or more of said independent search request selection fields, for searching said local databases for data pages indexed in accordance with the contents of said subsequent keyword search request.

29. A computer program product stored in signal bearing media for facilitating a keyword search request initiated at a client station within a multilevel data network, wherein said multilevel data network includes a plurality of local sites each containing a plurality of data pages, said program product comprising:

instruction means stored in signal bearing media for, within each of said plurality of local sites, indexing keywords from said plurality of data pages into local databases, such that within said local databases, each of said keywords points to one or more of said plurality of data pages;

instruction means stored in signal bearing media for compiling and indexing said keywords from each of said local databases into a central database, such that within said central database, each of said keywords points only to at least one of said local sites in response to a keyword search request initiated at said client station.

30. The program product of claim 29, wherein said multilevel data network further comprises a collection of interlinked hypertext documents, and wherein said instruction means for compiling and indexing utilize a hypertext transfer protocol.

31. The program product of claim 30, wherein each of said plurality of local sites is served by a local server, and wherein said instruction means for compiling and indexing comprises instruction means for associating each of said keywords with one or more of said local servers.

32. The program product of claim 29, wherein said instruction means for compiling and indexing keywords from said plurality of data pages into a local database, further comprises instruction means for individually searching each of said local databases for occurrences of said keywords.

33. The program product of claim 29, wherein said multilevel data network further comprises a global search engine accessible from a search graphic user interface (GUI) having a search executable and a search result window within said client station, said program product further comprising:

instruction means for receiving said keyword search request at said global search engine; and

instruction means for retrieving and delivering data from said central database into said search result window.

34. The program product of claim 33, wherein said global search engine is served by a network server, and wherein said instruction means for retrieving comprises instruction means for pointing to at least one of said local sites utilizing said network server.

35. The program product of claim 33, wherein said search result window further comprises a local site search executable linked to said local search engines, said program product further comprising instruction means for initiating a search by at least one of said local search engines of at least one of said local sites.

36. The program product of claim 33, further comprising instruction means for converting said keyword search request into a data format readable by said multilevel data network.

37. The program product of claim 29, wherein said multilevel data network further comprises local search engines associated with each of said plurality of local sites, and wherein said instruction means for updating said keywords contained within each of said local databases are executed by said local search engines.

39. The program product of claim 29, further comprising instruction means stored in signal bearing media for locally updating said plurality of keywords within each of said local indices.

40. A computer program product stored in signal bearing media for facilitating a keyword search request initiated at a client station within a multilevel data network, wherein said multilevel data network includes a plurality of local sites each containing a plurality of data pages, said program product comprising:

instruction means stored in signal bearing media for, within each of said plurality of local sites, indexing keywords from said plurality of data pages into local databases, such that within said local databases, each of said keywords points to one or more of said plurality of data pages;

instruction means stored in signal bearing media for compiling and indexing said keywords from each of said local databases into a central database, such that within said central database, each of said keywords points only to at least one of said local sites;

instruction means stored in signal bearing media responsive to receiving an initial keyword search request from a graphical user interface on said client station, for searching said central database for local sites indexed in accordance with the contents of said initial keyword search request;

instruction means stored in signal bearing media for returning a list of one or more of said local sites indexed in accordance with the contents of said keyword search request to a search result window within said graphical user interface, wherein said search result window includes a keyword entry field and an independent search request selection field associated with each entry of said returned one or more local sites; and

instruction means stored in signal bearing media responsive to receiving a subsequent keyword search request issued in accordance with the contents of said search result window keyword entry field and selection of one or more of said independent search request selection fields, for searching said local databases for data pages indexed in accordance with the contents of said subsequent keyword search request.