Search system for providing fulltext search over web pages of world wide web servers

• US 6,304,872 B1
• Filed: 08/13/1998
• Issued: 10/16/2001
• Est. Priority Date: 08/13/1998
• Status: Expired due to Fees

• Current Assignee: Tornado Technologies Co. Ltd.
• Original Assignee: Tornado Technologies Co. Ltd.
• Inventors: Chao, Kuo-Jen
• Primary Examiner(s): Black, Thomas
• Assistant Examiner(s): CHEUNG, MARY DA ZHI WANG
• Application Number:
  US09/133,674
• Time in Patent Office: 1,160 Days
• Field of Search: 707/1-6
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

The present invention provides a search system for providing fulltext search over web pages of world wide web servers which can save memory by storing only text, path and hyperlink data of a web page and excluding extraneous data. The system comprises a server connected to an internet, a plurality of data groups with web page data, and a management program. One user can input search parameter such as keywords into the search system over which the management program uses the search parameters to find matching web pages using an index file within the data groups, generates path data for the matched web pages and outputs the path and text data in a standard http format. The search system retrieve only text and path data of each web page and leaves out extraneous data so that the memory space of the server can be saved.

Claims

1. A search system for providing fulltext search of web pages of world wide web servers connected to an internet, the search system comprising:

an internet server connected to the internet;

a plurality of data groups stored in the server, each of the data groups comprising data from web pages of one world wide web server connected to the internet; and

a management program stored in the server for managing operations of the server and providing users with the fulltext search service over the data groups, the management program comprising a data group creating module for creating the data group of each of the world wide web servers for fulltext search;

wherein each of the data groups in the server comprises;

a text file for recording the text data contained in each of the web pages of the corresponding world wide web server;

a path file for recording path data of each of the web pages contained in the text file of the same data group; and

an index file for providing fulltext search for text data contained in the text file of the same data group;

wherein according to at least one user specified search parameter, the management program uses the index file of each data group to search the text file of the same data group to find web pages of the corresponding world wide web server which fit the specified search parameter, uses the text file of the same data group to retrieve text data of each web page which fits the search parameter, uses the path file of the same data group to find the path data of each of the web pages of the corresponding world wide web server which fit the specified search parameter, and then outputs the result in a predetermined format, and when creating one data group for a world wide web server, the data group creating module first connects to the world wide web server through the internet, retrieves text and path data stored in the web pages of the world wide web server, creates one text file and one path file using the retrieved data, and then creates one index file using the text file for fulltext search of the text data contained in the text file, and after retrieving the text data and path data contained in each of the web pages, the management program abandons all the other data to save memory space.

2. The search system of claim 1 wherein the management program outputs the text data and path data of the web pages which fit the specified search parameter in accordance with the http standard web page format.

3. The search system of claim 1 wherein the management program outputs a title portion or part of the text data contained in the web pages which fit the specified search parameter.

4. The search system of claim 1 wherein the search parameter is a keyword or a combination of keywords.

5. The search system of claim 1 wherein the path file of each data group comprises internal paths of all the web pages of the corresponding world wide web server and the internet address of the world wide web server on the internet, and wherein the internal paths and the internet address are included in the path data outputted by the management program.

6. A method for creating a data group for a world wide web server connected to an internet in a full text search system, the search system comprising:

an internet server connected to the internet for storing the data group of the world wide web server; and

a management program stored in the server for managing operations of the server and creating the data group of the world wide web server;

the data group of the world wide web server comprising;

a text file for recording the text data contained in web pages of the world wide web server;

a path file for recording path data of each of the web pages in the text file of the data group; and

an index file for providing fulltext search for the text data contained in the text file of the data group;

the method of creating the data group comprising;

connecting the server with the world wide web server through the internet;

retrieving text data from each of the web pages of the world wide web server to create the text file;

retrieving path data from each of the web pages of the world wide web server to create the path file;

using text data contained in each of the web pages of the world wide web server to create the index file for providing fulltext search over the text data of the web pages in the world wide web server; and

after retrieving the text data and path data contained in each of the web pages, the management program abandoning all the other data to save memory space.

7. The method of claim 6 wherein when retrieving the text data and path data contained in each of the web pages, the management program can retrieve the data from all the web pages, a predetermined number of web pages, or all of the web pages in a predetermined tree structure from the world wide web server.

8. A search system for providing full text search of web pages of world wide web servers connected to an internet, the search system comprising:

an internet server connected to the internet;

a text file for recording the text data contained in each of the web pages;

a path file for recording path data of each of the web pages contained in the text file;

an index file for providing fulltext search for the text data contained in the text file; and

a management program stored on the server for managing operations of the server and using the path file and the index file to provide users with the fulltext search service, the management program comprising a data creation module for creating the path file, the index file and the text file for fulltext search;

wherein according to at least one user specified search parameter, the management program uses the index file of each data group to search the text file to find web pages of a world wide web server which fit the specified search parameter, uses the path file of each data group to find the path data of each of the web pages of the corresponding world wide web server which fit the specified search parameter, and then outputs the result in a predetermined format, and when creating data for a world wide web server, the data creation module first connects to the world wide web server through the internet, retrieves text and path data stored in the web pages of the world wide web server, creates one text file and one path file using the retrieved data, and then creates one index file using the text file for fulltext search of the text data contained in the text file, and after retrieving the text data and path data contained in each of the web pages, the management program abandons all the other data to save memory space.

9. The search system of claim 8 wherein the management program outputs the text data and path data of the web pages which fit the specified search parameter in accordance with the http standard web page format.

10. The search system of claim 8 wherein the management program outputs a title portion or part of the text data contained in the web pages which fit the specified search parameter.

11. The search system of claim 8 wherein the search parameter is a keyword or a combination of keywords.

12. The search system of claim 8 wherein the path file of each data group comprises internal paths of all the web pages of the corresponding world wide web server and the internet address of the world wide web server on the internet, and wherein the internal paths and the internet address are included in the path data outputted by the management program.