Data Extraction System, Terminal Apparatus, Program of the Terminal Apparatus, Server Apparatus, and Program of the Server Apparatus

• US 20090106396A1
• Filed: 10/27/2005
• Published: 04/23/2009
• Est. Priority Date: 09/06/2005
• Status: Active Grant

• Current Assignee: Square Enix Holdings Co., Ltd.
• Original Assignee: Community Engine Incorporated
• Inventors: Nakajima, Kengo
• Granted Patent: US 8,321,198 B2
• Time in Patent Office: Days
• US Class Current: 709/219
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching

Abstract

This invention provides a terminal searching for web pages on the web and extracting the prescribed data from the web pages and a server verifying and accumulating the extracted data. The prescribed data can be extracted from the web pages on the web in a manner that the process relating to the data extraction is distributed between the terminal and the server. Therefore, necessary processes up to the data extraction are distributed, and the burden placed on each apparatus can be lessened. Further, new data not formerly found in the web pages can be found out and extracted from the web pages that has been updated or newly made.

Claims

1. A data extraction system for extracting prescribed data from a web page on the web, the data extraction system comprising:

a plurality of terminals; and

a server connected to the terminals,

wherein the server comprises;

a data accumulation unit for accumulating the prescribed data extracted by at least one of the plurality of terminals; and

a verification unit for verifying whether the extracted prescribed data is already accumulated by the data accumulation unit,

wherein the terminal comprises;

a search unit for searching for the web page from the web;

an extraction unit for extracting the prescribed data from the web page; and

an output unit for receiving from the server the prescribed data determined by the verification unit to not be already accumulated by the data accumulation unit or information corresponding to the prescribed data, and for outputting the prescribed data or the information corresponding to the prescribed data.

2. The data extraction system according to claim 1, wherein:

the prescribed data is a phrase having a prescribed part of speech of a morpheme or a prescribed combination of parts of speech of morphemes;

the server further comprises a part-of-speech accumulation unit for accumulating the prescribed part of speech of the morpheme or the prescribed combination of parts of speech of the morphemes for extracting the phrase; and

the terminal further comprises a morphological analysis unit for performing morphological analysis on text data in the web page searched for by the search unit, receives the part of speech of the morpheme or the combination of parts of speech of the morphemes accumulated by the part-of-speech accumulation unit from the server in advance, extracts from the text data, on which the morphological analysis unit performed morphological analysis, the phrase made up of a part of speech of a morpheme or a combination of parts of speech of morphemes identical to the part of speech of the morpheme or the combination of parts of speech of the morphemes received from the server, receives from the server the phrase determined by the verification unit to not be already accumulated by the data accumulation unit, and displays the phrase in a display screen through the output unit.

3. The data extraction system according to claim 2, wherein the server sends to all of the plurality of terminals the phrase determined by the verification unit to not be already accumulated by the data accumulation unit.

4. The data extraction system according to claim 2, wherein:

the server sends to the terminal, which has extracted the phrase by the extraction unit, the phrase determined by the verification unit to not be already accumulated by the data accumulation unit; and

the terminal that receives the phrase sends the phrase to another terminal.

5. The data extraction system according to claim 2, wherein the part-of-speech accumulation unit accumulates a new part of speech off a morpheme or a new combination of parts of speech of morphemes input by the terminal.

6. The data extraction system according to claim 2, wherein the server sends to the terminal only the phrase fulfilling a prescribed condition from among phrases extracted by the extraction unit.

7. The data extraction system according to claim 2, wherein the terminal receives only the web page fulfilling a prescribed condition.

8. The data extraction system according to claim 2, wherein the server sends to the terminal the part of speech of the morpheme or the combination of parts of speech of the morphemes requested by the terminal.

9. The data extraction system according to claim 2, wherein the output unit of the terminal, upon a phrase displayed in the display screen being selected, receives from the web the web page from which the phrase has been extracted and displays the web page on the display screen of the terminal.

10. The data extraction system according to claim 2, wherein the server calculates a number of times the phrase on the display screen of any one of the plurality of terminals is selected and sends the number of times to the terminal so that the terminal displays on the display screen a display based on the number of times in a manner that the number of times is associated with the phrase.

11. The data extraction system according to claim 2, wherein:

the terminal further comprises an image extraction unit for extracting an image from the web page searched for by the search unit;

the server receives the extracted image, comprises an image accumulation unit for accumulating the image, and verifies, by the verification unit, whether the extracted image is already accumulated by the image accumulation unit; and

the terminal receives from the server the information corresponding to the image determined by the verification unit to not be already accumulated in the image accumulation unit, and displays the information corresponding to the image in the display screen through the output unit.

12. The data extraction system according to claim 11, wherein:

the terminal contains an image compression unit for compressing to the prescribed number of bytes the image extracted by the image extraction unit by decreasing the size and the number of colors thereof; and

the server receives the image compressed by the image compression unit, accumulates the compressed image through the image accumulation unit, and verifies by the verification unit whether the image is already accumulated by the image accumulation unit based on bit strings of the compressed image.

13. The data extraction system according to claim 2, wherein:

the terminal contains a sound extraction unit for extracting a sound from the web page searched for by the search unit;

the server receives the extracted sound, comprises a sound accumulation unit for accumulating the sound, and verifies, by the verification unit, whether the extracted sound is already accumulated in the sound accumulation unit; and

the terminal receives from the server the information corresponding to the sound determined by the verification unit to not be already accumulated in the sound accumulation unit, and outputs the information corresponding to the sound through the output unit.

14. The data extraction system according to claim 13, wherein:

the terminal further comprises a sound compression unit for compressing a time-scale of the sound extracted by the sound extraction unit; and

the server receives the sound compressed by the sound compression unit, accumulates the compressed sound through the sound accumulation unit, and verifies by the verification unit whether the sound is already accumulated by the sound accumulation unit based on bit strings of the compressed sound.

15. The data extraction system according to claim 1, wherein the prescribed data is an image.

16. The data extraction system according to claim 1, wherein the prescribed data is a sound.

17. A terminal apparatus connected to a server and used by a data extraction system extracting prescribed data from a web page on the web, the terminal apparatus comprising:

a search unit for searching for the web page from the web;

an extraction unit for extracting the prescribed data from the web page;

a data sending unit for sending to the server the prescribed data extracted by the extraction unit;

a data reception unit for receiving, upon a verification whether the prescribed data sent by the data sending unit is already accumulated by a data accumulation unit of the server, from the server the prescribed data determined to not be already accumulated by the data accumulation unit or the information corresponding to the prescribed data; and

an output unit for outputting the prescribed data or the information corresponding to the prescribed data received by the data reception unit.

18. A program for a terminal apparatus connected to a server used by a data extraction system extracting prescribed data from a web page on the web, the program comprising:

a search process for searching for the web page from the web;

an extraction process for extracting the prescribed data from the web page;

a data sending process for sending to the server the prescribed data extracted by the extraction process;

a data reception process for receiving, upon a verification whether the prescribed data sent by the data sending process is already accumulated by a data accumulation process of the server, from the server the prescribed data determined to not be already accumulated by the data accumulation process or the information corresponding to the prescribed data; and

an output process for outputting the prescribed data or the information corresponding to the prescribed data received by the data reception process.

19. A server apparatus used by a data extraction system extracting prescribed data from a web page on the web, the server apparatus being connected to a plurality of terminals searching for the web page from the web and extracting the prescribed data from the web page, the server apparatus comprising:

a data reception unit for receiving from any one of the terminals the prescribed data extracted by the terminal;

a data accumulation unit for accumulating the prescribed data received by the data reception unit;

a verification unit for verifying whether the prescribed data received by the data reception unit is already accumulated by the data accumulation unit; and

a data sending unit for sending the prescribed data determined by the verification unit to not be accumulated by the data accumulation unit or information corresponding to the data so that the terminal displays the data or the information.

20. A program for a server apparatus used by a data extraction system extracting prescribed data from a web page on the web, the server apparatus being connected to a plurality of terminals searching for the web page from the web and extracting the prescribed data from the web page, the program comprising:

a data reception process for receiving from any one of the terminals the prescribed data extracted by the terminal;

a data accumulation process for accumulating the prescribed data received by the data reception process;

a verification process for verifying whether the prescribed data received by the data reception process is already accumulated by the data accumulation process; and

a data sending process for sending the prescribed data determined by the verification process to not be already accumulated by the data accumulation process or information corresponding to the prescribed data so that the terminal outputs the data or the information.