Document tabulation method and apparatus and medium for storing computer program therefor

• US 20050165819A1
• Filed: 09/02/2004
• Published: 07/28/2005
• Est. Priority Date: 01/14/2004
• Status: Abandoned Application

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Kudoh, Yoshimitsu, Aizono, Toshiko, Koizumi, Atsuko
• Application Number:
  US10/932,026
• Publication Number:
  US 20050165819A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification

Abstract

Aids in creating axes from the bottom up using a huge volume of document data and, during the process, aids the user to discover an analytical point of view. The following processing is performed: (1) the system extracts search formula candidates for categories (referred to as category candidates) and the user selects from among the extracted category candidates; (2) the system creates axes from the category candidates selected by the user; and (3) the user determines a name of each axis (i.e., name of analytical point of view). Of these steps, the system aids in the step (1).

Claims

1. In a text mining system having a database to store a plurality of documents, a processing unit, a display unit and a user input device;

a document tabulation support method for generating a document tabulation axis containing a plurality of categories for document tabulation, wherein the document tabulation classifies the plurality of documents into the plurality of categories to create a table, the document tabulation support method comprising the steps of;

displaying on the display unit a plurality of terms extracted from the plurality of documents stored in the database;

accepting in the user input device a first user input to select at least a part of the displayed, extracted terms;

extracting co-occurrence words of the selected, extracted terms from the plurality of documents, setting the co-occurrence words as a plurality of category candidates and evaluating a co-occurrence strength between the plurality of category candidates and the extracted terms;

displaying on the display unit at least a part of the category candidates in the order of the co-occurrence strength;

accepting in the user input device a second user input to select at least a part of the displayed category candidates; and

in the processing unit, determining the category candidates selected based on the first user input as categories and generating a document tabulation axis by using the categories.

2. A document tabulation support method according to claim 1, further including the steps of:

evaluating the plurality of category candidates based on information about co-occurrence words of the selected category candidates;

displaying on the display unit the plurality of category candidates according to a result of the evaluation; and

in the processing unit, adding to the categories category candidates selected by a third user input accepted in the user input device and generating a document tabulation axis by using the categories.

3. A document tabulation support method according to claim 1, wherein the processing unit narrows document data down to those document data containing the extracted terms selected by the first user input, evaluates a co-occurrence strength between the plurality of category candidates and the extracted terms in the narrowed document data, and displays on the display unit the first plurality of category candidates in the order of the co-occurrence strength.

4. A document tabulation support method according to claim 1, wherein the processing unit generates a plurality of document tabulation axes, extracts a plurality of axis pairs, or combinations of two axes, from the plurality of document tabulation axes, and calculates evaluation values to evaluate a quality of document tabulation that uses a synthesized axis comprised of two document tabulation axes or each of the plurality of axis pairs;

wherein the display unit displays the plurality of axis pairs in the order of magnitude of the evaluation value.

5. A document tabulation support method according to claim 1, wherein the processing unit creates a plurality of document tabulation axes, extracts a plurality of cross-tabulation table candidate axis pairs, or combinations of two axes, from the plurality of document tabulation axes, and calculates evaluation values to evaluate a quality of document tabulation that uses as an ordinate and an abscissa the two document tabulation axes in each of the plurality of cross-tabulation table candidate axis pairs;

wherein the display unit displays the plurality of cross-tabulation table candidate axis pairs in the order of magnitude of the evaluation value.

6. A document tabulation support method according to claim 5, wherein at least one of the document tabulation axes from which to extract the cross-tabulation table candidate axis pairs is a synthesized axis formed by combining two document tabulation axes.

7. A text mining system for aiding a generation of a document tabulation axis containing a plurality of categories for document tabulation, wherein the document tabulation classifies a plurality of documents into the plurality of categories to create a table, the text mining system comprising:

a database to store a plurality of documents;

a processing unit to select a plurality of categories for the document tabulation axis by using the plurality of documents read from the database;

a display unit; and

a user input device to accept a user input;

wherein, for extracted terms selected by a first input from the user input device, the processing unit extracts co-occurrence words from the plurality of documents to determine a plurality of category candidates, evaluates a co-occurrence strength between the plurality of the category candidates and the extracted terms, determines as categories at least a part of the category candidates that is selected by a second input from the user input device, and generates a document tabulation axis by using the categories;

wherein the display unit displays the extracted terms and also displays the plurality of category candidates in the order of the evaluated co-occurrence strength.

8. A text mining system according to claim 7, wherein the processing unit evaluates the plurality of category candidates based on information about co-occurrence words of the determined categories,

the display unit displays the plurality of category candidates in the order based on their evaluation, and

the processing unit adds to the categories category candidates selected by a third input accepted in the user input device and creates a document tabulation axis by using the categories.

9. A text mining system according to claim 7, wherein the processing unit narrows document data down to those document data containing the extracted terms selected by the first user input and evaluates a co-occurrence strength between the plurality of category candidates and the extracted terms in the narrowed document data, and the display unit displays the first plurality of category candidates in the order of the co-occurrence strength.

10. A text mining system according to claim 7, wherein the processing unit creates a plurality of document tabulation axes, extracts a plurality of axis pairs, or combinations of two axes, from the plurality of document tabulation axes, and calculates evaluation values to evaluate a quality of document tabulation that uses a synthesized axis comprised of two document tabulation axes or each of the plurality of axis pairs;

wherein the display unit displays the plurality of axis pairs in the order of magnitude of the evaluation value.

11. A text mining system according to claim 7, wherein the processing unit creates a plurality of document tabulation axes, extracts a plurality of cross-tabulation table candidate axis pairs, or combinations of two axes, from the plurality of document tabulation axes, and calculates evaluation values to evaluate a quality of document tabulation that uses as an ordinate and an abscissa the two document tabulation axes in each of the plurality of cross-tabulation table candidate axis pairs;

wherein the display unit displays the plurality of cross-tabulation table candidate axis pairs in the order of magnitude of the evaluation value.

12. A text mining system according to claim 11, wherein at least one of the document tabulation axes from which to extract the cross-tabulation table candidate axis pairs is a synthesized axis formed by combining two document tabulation axes.

13. In a text mining system having a database to store a plurality of documents, a processing unit, a display unit and a user input device;

a document tabulation support program for generating a document tabulation axis containing a plurality of categories for document tabulation, wherein the document tabulation classifies the plurality of documents into the plurality of categories to create a table, the document tabulation support program comprising;

a first step of displaying on the display unit a plurality of terms extracted from the plurality of documents stored in the database;

a second step of accepting in the user input device a first user input to select at least a part of the displayed, extracted terms;

a third step of causing the processing unit to extract co-occurrence words of the selected, extracted terms from the plurality of documents, to set the co-occurrence words as a plurality of category candidates and to evaluate a co-occurrence strength between the plurality of category candidates and the extracted terms;

a fourth step of displaying on the display unit at least a part of the category candidates in the order of the co-occurrence strength;

a fifth step of accepting in the user input device a second user input to select at least a part of the displayed category candidates;

a sixth step of causing the processing unit to determine the category candidates selected based on the first user input as categories; and

a seventh step of causing the processing unit to create a document tabulation axis by using the categories.

14. A document tabulation support program according to claim 13, wherein the sixth step includes an eighth step of evaluating the plurality of category candidates based on information of co-occurrence words of the determined categories and a ninth step of adding to the categories category candidates selected by a third user input accepted in the user input device.

15. A document tabulation support program according to claim 13, wherein the third step includes a tenth step of narrowing document data down to those document data containing the extracted terms selected by the first user input, and evaluates a co-occurrence strength between the plurality of category candidates and the extracted terms in the narrowed document data.

16. A document tabulation support program according to claim 13, wherein the text mining system creates a plurality of document tabulation axes by performing the first to seventh step;

wherein the document tabulation support program causes the processing unit to execute an 11th step of extracting a plurality of axis pairs, or combinations of two axes, from the plurality of document tabulation axes and calculating evaluation values to evaluate a quality of document tabulation that uses a synthesized axis comprised of two document tabulation axes or each of the plurality of axis pairs;

wherein the document tabulation support program also causes the display unit to execute a 12th step of displaying the plurality of axis pairs in the order of magnitude of the evaluation value.

17. A document tabulation support program according to claim 13, wherein the text mining system creates a plurality of document tabulation axes by performing the first to seventh step;

wherein the document tabulation support program causes the processing unit to execute an 13th step of extracting a plurality of cross-tabulation table candidate axis pairs, or combinations of two axes, from the plurality of document tabulation axes and calculating evaluation values to evaluate a quality of document tabulation that uses as an ordinate the two document tabulation axes in each of the plurality of cross-tabulation table candidate axis pairs;

wherein the document tabulation support program also causes the display unit to execute a 14th step of displaying the plurality of cross-tabulation table candidate axis pairs in the order of magnitude of the evaluation value.

18. A document tabulation support program according to claim 17, wherein at least one of the document tabulation axes from which to extract the cross-tabulation table candidate axis pairs is a synthesized axis formed by combining two document tabulation axes.