Data analysis method and apparatus for data mining

• US 6,510,457 B1
• Filed: 06/15/1999
• Issued: 01/21/2003
• Est. Priority Date: 06/17/1998
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Maeda, Akira, Morita, Toyohisa, Ayukawa, Erika, Ito, Yukiyasu
• Primary Examiner(s): Sheikh, Ayaz
• Assistant Examiner(s): Duong, Oanh
• Application Number:
  US09/332,896
• Time in Patent Office: 1,316 Days
• Field of Search: 792/17, 792/23, 792/24, 707/6, 707/10, 707/101, 707/505, 707/204, 707/2, 707/103, 706/25, 706/47, 379/34
• US Class Current: 709/217
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99936 Pattern matching access
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation

Abstract

Data analysis using online data summarization processing and rule-based data characteristic detection is performed at the time the transaction data is input. Online data input through an input device of a first server is stored into a transaction data memory device. A data summarizing device carries out summarization processing of online data according to stored parameters, and the resultant summary data is stored into a summary data memory device. A data joining device joins the summary data stored in the summary data memory device and the summary data transferred from a second server for the purpose of updating. In the first server, using rules generated by a rule generating device and stored in rule memory device, a detecting device detects characteristics of the summary data. Further, the results of data characteristic detection are sent to a client through.

Claims

1. A data analysis method using a first server and a second server, comprising the steps of:

a) generating summary data by summarizing transaction data input to said first server, and storing the thus generated summary data into said first server;

b) reading in summary data from said second server connected with said first server, and updating the summary data stored in said first server by joining the thus read-in summary data to the summary data stored in said first server;

c) generating rules using the summary data stored in said first server, and storing the thus generated rules into said first server;

d) selecting the transaction data to be added into the summary data based on conditions of the rules from transaction data added after the rules were generated; and

modifying the summary data using transaction data that is selecting in said selecting step.

2. A data analysis method as claimed in claim 1,

wherein said generating summary data is accomplished by deriving a sum value, a maximum value, a minimum value, a mode value or a weighted sum value from the input transaction data.

3. A data analysis method as claimed in claim 1,

wherein a timing point of summary data joining at said step b) is determined on the basis of a specific condition.

4. A data analysis method as claimed in claim 1,

wherein, in summary data joining at said step b), only the record updated after the previous joining in the summary data read from said second server is joined to the summary data stored in said first server.

5. A data analysis method as claimed in claim 1,

wherein, in summary data joining at said step b) non-summary data read from said second server is temporarily transformed to summary data, which is then joined to the summary data stored in said first server.

6. A data analysis method as claimed in claim 1,

wherein a timing point of rule generation processing at said step c) is determined on the basis of a specific condition.

7. A data analysis method as claimed in claim 1, wherein an If-Then rule is extracted to represent one of the conditions of the rules.

8. A data analysis method as claimed in claim 1, wherein an association rule is extracted to represent one of the conditions of the rules.

9. A data analysis system comprising:

data summarizing means for generating summary data by summarizing data extracted from transaction data and master data, and storing the thus generated summary data;

rule generating means for generating rules using the summary data, and storing the thus generated rules;

detecting means for detecting the transaction data to be added into the summary data based on conditions of the rules from transaction data added after the rules were generated; and

means for modifying the summary data using the detected transaction data.

10. A data analysis apparatus system as claimed in claim 9,

wherein said data joining means reads in non-summary data from said second server, temporarily transforms the non-summary data into summary data, and joining the thus transformed summary data to the summary data stored in said first server for updating.

14. A data analysis system as claimed in claim 9,

wherein the data analysis system comprises first server and second server connected mutually the transaction data is stored in the first server and the master data is stored in the second server.

11. A data analysis apparatus system including a server, said server comprising:

data summarizing means for generating summary data by summarizing input transaction data, and storing the thus generated summary data into said server;

rule generating means for generating rules using the summary data stored in said server, and storing the thus generated rules into said server;

means for selecting the transaction data to be added into the summary data based on conditions of the rules from transaction data added after the rules were generated; and

means for modifying the summary data using transaction data selected by the selecting means.

15. A data analysis apparatus system as claimed in claim 11,

wherein the selecting means first selects the transaction data based on summary ID, then selects based on the conditions of the rules.

12. A computer-readable storage medium containing programs for carrying out a data analysis method using a first server connected with a second server, said data analysis method comprising the steps of:

a) generating summary data by summarizing transaction data input to said first server, and storing the thus generated summary data into said first server;

b) reading in summary data from said second server connected with said first server, and updating the summary data stored in said first server by joining the thus read in summary data to the summary data stored in said first server;

c) generating rules using the summary data stored in said first server, and storing the thus generated rules into said first server;

d) selecting the transaction data to be added into the summary data based on conditions of the rules from transaction data added after the rules were generated; and

modifying the summary data using transaction data that is selecting in said selecting step.

13. A computer-readable storage medium containing programs for carrying out a data analysis method using a first server connected with a second server, said data analysis method comprising the steps of:

a) generating summary data by summarizing transaction data input to said first server, and storing the thus generated summary data into said first server;

b) temporarily transforming non-summary data read out of said second server, and joining the thus transformed summary data to the summary data stored in said first server;

c) generating rules using the summary data stored in said first server, and storing the thus generated rules into said first server;

d) selecting the transaction data to be added into the summary data based on conditions of the rules from transaction data added after the rules were generated; and

modifying the summary data using transaction data that is selecting in said selecting step.