DATA ANALYSIS SYSTEM AND METHOD

• US 20100318492A1
• Filed: 02/19/2010
• Published: 12/16/2010
• Est. Priority Date: 06/16/2009
• Status: Abandoned Application

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: UTSUGI, Kei
• Application Number:
  US12/709,298
• Publication Number:
  US 20100318492A1
• Time in Patent Office: Days
• US Class Current: 707/603
• CPC Class Codes: G06F 16/20 of structured data, e.g. relational data
• CPC Class Codes: G06F 2216/03 Data mining

Abstract

Provided is a technology capable of efficiently saving data generated at an intermediate stage of an analysis processing and reusing intermediate data. Data generated at the intermediate stage of the analysis is saved, quantified feedback information for the saved data is received as an evaluation value, and the intermediate data that has not been given an evaluation value is preferentially deleted while the analysis processing for similar data is performed with regard to the intermediate data that has received a particularly high evaluation value, thereby performing automatic management of the intermediate data by a background processing so that the analysis of data to be subjected to a comparison and a derivatively-assumed analysis can be performed at high speed.

Claims

1. A data analysis system for analyzing raw data and outputting an analysis result by using a computer comprising a processor and a storage device, comprising:

a raw data storage module for storing the raw data;

an analyzing module for reading the raw data, performing an analysis thereon, generating intermediate data in a process of the analysis, and outputting the analysis result;

an intermediate data storage module for storing the intermediate data generated by the analyzing module; and

an evaluation receiving module for receiving an evaluation value regarding the analysis result output by the analyzing module, wherein;

the analyzing module references usable intermediate data among the intermediate data within the intermediate data storage module at a time of the analysis; and

the evaluation receiving module distributes the evaluation value to the intermediate data corresponding to the evaluation value, and if the distributed evaluation value satisfies a predetermined condition, deletes the intermediate data corresponding to the evaluation value.

2. The data analysis system according to claim 1, wherein the analyzing module receives an analysis content, stores the analysis content onto the storage device, judges whether or not the analysis content and a past analysis content are similar to each other, and if the judgment results in similarity, generates, from the past analysis content and the received analysis content, a new analysis content that references the intermediate data in the intermediate data storage module to execute the new analysis content.

3. The data analysis system according to claim 1, further comprising a display module for displaying the analysis result,

wherein the evaluation receiving module receives the evaluation value regarding the displaying of the display module.

4. The data analysis system according to claim 1, wherein the analyzing module receives an analysis content, stores the analysis content onto the storage device, judges whether or not the intermediate data used for the analysis content and past intermediate data are similar to each other, and if the judgment results in similarity, generates new intermediate data by referencing, among the past intermediate data, the intermediate data used for the received analysis content from the intermediate data storage module to execute the analysis content by using the new intermediate data.

5. The data analysis system according to claim 1, wherein the evaluation value comprises at least one of a calculation cost taken for creation of the intermediate data, a size of the intermediate data, and a remaining capacity of the storage device.

6. The data analysis system according to claim 3, wherein the evaluation value comprises browsing information regarding the analysis result displayed in the display module.

7. A data analysis method of analyzing raw data and outputting an analysis result by using a computer comprising a processor and a storage device, comprising:

reading the raw data stored in the storage device;

generating intermediate data from the read raw data;

storing the intermediate data onto the storage device;

computing the analysis result from the intermediate data;

outputting the analysis result; and

receiving an evaluation value regarding the output analysis result, wherein;

the computing the analysis result from the intermediate data comprises referencing usable intermediate data among the intermediate data at a time of the analyzing; and

the receiving an evaluation value regarding the output analysis result comprises distributing the evaluation value to the intermediate data corresponding to the evaluation value, and if the distributed evaluation value satisfies a predetermined condition, deleting the intermediate data corresponding to the evaluation value.

8. The data analysis method according to claim 7, wherein the computing the analysis result from the intermediate data comprises receiving an analysis content, storing the analysis content onto the storage device, judging whether or not the analysis content and a past analysis content are similar to each other, and if the judgment results in similarity, generating, from the past analysis content and the received analysis content, a new analysis content that references the intermediate data to execute the new analysis content.

9. The data analysis method according to claim 7, wherein:

the outputting the analysis result comprises displaying the analysis result onto a display module of the computer; and

the receiving an evaluation value regarding the output analysis result comprises receiving the evaluation value regarding the displaying of the display module.

10. The data analysis method according to claim 7, wherein the computing the analysis result from the intermediate data comprises receiving an analysis content, storing the analysis content onto the storage device, judging whether or not the intermediate data used for the analysis content and past intermediate data are similar to each other, and if the judgment results in similarity, generating new intermediate data by referencing, among the past intermediate data, the intermediate data used for the received analysis content to execute the analysis content by using the new intermediate data.

11. The data analysis method according to claim 7, wherein the evaluation value comprises at least one of a calculation cost taken for creation of the intermediate data, a size of the intermediate data, and a remaining capacity of the storage device.

12. The data analysis method according to claim 9, wherein the evaluation value comprises browsing information regarding the analysis result displayed in the display module.