DATA CATALOG AUTOMATIC GENERATION SYSTEM AND DATA CATALOG AUTOMATIC GENERATION METHOD

• US 20190310982A1
• Filed: 04/09/2019
• Published: 10/10/2019
• Est. Priority Date: 04/10/2018
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: AIKOH, Kazuhide, TERUYA, Eri
• Granted Patent: US 11,308,102 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 18/24765 Rule-based classification
• CPC Class Codes: G06N 5/025 Extracting rules from data
• CPC Class Codes: G06Q 10/063 Operations research, analysis or management

Abstract

A technology is disclosed that makes it possible even for an analyst, who has poor knowledge relating to field data, to select and use analysis data in analysis. A data catalog automatic generation system that generates a catalog tag to be used to select analysis data from collected field data is configured such that, based on a set classification rule input, a relationship between an objective variable as an analysis perspective relating to field data and an explanatory variable or a causal relationship between a plurality of the explanatory variables is extracted, and based on a result of the extraction, a catalog tag of the objective variable and a catalog tag of the explanatory function are specified and attached.

Claims

1. A data catalog automatic generation system that generates a catalog tag to be used to select analysis data from collected field data, comprising:

a field data acceptance section configured to accept the field data; and

a data management section configured to extract, based on a set classification rule, a relationship between an objective variable as an analysis perspective of the field data and an explanatory variable corresponding to the objective variable or a causal relationship between a plurality of the explanatory variables corresponding to the objective variable, and attach a catalog tag, based on a result of the extraction of the relationship or the causal relationship, to the field data to manage the field data.

2. The data catalog automatic generation system according to claim 1, wherein

the data management section specifies a catalog tag for the objective variable and a catalog tag for the explanatory variable on the basis of a source classification rule as the classification rule and supplementary information attached to source data that is an acquisition source of the field data.

3. The data catalog automatic generation system according to claim 2, wherein

the data management section extends the source classification rule on the basis of frequent word analysis used in a table relating to the objective variable and the explanatory variable or a relation priority degree between a plurality of columns in the table.

4. The data catalog automatic generation system according to claim 1, wherein

the data management section specifies, where a query having been used to generate a data mart satisfies a given condition, the field data having been used in the query on the basis of an operation classification rule as the classification rule, and attach a catalog tag of the objective variable to manage the field data.

5. The data catalog automatic generation system according to claim 4, wherein

the data management section estimates a different data mart from the query from which the data mart has been generated.

6. A data catalog automatic generation method for generating a catalog tag to be used to select analysis data from collected field data, comprising:

by a field data acceptance section, accepting the field data; and

by a data management section, extracting, based on a set classification rule, a relationship between an objective variable as an analysis perspective of the field data and an explanatory variable corresponding to the objective variable or a causal relationship between a plurality of the explanatory variables corresponding to the objective variable, and attaching a catalog tag, based on a result of the extraction of the relationship or the causal relationship, to the field data to manage the field data.