Symmetry database system and method for data processing

• US 20050044086A1
• Filed: 08/18/2003
• Published: 02/24/2005
• Est. Priority Date: 08/18/2003
• Status: Abandoned Application

• Current Assignee: Taiwan Semiconductor Manufacturing Company Limited
• Original Assignee: Taiwan Semiconductor Manufacturing Company Limited
• Inventors: Liu, Cheng-Hwa, Chen, Chin-Hsuen
• Application Number:
  US10/643,241
• Publication Number:
  US 20050044086A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409

Abstract

A symmetry database system and method for data processing. The system includes a data source, a data preparation platform, and a plurality of process engines. In one embodiment, the separated business rules and the data preparation process of each process engine are integrated into the data preparation platform to avoid problems of asymmetry. The process engines are further configured to fetch data from the symmetry data source through a data generator and generate results according to the data.

Claims

1. A symmetry database system for a data processing system, comprising:

a data source for storing source data;

a data preparation platform to filter the source data into a symmetry data source; and

a plurality of process engines to fetch data from the symmetry data source and generate results according to the data.

2. The symmetry database system as claimed in claim 1 wherein the data source comprises a plurality of databases, the symmetry data source comprises a plurality of symmetry databases, and the data preparation platform filters data from the plurality of databases into corresponding symmetry databases.

3. The symmetry database system as claimed in claim 2 wherein the filtering operation of the data preparation platform is carried out by elements comprising:

logic for aligning data in the data source to link the databases in the data source;

logic for nature-checking the aligned data; and

logic for checking the aligned data by applying business rules of the process engines to filter the data that does not pass the business rules, so as to generate the symmetry data source.

4. The symmetry database system as claimed in claim 3 wherein the filtering operation of the data preparation platform is carried out by an element comprising logic for filtering the aligned data using a flexible filter to generate the symmetry data source.

5. The symmetry database system as claimed in claim 3 wherein the data alignment operation of the data preparation platform is carried out by elements comprising:

logic for listing primary keys of source tables in the data source;

logic for finding popular items according to a frequency of the primary keys in the source tables and the business rules of the process engines; and

logic for finding at least one critical item from the popular items, whereby the databases in the data source can be linked using at least one the critical item.

6. The symmetry database system as claimed in claim 1 further comprising a plurality of data generators corresponding to each process engine to fetch the data needed by each process engine from the symmetry data source.

7. The symmetry database system as claimed in claim 1 further comprising an application interface to provide users with access to the data source in real time.

8. The symmetry database system as claimed in claim 7 further comprising a monitor unit to monitor access of the data source through the application interface, and notify administrators or other responsible parties if a process engine crashes or result errors occur.

9. The symmetry database system as claimed in claim 8 wherein the monitor unit further identifies and repairs problems corresponding to process engine crashes or result errors according to the data source and the symmetry data source.

10. The symmetry database system as claimed in claim 1 wherein the process engines are serial data process engines.

11. A symmetry database method for a data processing system, comprising the steps of:

providing a data source for storing source data;

filtering the source data into a symmetry data source using a data preparation platform; and

fetching data from the symmetry data source by a plurality of process engines, and generating results according thereto.

12. The symmetry database method as claimed in claim 11 wherein the data source comprises a plurality of databases, the symmetry data source comprises a plurality of symmetry databases, and the data preparation platform filters data from the plurality of databases into corresponding symmetry databases.

13. The symmetry database method as claimed in claim 12 wherein the filtering method of the data preparation platform comprises:

aligning data in the data source to link the databases in the data source;

nature-checking the aligned data; and

checking the aligned data by applying business rules of the process engines to filter the data that does not pass the business rules, so as to generate the symmetry data source.

14. The symmetry database method as claimed in claim 13 wherein the filtering method of the data preparation platform further comprising filtering the aligned data using a flexible filter to generate the symmetry data source.

15. The symmetry database method as claimed in claim 13 wherein the data alignment method of the data preparation platform comprises:

listing primary keys of source tables in the data source;

finding popular items according to a frequency of the primary keys in the source tables and the business rules of the process engines; and

finding at least one critical item from the popular items, by which the databases in the data source can be linked.

16. The symmetry database method as claimed in claim 11 wherein the data needed by each process engine is fetched from the symmetry data source by a corresponding data generator.

17. The symmetry database method as claimed in claim 11 further allowing users to access the data source in real time.

18. The symmetry database method as claimed in claim 17 further monitoring accesses of the data source in real time, and notifying administrators or other responsible parties if a process engine crashes or result errors occur.

19. The symmetry database method as claimed in claim 18 further identifying and repairing problems corresponding to process engine crashes or result errors according to the data source and the symmetry data source.

20. The symmetry database system as claimed in claim 11 wherein the process engines are serial data process engines.