Adapting data quality rules based upon user application requirements

• US 9,330,148 B2
• Filed: 06/30/2011
• Issued: 05/03/2016
• Est. Priority Date: 06/30/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dani, Mohan N., Gupta, Anuj, Mohania, Mukesh K., Venkatachaliah, Girish
• Primary Examiner(s): Syed, Farhan
• Application Number:
  US13/173,371
• Publication Number:
  US 20130007629A1
• Time in Patent Office: 1,769 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

During application of data quality rules to a data set obtained from a data source, data is retrieved from the data source along with a common set of rules configured to format the retrieved data in a manner in accordance with one or more predefined data quality rules of the common set of rules. At least one predefined data quality rule is adjusted utilizing at least one editable widget to form a modified set of data quality rules adapted for use with a specified application. The modified set of data quality rules is applied to the retrieved data.

Claims

1. A system for applying data quality rules to a data set obtained from at least one data source, the system comprising:

a source system to retrieve data from the at least one data source along with a common set of rules configured to format and output the retrieved data in a manner in accordance with one or more predefined data quality rules of the common set of rules; and

a client comprising at least one processor configured with logic to;

query the retrieved data from the source system;

receive the retrieved data along with the common set of rules from the source system, wherein the client includes a widget module comprising at least one editable widget including one or more control elements to facilitate adapting the common set of rules to be applied to the received data in accordance with an application of the client;

select the at least one editable widget from the widget module;

modify the common set of rules using the at least one editable widget in accordance with a specified application of the client during operation of the specified application to form a modified set of data quality rules such that an output of an element of the received data has a revised form with respect to output in accordance with the common set of rules, wherein the modification is specific to the specified application of the client; and

apply the modified set of data quality rules to the retrieved data such that the retrieved data is output in accordance with the modified set of data quality rules by the specified application,

wherein the client is further configured with logic to generate a widget by selecting attributes from data tables of the at least one data source and grouping the selected attributes with the widget, and

wherein each editable widget comprises a first graphical user interface listing attributes associated with the widget and at least one additional graphical user interface comprising at least one editable field that facilitates modification of a predefined data quality rule.

2. The system of claim 1, wherein each widget is associated with an entity that defines a category of data records, and the client is configured with logic to apply the modified set of data quality rules to records or columns of the retrieved data.

3. The system of claim 1, wherein the client is further configured with logic to edit the modified set of data quality rules for at least one widget during operation of the specified application by the client.

4. The system of claim 1, wherein each editable widget facilitates modification of a predefined data quality rule applied to one attribute associated with the widget separately from another attribute associated with the widget.

5. The system of claim 1, wherein the source system provides data retrieved from the at least one data source and the common set of rules to a plurality of clients.

6. A computer program product for applying data quality rules to a data set obtained from at least one data source, the computer program product comprising:

a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code configured to;

query data from the at least one data source;

receive the data retrieved from the at least one data source along with a common set of rules configured to format and output the retrieved data in a manner in accordance with one or more predefined data quality rules of the common set of rules;

select at least one editable widget from a widget module;

modify the common set of rules using the at least one editable widget in accordance with a specified application during operation of the specified application to form a modified set of data quality rules such that an output of an element of the received data has a revised form with respect to output in accordance with the common set of rules, wherein the modification of the one or more predefined data quality rules is specific to the specified application, and the at least one editable widget includes one or more control elements to facilitate adapting the common set of rules to be applied to the received data in accordance with the specified application; and

apply the modified set of data quality rules to the retrieved data such that the retrieved data is output in accordance with the modified set of data quality rules by the specified application,

wherein the computer readable program code is configured to generate a widget by selecting attributes from data tables of the at least one data source and grouping the selected attributes with the widget, and

wherein each editable widget comprises a first graphical user interface listing attributes associated with the widget and at least one additional graphical user interface comprising at least one editable field that facilitates modification of a predefined data quality rule.

7. The computer program product of claim 6, wherein each widget is associated with an entity that defines a category of data records, and the modified set of data quality rules is applied by the computer readable program code to records or columns of the retrieved data.

8. The computer program product of claim 6, wherein the computer readable program code is configured to edit the modified set of data quality rules for at least one widget during operation of the specified application.

9. The computer program product of claim 6, wherein each editable widget facilitates modification of a predefined data quality rule applied to one attribute associated with the widget separately from another attribute associated with the widget.