System and method for providing an aggregation tool

• US 9,619,579 B1
• Filed: 11/26/2013
• Issued: 04/11/2017
• Est. Priority Date: 01/31/2007
• Status: Active Grant

• Current Assignee: Experian Information Solutions Incorporated (Experian plc)
• Original Assignee: Experian Information Solutions Incorporated (Experian plc)
• Inventors: Courbage, Magali, Rodenbusch, Richard, Morani, Jean-Dominique
• Primary Examiner(s): Nguyen, Tien
• Application Number:
  US14/091,174
• Time in Patent Office: 1,232 Days
• Field of Search: 705 34, 705 39, 705 37, 705 38, 705 42, 705 26, 705 14, 705 40, 705 50, 705 10, 707748, 707737, 707706, 707708, 715726, 709217, 713162, 706 15, 706 45
• CPC Class Codes: G06F 1/00 Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00 architectures of general purpose stored program computers G06F15/76
• CPC Class Codes: G06F 11/07 Responding to the occurrence of a fault, e.g. fault tolerance
• CPC Class Codes: G06F 11/22 Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
• CPC Class Codes: G06F 16/90 Details of database functions independent of the retrieved data types
• CPC Class Codes: G06Q 40/03 Credit; Loans; Processing thereof
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange

Abstract

Embodiments of the present invention assist in the development, management, and deployment of aggregated data attributes for multiple data sources. One embodiment provides a development interface that allows for elements of attributes, including filters, to be moved into a coding area in which an attribute or an attribute element is being edited. In another embodiment, the user interface presents data fields to assist in the development of filters for multiple data sources with divergent formats. The application further provides a validation interface through which users can validate attributes and trace the results returned by various elements referenced by the attributes under validation. Another embodiment provides a system for managing attributes and deploying them to various systems by creating a deployment file that is used by an attribute calculation system. In one embodiment, the attribute calculation system is a scalable system that dynamically calculates attributes for multiple data sources.

Claims

1. A computer-implemented method for validating and calculating scores based on data from multiple data sources, comprising:

selecting a plurality of data sets from a plurality of data sources, wherein each of the plurality of data sources stores its data in a specific format distinct from the other data sources in the plurality of data sources;

defining a plurality of sets of filters, wherein each set of filters is associated with the specific format of each of the plurality of data sources;

defining definitions for a plurality of data source-independent attributes, wherein a definition for a data source-independent attribute of the plurality of data source-independent attributes comprises (a) a plurality of dependencies between the data source-independent attribute and a plurality of filters selected from at least a first set of filters and a second set of filters from the plurality of sets of filters, and (b) at least one reference between the data source-independent attribute and at least one reference function;

validating the definition for the data source-independent attribute via a validation user interface configured to display information in a format that allows identification of errors in one or more of the filters in the first and second sets of filters, the validating comprising;

selecting a first data source associated with millions of consumers from the plurality of data sources, the data source comprising a plurality of credit data lines related to the consumers, each credit line comprising at least a first raw data value of a first raw data and a second raw data value of a second raw data;

selecting a first filter in the first set of filters based upon a dependency between the data source-independent attribute and the first filter, wherein the first filter is associated with the specific format of the first selected data source;

applying the first filter to the first raw data value to generate at least one first filter value;

selecting a second data source associated with millions of consumers and selecting a second filter in the second set of filters based upon a dependency between the data source-independent attribute and the second filter, wherein the second filter is associated with the specific format of the second selected data source;

applying the second filter to the second raw data value to generate at least one second filter value;

calculating a credit data attribute value for the data source-independent attribute by applying the at least one function reference to one or more of the at least one first filter value, the at least one second filter value, or one or more raw data values;

displaying, for each credit data line, via the validation user interface, the at least one first filter value, the at least one second filter value, the first raw data value, and the second raw data value;

displaying, via the validation user interface, the credit data attribute value in association with a name of the data source independent attribute;

identifying a coding error in the first filter, the second filter, or the at least one reference function;

receiving a revised definition for the data source-independent attribute, comprising at least one edit to the first filter, the second filter, or the at least one reference function;

associating the plurality of data source-independent attributes with at least one deployment group;

generating a deployment package based on a deployment group of the at least one deployment group, wherein the deployment package includes computer instructions; and

deploying the deployment package to an attribute engine, wherein the attribute engine is configured to access at least a portion of the plurality of data sources to generate attribute values based upon one or more computer instructions included within the deployment package.

2. The method of claim 1 wherein the attribute engine is configured to select the plurality of data sets from the plurality of data sources using the plurality of filters and calculate attributes in the deployment package on the selected data sets.

3. The method of claim 2 wherein the attributes in the deployment package are attributes for a related set of individuals.

4. The method of claim 1, wherein the plurality of data sources comprises at least fifteen data sources.

5. The method of claim 1, wherein defining definitions for the plurality of data source-independent attributes comprises locking a first source-independent attribute of the plurality of data source-independent attributes while editing the first source-independent attribute of the plurality of data source-independent attribute, the locking preventing a second user from editing the first source-independent attribute.

6. The method of claim 1, further comprising displaying, via the validation user interface, raw credit data of at least thirteen credit data lines of the plurality of credit data lines.

7. The method of claim 1, wherein defining the plurality of sets of filters, comprises concurrently displaying, with a filter from the plurality of filters, via a coding user interface, a set of data fields from the plurality of data sources, each data field from the set of data fields being selectable to be inserted, via the coding user interface, into a filter formula.

8. A system for validating and calculating scores based on data from multiple data sources, the system comprising:

one or more physical processors; and

non-transitory computer storage comprising code executable by the one or more physical processors, the executable code causing the one or more processors to, when executed;

select a plurality of data sets from a plurality of data sources, wherein each of the plurality of data sources stores its data in a specific format distinct from the other data sources in the plurality of data sources;

define a plurality of sets of filters, wherein each set of filters is associated with the specific format of each of the plurality of data sources;

define definitions for a plurality of data source-independent attributes, wherein a definition for a data source-independent attribute of the plurality of data source-independent attributes comprises (a) a plurality of dependencies between the data source-independent attribute and a plurality of filters selected from at least a first set of filters and a second set of filters from the plurality of sets of filters, and (b) at least one reference between the data source-independent attribute and at least one reference function;

validate the definition for the data source-independent attribute via a validation user interface configured to display information in a format that allows identification of errors in one or more of the filters in the first and second sets of filters, wherein causing the one or more processors to validate the definition comprises causing the one or more processors to;

select a first data source associated with a consumer from the plurality of data sources, the data source comprising a plurality of credit data lines related to the consumer, each credit line comprising at least a first raw data value of a first raw data and a second raw data value of a second raw data;

select a first filter in the first set of filters based upon a dependency between the data source-independent attribute and the first filter, wherein the first filter is associated with the specific format of the selected first data source;

apply the first filter to the first raw data value to generate at least one first filter value;

select a second source associated with the consumers and select a second filter in the second set of filters based upon a dependency between the data source-independent attribute and the second filter, wherein the second filter is associated with the specific format of the selected second data source;

apply the second filter to the second raw data value to generate at least one second filter value;

calculate a credit data attribute value for the data source-independent attribute by applying the at least one function reference to one or more of the first filter value, the second filter value, or one or more raw data values;

display, for each credit data line, via the validation user interface, the at least one first filter value, the at least one second filter value, the first raw data value, and the second raw data value;

display, via the validation user interface, the credit data attribute value in association with a name of the data source independent attribute;

identify a coding error in the first filter, the second filter, or the at least one reference function;

receive a revised definition for the data source-independent attribute, comprising at least one edit to the first filter, the second filter, or the at least one reference function;

associate the plurality of data source-independent attributes to at least one deployment group;

generate a deployment package based on a deployment group of the at least one deployment group; and

deploy the deployment package to an attribute engine, wherein the attribute engine is configured to generate attribute values based upon one or more computer instructions included within the deployment package.

9. The system of claim 8 wherein the attribute engine is configured to select the plurality of data sets from the plurality of data sources using the plurality of filters and calculate attributes in the deployment package on the selected data sets.

10. The system of claim 9 wherein the attributes in the deployment package are attributes for a related set of individuals.

11. The system of claim 8, wherein the plurality of data sources comprises at least 15 data sources.

12. The system of claim 8, wherein defining definitions for the plurality of data source-independent attributes comprises locking a first source-independent attribute of the plurality of data source-independent attributes while editing the first source-independent attribute of the plurality of data source-independent attribute, the locking preventing a second user from editing the first source-independent attribute.

13. The system of claim 8, further comprising displaying, via the validation user interface, raw credit data of at least thirteen credit data lines of the plurality of credit data lines.

14. The system of claim 8, wherein defining the plurality of sets of filters, comprises concurrently displaying, with a filter from the plurality of filters, via a coding user interface, a set of data fields from the plurality of data sources, each data field from the set of data fields being selectable to be inserted, via the coding user interface, into a filter formula.

15. A non-transitory computer storage medium which stores a client application comprising executable code, the executable code, when executed by the computing device, causing the computing device to perform operations comprising:

selecting a plurality of data sets from a plurality of data sources, wherein each of the plurality of data sources stores its data in a specific format distinct from the other data sources in the plurality of data sources;

defining a plurality of sets of filters, wherein each set of filters is associated with the specific format of each of the plurality of data sources;

defining definitions for a plurality of data source-independent attributes, wherein a definition for a data source-independent attribute of the plurality of data source-independent attributes comprises (a) a plurality of dependencies between the data source-independent attribute and a plurality of filters selected from at least a first set of filters and a second set of filters from the plurality of sets of filters, and (b) at least one reference between the data source-independent attribute and at least one reference function;

validating the definition for the data source-independent attribute via a validation user interface configured to display information in a format that allows identification of errors in one or more of the filters in the first and second sets of filters, the validating comprising;

selecting a data source associated with a consumer from the plurality of data sources, the data source comprising a plurality of credit data lines related to the consumer, each credit line comprising at least a first raw data value of a first raw data and a second raw data value of a second raw data;

selecting a first filter in the first set of filters based upon a dependency between the data source-independent attribute and the first filter, wherein the first filter is associated with the specific format of the selected data source;

applying the first filter to the first raw data value to generate at least one first filter value;

selecting a second filter in the second set of filters based upon a dependency between the data source-independent attribute and the second filter, wherein the second filter is associated with the specific format of the selected data source;

applying the second filter to the second raw data value to generate at least one second filter value;

calculating a credit data attribute value for the data source-independent attribute by applying the at least one function reference to one or more of the at least one first filter value, the at least one second filter value, or one or more raw data values;

displaying, for each credit data line, via the validation user interface, the at least one first filter value, the at least one second filter value, the first raw data value, and the second raw data value;

displaying, via the validation user interface, the credit data attribute value in association with a name of the data source independent attribute;

identifying a coding error in the first filter, the second filter, or the at least one reference function;

receiving a revised definition for the data source-independent attribute, comprising at least one edit to the first filter, the second filter, or the at least one reference function;

associating the plurality of data source-independent attributes to at least one deployment group;

generating a deployment package based on a deployment group of the at least one deployment group; and

deploying the deployment package to an attribute engine, wherein the attribute engine is configured to generate attribute values based upon one or more computer instructions included within the deployment package.

16. The non-transitory computer storage medium of claim 15

wherein the attribute calculation engine is configured to select the plurality of data sets from the plurality of data sources using the plurality of filters and calculate attributes in the deployment package on the selected data sets.

17. The non-transitory computer storage medium of claim 16, wherein the attributes in the deployment package are attributes for a related set of individuals.

18. The non-transitory computer storage medium of claim 15, wherein the plurality of data sources comprises at least 15 data sources.

19. The non-transitory computer storage medium of claim 15, wherein defining definitions for the plurality of data source-independent attributes comprises locking a first source-independent attribute of the plurality of data source-independent attributes while editing the first source-independent attribute of the plurality of data source-independent attribute, the locking preventing a second user from editing the first source-independent attribute.

20. The non-transitory computer storage medium of claim 15, wherein defining the plurality of sets of filters, comprises concurrently displaying, with a filter from the plurality of filters, via a coding user interface, a set of data fields from the plurality of data sources, each data field from the set of data fields being selectable to be inserted, via the coding user interface, into a filter formula.