Distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing

• US 20060271568A1
• Filed: 05/25/2005
• Published: 11/30/2006
• Est. Priority Date: 05/25/2005
• Status: Active Grant

• Current Assignee: Experian Marketing Solutions, LLC (Experian plc)
• Original Assignee: Experian Marketing Solutions Incorporated (Experian plc)
• Inventors: Lindgren, Peter J., Tagliere, Eric Michael, Gutchell, Marc Louis, Balkir, Nevzat Hurkan
• Granted Patent: US 8,510,329 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

The various embodiments of the invention provide a data processing system and method, for applications such as marketing campaign management, speech recognition and signal processing. An exemplary system embodiment includes a first data repository adapted to store a plurality of entity and attribute data; a second data repository adapted to store a plurality of entity linkage data; a metadata data repository adapted to store a plurality of metadata modules, with a first metadata module having a plurality of selectable parameters, received through a control interface, and having a plurality of metadata linkages to a first subset of metadata modules; and a multidimensional data structure. The control interface may modify the plurality of selectable parameters in response to received control information. A plurality of processing nodes are adapted to use the plurality of selectable parameters to assemble a first plurality of data from the first and second data repositories and from input data, to reduce the first plurality of data to form a second plurality of data, and to aggregate and dimension the second plurality of data for storage in the multidimensional data structure.

Claims

1. A data processing system for marketing campaign management, comprising:

a plurality of data repositories, a first data repository of the plurality of data repositories adapted to store a plurality of entity and attribute data, a second data repository of the plurality of data repositories adapted to store a plurality of entity linkage data, and a metadata data repository of the plurality of data repositories adapted to store a plurality of metadata modules, a first metadata module of the plurality of metadata modules having a plurality of selectable parameters;

a control interface coupled to the plurality of data repositories, the control interface adapted to receive the plurality of selectable parameters;

a data storage device storing a multidimensional data structure; and

a plurality of processing nodes coupled to the plurality of data repositories, to the control interface, and to the data storage device, the plurality of processing nodes adapted to use the plurality of selectable parameters to perform a plurality of data processes, the plurality of data processes comprising assembling a first plurality of data from the first and second data repositories and from input data, reducing the first plurality of data to form a second plurality of data, and dimensioning and aggregating the second plurality of data for storage as the multidimensional data structure in the data storage device.

2. The system of claim 1, wherein the control interface is further adapted to modify the plurality of selectable parameters in response to received control information.

3. The system of claim 1, wherein the first metadata module has a corresponding plurality of metadata linkages to a first subset of metadata modules of the plurality of metadata modules, and wherein the corresponding plurality of metadata linkages comprise at least one metadata linkage type of the following group of metadata linkage types:

a common or communicated parameter of the plurality of modifiable parameters, a common or communicated attribute of a plurality of attributes, a common process definition, a common process flow, or a communication between processes.

4. The system of claim 1, wherein the control interface further comprises a user interface, the user interface adapted to provide for selection of the plurality of selectable parameters, selection of input data sources, selection of a plurality of attributes for data processing, selection and ordering of a subset of data processes of the plurality of data processes, and selection of a plurality of dimensions for aggregation.

5. The system of claim 1, further comprising:

a data input coupled to the plurality of processing nodes, the data input adapted to receive information from a plurality of data sources selectable through the control interface.

6. The system of claim 1, wherein the plurality of processing nodes are adapted to assemble the first plurality of data by performing in parallel and asynchronously at least two data assembly processes of the following group of data assembly processes:

a data input process, a data layout process, a data conversion process, a data correction process, a data audit process, a data matching process, a linkage assignment process, a linkage selection process, a data coding process, a data enhancement process, a data change detection process, or a data update process.

7. The system of claim 1, wherein at least one processing node of the plurality of processing nodes is adapted to use modeled information to provide a version of the plurality of selectable parameters.

8. The system of claim 1, wherein at least one processing node of the plurality of processing nodes is adapted to provide a plurality of dimensions for aggregation of the second plurality of data.

9. The system of claim 1, wherein at least one processing node of the plurality of processing nodes is adapted to dimension the second plurality of data using a plurality of attribute ranges selectable through the control interface.

10. The system of claim 1, wherein the plurality of processing nodes are further adapted to reduce the first plurality of data to form the second plurality of data, in parallel and asynchronously, and to store in an associated memory interim results comprising entity linkage data having a plurality of persistent identifiers.

11. The system of claim 1, wherein the plurality of processing nodes are adapted to reduce the first plurality of data to form the second plurality of data using at least one process of the following group of data reduction processes:

a data netdown process, a data suppression process, or a data prioritization process.

12. The system of claim 1, wherein at least one processing node of the plurality of processing nodes is adapted to use the multidimensional data structure to process a query received through the control interface and to provide a query response.

13. The system of claim 12, wherein at least one processing node of the plurality of processing nodes is adapted to determine a plurality of sets from the multidimensional data structure and to perform a plurality of set operations on the plurality of sets, the plurality of set operations comprising union operations, intersection operations, sum operations, and difference operations.

14. The system of claim 13, wherein the at least one processing node is adapted to determine a plurality of mutually exclusive sets from a plurality of sequential union sets by forming a difference set by subtracting a previous union set from a next union set.

15. The system of claim 1, wherein the plurality of processing nodes are further adapted to use a modified plurality of selectable parameters to reduce the first plurality of data to form a modified second plurality of data.

16. The system of claim 15, wherein the plurality of processing nodes are further adapted to use the modified plurality of selectable parameters to dimension and aggregate the modified second plurality of data.

17. The system of claim 1, wherein the plurality of processing nodes are further adapted to use a modified plurality of selectable parameters to re-dimension and re-aggregate the second plurality of data.

18. The system of claim 1, wherein the plurality of processing nodes are further adapted to provide a marketing campaign fulfillment process of the plurality of data processes, the marketing campaign fulfillment process comprising at least one process of the following group of fulfillment processes:

report generation;

postal services;

postal presort services;

inkjet services;

printing preparation services;

shipping services;

data extraction;

email formatting;

generation of a magnetic tape, disk or electronic file having selected names and physical addresses;

generation of email addresses;

selected content determination;

selected communication channel determination, variable formatting, and variable layout.

19. The system of claim 1, further comprising:

a network server coupled to the plurality of processing nodes, the network server adapted to receive control information transmitted from an authorized user.

20. The system of claim 1, further comprising:

a data processing selection and planning node coupled to the plurality of processing nodes, the data processing selection and planning node adapted to provide the plurality of selectable parameters in response to user input.

21. The system of claim 1, wherein the plurality of metadata modules define the plurality of data processes and further define a plurality of data structures stored in the plurality of data repositories.

22. The system of claim 1, wherein the plurality of metadata modules is comprised of at least two metadata modules of the following group:

a parties module, an accounting module, a hardware resource module, an activities definition module, a service invocation module, a process definition module, a marketing campaign definition module, a list selection module, a list layout module, and a data enhancement module.

23. The system of claim 22, wherein the marketing campaign definition module has a metadata linkage to the activities definition module, wherein the activities definition module defines a plurality of activities comprising a selected marketing campaign.

24. The system of claim 22, wherein the activities definition module has a metadata linkage to the process definition module, wherein the process definition module defines the plurality of data processes comprising a selected activity.

25. The system of claim 22, wherein the parties module and the activities definition module each have a metadata linkage to the accounting module, wherein the accounting module tracks costs and expenses associated with a plurality of activities for a selected party of a plurality of parties defined in the parties module.

26. The system of claim 1, wherein the entity linkage data comprises plurality of persistent identifiers linking individual or household entities to a corresponding plurality of attributes, the corresponding plurality of attributes comprising at least two of the attributes of the following group of attributes:

name, current address, name and address variations, previous address, age, gender, income, social security number, vehicle ownership, marital status, spouse name, spouse address, children names, children addresses, household identification, home ownership, purchasing histories, marketing responses, and employment histories.

27. The system of claim 1, wherein the plurality of data repositories comprises one or more databases having relational schema, a data warehouse having relational schema, and a data mart having a star or snowflake schema.

28. The system of claim 1, wherein the multidimensional data structure has a multidimensional, on-line analytical processing (OLAP) data cube schema.

29. The system of claim 1, wherein the plurality of data repositories are embodied as one or more of the following group of data storage devices:

a stored area network (SAN) magnetic disk array, a memory, a mainframe file system, partitioned database storage, a Unix file system, or a Windows file system.

30. The system of claim 1, wherein the plurality of processing nodes are embodied as one or more of the following group of processors:

a mainframe processing node, a clustered database node, a Unix application node, or a Windows application node.

31. A data processing system, comprising:

a control interface adapted to receive a first plurality of selectable parameters, a second plurality of selectable parameters, and a third plurality of selectable parameters, the control interface further adapted to modify the first, second and third pluralities of selectable parameters in response to received control information;

a data input adapted to receive input data;

a data and messaging network coupled to the control interface and to the data input interface;

a first data repository coupled to the data and messaging network, the first data repository adapted to store a plurality of entity data and a plurality of corresponding entity attribute data;

a second, linkage data repository coupled to the data and messaging network, the second data repository adapted to store a plurality of unique and persistent identifiers wherein each persistent identifier corresponds to each unique entity;

a data assembly processor coupled to the data and messaging network, the data assembly processor adapted to use the first plurality of selectable parameters to generate a first plurality of data from the first data repository, from the second data repository, and from input data;

a third data repository coupled to the data and messaging network, the third data repository adapted to store the first plurality of data;

a data reduction processor coupled to the data and messaging network, the data reduction processor adapted to use the second plurality of selectable parameters to generate a second plurality of data from the first plurality of data;

a fourth data repository coupled to the data and messaging network, the fourth data repository adapted to store the second plurality of data;

an aggregation processor coupled to the data and messaging network, the aggregation processor adapted to use the third plurality of selectable parameters to dimension and aggregate the second plurality of data; and

a fifth data repository coupled to the data and messaging network, the fifth data repository having a multidimensional data structure adapted to store the dimensioned and aggregated second plurality of data.

32. The system of claim 31, further comprising:

a sixth, metadata repository coupled to the data and messaging network, the sixth repository adapted to store a plurality of metadata modules, a first metadata module of the plurality of metadata modules comprising the first, second and third pluralities of selectable parameters, and the first metadata module having a corresponding plurality of metadata linkages to a first subset of metadata modules of the plurality of metadata modules.

33. The system of claim 31, wherein the data input is adapted to receive information from a plurality of data sources selectable through the control interface.

34. The system of claim 31, wherein the data assembly processor is adapted to perform at least one data assembly process of the following group of data assembly processes:

a data input process, a data layout process, a data conversion process, a data correction process, a data audit process, a data matching process, a linkage assignment process, a linkage selection process, a data coding process, a data enhancement process, a data change detection process, or a data update process.

35. The system of claim 31, further comprising:

an analytic recommendation processor coupled to the data and messaging network, the analytic recommendation processor adapted to use modeled information to provide a version of the first, second and third pluralities of selectable parameters.

36. The system of claim 31, further comprising:

an analytic recommendation processor coupled to the data and messaging network, the analytic recommendation processor adapted to provide a plurality of dimensions for aggregation of the second plurality of data.

37. The system of claim 31, wherein the aggregation processor is adapted to dimension the second plurality of data using a plurality of attribute ranges selectable through the control interface.

38. The system of claim 31, wherein the data reduction processor is further adapted to perform the data reduction process in parallel and asynchronously, and to store in an associated memory interim results comprising at least one set of a plurality of persistent identifiers.

39. The system of claim 31, wherein the data reduction processor performs at least one data reduction process of the following group of data reduction processes:

a data netdown process, a data suppression process, or a data prioritization process.

40. The system of claim 31, further comprising:

a processing node coupled to the data and messaging network, the processing node adapted to process a query and provide a query response using the multidimensional data structure, the query received through the control interface.

41. The system of claim 31, wherein the aggregation processor is adapted to determine a plurality of sets from the multidimensional data structure and to perform a plurality of set operations on the plurality of sets the plurality of set operations comprising union operations, intersection operations, sum operations, and difference operations.

42. The system of claim 41, wherein the aggregation processor is adapted to determine a plurality of mutually exclusive sets from a plurality of sequential union sets by forming a difference set by subtracting a previous union set from a next union set.

43. The system of claim 31, wherein the data reduction processor is further adapted to use a modified second plurality of selectable parameters to generate a modified second plurality of data from the first plurality of data.

44. The system of claim 43, wherein the aggregation processor is further adapted to dimension and aggregate the modified second plurality of data.

45. The system of claim 31, wherein the aggregation processor is further adapted to use a modified third plurality of selectable parameters to re-dimension and re-aggregate the second plurality of data.

46. The system of claim 31, further comprising:

a fulfillment processor coupled to the data and messaging network, the fulfillment processor adapted to provide a marketing campaign fulfillment process, the marketing campaign fulfillment process comprising at least one of the following processes;

report generation;

postal services;

postal presort services;

inkjet services;

printing preparation services;

shipping services;

data extraction;

email formatting;

generation of a magnetic tape, disk or electronic file having selected names and physical addresses;

generation of email addresses;

selected content determination;

selected communication channel determination, variable formatting, and variable layout.

47. The system of claim 31, further comprising:

a network server coupled to the data and messaging network, the network server adapted to receive control information transmitted from an authorized user.

48. The system of claim 31, further comprising:

a data processing selection and planning node coupled to the data and messaging network, the data processing selection and planning node adapted to provide the first, second and third pluralities of selectable parameters in response to user input.

49. The system of claim 31, wherein the system performs speech recognition from a plurality of received speech signals provided as input data.

50. The system of claim 31, wherein the system performs marketing campaign management.

51. A parallel and asynchronous data processing system for marketing campaign management, comprising:

a user interface;

a control interface;

a plurality of data processing nodes coupled through a data and messaging network to the user interface and to the control interface, the plurality of data processing nodes adapted to process data;

a first data repository coupled through the data and messaging network to the plurality of data processing nodes, the first data repository adapted to store a plurality of entity name and address information, and a plurality of corresponding entity attribute information;

a linkage data repository coupled through the data and messaging network to the plurality of data processing nodes, the linkage data repository adapted to store a plurality of unique and persistent identifiers wherein each persistent identifier corresponds to each unique entity;

a second data repository coupled through the data and messaging network to the plurality of data processing nodes, the second data repository adapted to store a first subset of information from the first data repository and the linkage data repository, the first subset of information including a first subset of entity attribute information;

a data storage device coupled through the data and messaging network to the plurality of data processing nodes, the data storage device adapted to store a multidimensional data structure, the multidimensional data structure having an aggregation of the first subset of information dimensioned with a first plurality of selected attributes of the first subset of entity attribute information, wherein the first plurality of selected attributes are adapted to be modifiable during data processing through the user interface or the control interface; and

wherein at least one processing node of the plurality of processing nodes is further adapted to determine the first subset of information stored in the second data repository and to dimension and aggregate the first subset of information using the first plurality of selected attributes.

52. The system of claim 51, further comprising:

a metadata repository coupled through the data and messaging network to the plurality of data processing nodes, the metadata repository adapted to store a plurality of metadata modules, a first metadata module of the plurality of metadata modules comprising a plurality of modifiable parameters adapted to be modifiable during data processing through the user interface or the control interface, and the first metadata module having a corresponding plurality of metadata linkages to a first subset of metadata modules of the plurality of metadata modules.

53. The system of claim 51, further comprising:

a data input coupled to data and messaging network, the data input adapted to receive information from a plurality of data sources.

54. The system of claim 53, wherein the plurality of data sources are selectable through the user interface or the control interface.

55. The system of claim 53, further comprising:

a third data repository coupled through the data and messaging network to the plurality of data processing nodes, the third data repository adapted to store a second subset of information from the plurality of data sources, from the first data repository, and from the linkage repository.

56. The system of claim 55, wherein at least one processing node of the plurality of processing nodes is further adapted to determine the second subset of information by performing a data assembly process on the information from the plurality of data sources, from the first data repository, and from the linkage repository, the data assembly process determined by a first plurality of selected parameters input through the user interface or the control interface.

57. The system of claim 56, wherein the data assembly process comprises at least two data assembly processes of the following group of data assembly processes:

a data input process, a data layout process, a data conversion process, a data correction process, a data audit process, a data matching process, a linkage assignment process, a linkage selection process, a data coding process, a data enhancement process, a data change detection process, or a data update process.

58. The system of claim 57, wherein at least one processing node of the plurality of processing nodes is further adapted to determine the first subset of information stored in the second data repository by performing a data reduction process on the plurality of entity name and address information and the plurality of corresponding entity attribute information, the data reduction determined by a second plurality of selected parameters input through the user interface or the control interface.

59. The system of claim 58, wherein the plurality of data processing nodes are further adapted to perform the data assembly process or the data reduction process in parallel and asynchronously.

60. The system of claim 58, wherein at least one processing node of the plurality of processing nodes is further adapted to store in an associated memory interim results obtained in the data reduction process, the interim results comprising at least one set of a plurality of persistent identifiers.

61. The system of claim 58, further comprising:

an analytic recommendation processor coupled through the data and messaging network to the plurality of data processing nodes, the analytic recommendation processor adapted to generate a subset of the second plurality of selected parameters.

62. The system of claim 58, wherein the data reduction process comprises at least one data reduction process of the following data reduction processes:

a data netdown process, a data suppression process, or a data prioritization process.

63. The system of claim 51, further comprising:

an analytic recommendation processor coupled through the data and messaging network to the plurality of data processing nodes, the analytic recommendation processor adapted to determine a subset of the first plurality of selected parameters.

64. The system of claim 51, wherein at least one processing node of the plurality of processing nodes is further adapted to process a query and provide a query response using the multidimensional data structure, the query received through the user interface or the control interface.

65. The system of claim 51, wherein at least one processing node of the plurality of processing nodes is further adapted to redetermine the first subset of information stored in the second data repository and to re-dimension and re-aggregate the first subset of information using a second plurality of selected attributes received through the user interface or the control interface.

66. The system of claim 51, wherein at least one processing node of the plurality of processing nodes is further adapted to provide a marketing campaign fulfillment process, the marketing campaign fulfillment process comprising at least one of the following processes:

report generation;

postal services;

postal presort services;

inkjet services;

printing preparation services;

shipping services;

data extraction;

email formatting;

generation of a magnetic tape, disk or electronic file having selected names and physical addresses;

generation of email addresses;

selected content determination;

selected communication channel determination, variable formatting, and variable layout.

67. The system of claim 51, further comprising:

an analytic recommendation processor coupled through the data and messaging network to the plurality of data processing nodes, the analytic recommendation processor adapted to generate a subset of the first plurality of selected attributes.

68. The system of claim 51, wherein at least one processing node of the plurality of processing nodes is further adapted to provide a plurality of dimensions for aggregation of the first subset of information.

69. The system of claim 51, wherein at least one processing node of the plurality of processing nodes is further adapted to dimension the first subset of information using a plurality of attribute ranges selectable through the control interface.

70. The system of claim 51, wherein at least one processing node of the plurality of processing nodes is adapted to determine a plurality of sets from the multidimensional data structure and to perform a plurality of set operations on the plurality of sets, the plurality of set operations comprising union operations and difference operations.

71. The system of claim 70, wherein the at least one processing node is adapted to determine a plurality of mutually exclusive sets from a plurality of sequential union sets by forming a difference set by subtracting a previous union set from a next union set.

72. A data processing method for marketing campaign management, comprising:

storing a plurality of entity and attribute data in a first data repository of a plurality of data repositories;

storing a plurality of entity linkage data in a second data repository of the plurality of data repositories;

receiving a plurality of selectable parameters;

storing a plurality of metadata modules in a metadata data repository of the plurality of data repositories, a first metadata module of the plurality of metadata modules referencing the plurality of selectable parameters;

using the plurality of selectable parameters, assembling a first plurality of data from the first and second data repositories and from input data;

using the plurality of selectable parameters, reducing the first plurality of data to form a second plurality of data;

using the plurality of selectable parameters, dimensioning and aggregating the second plurality of data; and

storing the aggregated and dimensioned second plurality of data in a multidimensional data structure.

73. The method of claim 72, further comprising:

modifying the plurality of selectable parameters in response to received control information.

74. The method of claim 72, wherein the first metadata module has a corresponding plurality of metadata linkages to a first subset of metadata modules of the plurality of metadata modules, the corresponding plurality of metadata linkages comprising at least one metadata linkage type of the following group of metadata linkage types:

a common or communicated parameter of the plurality of modifiable parameters, a common or communicated attribute of a plurality of attributes, a common process definition, a common process flow, or a communication between processes.

75. The method of claim 72, wherein the assembling of the first plurality of data further comprises:

performing in parallel and asynchronously at least two of the following group of processes;

a data input process, a data layout process, a data conversion process, a data correction process, a data audit process, a data matching process, a linkage assignment process, a linkage selection process, a data coding process, a data enhancement process, a data change detection process, or a data update process.

76. The method of claim 72, further comprising:

using modeled information to provide a version of the plurality of selectable parameters.

77. The method of claim 72, wherein the reducing of the first plurality of data to form the second plurality of data is performed in parallel and asynchronously, and further comprises storing interim results comprising entity linkage data having a plurality of persistent identifiers.

78. The method of claim 72, wherein the reducing of the first plurality of data to form the second plurality of data comprises at least one of the following group of processes:

a data netdown process, a data suppression process, or a data prioritization process.

79. The method of claim 72, further comprising:

processing a query and providing a query response using the multidimensional data structure.

80. The method of claim 72, further comprising:

using a modified plurality of selectable parameters to reduce the first plurality of data to form a modified second plurality of data; and

using the modified plurality of selectable parameters to aggregate and dimension the modified second plurality of data.

81. The method of claim 72, further comprising:

providing a marketing campaign fulfillment process, the marketing campaign fulfillment process comprising at least one of the following group of processes;

report generation;

postal services;

postal presort services;

inkjet services;

printing preparation services;

shipping services;

data extraction;

email formatting;

generation of a magnetic tape, disk or electronic file having selected names and physical addresses;

generation of email addresses;

selected content determination;

selected communication channel determination, variable formatting, and variable layout.

82. A tangible medium storing computer readable software for programming a parallel and asynchronous database architecture and data processing system for execution of marketing campaign management and analysis, the tangible medium storing computer readable software comprising:

first program means for receiving a plurality of selectable parameters, for modifying the plurality of selectable parameters in response to received control information or in response to modeled information to form a modified plurality of selectable parameters;

second program means for storing a plurality of entity and attribute data in a first data repository of a plurality of data repositories and for storing a plurality of entity linkage data in a second data repository of the plurality of data repositories; and

for storing a plurality of metadata modules in a metadata data repository of the plurality of data repositories, a first metadata module of the plurality of metadata modules referencing the plurality of selectable parameters;

third program means for using the plurality of selectable parameters to assemble in parallel and asynchronously a first plurality of data from the first and second data repositories and from input data;

to reduce the first plurality of data to form a second plurality of data; and

to dimension and aggregate the second plurality of data;

fourth program means for storing the dimensioned and aggregated second plurality of data in a multidimensional data structure;

fifth program means for processing a query and providing a query response using the multidimensional data structure; and

sixth program means for using the modified plurality of selectable parameters to reduce the first plurality of data to form a modified second plurality of data; and

using the modified plurality of selectable parameters to dimension and aggregate the modified second plurality of data.

83. The tangible medium storing computer readable software of claim 82, wherein the program means are embodied as a plurality of metadata modules, wherein a first metadata module of the plurality of metadata modules has a corresponding plurality of metadata linkages to a first subset of metadata modules of the plurality of metadata modules, the corresponding plurality of metadata linkages comprising at least one metadata linkage type of the following group of metadata linkage types:

a common or communicated parameter of the plurality of modifiable parameters, a common or communicated attribute of a plurality of attributes, a common process definition, a common process flow, or a communication between processes.

84. The tangible medium storing computer readable software of claim 82, wherein the third program means further comprises:

seventh program means for performing in parallel and asynchronously at least two of the following group of processes;

a data input process, a data layout process, a data conversion process, a data correction process, a data audit process, a data matching process, a linkage assignment process, a linkage selection process, a data coding process, a data enhancement process, a data change detection process, or a data update process.

85. The tangible medium storing computer readable software of claim 82, further comprising:

eighth program means for using modeled information to provide a version of the plurality of selectable parameters.

86. The tangible medium storing computer readable software of claim 82, further comprising:

ninth program means for reducing of the first plurality of data to form the second plurality of data is performed in parallel and asynchronously, storing interim results comprising entity linkage data having a plurality of persistent identifiers, and wherein the reducing of the first plurality of data to form the second plurality of data comprises at least one of the following group of processes;

a data netdown process, a data suppression process, or a data prioritization process.

87. The tangible medium storing computer readable software of claim 82, further comprising:

tenth program means for processing a query and providing a query response using the multidimensional data structure.

88. The tangible medium storing computer readable software of claim 82, further comprising:

eleventh program means for using a modified plurality of selectable parameters to reduce the first plurality of data to form a modified second plurality of data; and

for using the modified plurality of selectable parameters to aggregate and dimension the modified second plurality of data.

89. The tangible medium storing computer readable software of claim 82, further comprising:

twelfth program means for providing a marketing campaign fulfillment process, the marketing campaign fulfillment process comprising at least one of the following group of processes;

report generation;

postal services;

postal presort services;

inkjet services;

printing preparation services;

shipping services;

data extraction;

email formatting;

generation of a magnetic tape, disk or electronic file having selected names and physical addresses;

generation of email addresses;

selected content determination;

selected communication channel determination, variable formatting, and variable layout.

90. A data processing system for marketing campaign management, comprising:

a plurality of data repositories having a corresponding plurality of data structures, a first data repository of the plurality of data repositories adapted to store a plurality of entity data and entity attribute data, a second data repository of the plurality of data repositories adapted to store a plurality of entity linkage data, a third data repository of the plurality of data repositories adapted to store a plurality of metadata modules, wherein the plurality of metadata modules define a plurality of data processes, the plurality of data structures and a multidimensional data structure, and wherein a first metadata module of the plurality of metadata modules comprises a plurality of selectable parameters;

a control interface coupled to the plurality of data repositories, the control interface further comprising a user interface for selection of the plurality of selectable parameters, selection of input data sources, selection of a plurality of attributes for data processing, selection and ordering of a subset of data processes of the plurality of data processes, and selection of a plurality of dimensions for aggregation;

a data storage device storing the multidimensional data structure;

a plurality of processing nodes coupled to the plurality of data repositories, to the control interface, and to the data storage device, the plurality of processing nodes adapted to perform the subset of data processes in the selected order using the plurality of selectable parameters, the selection of the plurality of attributes, and the selection of the plurality of dimensions, wherein the subset of data processes comprises assembling asynchronously and in parallel a first plurality of data from the first and second data repositories and from the selection of input data sources, asynchronously reducing the first plurality of data to form a second plurality of data, and dimensioning and aggregating the second plurality of data for storage as the multidimensional data structure in the data storage device; and

wherein at least one processing node of the plurality of processing nodes is adapted to use the multidimensional data structure to process a query received through the control interface and to provide a query response, and wherein at least one processing node of the plurality of processing nodes is adapted to use modeled information to provide a suggested version of the plurality of selectable parameters.