Proactive analytic data set reduction via parameter condition injection

• US 8,326,848 B2
• Filed: 08/11/2009
• Issued: 12/04/2012
• Est. Priority Date: 08/11/2009
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dettinger, Richard Dean, Kulack, Frederick Allyn, Peters, Amanda E.
• Primary Examiner(s): LU, KUEN S
• Application Number:
  US12/538,980
• Publication Number:
  US 20110040775A1
• Time in Patent Office: 1,211 Days
• Field of Search: 707/755, 707/722
• US Class Current: 707/755
• CPC Class Codes: G06F 16/24556 Aggregation; Duplicate elimination

Abstract

Systems, methods and articles of manufacture are disclosed for injecting parameter conditions to reduce a size of a data set to be processed. A data set may be received to be processed by an analytic routine. The data set may include results from executing a first query. Further, input may be received from a user, the input specifying a parameter specific to the analytic routine to be performed on the data set. At least one condition associated with the specified parameter may be identified. A second query may be generated from the first query and the identified condition. The second query may be executed to generate a reduced data set. The analytic routine may be performed on the reduced data set to generate an output to the user.

Claims

1. A computer-implemented method for reducing a size of a data set to be processed by an analytic routine, the method comprising:

configuring one or more computer processors to perform an operation comprising;

receiving a data set to be processed by the analytic routine, wherein the data set includes a set of data records returned from executing a first query;

receiving, from a user, one or more parameters to pass with the data set to the to the analytic routine;

identifying, from the one or more parameters, one or more conditions having predefined relationships to the respective parameters;

evaluating each data record of the data set based on the one or more parameters and the one or more conditions to generate identify a reduced data set containing less than all of the set of data records;

performing the analytic routine on the reduced data set to generate a result set; and

outputting the result set, wherein evaluating each record of the data set includes

generating a second query from the first query, the one or more parameters, and the identified condition; and

executing the second query to generate the reduced data set.

2. The computer-implemented method of claim 1, wherein each record of the data set is evaluated to identify which records are to be excluded from the analytic routine.

3. The computer-implemented method of claim 1, wherein each record of the data set is evaluated to identify which records are to be included to the analytic routine.

4. The computer-implemented method of claim 1, wherein the analytic routine is a molecular docking routine configured to perform a docking analysis between a receptor specified by the parameter and each of a plurality of chemical structures, each of the plurality of chemical structures represented by a record of the data set, and wherein the output includes an activation energy for docking each chemical structure to the specified receptor.

5. The computer-implemented method of claim 1, wherein the operation further comprises:

identifying at least one element of the data present in the received data set that is not present in the reduced data set; and

conveying to the user identified elements excluded from processing by the analytic routine.

6. The computer-implemented method of claim 1, wherein both the first query and the second query are abstract queries composed from a plurality of logical fields of a database abstraction model, wherein each logical field identifies a name for the logical field and an access method that maps the logical field to a data source in a relational database, wherein each access method is selected from at least two different access method types, wherein each of the different access methods types defines a different manner of exposing, in the relational database, data corresponding to the name of the logical field, and wherein the database abstraction model comprises:

the plurality of logical fields;

a query building interface configured to allow the composition of an abstract query from the plurality of logical fields; and

a runtime component configured to process an abstract query to generate a resolved query of the relational database from the abstract query.

7. The computer-implemented method of claim 1, wherein the second query is executed against the data set to exclude one or more records of the data set that fail to satisfy the identified conditions, and wherein the reduced data set comprises the data set less the excluded one or more records.

8. A computer readable non-transitory storage medium containing a program which, when executed, performs an operation for reducing a size of a data set to be processed by an analytic routine, the operation comprising:

receiving a data set to be processed by the analytic routine, wherein the data set includes a set of data records returned from executing a first query;

receiving, from a user, one or more parameters to pass with the data set to the to the analytic routine;

identifying, from the one or more parameters, one or more conditions having predefined relationships to the respective parameters;

evaluating each data record of the data set based on the one or more parameters and the one or more conditions to generate a reduced data set containing less than all of the set of data records;

performing the analytic routine on the reduced data set to generate a result set; and

outputting the result set.

9. The computer readable non-transitory storage medium of claim 8, wherein evaluating each record of the data set comprises:

generating a second query from the first query, the one or more parameters, and the identified condition; and

executing the second query to generate the reduced data set.

10. The computer readable non-transitory storage medium of claim 8, wherein each record of the data set is evaluated to identify which records are to be excluded from the analytic routine.

11. The computer readable non-transitory storage medium of claim 8, wherein each record of the data set is evaluated to identify which records are to be included to the analytic routine.

12. The computer readable non-transitory storage medium of claim 8, wherein the analytic routine is a molecular docking routine configured to perform a docking analysis between a receptor specified by the parameter and each of a plurality of chemical structures, each of the plurality of chemical structures represented by a record of the data set, and wherein the output includes an activation energy for docking each chemical structure to the specified receptor.

13. The computer readable non-transitory storage medium of claim 8, wherein the operation further comprises:

identifying at least one element of the data present in the received data set that is not present in the reduced data set; and

conveying to the user identified elements excluded from processing by the analytic routine.

14. The computer readable storage medium of claim 8, wherein both the first query and the second query are abstract queries composed from a plurality of logical fields of a database abstraction model, wherein each logical field identifies a name for the logical field and an access method that maps the logical field to a data source in a relational database, wherein each access method is selected from at least two different access method types, wherein each of the different access methods types defines a different manner of exposing, in the relational database, data corresponding to the name of the logical field, and wherein the database abstraction model comprises:

the plurality of logical fields;

a query building interface configured to allow the composition of an abstract query from the plurality of logical fields; and

a runtime component configured to process an abstract query to generate a resolved query of the relational database from the abstract query.

15. The computer readable non-transitory storage medium of claim 8, wherein the second query is executed against the data set to exclude one or more records of the data set that fail to satisfy the identified conditions, and wherein the reduced data set comprises the data set less the excluded one or more records.

16. A system, comprising:

a processor; and

a memory containing a program, which when executed by the processor is configured to perform an operation for reducing a size of a data set to be processed by an analytic routine, the operation comprising;

receiving a data set to be processed by the analytic routine, wherein the data set includes a set of data records returned from executing a first query,

receiving, from a user, one or more parameters to pass with the data set to the to the analytic routine,

identifying, from the one or more parameters, one or more conditions having predefined relationships to the respective parameters,

evaluating each data record of the data set based on the one or more parameters and the one or more conditions to generate identify a reduced data set containing less than all of the set of data records,

performing the analytic routine on the reduced data set to generate a result set, and

outputting the result set, wherein evaluating each record of the data set includes,

generating a second query from the first query, the one or more parameters, and the identified condition; and

executing the second query to generate the reduced data set.

17. The system of claim 16, wherein each record of the data set is evaluated to identify which records are to be excluded from the analytic routine.

18. The system of claim 16, wherein each record of the data set is evaluated to identify which records are to be included to the analytic routine.

19. The system of claim 16, wherein the analytic routine is a molecular docking routine configured to perform a docking analysis between a receptor specified by the parameter and each of a plurality of chemical structures, each of the plurality of chemical structures represented by a record of the data set, and wherein the output includes an activation energy for docking each chemical structure to the specified receptor.

20. The system of claim 16, wherein the operation further comprises:

identifying at least one element of the data present in the received data set that is not present in the reduced data set; and

conveying to the user identified elements excluded from processing by the analytic routine.

21. The system of claim 16, wherein both the first query and the second query are abstract queries composed from a plurality of logical fields of a database abstraction model, wherein each logical field identifies a name for the logical field and an access method that maps the logical field to a data source in a relational database, wherein each access method is selected from at least two different access method types, wherein each of the different access methods types defines a different manner of exposing, in the relational database, data corresponding to the name of the logical field, and wherein the database abstraction model comprises:

the plurality of logical fields;

a query building interface configured to allow the composition of an abstract query from the plurality of logical fields; and

a runtime component configured to process an abstract query to generate a resolved query of the relational database from the abstract query.

22. The system of claim 16, wherein the second query is executed against the data set to exclude one or more records of the data set that fail to satisfy the identified conditions, and wherein the reduced data set comprises the data set less the excluded one or more records.