Modeling and implementing complex data access operations based on lower level traditional operations

• US 7,949,685 B2
• Filed: 02/04/2008
• Issued: 05/24/2011
• Est. Priority Date: 10/09/2003
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dettinger, Richard D., Stevens, Richard J.
• Primary Examiner(s): Lovel; Kimberly
• Assistant Examiner(s): Uddin; Mohammed R
• Application Number:
  US12/025,077
• Publication Number:
  US 20080147648A1
• Time in Patent Office: 1,205 Days
• Field of Search: 707/791, 707/802, 707/999.101
• US Class Current: 707/802
• CPC Class Codes: G06F 16/2454 Optimisation of common expressions
• CPC Class Codes: G06F 16/24549 Run-time optimisation

Abstract

A system, method and article of manufacture for data processing and, more particularly, for managing execution of complex data access operations in a data processing system. One embodiment provides a method of managing execution of query operations in a data processing system. The method comprises issuing, by a requesting entity, a request to perform a composite query operation defining an initial query operation and a subsequent query operation to be executed against a data repository of the data processing system, executing the initial query operation, determining an operation status of the initial query operation, and managing execution of the subsequent query operation on the basis of the determined operation status.

Claims

1. A method of managing execution of query operations in a data processing system, comprising:

providing a composite query operation to be executed against a data repository of the data processing system;

providing at least two implementation schemas for the composite query operation, each defining a different order of execution of at least two different query operations required to perform the composite query operation;

executing the composite query operation according to a first implementation schema of the implementation schemas;

determining, upon completion of the execution of the composite query operation, a completion status of the composite query operation, wherein the completion status indicates a number of query operations executed as part of the composite query operation; and

managing a subsequent execution of the composite query operation on the basis of the determined completion status, wherein the managing comprises;

executing the composite query operation according to a second implementation schema of the at least two implementation schemas, if the number of query operations exceeds a predetermined threshold.

2. The method of claim 1, wherein the completion status indicates a number of query operations executed as part of the composite query operation;

and wherein the managing comprises;

initializing a failure count;

repeatedly executing the composite query operation in response to subsequent requests for execution of the composite query operation according to the first implementation schema; and

upon each execution of the composite query operation according to the first implementation schema;

incrementing the failure count if the number of query operations indicated by the completion status exceeds a first predetermined threshold; and

if the failure count exceeds a second predetermined threshold;

resetting the failure count; and

executing the composite query operation according to the second implementation schema of the implementation schemas.

3. The method of claim 1, wherein the completion status indicates a number of query operations executed as part of the composite query operation;

and wherein the managing comprises;

initializing an accumulated number of query operations;

repeatedly executing the composite query operation in response to subsequent requests for execution of the composite query operation according to the first implementation schema; and

upon each execution of the composite query operation according to the first implementation schema;

summing the number of query operations indicated by the completion status to the accumulated number of query operations; and

if the accumulated number of query operations exceeds a predetermined threshold;

resetting the accumulated number of query operations; and

executing the composite query operation according to the second implementation schema of the implementation schemas.

4. The method of claim 1, wherein the first and second query operations are SQL statements.

5. A method of managing execution of query operations in a data processing system, comprising:

a) providing a composite query operation defining a first and a second query operation to be executed against a data repository of the data processing system;

b) providing a first and a second implementation schema for the composite query operation, each defining a different order of execution of the first and the second query operation;

c) selecting an implementation schema of the first and second implementations schemas;

d) initializing a failure count;

e) repeatedly executing the composite query operation according to the selected implementation schema in response to subsequent requests for execution of the composite query operation according to the selected implementation schema; and

f) upon each execution of the composite query operation according to the selected implementation schema;

f1) determining a completion status of the composite query operation indicating a number of query operations executed as part of the composite query operation;

f2) incrementing the failure count if the number of query operations indicated by the completion status exceeds a first predetermined threshold;

f3) determining whether the failure count exceeds a second predetermined threshold; and

f4) if the failure count exceeds the second predetermined threshold;

i) resetting the failure count;

ii) selecting the other implementation schema; and

iii) returning to step e).

6. The method of claim 5, wherein the first and second query operations are SQL statements.

7. A computer readable storage medium containing a program which, when executed, performs a process of managing execution of query operations in a data processing system, the process comprising:

receiving a request to perform a composite query operation against a data repository of the data processing system;

providing at least two implementation schemas for the composite query operation, each defining a different order of execution of at least two different query operations required to perform the composite query operation;

executing the composite query operation according to a first implementation schema of the implementation schemas;

determining, upon completion of the execution of the composite query operation, a completion status of the composite query operation, wherein the completion status indicates a number of query operations executed as part of the composite query operation; and

managing a subsequent execution of the composite query operation on the basis of the determined completion status, wherein the managing comprises;

executing the composite query operation according to a second implementation schema of the at least two implementation schemas, if the number of query operations exceeds a predetermined threshold.

8. The computer readable storage medium of claim 7, wherein the completion status indicates a number of query operations executed as part of the composite query operation;

and wherein the managing comprises;

initializing a failure count;

repeatedly executing the composite query operation in response to subsequent requests for execution of the composite query operation according to the first implementation schema; and

upon each execution of the composite query operation according to the first implementation schema;

incrementing the failure count if the number of query operations indicated by the completion status exceeds a first predetermined threshold; and

if the failure count exceeds a second predetermined threshold;

resetting the failure count; and

executing the composite query operation according to the second implementation schema of the implementation schemas.

9. The computer readable storage medium of claim 7, wherein the completion status indicates a number of query operations executed as part of the composite query operation;

and wherein the managing comprises;

initializing an accumulated number of query operations;

repeatedly executing the composite query operation in response to subsequent requests for execution of the composite query operation according to the first implementation schema; and

upon each execution of the composite query operation according to the first implementation schema;

summing the number of query operations indicated by the completion status to the accumulated number of query operations; and

if the accumulated number of query operations exceeds a predetermined threshold;

resetting the accumulated number of query operations; and

executing the composite query operation according to the second implementation schema of the implementation schemas.

10. The computer readable storage medium of claim 7, wherein the first and second query operations are SQL statements.

11. A computer readable storage medium containing a program which, when executed, performs a process of managing execution of query operations in a data processing system, the process comprising:

a) receiving a request to perform a composite query operation defined by at least a first and a second query operation to be executed against a data repository of the data processing system;

b) retrieving a first and a second implementation schema for the composite query operation, each defining a different order of execution of the first and the second query operation;

c) selecting an implementation schema of the first and second implementations schemas;

d) initializing a failure count;

e) repeatedly executing the composite query operation according to the selected implementation schema in response to subsequent requests for execution of the composite query operation according to the selected implementation schema; and

f) upon each execution of the composite query operation according to the selected implementation schema;

f1) determining a completion status of the composite query operation indicating a number of query operations executed as part of the composite query operation;

f2) incrementing the failure count if the number of query operations indicated by the completion status exceeds a first predetermined threshold;

f3) determining whether the failure count exceeds a second predetermined threshold; and

f4) if the failure count exceeds the second predetermined threshold;

i) resetting the failure count;

ii) selecting the other implementation schema; and

iii) returning to step e).

12. The computer readable storage medium of claim 11, wherein the first and second query operations are SQL statements.

13. A data processing system, comprising:

a data repository; and

a composite query operations manager residing in memory for managing execution of query operations in the data processing system, the composite query operations manager being configured for;

receiving a request to perform a composite query operation against a data repository of the data processing system;

providing at least two implementation schemas for the composite query operation, each defining a different order of execution of at least two different query operations required to perform the composite query operation;

executing the composite query operation according to a first implementation schema of the implementation schemas;

determining, upon completion of the execution of the composite query operation, a completion status of the composite query operation, wherein the completion status indicates a number of query operations executed as part of the composite query operation; and

managing a subsequent execution of the composite query operation on the basis of the determined completion status, wherein the managing comprises;

executing the composite query operation according to a second implementation schema of the at least two implementation schemas, if the number of query operations exceeds a predetermined threshold.

14. A data processing system, comprising:

a data repository; and

a composite query operations manager residing in memory for managing execution of query operations in the data processing system, the composite query operations manager being configured for;

a) receiving a request to perform a composite query operation defined by at least a first and a second query operation to be executed against the data repository;

b) retrieving a first and a second implementation schema for the composite query operation, each defining a different order of execution of the first and the second query operation;

c) selecting an implementation schema of the first and second implementations schemas;

d) initializing a failure count;

e) repeatedly executing the composite query operation according to the selected implementation schema in response to subsequent requests for execution of the composite query operation according to the first implementation schema; and

f) upon each execution of the composite query operation according to the selected implementation schema;

f1) determining a completion status of the composite query operation indicating a number of query operations executed as part of the composite query operation;

f2) incrementing the failure count if the number of query operations indicated by the completion status exceeds a first predetermined threshold;

f3) determining whether the failure count exceeds a second predetermined threshold; and

f4) if the failure count exceeds the second predetermined threshold;

i) resetting the failure count;

ii) selecting the other implementation schema; and

iii) returning to step e).