JOINING OPERATOR GRAPH ELEMENTS VIA WHOLE PROGRAM OPTIMIZATION

• US 20160364217A1
• Filed: 06/10/2015
• Published: 12/15/2016
• Est. Priority Date: 06/10/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: BARSNESS, Eric L., BRANSON, Michael J., CAREY, James E., SANTOSUOSSO, John M.
• Granted Patent: US 10,175,961 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 8/41 Compilation
• CPC Class Codes: G06F 8/43 Checking; Contextual analysis
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals

Abstract

Techniques disclosed herein describe joining processing elements (e.g., of a streams processing environment) using optimization techniques, such as by whole program optimization. An optimization tool evaluates multiple processing elements based on one or more optimization rules. The optimization tool identifies, based on the evaluation, processing elements that can be merged. The optimization tool joins the identified processing elements together.

Claims

1-7. -7. (canceled)

8. A computer program product, comprising:

a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured to perform an operation comprising;

evaluating instructions associated with each of a plurality of processing elements organized in an operator graph, wherein the plurality of processing elements includes at least a first processing element and a second processing element,

determining, based on the evaluation, that the first processing element and the second processing element satisfy at least one optimization rule, and

joining the first processing element with the second processing element to generate a third processing element which includes at least some of the instructions from both the first processing element and the second processing element.

9. The computer program product of claim 8, wherein the operation further comprises, prior to joining the first processing element with the second processing element:

generating a suggestion to join the first processing element with the second processing element; and

presenting the suggestion in an interface associated with the operator graph.

10. The computer program product of claim 9, wherein the operation further comprises, prior to joining the first processing element with the second processing element:

receiving, via the interface, a selection of the first processing element and the second processing element in response to the suggestion.

11. The computer program product of claim 8, wherein the at least one optimization rule specifies that the first processing element should be joined with the second processing element based on at least one of (i) a type of the first processing element being compatible with a type of the second processing element, (ii) a function performed by the first processing element being identical to a function performed by the second processing element, and (iii) input data processed sequentially by the first processing element and then by the second processing element.

12. The computer program product of claim 8, wherein the processing elements are of a streams processing environment.

13. The computer program product of claim 8, wherein evaluating the plurality of processing elements comprises:

evaluating the first processing element relative to each of the other processing elements in the operator graph as the second processing element based on the one or more optimization rules.

14. The computer program product of claim 8, wherein joining the first processing element with the second processing element comprises:

merging instruction code of the first processing element and the second processing element into the third processing element.

15. A system, comprising:

a processor; and

a memory storing a program, which, when executed on the processor, performs an operation comprising;

evaluating instructions associated with each of a plurality of processing elements organized in an operator graph, wherein the plurality of processing elements includes at least a first processing element and a second processing element,

determining, based on the evaluation, that the first processing element and the second processing element satisfy at least one optimization rule, and

joining the first processing element with the second processing element to generate a third processing element which includes at least some of the instructions from both the first processing element and the second processing element.

16. The system of claim 15, wherein the operation further comprises, prior to joining the first processing element with the second processing element:

generating a suggestion to join the first processing element with the second processing element; and

presenting the suggestion in an interface associated with the operator graph.

17. The system of claim 16, wherein the operation further comprises, prior to joining the first processing element with the second processing element:

receiving, via the interface, a selection of the first processing element and the second processing element in response to the suggestion.

18. The system of claim 15, wherein the at least one optimization rule specifies that the first processing element should be joined with the second processing element based on at least one of (i) a type of the first processing element being compatible with a type of the second processing element, (ii) a function performed by the first processing element being identical to a function performed by the second processing element, and (iii) input data processed sequentially by the first processing element and then by the second processing element.

19. The system of claim 15, wherein evaluating the plurality of processing elements comprises:

evaluating the first processing element relative to each of the other processing elements in the operator graph as the second processing element based on the one or more optimization rules.

20. The system of claim 15, wherein joining the first processing element with the second processing element comprises:

merging instruction code of the first processing element and the second processing element into the third processing element.