Application bundle management in stream computing

• US 10,303,792 B2
• Filed: 06/27/2015
• Issued: 05/28/2019
• Est. Priority Date: 05/21/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fawcett, Bradley W.
• Primary Examiner(s): Harrell, Robert B
• Application Number:
  US14/752,852
• Publication Number:
  US 20160344786A1
• Time in Patent Office: 1,431 Days
• Field of Search: 709223
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

Disclosed aspects include managing an application bundle for processing a stream of tuples. The stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes is received. The stream of tuples is processed on a first compute node using the application bundle. A staleness factor with respect to the application bundle is detected by the first compute node. Based on a maintenance criterion related to both the application bundle and the plurality of processing elements, the application bundle is maintained on the first compute node.

Claims

1. A system for managing a plurality of application bundles for processing a stream of tuples, the system comprising:

a memory having a set of computer readable computer instructions, and

a processor for executing the set of computer readable instructions, the set of computer readable instructions including;

receiving the stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes;

executing, on a first compute node using the plurality of application bundles, the stream of tuples;

monitoring, by an application bundle monitor, which application bundle is executing the stream of tuples, wherein the application bundle monitor controls a policy setting for the first compute node, wherein the policy setting is selected from the group consisting of a computing resource, a job status, a processing element status and a configuration;

detecting, by the application bundle monitor, a first application bundle is executing the monitored stream of tuples;

detecting, by the application bundle monitor, a second application bundle is executing a second stream of tuples;

detecting, by the application bundle monitor, the monitored stream of tuples is finished being executed by the first application bundle;

determining, by the first compute node, a staleness factor of the first application bundle has exceeded a policy setting threshold value of the first compute node, wherein the staleness factor is determined by considering the policy setting of the first node and the activity value of the first application bundle;

removing, by the first compute node, the first application bundle; and

maintaining, by the first compute node, execution of the second stream of tuples by the second application bundle.

2. The system of claim 1, wherein maintaining the second application bundle includes:

preserving the second application bundle on the first compute node; and

preventing removal of the second application bundle from the first compute node.

3. The system of claim 1, wherein the policy setting threshold value includes a threshold temporal value.

4. The system of claim 1, wherein the policy setting threshold value includes a threshold computing resources value.

5. The system of claim 1, wherein the policy setting threshold value includes a threshold processing element accessibility value.

6. The system of claim 1, wherein using the second application bundle when activating the plurality of processing elements.

7. The system of claim 1, wherein the staleness factor with respect to the first application bundle interrelates with the plurality of processing elements.

8. A computer program product for managing a plurality of application bundles for processing a stream of tuples, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:

receiving the stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes;

executing, on a first compute node using the plurality of application bundles, the stream of tuples;

monitoring, by an application bundle monitor, which application bundle is executing the stream of tuples, wherein the application bundle monitor controls a policy setting for the first compute node, wherein the policy setting is selected from the group consisting of a computing resource, a job status, a processing element status and a configuration;

detecting, by the application bundle monitor, a first application bundle is executing the monitored stream of tuples;

detecting, by the application bundle monitor, a second application bundle is executing a second stream of tuples;

detecting, by the application bundle monitor, the monitored stream of tuples is finished being executed by the first application bundle;

determining, by the first compute node, a staleness factor of the first application bundle has exceeded a policy setting threshold value of the first compute node, wherein the staleness factor is determined by considering the policy setting of the first node and the activity value of the first application bundle;

removing, by the first compute node, the first application bundle; and

maintaining, by the first compute node, execution of the second stream of tuples by the second application bundle.

9. The computer program product of claim 8, wherein maintaining the second application bundle includes:

preserving the second application bundle on the first compute node; and

preventing removal of the second application bundle from the first compute node.

10. The computer program product of claim 8, wherein the program instructions are stored in a computer readable storage medium in a data processing system, and wherein the program instructions were downloaded over a network from a remote data processing system.

11. The computer program product of claim 8, wherein the program instructions are stored in a computer readable storage medium in a server data processing system, and wherein the program instructions are downloaded over a network to a remote data processing system for use in a computer readable storage medium with the remote data processing system.