Managing staleness latency among application bundles

• US 10,152,516 B2
• Filed: 05/21/2015
• Issued: 12/11/2018
• Est. Priority Date: 05/21/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fawcett, Bradley W.
• Primary Examiner(s): Leroux, Etienne P
• Assistant Examiner(s): Samara, Husam Turki
• Application Number:
  US14/718,310
• Publication Number:
  US 20160342659A1
• Time in Patent Office: 1,300 Days
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

Disclosed aspects include managing an application bundle for processing a stream of tuples. The stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes is received. The stream of tuples is processed on a first compute node using the application bundle. A staleness factor with respect to the application bundle is detected by the first compute node. Based on a maintenance criterion related to both the application bundle and the plurality of processing elements, the application bundle is maintained on the first compute node.

Claims

1. A computer-implemented method for managing a plurality of application bundles for processing a stream of tuples, the method comprising:

receiving the stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes;

executing, on a first compute node using a plurality of application bundles, the stream of tuples;

monitoring, by an application bundle monitor, which application bundle is executing the stream of tuples, wherein the application bundle monitor controls a policy setting for the first compute node, and wherein the policy setting is selected from the group consisting of a computing resource, a job status, a processing element status and a configuration;

detecting, by the application bundle monitor, a first application bundle is executing the monitored stream of tuples;

detecting, by the application bundle monitor, the monitored stream of tuples are finished being executed by the first application bundle;

determining, by the first compute node, a staleness factor of the first application bundle has exceeded a policy setting threshold value of the first compute node, wherein the staleness factor is determined by considering a policy setting of the first node and the activity value of the first application bundle, wherein a policy setting threshold value comprises a threshold temporal value, threshold computing resources value, and a threshold processing element accessibility value;

and removing, by the first compute node, the first application bundle.

2. The method of claim 1, wherein using the application bundle when activating the plurality of processing elements.

3. The method of claim 1, wherein the staleness factor with respect to the application bundle interrelates with the plurality of processing elements.