Managing redundancy among application bundles

• US 10,389,794 B2
• Filed: 05/21/2015
• Issued: 08/20/2019
• Est. Priority Date: 05/21/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fawcett, Bradley W.
• Primary Examiner(s): Chea, Philip J
• Assistant Examiner(s): Solomon, Ruth
• Application Number:
  US14/718,322
• Publication Number:
  US 20160344799A1
• Time in Patent Office: 1,552 Days
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 8/60 Software deployment
• CPC Class Codes: G06F 8/61 Installation
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

Disclosed aspects include managing an application bundle for processing a stream of tuples. A set of application bundle data related to both a set of compute nodes and the application bundle is monitored by a first compute node. A determination is made that the application bundle is installed on fewer than a threshold number of compute nodes by the first compute node based on the set of application bundle data. The application bundle is retrieved by the first compute node in response to determining the application bundle is installed on fewer than a threshold number of compute nodes. The application bundle is installed on the first compute node by the first compute node in response to retrieving the application bundle.

Claims

1. A computer-implemented method for managing an application bundle for processing a stream of tuples, the method comprising:

monitoring, by a first compute node, a set of application bundle data related to both a set of compute nodes and the application bundle;

determining, by the first compute node based on the set of application bundle data, the application bundle is installed on fewer than a predetermined threshold number of compute nodes, wherein the determination includes analyzing and identifying the set of application bundles based on a criterion which indicates to retrieve the application bundle, wherein the criterion is selected from a group consisting of an unavailability burden criterion, an expected resource burden criterion, a failover frequency criterion and a temporal benefit criterion, wherein the temporal benefit criterion indicates a beneficial value arising out of a timely performance for processing the stream of tuples, wherein a temporal benefit is estimated based on a job request queue and a historic expectation;

determining, by the first compute node, to retrieve the application bundle from a second compute node based on the predetermined threshold, wherein the predetermined threshold is based on a recovery implication of the failover frequency for the set of compute nodes, wherein the determination is made by comparing the predetermined threshold number of compute nodes that include the installed set of application bundles with a failure rate for the set of compute nodes, wherein the failure rate includes the failover frequency for a type of application bundle and a type of compute node;

retrieving, by the first compute node in response to determining the application bundle is installed on fewer than the threshold number of compute nodes, the application bundle from the second node; and

installing, by the first compute node in response to retrieving the application bundle, the application bundle on the first compute node.

2. The method of claim 1, further comprising:

receiving the stream of tuples to be processed by a plurality of processing elements operating on the set of compute nodes; and

processing, using the application bundle on the first compute node, the stream of tuples in response to installing the application bundle on the first compute node.

3. The method of claim 1, wherein monitoring, by the first compute node, the set of application bundle data related to both the set of compute nodes and the application bundle includes:

observing the set of application bundle data; and

analyzing the set of application bundle data.