Application bundle pulling

• US 9,965,262 B2
• Filed: 05/21/2015
• Issued: 05/08/2018
• Est. Priority Date: 05/21/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fawcett, Bradley W.
• Primary Examiner(s): Dam, Tuan Q.
• Assistant Examiner(s): Wei, Zheng
• Application Number:
  US14/718,256
• Publication Number:
  US 20160342402A1
• Time in Patent Office: 1,083 Days
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 8/41 Compilation
• CPC Class Codes: G06F 8/61 Installation
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

Disclosed aspects include receiving a stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes. A determination is made to retrieve an application bundle from a second compute node. The determination is made by a first compute node based on a set of application bundle data. The application bundle is installed on the first compute node by the first compute node. Using the application bundle on the first compute node, the stream of tuples is processed. In embodiments, the application bundle is retrieved by the first compute node in response to determining to retrieve the application bundle from the second compute node.

Claims

1. A computer-implemented method for processing a stream of tuples using an application bundle, the method comprising:

receiving the stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes;

determining, by a first compute node based on a set of application bundle data, to retrieve the application bundle from a second compute node, wherein the determination includes examining the set of application bundle data for the application bundle, detecting the second compute node has the application bundle, and determining, using at least one source criterion, to retrieve the application bundle from the second compute node;

retrieving, by the first compute node in response to determining to retrieve the application bundle from the second compute node, the application bundle;

installing, by the first compute node, the application bundle on the first compute node;

processing, using the application bundle on the first compute node, the stream of tuples;

detecting a staleness factor with respect to the application bundle on the first compute node;

maintaining or removing the application bundle based on the detected staleness factor and the at least one source criterion;

updating the set of application bundle data to include that the first compute node has the application bundle, wherein first compute node communicates directly to the application bundle directory to update status, and wherein the direct communication consists of transmitting a status notification to the application bundle directory for updating or editing the set of application bundle data;

determining, by a third compute node based on the set of application bundle data, to retrieve the application bundle from the first compute node; and

installing, by the third compute node, the application bundle on the third compute node.

2. The method of claim 1, wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:

analyzing the set of application bundle data; and

identifying a criterion which indicates to retrieve the application bundle from the second compute node.

3. The method of claim 1, wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:

using a physical proximity criterion of the second compute node with respect to the first compute node.

4. The method of claim 1, wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:

using an expected resource burden criterion when downloading the application bundle to the first compute node from the second compute node.

5. The method of claim 1, wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:

using a utilization frequency criterion of the second compute node.

6. The method of claim 1, wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:

using a random selection criterion of the second compute node.

7. The method of claim 1, wherein the set of application bundle data is stored separate from both the first compute node and the second compute node.

8. The method of claim 1, wherein the set of application bundle data indicates to utilize the application bundle to process the stream of tuples.

9. The method of claim 1, further comprising:

locating, in the set of application bundle data, the application bundle to process information in tuples expected to be received for processing within a temporal period.

10. The method of claim 1, further comprising:

inspecting the set of application bundle data to find a listing of nodes having the application bundle.

11. The method of claim 1, further comprising:

indicating, by the set of application bundle data, possession of the application bundle by one or more compute nodes including the second compute node.

12. The method of claim 1, further comprising:

retrieving the application bundle which includes an executable code image to process one or more tuples of the stream of tuples.

13. The method of claim 1, further comprising:

retrieving, by the first compute node for load-balancing in a cloud environment, the application bundle to process one or more tuples of the stream of tuples.

14. The method of claim 1, further comprising:

retrieving, by the first compute node in response to a failover of a host in a cloud environment, the application bundle to process one or more tuples of the stream of tuples.

15. The method of claim 1, further comprising:

determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node using both;

a physical proximity criterion of the second compute node with respect to the first compute node, and

an expected resource burden criterion when downloading the application bundle to the first compute node from the second compute node.

16. The method of claim 1, further comprising:

determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node using both;

a physical proximity criterion of the second compute node with respect to the first compute node, and

a utilization frequency criterion of the second compute node.

17. A computer-implemented method for processing a stream of tuples using an application bundle in a stream computing environment, the method comprising:

receiving, in the stream computing environment, the stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes;

analyzing, in the stream computing environment by a first compute node, the set of application bundle data which indicates to utilize the application bundle to process the stream of tuples; and

identifying a criterion which indicates to retrieve the application bundle from the second compute node;

determining, in the stream computing environment by the first compute node based on the set of application bundle data and the criterion which indicates to retrieve the application bundle from the second compute node, to retrieve the application bundle from a second compute node, wherein the determination includes examining the set of application bundle data for the application bundle, detecting the second compute node has the application bundle, and determining, using at least one source criterion, to retrieve the application bundle from the second compute node;

retrieving, in the stream computing environment by the first compute node in response to determining to retrieve the application bundle from the second compute node, the application bundle which includes an executable code image to process one or more tuples of the stream of tuples;

installing, in the stream computing environment by the first compute node, the application bundle on the first compute node;

processing, in the stream computing environment using the application bundle on the first compute node, the stream of tuples;

detecting a staleness factor with respect to the application bundle on the first compute node;

maintaining or removing the application bundle based on the detected staleness factor and the at least one source criterion;

updating, in the stream computing environment by the first compute node, the set of application bundle data to include that the first compute node has the application bundle, wherein first compute node communicates directly to the application bundle directory to update status, and wherein the direct communication consists of transmitting a status notification to the application bundle directory for updating or editing the set of application bundle data;

determining, in the stream computing environment by a third compute node based on the set of application bundle data, to retrieve the application bundle from the first compute node; and

installing, in the stream computing environment by the third compute node, the application bundle on the third compute node.