Application bundle management across mixed file system types
First Claim
1. A system for managing a file system having a cluster of compute nodes to process a stream of tuples using an application bundle, the system comprising:
- a memory having a set of computer readable computer instructions, anda processor for executing the set of computer readable instructions, the set of computer readable instructions including;
establishing, on the cluster of compute nodes, a cluster bundle directory, wherein the cluster bundle directory is a first level of a multilevel directory structure, and wherein the cluster bundle directory is a global directory that tracks which host has the application bundle installed;
establishing, on a first compute node of the cluster of compute nodes, a host bundle library, wherein the host bundle library is a second level of the multilevel directory structure, and wherein the host bundle library is a local library that tracks which host shares the application bundle;
receiving the stream of tuples to be processed by a plurality of processing elements operating on the cluster of compute nodes including the first compute node;
detecting, using the cluster bundle directory, that the application bundle is not installed on the first compute node;
determining, using both the cluster bundle directory and the host bundle library, to initiate a sourcing operation with respect to the application bundle; and
processing, in response to initiating the sourcing operation, the stream of tuples using the application bundle.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed aspects include managing a file system having a cluster of compute nodes to process a stream of tuples using an application bundle. A cluster bundle directory is established on the cluster of compute nodes. A host bundle library is established on a first compute node of the cluster of compute nodes. The stream of tuples to be processed by a plurality of processing elements operating on the cluster of compute nodes including the first compute node is received. Using the cluster bundle directory, it is detected that the application bundle is not installed on the first compute node. Using both the cluster bundle directory and the host bundle library, a determination is made to initiate a sourcing operation with respect to the application bundle. In response to initiating the sourcing operation, the stream of tuples is processed using the application bundle.
-
Citations
12 Claims
-
1. A system for managing a file system having a cluster of compute nodes to process a stream of tuples using an application bundle, the system comprising:
-
a memory having a set of computer readable computer instructions, and a processor for executing the set of computer readable instructions, the set of computer readable instructions including; establishing, on the cluster of compute nodes, a cluster bundle directory, wherein the cluster bundle directory is a first level of a multilevel directory structure, and wherein the cluster bundle directory is a global directory that tracks which host has the application bundle installed; establishing, on a first compute node of the cluster of compute nodes, a host bundle library, wherein the host bundle library is a second level of the multilevel directory structure, and wherein the host bundle library is a local library that tracks which host shares the application bundle; receiving the stream of tuples to be processed by a plurality of processing elements operating on the cluster of compute nodes including the first compute node; detecting, using the cluster bundle directory, that the application bundle is not installed on the first compute node; determining, using both the cluster bundle directory and the host bundle library, to initiate a sourcing operation with respect to the application bundle; and processing, in response to initiating the sourcing operation, the stream of tuples using the application bundle. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer program product for managing a file system having a cluster of compute nodes to process a stream of tuples using an application bundle, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:
-
establishing, on the cluster of compute nodes, a cluster bundle directory, wherein the cluster bundle directory is a first level of a multilevel directory structure, and wherein the cluster bundle directory is a global directory that tracks which host has the application bundle installed; establishing, on a first compute node of the cluster of compute nodes, a host bundle library, wherein the host bundle library is a second level of the multilevel directory structure, and wherein the host bundle library is a local library that tracks which host shares the application bundle; receiving the stream of tuples to be processed by a plurality of processing elements operating on the cluster of compute nodes including the first compute node; detecting, using the cluster bundle directory, that the application bundle is not installed on the first compute node; determining, using both the cluster bundle directory and the host bundle library, to initiate a sourcing operation with respect to the application bundle; and processing, in response to initiating the sourcing operation, the stream of tuples using the application bundle. - View Dependent Claims (11, 12)
-
Specification