Federating applications providing modular data

• US 9,635,099 B2
• Filed: 03/27/2015
• Issued: 04/25/2017
• Est. Priority Date: 06/09/2008
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Setnes, Marie L., Warren, John S.
• Primary Examiner(s): BOUTAH, ALINA A
• Application Number:
  US14/671,875
• Publication Number:
  US 20150207868A1
• Time in Patent Office: 760 Days
• Field of Search: 709208
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 9/5033 considering data affinity
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

A computer program product in one embodiment a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method that includes establishing, by the computer, communication between a master node and several federated nodes, where each node is an instance of a distributed application; initialize, by the computer, the distributed application, where the initialization includes the federated nodes processing data local thereto and providing information about the local data to the master node; and after initialization, at run time, receive, by the computer, data requests, where the master node services the data requests by routing the requests to the nodes.

Claims

1. A computer program product, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:

establishing, by the computer, communication between a master node and several federated nodes, wherein each node is an instance of a distributed application;

initializing, by the computer, the distributed application, wherein the initialization includes the federated nodes processing data local thereto and providing information about the local data to the master node; and

after initialization, at run time, receiving, by the computer, data requests, wherein the master node services the data requests by routing the requests to the federated nodes.

2. The computer program product of claim 1, wherein at least some of the federated nodes are running on a machine or machines other than a machine running the master node.

3. The computer program product of claim 1, wherein the master node orchestrates the initializing.

4. The computer program product of claim 1, wherein the initializing is performed in phases, wherein each phase of the initialization is completed by all of the federated nodes before a subsequent initialization phase is performed.

5. The computer program product of claim 1, wherein the initializing comprises sharing information about the local data among the federated nodes, each federated node calculating associations of the data local thereto and local data on another federated node.

6. The computer program product of claim 5, wherein the calculating includes generating a hierarchy of local data found in multiple federated nodes, and further comprising storing references to the federated nodes associated with the local data.

7. The computer program product of claim 6, comprising program instructions executable by the computer to cause the computer to identify branch roots contained in a set of the local data, retrieve subordinate resources to a home node of the root of its branch, and assign to each branch node a set of references to all descendants of the branch root.

8. The computer program product of claim 7, comprising program instructions executable by the computer to cause the computer to assign to each of the descendants a reference to its root branch.

9. The computer program product of claim 8, comprising program instructions executable by the computer to cause the computer to assign relationship properties to each of the descendants of the root branches, the relationship properties reflecting relationships of the descendants with each other.

10. The computer program product of claim 9, comprising program instructions executable by the computer to cause the computer to, on each node, serialize the calculations involving data local thereto.

11. The computer program product of claim 10, comprising program instructions executable by the computer to cause the computer to, during a subsequent initialization, reload the serialized data for use and update the serialized data at run time in response to determine that some local data on some federated nodes has changed.

12. The computer program product of claim 10, comprising program instructions executable by the computer to cause the computer to, during a subsequent initialization, in response to determining that some local data on one of the federated nodes has changed:

discard the serialized data, process the data on the one of the federated nodes, reperform the calculating, and reperform the serializing.

13. The computer program product of claim 1, wherein the master node routes the requests to all nodes.

14. The computer program product of claim 1, wherein the master node routes the requests only to those nodes believed to have the requested data.

15. A system, comprising:

a processor and logic integrated with and/or executable by the processor to cause the processor to perform a method comprising;

establishing, by the processor, communication between a master node and several federated nodes, wherein each node is an instance of a distributed application;

initializing, by the processor, the distributed application, wherein the initialization includes the federated nodes processing data local thereto and providing information about the local data to the master node; and

after initialization, at run time, receiving, by the processor, data requests, wherein the master node services the data requests by routing the requests to the federated nodes.

16. A computer program product, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:

establishing, by the computer, communication between a master node and several federated nodes, wherein each node is an instance of a distributed application;

initializing, by the computer, the distributed application, including gathering information about local data associated with each of the federated nodes, the information including associations of local data across multiple federated nodes; and

after initialization, at run time, receiving, by the computer, data requests, wherein the master node services the data requests by routing the requests to one of the federated nodes believed to have the requested data.

17. The computer program product of claim 16, wherein the initializing comprises sharing information about the local data among the federated nodes, each federated node calculating associations of the data local thereto and local data on another federated node, wherein the calculating includes generating a hierarchy of local data found in multiple federated nodes, and further comprising storing references to the federated nodes associated with the local data.

18. The computer program product of claim 17, comprising program instructions executable by the computer to cause the computer to:

identify branch roots contained in a set of the local data, retrieve subordinate resources to a home node of the root of its branch, and assign to each branch node a set of references to all descendants of the branch root.

19. The computer program product of claim 18, comprising program instructions executable by the computer to cause the computer to assign to each of the descendants a reference to its root branch.

20. The computer program product of claim 19, comprising program instructions executable by the computer to cause the computer to assign relationship properties to each of the descendants of the root branches, the relationship properties reflecting relationships of the descendants with each other.