Clustering of analytic functions

• US 8,560,544 B2
• Filed: 09/15/2010
• Issued: 10/15/2013
• Est. Priority Date: 09/15/2010
• Status: Active Grant

• Current Assignee: International Business Machines Corporation, ServiceNow Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Kamath, Monty Ravindra, Pikovsky, Alexander
• Primary Examiner(s): Kerzhner, Aleksandr
• Application Number:
  US12/882,824
• Publication Number:
  US 20120066224A1
• Time in Patent Office: 1,126 Days
• Field of Search: 707/737, 707/999.002
• US Class Current: 707/737
• CPC Class Codes: G06F 9/4494 data driven

Abstract

A method, system, and computer program product for improved clustering of analytic functions in a data processing environment are described. A set of instances of an analytic function receiving data input from a set of data sources is identified. A first subset of instances is configured to receive input from a first subset of data sources, and a second subset of instances is configured to receive input from a second subset of data sources. The set of instances is assigned to a cluster. The cluster begins executing in a computer in the data processing environment, when the first subset of data sources begins transmitting time series data input to the first subset of instances in the cluster.

Claims

1. A computer implemented method for improved clustering of analytic functions in a data processing environment, the computer implemented method comprising:

identifying a set of instances of an analytic function receiving data input from a set of data sources, a first subset of instances configured to receive input from a first subset of data sources, and a second subset of instances configured to receive input from a second subset of data sources, wherein the analytic function is described by an analytic function specification, an instance in the set of instances executing in the data processing environment, and wherein the analytic function performs an analytical computation when the instance executes in the data processing environment;

assigning the set of instances to a cluster, wherein the cluster is a process within which the set of instances are configured to execute, and wherein the instances in the set of instances satisfy a condition; and

beginning executing the cluster in a computer in the data processing environment when the first subset of data sources begins transmitting time series data input to the first subset of instances in the cluster.

2. The computer implemented method of claim 1, further comprising:

selecting a condition for clustering sets of instances of different analytic functions in the cluster;

selecting a second analytic function having a second set of instances according to the condition;

assigning the second set of instances to the cluster.

3. The computer implemented method of claim 2, wherein the second analytic function satisfies the condition.

4. The computer implemented method of claim 3, wherein to satisfy the condition, the second analytic function has greater affinity to the analytic function as compared to affinity to a third analytic function.

5. The computer implemented method of claim 2, wherein the second set of instances satisfies the condition.

6. The computer implemented method of claim 5, wherein to satisfy the condition, total number of instances in the first and second sets of instances does not exceed a threshold capacity of the cluster.

7. The computer implemented method of claim 1, wherein the beginning executing the cluster occurs when the second subset of data sources also begins transmitting time series data input to the second subset of instances in the cluster.

8. A computer program product comprising a computer usable storage device including computer usable code for improved clustering of analytic functions in a data processing environment, the computer usable code comprising:

computer usable code for identifying a set of instances of an analytic function receiving data input from a set of data sources, a first subset of instances configured to receive input from a first subset of data sources, and a second subset of instances configured to receive input from a second subset of data sources, wherein the analytic function is described by an analytic function specification, an instance in the set of instances executing in the data processing environment, and wherein the analytic function performs an analytical computation when the instance executes in the data processing environment;

computer usable code for assigning the set of instances to a cluster, wherein the cluster is a process within which the set of instances are configured to execute, and wherein the instances in the set of instances satisfy a condition; and

computer usable code for beginning executing the cluster in a computer in the data processing environment when the first subset of data sources begins transmitting time series data input to the first subset of instances in the cluster.

9. The computer program product of claim 8, further comprising:

computer usable code for selecting a condition for clustering sets of instances of different analytic functions in the cluster;

computer usable code for selecting a second analytic function having a second set of instances according to the condition;

computer usable code for assigning the second set of instances to the cluster.

10. The computer program product of claim 9, wherein the second analytic function satisfies the condition.

11. The computer program product of claim 10, wherein to satisfy the condition, the second analytic function has greater affinity to the analytic function as compared to affinity to a third analytic function.

12. The computer program product of claim 9, wherein the second set of instances satisfies the condition.

13. The computer program product of claim 12, wherein to satisfy the condition, total number of instances in the first and second sets of instances does not exceed a threshold capacity of the cluster.

14. The computer program product of claim 8, wherein the beginning executing the cluster occurs when the second subset of data sources also begins transmitting time series data input to the second subset of instances in the cluster.

15. The computer program product of claim 8, wherein the computer usable code is stored in a computer readable storage medium in a data processing system, and wherein the computer usable code is transferred over a network from a remote data processing system.

16. The computer program product of claim 8, wherein the computer usable code is stored in a computer readable storage medium in a server data processing system, and wherein the computer usable code is downloaded over a network to a remote data processing system for use in a computer readable storage medium associated with the remote data processing system.

17. A data processing system for improved clustering of analytic functions in a data processing environment, the data processing system comprising:

a storage device including a storage medium, wherein the storage device stores computer usable program code; and

a processor, wherein the processor executes the computer usable program code, and wherein the computer usable program code comprises;

computer usable code for identifying a set of instances of an analytic function receiving data input from a set of data sources, a first subset of instances configured to receive input from a first subset of data sources, and a second subset of instances configured to receive input from a second subset of data sources, wherein the analytic function is described by an analytic function specification, an instance in the set of instances executing in the data processing environment, and wherein the analytic function performs an analytical computation when the instance executes in the data processing environment;

computer usable code for assigning the set of instances to a cluster, wherein the cluster is a process within which the set of instances are configured to execute, and wherein the instances in the set of instances satisfy a condition; and

computer usable code for beginning executing the cluster in a computer in the data processing environment when the first subset of data sources begins transmitting time series data input to the first subset of instances in the cluster.

18. The data processing system of claim 17, further comprising:

computer usable code for selecting a condition for clustering sets of instances of different analytic functions in the cluster;

computer usable code for selecting a second analytic function having a second set of instances according to the condition;

computer usable code for assigning the second set of instances to the cluster.

19. The data processing system of claim 18, wherein the second analytic function satisfies the condition.

20. The data processing system of claim 19, wherein to satisfy the condition, the second analytic function has greater affinity to the analytic function as compared to affinity to a third analytic function.