METHOD AND APPARATUS FOR EFFICIENT AND ACCURATE ANALYTICS WITH CROSS-DOMAIN CORRELATION

• US 20120215829A1
• Filed: 02/17/2011
• Published: 08/23/2012
• Est. Priority Date: 02/17/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Naphade, Milind, Sahu, Sambit, Dai, Jing
• Granted Patent: US 8,972,484 B2
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation

Abstract

A method of generating analytics to provide an analysis of data from distinct data domains includes collecting sensor data from at least two distinct data domains, deriving parameters from the collected data, wherein at least one of the parameters is a first domain parameter derived from one of the data domains and at least another one of the parameters is a second domain parameter derived from the other data domain, providing a data model that enables a user to specify at least one of the first parameters and at least one of the second domain parameters and generate at least one rule based on the selected parameters, and generating analytics that analyze the collected data against the rules to determinate whether the rules have been satisfied and provide results of the analysis to a user of the analytics.

Claims

1. A method of generating analytics to provide an analysis of data from distinct data domains, the method comprising:

collecting data from at least two distinct data domains;

deriving parameters from the collected data, wherein at least one of the parameters is a first domain parameter derived from one of the data domains and at least another one of the parameters is a second domain parameter derived from the other data domain;

providing a data model that enables a user to specify at least one of the first parameters, at least one of the second domain parameters, and create at least one rule based on the selected parameters; and

generating analytics that analyzes the collected data against the rules to determine whether the rules have been satisfied and provide results of the analysis to a user of the analytics,

wherein the method is performed by a data processing machine.

2. The method of claim 1, wherein each data domain includes information generated from different information silos, which are incapable of communicating their corresponding information with one another.

3. The method of claim 1, wherein for each selected parameter, the user interface enables the user to enter a condition, and the rule is based on all of the conditions.

4. The method of claim 3, wherein the user interface enables the user to select logical operators to form the rule from the conditions and the selected logical operators.

5. The method of claim 1, wherein the sensor data is received from Smart Sensors remote from the data processing system.

6. The method of claim 5, wherein the sensor data is time-stamped.

7. The method of claim 6, wherein at least one of the parameters is a consumption amount of a resource used by a consumer during a consumption period.

8. The method of claim 7, wherein the analytics are configured to determine an average period of non-use of the resource.

9. The method of claim 8, wherein at least one of the rules is based on the period of non-use.

10. The method of claim 1, wherein the first domain parameter is an amount of electricity consumed over a period and the second domain parameter is an amount of water.

11. The method of claim 1, wherein the data includes locations from where the data is sourced and the parameters include the locations.

12. The method of claim 11, wherein the data includes weather data at the locations, and the parameters include weather parameters based on the weather data.

13. The method of claim 1, wherein the interface enables the user to provide a prediction for each rule and the analytics is configured to provide these predictions to a user.

14. The method of claim 13, wherein the analytics is configured to receive feedback from a user and suppress output of a prediction of a rule based on the feedback.

15. A system to provide an analysis of sensor data from distinct data domains to clients, the system comprising:

a computer network;

first sensors configured to measure data from a first data domain and transmit the measured data across the network;

second sensors configured to measure data from a second data domain and transmit the measured data across the network, wherein the data domains are different from one another;

a plurality of client workstations configured to communicate across the network;

a server workstation that is remote from client workstations and configured to communicate with the client workstations and receive the measured data from the sensors across the network, wherein the server workstation comprises;

a user interface server that enables a user to select parameters derived from the data domains, respectively, and generate correlation rules based on the selected parameters; and

a database server to store the sensor data, the parameters, and the correlation rules; and

analytics that analyze the stored sensor against the correlation rules to determine whether the rules have been satisfied.

16. The system of claim 15, wherein each data domain includes information generated from different information silos, which are incapable of communicating the information with one another.

17. The system of claim 15, wherein the server workstation is a cloud computing infrastructure.

18. The system of claim 15, further comprising an FTP server, wherein the FTP server receives the sensor data from the FTP server, anonymizes the sensor data, and sends the anonymized sensor data to the server workstation.

19. The system of claim 18, further comprising:

a security server to authenticate clients of the client workstations that desire to connect to the analytics;

a source data staging area to temporarily buffer the anonymized sensor data; and

a data integration server integrating the buffered anonymized sensor data into tables in the database server.

20. The system of claim 15, wherein the first data domain is water consumption data, the second data domain is electricity consumption data, the first sensors are water meters and the second sensors are electricity meters, and the parameters includes an amount of water consumed within a predefined interval and an amount of electricity consumed within a predefined interval.

21. The system of claim 20, wherein one of the correlation rules predicts that a leak has occurred when the amount of the water consumed is greater than a threshold value and the amount of electricity consumed is below a threshold value.

22. The system of claim 20, wherein one of the correlations rules predicts that an appliance is present when the amount of the water consumed is greater than a threshold value and the amount of electricity consumed is greater than a threshold.

23. A computer program product for generating analytics to provide an analysis of data from distinct data domains, the computer program product comprising:

a computer readable storage medium having computer readable program code embodied therewith, the computer readable program, code comprising;

computer readable program code configured to collect data from at least two distinct data domains, derive parameters from the collected data, provide a data mode that enables a user to specify at least two one of the parameters and generate at least one rule based on the selected parameters, and generating analytics that analyze the sensor data against the rules to determinate whether the rules have been satisfied and provide results of the analysis to a user of the analytics,

wherein each of the two parameters is respectively derived from a distinct one of the data domains.

24. A system to provide an analysis of sensor data from distinct data domains to clients, the system comprising:

a server workstation that communicates with client workstations remotely across a network and receives measured sensor data from at least two information silos across the network, wherein the server workstation comprises;

a security server to authenticate clients of the client workstations that desire to connect to the cloud computing infrastructure;

a database server that stores correlation rules based the sensor data from both the information silos;

a source data staging area to temporarily buffer the measured sensor data; and

a data integration server integrating the buffered sensor data into tables in the database server;

analytics that analyze the stored sensor data against the correlations rules to determine whether the correlation rules have been satisfied ; and

a user interface server that provides the clients with access to results of the monitoring.

25. The system of claim 24, wherein the sensor data provided by one of the information silos is in a format that is incompatible with the other information silo.