Method for providing a real time view of heterogeneous enterprise data

• US 8,539,510 B2
• Filed: 03/09/2009
• Issued: 09/17/2013
• Est. Priority Date: 05/27/2003
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Nesamoney, Diaz H., Yan, Weipeng Paul, Martin, Jameison Bear, Radalj, Maurice Mate, Younas, Fayyaz Ahmad
• Primary Examiner(s): Sough, H S
• Assistant Examiner(s): JORDAN, KIMBERLY L
• Application Number:
  US12/400,626
• Publication Number:
  US 20090171927A1
• Time in Patent Office: 1,653 Days
• Field of Search: None
• US Class Current: 719/318
• CPC Class Codes: G06F 16/2458 Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
• CPC Class Codes: G06Q 10/063 Operations research, analysis or management
• CPC Class Codes: Y10S 707/99938 Concurrency, e.g. lock management in shared database

Abstract

A method for providing a real time view of heterogeneous enterprise data of operational systems includes capturing streams of operational events in real time, combining the events with contextual data, and materializing a resulting view. The resulting view includes a dynamically defined view of the stream of events and provides visibility into a current state of the operational system. A view snapshot is continuously incrementally updated by a view maintenance engine as a stream of rows. The views are used to evaluate a business rule. An alert is fired when a business rule holds true. To enable the view in a view engine, a SQL string characterizing the view is parsed into a parse tree, which is normalized to form a query graph. The query graph is then optimized to obtain a query plan, which is compiled into an operator graph. Queries are executed based upon the operator graph.

Claims

1. A method comprising:

capturing a stream of operational events; and

materializing, by an activity monitoring computer system, a resulting view, wherein the resulting view comprises a dynamically defined view of the stream of operational events, wherein the materializing of the resulting view comprises;

forming a row for at least one event in the stream of operational events;

capturing a context that comprises data relevant to the at least one event; and

joining the context with the row to form a compound row within the resulting view; and

when a business rule applied to the resulting view holds true, outputting a reportlet corresponding to an alert that is based at least in part on the business rule.

2. The method as recited in claim 1, wherein the capturing comprises receiving the stream of operational events, wherein the stream of operational events is pushed into the activity monitoring computer system.

3. The method as recited in claim 2, wherein the receiving comprises subscribing to the stream of operational events and wherein the receiving is performed asynchronously.

4. The method as recited in claim 3, wherein the subscribing comprises subscribing to an event publisher.

5. The method as recited in claim 4, wherein the subscribing is performed by an asynchronous publishing mechanism.

6. The method as recited in claim 5, wherein the asynchronous publishing mechanism comprises a messaging system.

7. The method as recited in claim 1, wherein the capturing comprises receiving the stream of operational events, wherein the stream is pulled into the activity monitoring computer system.

8. The method as recited in claim 7, wherein the method defines context, and wherein the receiving is performed synchronously and comprises issuing a blocking query to a source system.

9. The method as recited in claim 1, wherein the materializing the resulting view comprises:

formatting the resulting view as a plurality of compound rows that each contain contextual data joined with event data; and

outputting the view to a rule engine.

10. The method as recited in claim 9, wherein the capturing and the joining are performed before the outputting, and wherein the resulting view is constructed based on a defined time window.

11. The method as recited in claim 10, wherein the capturing the context comprises pulling the context from a source system, wherein the pulling is performed synchronously.

12. The method as recited in claim 1, further comprising outputting a reportlet to a rule engine, wherein the reportlet comprises information relevant to an event comprising the stream of operational events and additional context.

13. A method for updating a view snapshot of a view, comprising:

subscribing the view to a stream publisher, wherein the stream publisher publishes a stream of data corresponding to the view; and

continuously maintaining, by an activity monitoring computer system, the view corresponding to the stream of data, wherein continuously maintaining of the view comprises;

forming a row for event data that is included within the stream of data;

joining contextual data with the row to form a compound row within the view; and

wherein the contextual data comprises data selected from a group consisting of static data and changing data, and

wherein when the contextual data comprises the changing data, a change in the contextual data is reflected upon joining the change in the contextual data with a subsequent event row.

14. The method as recited in claim 13, wherein the view comprises a joiner selected from a group consisting of a first event view with a second event view, and the input stream with a context view for the contextual data.

15. The method as recited in claim 13, wherein the view snapshot comprises an input stream for a subsequent view.

16. A method comprising:

capturing a stream of operational events in real time;

materializing a resulting view, wherein the resulting view comprises a dynamically defined view of the stream of operational events;

returning, by an activity monitoring computer system, a state comprising the resulting view as stateful if the resulting view, which is defined by a query that includes one or more query clauses, comprises an element selected from a group consisting of a “

group by”

clause and a “

set”

function in a “

select”

clause within the query; and

returning, by the activity monitoring computer system, a state comprising the resulting view as stateless if the resulting view does not comprise an element selected from a group consisting of a “

group by”

clause and a “

set”

function in a “

select”

clause and if the resulting view is not defined on top of a stateful view.

17. A method comprising:

capturing a stream of operational events in real time; and

materializing, by an activity monitoring computer system, a resulting view, wherein the resulting view comprises a dynamically defined view of the stream of operational events, wherein the materializing of the resulting view comprises;

forming a context lookup query comprising a join plan, wherein each join node in the join plan joins a stream table and a context table, the stream table being associated with at least one event in the stream of events, and the context table being associated with context relevant to the at least one event.

18. The method as recited in claim 17, wherein the context lookup query comprises a Java database connectivity (JDBC) context query in structured query language (SQL).

19. The method as recited in claim 17, wherein the context lookup query comprises a context query in SQL wherein the context query does not comprise a JDBC query.

20. The method as recited in claim 17, wherein the context lookup query comprises a two-table join context lookup.

21. The method as recited in claim 17, wherein the join plan comprises a left deep tree, and wherein a corresponding join result joins with a next context table.

22. The method as recited in claim 17, wherein the context lookup query comprises a join plan, wherein the join plan comprises a bushy query plan.