Deriving and interpreting users collective data asset use across analytic software systems

• US 10,664,501 B2
• Filed: 10/11/2016
• Issued: 05/26/2020
• Est. Priority Date: 10/11/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kandogan, Eser, Roth, Mary Ann, Terrizzano, Ignacio Gabriel
• Primary Examiner(s): Dang, Thanh-Ha
• Application Number:
  US15/290,923
• Publication Number:
  US 20180101596A1
• Time in Patent Office: 1,323 Days
• Field of Search: 707736
• CPC Class Codes: G06F 16/288 Entity relationship models

Abstract

One embodiment provides a method, including: utilizing at least one processor to execute computer code that performs the steps of: receiving at least one heterogeneous system log from each of a plurality of systems, wherein each of the heterogeneous system logs comprises events corresponding to activities occurring within its corresponding system; for each of the plurality of systems, analyzing the events contained within its at least one heterogeneous system log to identify a plurality of entities, wherein each of the entities is associated with at least one of the activities; identifying relationships, across the plurality of systems, between entities within the plurality of entities; and linking (i) the entities having an identified relationship and (ii) the activities of those entities. Other aspects are described and claimed.

Claims

1. A method, comprising:

utilizing at least one processor to execute computer code that performs the steps of;

receiving at least one heterogeneous system log from each of a plurality of systems, wherein each of the heterogeneous system logs comprises events corresponding to activities occurring within a system corresponding to the heterogeneous system log;

for each of the plurality of systems, analyzing the events contained within at least one corresponding heterogeneous system log to identify a plurality of entities, wherein each of the plurality of entities is associated with at least one of the activities, wherein each of the plurality of entities comprises attributes derived from metadata and a unique identifier;

identifying relationships, across the plurality of systems, between entities within the plurality of entities, wherein the identifying comprises utilizing cross-system entity information and identifying entities that are present across more than one of the plurality of systems by comparing at least one attribute of the plurality of entities and identifying a match of at least one attribute of the entities and identifying entities having a match as the same entity; and

linking (i) the entities having an identified relationship and (ii) the activities of those entities, wherein the linking comprises connecting the entities that are present across more than one of the plurality of systems.

2. The method of claim 1, wherein the analyzing comprises identifying relationships between the entities of a single system.

3. The method of claim 1, wherein the identifying relationships comprises identifying entities that are the same between at least one of the plurality of systems and at least another of the plurality of systems.

4. The method of claim 3, wherein each of the plurality of entities has a corresponding identifier and wherein the identifying entities that are the same comprises matching the identifiers.

5. The method of claim 1, wherein the analyzing comprises parsing the plurality of heterogeneous system logs to identify events.

6. The method of claim 1, wherein the analyzing comprises filtering the plurality of heterogeneous system logs and discarding events related to system events.

7. The method of claim 1, comprising generating a relationship graph of (i) the plurality of entities and (ii) relationships identified between entities.

8. The method of claim 7, wherein the relationship graph comprises:

a plurality of nodes, wherein each node represents an entity; and

a plurality of edges connecting at least two nodes, wherein each edge represents a relationship between two of the plurality of entities.

9. The method of claim 1, comprising identifying a provenance of a predetermined data asset by tracing a link of the data asset from one entity to another entity.

10. The method of claim 1, wherein the analyzing comprises obtaining metadata for (i) each of the events and (ii) each of the entities, within the heterogeneous system logs.

11. An apparatus, comprising:

at least one processor; and

a computer readable storage medium having computer readable program code embodied therewith and executable by the at least one processor, the computer readable program code comprising;

computer readable program code that receives at least one heterogeneous system log from each of a plurality of systems, wherein each of the heterogeneous system logs comprises events corresponding to activities occurring within a system corresponding to the heterogeneous system log;

computer readable program code that, for each of the plurality of systems, analyzes the events contained within at least one corresponding heterogeneous system log to identify a plurality of entities, wherein each of the plurality of entities is associated with at least one of the activities, wherein each of the plurality of entities comprises attributes derived from metadata and a unique identifier;

computer readable program code that identifies relationships, across the plurality of systems, between entities within the plurality of entities, wherein the identifying comprises utilizing cross-system entity information and identifying entities that are present across more than one of the plurality of systems by comparing at least one attribute of the plurality of entities and identifying a match of at least one attribute of the entities and identifying entities having a match as the same entity; and

computer readable program code that links (i) the entities having an identified relationship and (ii) the activities of those entities, wherein the linking comprises connecting the entities that are present across more than one of the plurality of systems.

12. A computer program product, comprising:

a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising;

computer readable program code that receives at least one heterogeneous system log from each of a plurality of systems, wherein each of the heterogeneous system logs comprises events corresponding to activities occurring within a system corresponding to the heterogeneous system log;

computer readable program code that, for each of the plurality of systems, analyzes the events contained within at least one corresponding heterogeneous system log to identify a plurality of entities, wherein each of the plurality of entities is associated with at least one of the activities, wherein each of the plurality of entities comprises attributes derived from metadata and a unique identifier;

computer readable program code that identifies relationships, across the plurality of systems, between entities within the plurality of entities, wherein the identifying comprises utilizing cross-system entity information and identifying entities that are present across more than one of the plurality of systems by comparing at least one attribute of the plurality of entities and identifying a match of at least one attribute of the entities and identifying entities having a match as the same entity; and

computer readable program code that links (i) the entities having an identified relationship and (ii) the activities of those entities, wherein the linking comprises connecting the entities that are present across more than one of the plurality of systems.

13. The computer program product of claim 12, wherein the analyzing comprises identifying relationships between the entities of a single system.

14. The computer program product of claim 12, wherein the identifying relationships comprises identifying entities that are the same between at least one of the plurality of systems and at least another of the plurality of systems.

15. The computer program product of claim 12, wherein the analyzing comprises parsing the plurality of heterogeneous system logs to identify events.

16. The computer program product of claim 12, wherein the analyzing comprises filtering the plurality of heterogeneous system logs and discarding events related to system events.

17. The computer program product of claim 12, comprising identifying related entities to generate entity recommendations.

18. The computer program product of claim 12, comprising generating a relationship graph of the entities and relationships identified between entities, wherein the relationship graph comprises:

a plurality of nodes, wherein each node represents an entity; and

a plurality of edges connecting at least two nodes, wherein each edge represents a relationship between two of the plurality of entities.

19. The computer program product of claim 12, comprising identifying a provenance of a predetermined data asset by tracing a link of the data asset from one entity to another entity.

20. A method, comprising:

obtaining a plurality of system logs from a plurality of systems, wherein each of the system logs is unique to a corresponding system and wherein the system logs comprise activities performed by entities on at least one data asset within at least one of the plurality of systems;

associating at least one entity with each of the data assets by analyzing the system logs to identify at least one entity that performed an activity on the data asset, wherein each identified at least one entity comprises attributes derived from metadata and a unique identifier;

identifying relationships between the entities across the plurality of systems by matching entities across the plurality of systems, wherein the identifying comprises utilizing cross-system entity information and identifying entities that are present across more than one of the plurality of systems by comparing at least one attribute of the plurality of entities and identifying a match of at least one attribute of the entities and identifying entities having a match as the same entity; and

generating a relationship graph identifying the entities, data assets, and relationships between entities and data assets, wherein the generating comprises connecting the entities that are present across more than one of the plurality of systems and reflecting the connected entities within the relationship graph.