System and method for analyzing complex metadata

• US 10,223,389 B2
• Filed: 11/03/2015
• Issued: 03/05/2019
• Est. Priority Date: 11/03/2015
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Gackiere, Gregory
• Primary Examiner(s): Casanova, Jorge A
• Application Number:
  US14/930,832
• Publication Number:
  US 20170124124A1
• Time in Patent Office: 1,218 Days
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof

Abstract

In one embodiment, a computer-implemented method executable by a computer to analyze complex metadata of a data source is provided. The method includes: receiving, by a processor, complex metadata from the data source; processing, by a processor, the complex metadata to determine a dictionary of metadata; processing, by a processor, the dictionary of metadata to determine a graph of nodes and edges; processing, by a processor, the graph using a single feature analysis method; and displaying a representation of a visual graph based on results of the feature analysis method.

Claims

1. A computer-implemented method executable by a computer having a processor to analyze complex metadata of a data source, the method comprising:

receiving, by the computer, a data file from the data source, wherein the data file comprises digital data representing the complex metadata of the data source;

creating a dictionary of metadata by the processor, wherein the dictionary of metadata defines nodes and edges in the complex metadata of the data source, and wherein the nodes represent at least portions of metadata objects in the complex metadata and the edges represent relationships between nodes;

forming, by the processor, a graphical representation of the dictionary using a cleaning analysis method that considers the nodes and edges that define the complex metadata of the data source, wherein the processor automatically identifies unused objects in the complex metadata by identifying nodes that are associated with a low number of edges; and

providing the graphical representation for presentation on a display.

2. The method of claim 1, wherein the dictionary includes entries associated with each metadata object of the complex metadata.

3. The method of claim 2, wherein the entries include relationship information for each metadata object of the complex metadata.

4. The method of claim 1, wherein the graph of nodes is a directed graph.

5. The method of claim 1, wherein the graph of nodes is an undirected graph.

6. The method of claim 1, wherein the data source is a multi-tenant database system.

7. A multi-tenant server system for analyzing complex metadata of a data source, comprising:

a multi-tenant database having stored thereon complex metadata; and

at least one data processing system configured to receive a data file comprising the complex metadata from the multi-tenant database, to assemble a dictionary of metadata that defines nodes and edges in the complex metadata such that the nodes represent at least portions of metadata objects in the complex metadata and the edges represent relationships between nodes, to form a graphical representation of the dictionary using a cleaning analysis method that considers the nodes and edges that define the complex metadata and that automatically identifies unused objects in the complex metadata by identifying nodes that are associated with a low number of edges, and to provide the graphical representation of the dictionary for presentation on a display.

8. The multi-tenant server system of claim 7, wherein the dictionary includes entries associated with each metadata object of the complex metadata, wherein the entries include relationship information for each metadata object of the complex metadata, wherein the graph is at least one of a directed graph and an undirected graph, and wherein the feature analysis method is at least one of an impact analysis method, a use analysis method, a collision analysis method, a contagion analysis method, a toxicity analysis method, and a cleaning analysis method.

9. A computer-implemented method executable by a computer having a processor to analyze complex metadata of a data source, the method comprising:

receiving, by the computer, a data file from the data source, wherein the data file comprises digital data representing the complex metadata of the data source;

creating a dictionary of metadata by the processor, wherein the dictionary of metadata defines nodes and edges in the complex metadata of the data source, and wherein the nodes represent at least portions of metadata objects in the complex metadata and the edges represent relationships between nodes;

forming, by the processor, a graphical representation of the dictionary using a contagion analysis method that considers the nodes and edges that define the complex metadata of the data source so that the edges are mapped to show chains of relationships between nodes, and wherein the chains of relationships are filtered so only those nodes having the greatest chains of relationships are presented in the visual representation; and

providing the graphical representation for presentation on a display.

10. The method of claim 9, wherein the dictionary includes entries associated with each metadata object of the complex metadata.

11. The method of claim 10, wherein the entries include relationship information for each metadata object of the complex metadata.

12. The method of claim 9, wherein the graph of nodes is a directed graph.

13. The method of claim 9, wherein the graph of nodes is an undirected graph.

14. The method of claim 9, wherein the data source is a multi-tenant database system.