TRANSMUTING DATA ASSOCIATIONS AMONG DATA ARRANGEMENTS TO FACILITATE DATA OPERATIONS IN A SYSTEM OF NETWORKED COLLABORATIVE DATASETS

• US 20190042606A1
• Filed: 04/02/2018
• Published: 02/07/2019
• Est. Priority Date: 06/19/2016
• Status: Active Grant

• Current Assignee: Data.World, Inc.
• Original Assignee: Data.World, Inc.
• Inventors: Griffith, David Lee, Jacob, Bryon Kristen, Reynolds, Shad William
• Granted Patent: US 11,036,697 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/213 with details for schema evolution support
• CPC Class Codes: G06F 16/2272 Management thereof
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity

Abstract

Various embodiments relate generally to data science and data analysis and computer software and systems to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform configured to transmute associations between data arrangements of different formats or different data models to facilitate data operations, such as queries, configured to enhance, for example, an ingested dataset via transmuted associations as, for example, interrelations among a system of networked collaborative datasets. For example, a method may include identifying a referential indicator, determining an association with a value representative of the referential indicator to an equivalent value representative of another referential indicator associated with a different dataset, transmuting the association to form a transmuted association as a link between the value and the equivalent value, and integrating the link into an ingested data arrangement.

Claims

1. A method comprising:

receiving data representing a dataset into dataset ingestion controller;

identifying a first data arrangement in which the data representing the dataset has a first format;

identifying a first referential indicator for a first set of the dataset in the first data arrangement;

determining an association with a value representative of the first referential indicator to an equivalent value representative of a second referential indicator associated with a second set of a different dataset;

formatting the dataset into a second data arrangement having a second format;

transmuting the association to form a transmuted association as a link between the value and the equivalent value; and

integrating the transmuted association into at least a portion of the first data arrangement.

2. The method of claim 1 wherein transmuting the association to form the transmuted association comprises:

transmuting an indexed-based association to form the transmuted association based on the second format.

3. The method of claim 2 wherein transmuting the indexed-based association comprises:

forming linked data compatible with the second format; and

replacing the indexed-based association with the linked data.

4. The method of claim 2 wherein transmuting the indexed-based association comprises:

replacing an equality determination to join two or more datasets.

5. The method of claim 2 wherein the second format is a graph data arrangement.

6. The method of claim 1 further comprising:

identifying one of the value and the_equivalent value as a unique value; and

determining the association as one of one or more associations between the unique value to one or more equivalent values of the other of the first data arrangement and the second data arrangement.

7. The method of claim 1 further comprising:

wherein one of the first referential indicator and the second referential indicator is a value in one of the first data arrangement and the second data arrangement, and the value is linked to one or more equivalent values of the other of the first data arrangement and the second data arrangement.

8. The method of claim 1 further comprising:

wherein one of the first referential indicator and the second referential indicator is a primary key, and the other of the first referential indicator and the second referential indicator is a foreign key.

9. The method of claim 1 wherein formatting the dataset into a second data arrangement having a second format comprises:

formatting the dataset in a tabular data arrangement as the first data arrangement having a table format as the first format into a graph data arrangement as the second data arrangement having a graph format as the second format.

10. The method of claim 1 wherein formatting the dataset into a second data arrangement having a second format comprises:

forming referential data associated with a unit of data in a tabular data arrangement to the unit of data in a graph data arrangement.

11. The method of claim 10 further comprising:

receiving data representing a query; and

applying the query to either the tabular data arrangement or the graph data arrangement.

12. The method of claim 10 further comprising:

receiving data representing a query directed to the tabular data arrangement to join the dataset to the different dataset to extract data from both the dataset and the different dataset; and

using the transmuted association to retrieve results of the query.

13. The method of claim 12 wherein using the transmuted association retrieve the results of the query comprises:

applying the query via linked data, thereby foregoing computing equality operations to detect whether the first referential indicator matches the second referential indicator.

14. The method of claim 12 wherein receiving data representing the query comprises:

receiving a command configured to access a relational data structure.

15. The method of claim 1 further comprises:

generating data to present one or more user inputs in a user interface to initiate execution of instructions to associate the first referential indicator to the second referential indicator; and

receiving a response to at least one of the one or more user inputs to transmute the association to form the transmuted association.

16. An apparatus comprising:

a memory including executable instructions; and

a processor, responsive to executing the instructions, is configured to;

receive data representing a dataset into dataset ingestion controller;

arrange the data representing the dataset into a first data arrangement having a first format;

identify a first referential indicator for a first set of the dataset in the first data arrangement;

determine an association with a value representative of the first referential indicator to an equivalent value representative of a second referential indicator associated with a second set of a different dataset;

format the dataset into a second data arrangement having a second format;

transmute the association to form a transmuted association as a link between the value and the equivalent value; and

integrate the transmuted association into at least a portion of the first data arrangement.

17. The apparatus of claim 16 wherein a subset of the instructions to cause the processor to transmute the association to form the transmuted association further causes the processor to:

transmute an indexed-based association to form the transmuted association based on the second format.

18. The apparatus of claim 16 wherein a subset of the instructions to cause the processor to transmute the association to form the transmuted association further causes the processor to:

form linked data compatible with the second format; and

replace the indexed-based association with the linked data.

19. The apparatus of claim 16 wherein of the first referential indicator and the second referential indicator is a primary key, and the other of the first referential indicator and the second referential indicator is a foreign key.

20. The apparatus of claim 16 wherein the processor is further configured to:

receive data representing a query directed to a tabular data arrangement to join the dataset to the different dataset to extract data from both the dataset and the different dataset; and

use the transmuted association to retrieve results of the query.