DYNAMIC COMPOSITE DATA DICTIONARY TO FACILITATE DATA OPERATIONS VIA COMPUTERIZED TOOLS CONFIGURED TO ACCESS COLLABORATIVE DATASETS IN A NETWORKED COMPUTING PLATFORM

• US 20190065569A1
• Filed: 05/22/2018
• Published: 02/28/2019
• Est. Priority Date: 06/19/2016
• Status: Active Grant

• Current Assignee: Data.World, Inc.
• Original Assignee: Data.World, Inc.
• Inventors: Boutros, Joseph, Brener, Sharon, Zelenak, Alexander John, Grochowicz, Robert Thomas, DiMarco, Mark Joseph, Jacob, Bryon Kristen, Griffith, David Lee, Reynolds, Shad William
• Granted Patent: US 11,086,896 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/212 with details for data modelling support
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 16/9024 Graphs; Linked lists G06F16/9027 takes precedence

Abstract

Various embodiments relate generally to data science and data analysis, computer software and systems, network communications to interface among repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform configured to provide one or more computerized tools that facilitate data projects by providing an interactive, project-centric workspace interface that may include, for example, a unified view in which to identify data sources, generate transformative datasets, and/form queries over a composite data dictionary coupled to collaborative computing devices and user accounts. For example, a method may include forming a first data dictionary, linking a dataset associated with the first data dictionary to another dataset, which may be associated with a second data dictionary, and forming a dynamic composite data dictionary.

Claims

1. A method comprising:

receiving data representing a dataset into dataset ingestion controller;

identifying a first data arrangement in which the data representing the dataset has a first format;

analyzing the data representing the dataset to determine a first subset of identifiers for subsets of data;

forming a first data dictionary including the first subset of identifiers for the subsets of data in the dataset;

formatting the dataset into a second data arrangement having a second format;

receiving data originating at a data project user interface to link the dataset to another dataset, which is associated with a second data dictionary; and

forming a composite data dictionary including the first data dictionary and the second data dictionary.

2. The method of claim 1 further comprising:

receiving data representing a request to import the another dataset into a data project;

associating the first set of identifiers of the dataset and the second set of identifiers of the another dataset in a data arrangement representing the data project; and

forming a combined dataset that is associated with the composite data dictionary.

3. The method of claim 1 further comprising:

determining whether to store data of the another dataset at a first computing device.

4. The method of claim 3 further comprising:

forming a link identifier to reference data of the another dataset locally;

storing the data of the another dataset in a data repository at the first computing device; and

implementing a dataset identifier in the composite data dictionary,

wherein the first computing device is disposed locally relative to a collaborative dataset consolidation system.

5. The method of claim 3 further comprising:

detecting linkage to a remote dataset at a second computing device;

forming a link identifiers to reference data of the another dataset remotely to identify a remote dataset; and

transforming a dataset identifier associated with the remote dataset into a local namespace;

wherein the second computing device is disposed externally relative to a collaborative dataset consolidation system.

6. The method of claim 5 further comprising:

implementing the dataset identifier in the composite data dictionary.

7. The method of claim 1 further comprising:

detecting activation of user input to form a query operation; and

detecting selection of a dataset identifier associated with the composite data dictionary, the dataset identifier referencing a subset of data in the another dataset.

8. The method of claim 7 further comprising:

determining the another dataset is disposed remotely to form a remote dataset.

9. The method of claim 8 further comprising:

determining a transformed link identifier is available; and

applying the query operation via the transformed link identifier against the remote dataset as an implicit federated query.

10. The method of claim 8 further comprising:

applying the query operation via a path identifier against the remote dataset as an explicit federated query.

11. The method of claim 8 further comprising:

generating a service graph call to access the remote dataset.

12. The method of claim 1 wherein formatting the dataset into the second data arrangement comprises:

converting the dataset into an atomized dataset having a graph data arrangement.

13. The method of claim 12 further comprising:

associating an identifier of the data dictionary to a subset of the atomized dataset.

14. The method of claim 12 wherein analyzing the data representing the dataset to determine identifiers for subsets of data comprises:

determining a subset of dataset attributes for a subset of the atomized dataset; and

deriving an annotation to form a derived annotation for the subset of the atomized dataset; and

forming the identifier as a function of the derived annotation.

15. The method of claim 14 wherein deriving the annotation comprises:

extracting data representing a column header associated with the first data arrangement; and

implementing the data representing the column header as an identifier.

16. The method of claim 13 wherein analyzing the data representing the dataset to determine identifiers for subsets of data comprises:

generating data representing a request for an identifier;

receiving data responsive to the request for the identifier; and

applying the data as the identifier.

17. An apparatus comprising:

a memory including executable instructions; and

a processor, responsive to executing the instructions, is configured to;

receive data representing a dataset into dataset ingestion controller;

identify a first data arrangement in which the data representing the dataset has a first format;

analyze the data representing the dataset to determine a first subset of identifiers for subsets of data;

form a first data dictionary including the first subset of identifiers for the subsets of data in the dataset;

format the dataset into a second data arrangement having a second format;

receive data originating at a data project user interface to link the dataset to another dataset, which is associated with a second data dictionary; and

form a composite data dictionary including the first data dictionary and the second data dictionary.

18. The apparatus of claim 17 wherein a subset of the instructions further causes the processor to:

receive data representing a request to import the another dataset into a data project;

associate the first set of identifiers of the dataset and the second set of identifiers of the another dataset in a data arrangement representing the data project; and

form a combined dataset that is associated with the composite data dictionary.

19. The apparatus of claim 17 wherein a subset of the instructions further causes the processor to:

determine whether to store data of the another dataset at a first computing device;

form a link identifiers to reference data of the another dataset locally;

store the data of the another dataset in a data repository at the first computing device; and

implement a dataset identifier in the composite data dictionary,

wherein the first computing device is disposed locally relative to a collaborative dataset consolidation system.

20. The apparatus of claim 17 wherein a subset of the instructions further causes the processor to:

form a link identifier to reference data of the another dataset locally;

store the data of the another dataset in a data repository at a first computing device; and

implement a dataset identifier in the composite data dictionary,

wherein the first computing device is disposed locally relative to a collaborative dataset consolidation system.