COMPUTERIZED TOOL IMPLEMENTATION OF LAYERED DATA FILES TO DISCOVER, FORM, OR ANALYZE DATASET INTERRELATIONS OF NETWORKED COLLABORATIVE DATASETS

• US 20180262864A1
• Filed: 03/09/2017
• Published: 09/13/2018
• Est. Priority Date: 06/19/2016
• Status: Active Grant

• Current Assignee: Data.World, Inc.
• Original Assignee: Data.World, Inc.
• Inventors: Reynolds, Shad William, Griffith, David Lee, Jacob, Bryon Kristen
• Granted Patent: US 10,645,548 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06F 17/18 for evaluating statistical data , e.g. average values, frequency distributions, probability functions, regression analysis forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04
• CPC Class Codes: G06F 21/604 Tools and structures for managing or administering access control systems
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 63/104 Grouping of entities
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04W 4/38 for collecting sensor information
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]

Abstract

Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform that facilitates consolidation of one or more datasets, whereby one or more computerized tools may be configured to discover, form, and analyze, for example, via one or more layered data files, interrelations among a system of networked collaborative datasets. In some examples, a method may include transforming of a set of data to an atomized format to form an atomized dataset that includes a derived dataset attribute. The method may also include presenting data representing an annotation at the user interface based on the derived dataset attribute. In some examples, the annotation may be associated with a layer file.

Claims

1. A method comprising:

receiving data to form a first input via a user interface as a first user interface element to initiate creation of a dataset based on a set of data;

activating a programmatic interface to facilitate the creation of the dataset responsive to receiving the first input;

causing transformation of the set of data from a first format to an atomized format to form an atomized dataset, the transformation of the set of data including deriving a dataset attribute based on a subset of data to form a derived dataset attribute for the set of data; and

presenting data representing an annotation at the user interface based on the derived dataset attribute for the subset of data from the set of data.

2. The method of claim 1 wherein presenting the data representing the annotation for the subset of the set of data comprises:

accepting a second input via the user interface as a second user interface element to cause linking between the atomized dataset and to another dataset based on the annotation; and

presenting data that represents the annotation for a column of data.

3. The method of claim 1 further comprising:

presenting in the user interface a data view of the subset of data as a column of data associated with an unknown dataset attribute.

4. The method of claim 3 further comprising:

receiving data to annotate a column header to form the annotation to resolve the unknown dataset attribute.

5. The method of claim 3 further comprising:

receiving data to annotate a datatype to form the annotation to resolve the unknown dataset attribute for the column of data.

6. The method of claim 1 further comprising:

presenting a data view in the user interface of subsets of data from the set of data, each subset representing a column of data; and

presenting a derived column of data that includes data derived from one or more other columns of data.

7. The method of claim 6 further comprising:

receiving data to form a third input via the user interface as a third user interface element that is configured to receive data signals to add the derived column of data; and

transmitting the data signals to add the derived column of data.

8. The method of claim 6 further comprising:

receiving data to form a fourth input via the user interface as a fourth user interface element that is configured to receive data signals to substitute the derived column of data; and

transmitting the data signals to substitute the derived column of data to replace the one or more other columns of data from which the derived column were derived.

9. The method of claim 6 further comprising:

receiving data to form a fifth input via the user interface as a fifth user interface element that is configured to receive data signals to reject the derived column of data; and

transmitting the data signals to reject the derived column.

10. The method of claim 6 wherein presenting the derived column of data comprises:

expanding the column of data into two or more columns of data.

11. The method of claim 6 wherein presenting the derived column of data comprises:

collapsing two or more columns of data into the column of data.

12. The method of claim 1 wherein causing transformation of the set of data to include deriving the dataset attribute comprises:

causing access to a first subset of layer files specifying datatypes to identify an inferred attribute.

13. The method of claim 1 wherein causing transformation of the set of data to include deriving the dataset attribute comprises:

causing access to a second subset of layer files specifying a data classification to identify an inferred attribute.

14. The method of claim 1 wherein causing transformation of the set of data to include deriving the dataset attribute comprises:

causing access to a third subset of layer files specifying contextual data to identify the inferred attribute.

15. The method of claim 1 accepting a second input to create the atomized dataset linked to the another dataset comprises:

identifying the another data set as a protected dataset;

transmitting authorization to access the protected dataset; and

causing the atomized dataset to form based on the access to the protected dataset.

16. The method of claim 1 wherein causing transformation of the set of data to include deriving the dataset attribute comprises:

causing a collaborative dataset consolidation system to identify contextual data with which to link the atomized data set to other atomized data sets.

17. The method of claim 1 further comprising:

receiving data from the user interface to modify units for values of data in a column of data; and

receiving data representing a derived column of data that includes the values of data having modified units.

18. The method of claim 1 wherein the atomized dataset and the other dataset include subsets of linked data points.

19. The method of claim 18 wherein linked data points comprise triples, at least one triple of the triples are formatted to comply with a Resource Description Framework (“

RDF”

) data model.

20. An apparatus comprising:

a memory including executable instructions; and

a processor, responsive to executing the instructions, is configured to;

receive data to form a first input via a user interface as a first user interface element to initiate creation of a dataset based on a set of data;

activate a programmatic interface to facilitate the creation of the dataset responsive to receiving the first input;

cause transformation of the set of data from a first format to an atomized format to form an atomized dataset, the transformation of the set of data including deriving a dataset attribute based on a subset of data to form a derived dataset attribute for the set of data; and

present data representing an annotation at the user interface based on the derived dataset attribute for the subset of data from the set of data,

wherein the derived dataset attribute is associated with a layer files specifying an inferred datatype as the derived dataset attribute.