CONSOLIDATOR PLATFORM TO IMPLEMENT COLLABORATIVE DATASETS VIA DISTRIBUTED COMPUTER NETWORKS

• US 20170364564A1
• Filed: 06/19/2016
• Published: 12/21/2017
• Est. Priority Date: 06/19/2016
• Status: Active Grant

• Current Assignee: Data.World, Inc.
• Original Assignee: Data.World, Inc.
• Inventors: Jacob, Bryon Kristen, Griffith, David Lee, Le, Triet Minh, Keen, Arthur Albert, Zelenak, Alexander John, Loyens, Jon, Hurt, Brett A., Reynolds, Shad William, Boutros, Joseph
• Granted Patent: US 10,515,085 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: G06F 21/6227 where protection concerns the structure of data, e.g. records, types, queries

Abstract

Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform that facilitates consolidation of one or more datasets, whereby a collaborative data layer and associated logic facilitate, for example, efficient access to, and implementation of, collaborative datasets. In some examples, a system may include data ingestion controller configured to format datasets to form a first and a second atomized dataset, the second atomized dataset including the first atomized dataset and one or more other atomized datasets. The system may include a dataset query engine configured to identify a portion of a dataset relevant to a query, and to retrieve query results from at least one of different data repositories.

Claims

1. A system comprising:

a dataset query engine configured to receive data representing a query, the dataset being associated with an identifier, and to identify datasets relevant to the query, the datasets being disposed in disparate data repositories, the dataset query engine further configured to determine a level of authorization associated with the identifier to access each of the datasets, to generate one or more queries based on the query to access the disparate data repositories, and to retrieve data representing query results from the accessed disparate data repositories.

2. The system of claim 1 wherein the datasets comprise atomized datasets that include one or more subsets of linked data points.

3. The system of claim 1 comprising a collaborative dataset consolidation system that comprises:

one or more memory devices storing modules of executable instructions; and

one or more processors configured to execute a module of executable instructions to implement the dataset query engine.

4. The system of claim 1 wherein the dataset query engine is further configured to retrieve the data representing the query results from an accessed external repository external to the system.

5. The system of claim 1 wherein the dataset query engine is further configured to determine a subset of data attributes associated with the query to identify the datasets relevant to the query, and to retrieve a subset of atomized datasets that include data associated with one or more of the data attributes.

6. The system of claim 5 wherein the dataset query engine is further configured to search for a derived attribute as at least one of data attributes to determine a data attribute associated with the query.

7. The system of claim 6 wherein the dataset query engine is further configured to analyze a plurality of datasets associated with the collaborative dataset consolidation system to infer data representing the derived attribute.

8. The system of claim 1 wherein the dataset query engine is configured to:

receive data representing another query into the collaborative dataset consolidation system, the another query being associated with another identifier;

identify the datasets relevant to the another query; and

deny access to datasets to perform the another query if the level of authorization is absent.

9. The system of claim 1 wherein the dataset query engine is configured to:

receive data representing another query into the collaborative dataset consolidation system, the another query being associated with another identifier;

identify the datasets relevant to the another query; and

grant access to at least one dataset to perform the another query if the level of authorization is present.

10. The system of claim 1 wherein dataset query engine is configured to generate the one or more queries as a federated query.

11. The system of claim 10 wherein the federated query is a query of disparate data stores.

12. The system of claim 10 wherein the federated query is a query of different triplestores.

13. A system comprising:

a data ingestion controller configured to;

receive a data file including a dataset, and to

format the dataset to form an atomized dataset including atomized data points each including data representing at least two objects and an association between the two objects, the data ingestion controller is further configured to

form another atomized dataset including the atomized dataset and other atomized datasets; and

a dataset query engine configured to

receive data representing a query being associated with an identifier, the dataset query engine further configured to

identify a subset of the another atomized dataset relevant to the query, wherein portions of the another atomized dataset are disposed in different data repositories, the dataset query engine also configured to

generate a plurality of sub-queries each of which is configured to access at least one of the different data repositories, and to

retrieve data representing query results from the at least one of the different data repositories.

14. The system of claim 13 wherein the data ingestion controller is configured to classify query portions.

15. The system of claim 14 wherein the data ingestion controller is further configured to identify a classification type to classify a portion of the query.

16. The system of claim 13 wherein the datasets comprise linked data points.

17. The system of claim 16 wherein linked data points comprise triples.

18. The system of claim 17 wherein at least one triple of the triples are formatted to comply with a Resource Description Framework (“

RDF”

) data model.