Systems and methods for accessing federated data

• US 10,402,397 B1
• Filed: 06/14/2018
• Issued: 09/03/2019
• Est. Priority Date: 05/09/2018
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Bagdis, Jeffrey, Ossher, Joel, Tibshirani, Julie
• Primary Examiner(s): Torgrimson, Tyler J
• Application Number:
  US16/008,932
• Time in Patent Office: 446 Days
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06F 16/256 in federated or virtual databases
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database

Abstract

Systems and methods are provided that allow federated data from various source systems to be accessed and analyzed through a data analysis platform. The federated data may be stored in different formats. The data analysis platform can receive the federated data in whatever format it has been stored at its respective source system. A script can be used to generate temporary representations (or temporary objects) for the federated data by transforming the federated data. Moreover, the temporary representations or temporary objects can be further transformed into a data analysis platform-specific format. A user of data analysis platform may access and/or manipulate either the temporary representations or objects as well as the data analysis platform-specific objects. Temporary objects can be transformed automatically into corresponding platform-specific objects when necessary to provide an enhanced capability or operation on the objects.

Claims

1. A system, comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the system to perform;

determining a script for transforming federated data in one or more source computing systems to corresponding data platform objects;

executing the script;

determining a set of temporary objects based at least in part on execution of the script, wherein the temporary objects each provide a first representation of some portion of the federated data;

determining a set of data platform objects based at least in part on execution of the script, wherein the data platform objects each provide a second representation of some portion of the federated data; and

providing a graphical user interface for accessing the federated data;

performing, through the graphical user interface, one or more operations, the one or more operations being applied to the set of temporary objects, the one or more operations performed through the graphical user interface including a promotion to a particular temporary object of the set of the temporary objects, the graphical user interface causing the promotion to be automatically applied to a corresponding data platform object.

2. The system of claim 1, wherein the set of temporary objects are cached in the memory.

3. The system of claim 1, wherein execution of the script determines an ontology for an object-based data modeling framework of the system.

4. The system of claim 1, wherein the temporary object and the corresponding data platform object have identical properties and links.

5. The system of claim 1, wherein, when the temporary object is accessed through the interface, the system obtains and provides the corresponding data platform object through the interface.

6. The system of claim 1, wherein each temporary object references some portion of the federated data, and wherein each temporary object has a corresponding data platform object that also references the same portion of the federated data.

7. The system of claim 6, wherein modification of the portion of the federated data in the one or more source computing systems triggers an update to the corresponding data platform object that references the portion of the federated data.

8. The system of claim 7, wherein the update is triggered in response to a search result that references the portion of the federated data, the search result being provided in response to a search query submitted through the interface.

9. The system of claim 8, wherein the system stores metadata describing the promotions applied to the temporary object.