Systems and methods for structuring data from unstructured electronic data files

• US 9,984,428 B2
• Filed: 10/27/2015
• Issued: 05/29/2018
• Est. Priority Date: 09/04/2015
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Doyle, John McKinstry, Beard, Mitch, Brahms, Christopher, Huber, Tristan, Kapitanova, Krasimira, Kwon, Ohsuk, Richbourg, Christopher, Stoeckel, Michael, Robinson, Seth
• Primary Examiner(s): Mincarelli, Jan P
• Application Number:
  US14/923,712
• Publication Number:
  US 20170069043A1
• Time in Patent Office: 945 Days
• Field of Search: None
• CPC Class Codes: G06F 16/243 Natural language query formulation
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/34 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 2230/00 Voting or election arrangements
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06Q 50/18 Legal services

Abstract

Computer implemented systems and methods are disclosed for structuring data from unstructured electronic data files. In accordance with some embodiments, an electronic data file including unstructured content associated with a legal process return is received and the unstructured content parsed. The unstructured content is parsed to identify one or more objects and properties based on a database ontology that are processed to generate an object model. A data report may be generated based on the identified objects and properties.

Claims

1. A data structuring system for structuring data from electronic data files of a social media platform received in association with a legal process return, the system comprising:

a memory device that stores a set of instructions;

at least one processing device configured to execute the instructions to;

receive an electronic data file, the electronic data file including unstructured content of the social media platform received in association with the legal process return;

determine, based on scanning a header included in the electronic data file, that the electronic data file includes data received from the social media platform;

identify, from a plurality of database ontologies corresponding to a plurality of social media platforms, a database ontology corresponding to the social media platform associated with the electronic data file, the database ontology defining known data objects and corresponding property types for unstructured data received from the social media platform;

parse the unstructured content to identify a first string in the unstructured content;

compare the first string to the known data objects defined in the database ontology corresponding to the social media platform, yielding a comparison;

determine, based on the comparison, that the first string matches a first known data object defined in the database ontology corresponding to the social media platform, the first data object being of a first data object type that is associated with a first property type;

in response to determining that the first string matches the first known data object, identify the first string as a first identified object in the unstructured content and assign the first object type to the first string;

parse the electronic data file to identify a second string that follows the first string in the unstructured content;

identify the second string as a first identified property of the first identified object in the unstructured content and assign the first property type to the second string; and

generate a data report based on the first identified data object and the first identified property.

2. The system of claim 1, wherein the electronic data file associated with the legal process return is received in response to a legal process.

3. The system of claim 2, wherein the legal process includes at least one of a warrant, a national security letter, and a subpoena.

4. The system of claim 1, wherein the first identified data object is a private message, and the first identified property is an identifier included in the private message.

5. The system of claim 4, wherein the at least one processing device is configured to execute the instructions to:

parse the identifier to normalize the identifier.

6. The system of claim 1, wherein the data report includes at least one of a list of histogramed telephone number data report, a conversation reconstructed from one or more private messages, a login information data report, a picture mapping data report, and a shared IP address data report.

7. A method of structuring data from unstructured electronic data files of a social media platform received in association with a legal process return, the method performed by at least one processing device and comprising:

receiving an electronic data file, the electronic data file including unstructured content of the social media platform received in association with the legal process return;

determining, based on scanning a header included in the electronic data file, that the electronic data file includes data received from the social media platform;

identifying, from a plurality of database ontologies corresponding to a plurality of social media platforms, a database ontology corresponding to the social media platform associated with the electronic data file, the database ontology defining known data objects and corresponding property types for unstructured data received from the social media platform;

parsing the unstructured content to identify a first string in the unstructured content;

comparing the first string to the known data objects defined in the database ontology corresponding to the social media platform, yielding a comparison;

determining, based on the comparison, that the first string matches a first known data object defined in the database ontology corresponding to the social media platform, the first data object being of a first data object type that is associated with a first property type;

in response to determining that the first string matches the first known data object, identifying the first string as a first identified object in the unstructured content and assign the first object type to the first string;

parse the electronic data file to identify a second string that follows the first string in the unstructured content;

identifying the second string as a first identified property of the first identified object in the unstructured content and assign the first property type to the second string; and

generating a data report based on the first identified data object and the first identified property.

8. The method of claim 7, wherein the electronic data file associated with the legal process return is received in response to a legal process.

9. The method of claim 8, wherein the legal process includes at least one of a warrant, a national security letter, and a subpoena.

10. The method of claim 7, wherein the data report is an interactive data report.

11. The method of claim 10, wherein the first identified data object is a private message, and the first identified property is an identifier included in the private message.

12. The method of claim 7, wherein the report includes at least one of a list of histogramed telephone number data report, a conversation reconstructed from one or more private messages, a login information data report, a picture mapping data report, and a shared IP address data report.

13. A non-transitory computer-readable medium storing a set of instructions that, when executed by one or more processors, cause the one or more processing devices to perform a method of structuring data from unstructured electronic data files of a social media platform received in association with a legal process return, the method comprising:

receiving an electronic data file, the electronic data file including unstructured content of the social media platform received in association with the legal process return;

determining, based on scanning a header included in the electronic data file, that the electronic data file includes data received from the social media platform;

identifying, from a plurality of database ontologies corresponding to a plurality of social media platforms, a database ontology corresponding to the social media platform associated with the electronic data file, the database ontology defining known data objects and corresponding property types for unstructured data received from the social media platform;

parsing the unstructured content to identify a first string in the unstructured content;

comparing the first string to the known data objects defined in the database ontology corresponding to the social media platform, yielding a comparison;

determining, based on the comparison, that the first string matches a first known data object defined in the database ontology corresponding to the social media platform, the first data object being of a first data object type that is associated with a first property type;

in response to determining that the first string matches the first known data object, identifying the first string as a first identified object in the unstructured content and assign the first object type to the first string;

parse the electronic data file to identify a second string that follows the first string in the unstructured content;

identifying the second string as a first identified property of the first identified object in the unstructured content and assign the first property type to the second string; and

generating a data report based on the first identified data object and the first identified property.