Communication data processing architecture

• US 10,362,133 B1
• Filed: 06/25/2015
• Issued: 07/23/2019
• Est. Priority Date: 12/22/2014
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Maag, Peter, O'Brien, Tom, Tosirisuk, Peter, Abdali, Saad, Freeland, Carl, DeArment, Greg, Albin, Maciej, Lynch, Matthew, Worton-Cross, Phillip
• Primary Examiner(s): Chea, Philip J
• Assistant Examiner(s): Ahmed, Mohammed
• Application Number:
  US14/750,773
• Time in Patent Office: 1,489 Days
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 51/42 Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data

Abstract

Various systems and methods are provided that allow reviewers to review and potentially flag processed communication data in order to spot potential malfeasance or illegal activity. Certain systems and methods includes modules for removing duplicate data from the communication data files, generating thread data for email data files, generating lexicon tag data for the data files, removing blacklisted data that meets blacklisted criteria, or generating group association data.

Claims

1. A computing system configured to display computer communication data, the computing system comprising:

a network interface;

a non-transitory memory;

a computer processor; and

a computer readable storage medium storing program instructions configured for execution by the computer processor in order to cause the computing system to;

access a plurality of communication data files in a plurality of different formats;

electronically decompress the plurality of communication data files;

convert the plurality of communication data files into a pre-determined, browser-renderable standard format to create a plurality of formatted communication data files;

generate lexicon tag data indicating a change in position from an original position of text in an original data file of the plurality of communication data files, the change in position being caused at least in part by the conversion of the plurality of communication data files into the pre-determined, browser-renderable standard format;

insert the lexicon tag data into a subset of the plurality of formatted communication data files that are in the pre-determined, browser-renderable standard format;

process the plurality of formatted communication data files to generate a plurality of revised formatted communication data files by performing two or more of the following;

removing duplicate data among the plurality of formatted communication data files;

generating thread data for at least the subset of the plurality of formatted communication data files;

removing, from the plurality of formatted communication data files, data that meets pre-identified blacklisted criteria;

or

generating group association data for the plurality of formatted communication data files;

store the plurality of revised formatted communication data files in the non-transitory memory; and

transmit the revised formatted communication data files, including the lexicon tag data, for rendering in a browser.

2. The computing system of claim 1, wherein the two or more includes generating the group association data, and the generated group association data indicates one or more groups associated with one or more persons who correspond to data files.

3. The computing system of claim 1, wherein converting the plurality of communication data files includes applying a first conversion process to email data in the plurality of communication data files and a second conversion process to a different type of communication data in the plurality of communication data files, the first conversion process different from the second conversion process.

4. The computing system of claim 1, wherein converting the plurality of communication data files includes applying a first conversion process to a first communication data in the plurality of communication data files, and a second conversion process to second communication data in the plurality of communication data files, the first communication data generated by a first communications program from a first provider, the second communication data generated by a second communications program from a second provider, and first conversion process different from the second conversion process.

5. The computing system of claim 1, wherein the one or more stored program instructions further cause the processor to access human resources data to correlate each of the plurality of communication data files to one or more persons.

6. The computing system of claim 5, wherein the two or more includes generating the group association data, and generating the group association data further includes correlating each of the plurality of communication data files to one or more groups associated with one or more persons.

19. The computing system of claim 1, wherein the two or more of the following are performed in parallel.

20. The computing system of claim 1, wherein at least one of generating the lexicon tag data or inserting the lexicon tag data is performed in parallel with the two or more of the following.

7. A computer-implemented method of displaying a large amount of communication data, the computer-implemented method comprising:

as implemented by one or more computer systems comprising computer hardware and memory, the one or more computer systems configured with specific executable instructions,

accessing a plurality of communication data files that are in a plurality of different formats;

electronically decompressing the plurality of communication data files;

converting the plurality of communication data files into a pre-determined, browser-renderable standard format to create a plurality of formatted communication data files;

generating lexicon tag data indicating a change in position from an original position of text in an original data file of the plurality of communication data files, the change in the position being caused at least in part by the conversion of the plurality of communication data files into the pre-determined, browser-renderable standard format;

inserting the lexicon tag data into a subset of the plurality of formatted communication data files that are in the pre-determined, browser-renderable standard format;

processing the plurality of formatted communication data files to generate a plurality of revised formatted communication data files by performing two or more of the following;

removing duplicate data among the plurality of formatted communication data files;

generating thread data for at least the subset of the plurality of formatted communication data files;

removing, from the plurality of formatted communication data files, data that meets pre-identified blacklisted criteria;

or

generating group association data for the plurality of formatted communication data files;

storing the plurality of revised formatted communication data files in a non-transitory memory; and

transmitting at least the lexicon tag data for rendering in a browser.

8. The computer-implemented method of claim 7, wherein the two or more includes generating the group association data, and the generated group association data indicates one or more groups associated with one or more persons who correspond to data files.

9. The computer-implemented method of claim 7, wherein converting the plurality of communication data files includes applying a first conversion process to email data in the plurality of communication data files and a second conversion process to a different type of communication data in the plurality of communication data files, the first conversion process different from the second conversion process.

10. The computer-implemented method of claim 7, wherein converting the plurality of communication data files includes applying a first conversion process to a first communication data in the plurality of communication data files, and a second conversion process to second communication data in the plurality of communication data files, the first communication data generated by a first communications program from a first provider, the second communication data generated by a second communications program from a second provider, and the first conversion process different from the second conversion process.

11. The computer-implemented method of claim 7 further comprising accessing human resources data to correlate each of the plurality of communication data files to one or more persons.

12. The computer-implemented method of claim 11, wherein the two or more includes generating the group association data, and generating the group association data further includes correlating each of the plurality of communication data files to one or more groups associated with one or more persons.

21. The computer-implemented method of claim 7, wherein the two or more of the following are performed in parallel.

22. The computer-implemented method of claim 7, wherein at least one of generating the lexicon tag data or inserting the lexicon tag data is performed in parallel with the two or more of the following.

13. A non-transitory computer-readable medium comprising one or more program instructions recorded thereon, the instructions configured for execution by a computing system comprising one or more processors in order to cause the computing system to:

access a plurality of communication data files that are in a plurality of different formats;

electronically decompress the plurality of communication data files;

convert the plurality of communication data files into a pre-determined, browser-renderable standard format to create a plurality of formatted communication data files;

generate lexicon tag data indicating a change in position from an original position of text in an original data file of the plurality of communication data files, the change in the position being caused at least in part by the conversion of the plurality of communication data files into the pre-determined, browser-renderable standard format;

insert the lexicon tag data into a subset of the plurality of formatted communication data files that are in the pre-determined, browser-renderable standard format;

process the plurality of formatted communication data files to generate a plurality of revised formatted communication data files by performing two or more of the following;

removing duplicate data among the plurality of formatted communication data files;

generating thread data for at least the subset of the plurality of formatted communication data files;

removing, from the plurality of formatted communication data files, data that meets pre-identified blacklisted criteria;

or

generating group association data for the plurality of formatted communication data files;

store the plurality of revised formatted communication data files in non-transitory memory; and

transmit at least the lexicon tag data for rendering in a browser.

14. The non-transitory computer-readable medium of claim 13, wherein the two or more includes generating the group association data, and the generated group association data indicates one or more groups associated with one or more persons who correspond to data files.

15. The non-transitory computer-readable medium of claim 13, wherein converting the plurality of communication data files includes applying a first conversion process to email data in the plurality of communication data files and a second conversion process to a different type of communication data in the plurality of communication data files, the first conversion process different from the second conversion process.

16. The non-transitory computer-readable medium of claim 13, wherein converting the plurality of communication data files includes applying a first conversion process to a first communication data in the plurality of communication data files, and a second conversion process to second communication data in the plurality of communication data files, the first communication data generated by a first communications program from a first provider, the second communication data generated by a second communications program from a second provider, and the first conversion process different from the second conversion process.

17. The non-transitory computer-readable medium of claim 13 further comprising accessing human resources data to correlate each of the plurality of communication data files to one or more persons.

18. The non-transitory computer-readable medium of claim 17, wherein the two or more includes generating the group association data, and generating group association data further includes correlating each of the plurality of communication data files to one or more groups associated with one or more persons.

23. The non-transitory computer-readable medium of claim 13, wherein the two or more of the following are performed in parallel.