Simplified frontend processing and visualization of large datasets

• US 9,996,236 B1
• Filed: 02/09/2016
• Issued: 06/12/2018
• Est. Priority Date: 12/29/2015
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Spencer-Harper, Quentin, Sparrow, Alexander, Riarola, Jose
• Primary Examiner(s): Weng, Peiyong
• Application Number:
  US15/019,844
• Time in Patent Office: 854 Days
• CPC Class Codes: G06F 16/26 Visual data mining; Browsing structured data
• CPC Class Codes: G06F 16/287 Visualization; Browsing
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs

Abstract

Systems and methods for simplified frontend processing and visualization of large datasets are provided. In example embodiments, a plurality of data objects are accessed. One or more of data objects from among the plurality of data objects are grouped into a first group. A group identifier that identifies data objects included in the first group is created. A visualization comprising a first node that represents the first group is generated. The first node is linked to the group identifier. The visualization is presented on a user interface of the user device. User input indication a user-specified action and the group identifier is received. The user-specified action is performed with the data objects identified by the group identifier.

Claims

1. A method comprising:

accessing a plurality of data objects that are each associated with at least one object property;

grouping, into a first group, a plurality of data objects from among the plurality of data objects that are associated with a first object property;

creating, using a hardware processor of a machine, a group identifier that identifies data objects included in the first group, the group identifier being stored in association with the data objects;

automatically summarizing, by the hardware processor of the machine, a second object property of the plurality of data objects in the first group to create summary information, the summary information including a summary of the second object property without including the second object property itself, the second object property being different than the first object property;

generating a visualization comprising a plurality of nodes including a first node that represents the first group, the first node being linked to the group identifier and including the summary information; and

causing presentation of the visualization on a user interface of a user device of a user.

2. The method of claim 1, further comprising:

receiving user input indicating a user-specified action relating to the group identifier; and

performing the user-specified action with the data objects identified by the group identifier.

3. The method of claim 2, wherein the user-specified action comprises a modification of the first group, wherein the modification includes at least one of a group union, a group intersection, or a group split.

4. The method of claim 1, further comprising:

determining a suggested modification of the first group based on an analysis of the data objects included in the first group;

providing an option to perform the suggested modification of the first group, the option to be displayed on the user interface of the user device;

receiving a selection of the option to perform the suggested modification of the first group; and

updating the visualization according to the suggested modification of the first group.

5. The method of claim 1, further comprising:

receiving user input indicating a user-specified modification to the visualization;

during a first session at a first time, storing a visualization configuration comprising the user-specified modifications; and

during a second session at a second time after the first time, generating the visualization according to the stored visualization configuration.

6. The method of claim 1, further comprising:

identifying a relationship between the first group and a second group of data objects from among the plurality of data objects; and

generating the visualization to include the first node and a second node that represents the second group, wherein the visualization includes a visual indication of the identified relationship between the first node and the second node.

7. The method of claim 6, wherein the first node and the second node are arranged in the visualization according to a layout specifying rule for placing nodes within the visualization.

8. The method of claim 1, further comprising:

generating summary information for the first group, wherein the first node that represents the first group includes a visual indication of the summary information.

9. A system comprising:

one or more processors; and

a memory storing executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising;

accessing a plurality of data objects that are each associated with at least one object property;

grouping, into a first group, a plurality of data objects from among the plurality of data objects that are associated with a first object property;

creating, using a hardware processor of a machine, a group identifier that identifies data objects included in the first group, the group identifier being stored in association with the data objects;

summarizing a second object property of the plurality of data objects in the first group to create summary information, the summary information including a summary of the second object property without including the second object property itself, the second object property being different than the first object property;

generating a visualization comprising a plurality of nodes including a first node that represents the first group, the first node being linked to the group identifier, and including the summary information; and

causing presentation of the visualization on a user interface of a user device of a user.

10. The system of claim 9, further comprising:

receiving user input indicating a user-specified action relating to the group identifier; and

performing the user-specified action with the data objects identified by the group identifier.

11. The system of claim 10, wherein the user-specified action comprises a modification of the first group, wherein the modification includes at least one of a group union, a group intersection, or a group split.

12. The system of claim 9, wherein:

determining a suggested modification of the first group based on an analysis of the data objects included in the first group;

providing an option to perform the suggested modification of the first group, the option to be displayed on the user interface of the user device;

receiving a selection of the option to perform the suggested modification of the first group; and

updating the visualization according to the suggested modification of the first group.

13. A machine-readable medium having no transitory signals and storing instructions that, when executed by at least one processor of a machine, cause the machine to perform operations comprising:

accessing a plurality of data objects that are each associated with at least one object property;

grouping, into a first group, a plurality of data objects from among the plurality of data objects that are associated with a first object property;

creating, using a hardware processor of a machine, a group identifier that identifies data objects included in the first group, the group identifier being stored in association with the data objects;

summarizing a second object property of the plurality of data objects in the first group to create summary information, the summary information including a summary of the second object property without including the second object property itself, the second object property being different than the first object property;

generating a visualization comprising a plurality of nodes including a first node that represents the first group, the first node being linked to the group identifier, and including the summary information; and

causing presentation of the visualization on a user interface of a user device of a user.

14. The machine-readable medium of claim 13, wherein the operations further comprise:

receiving user input indicating a user-specified action relating to the group identifier; and

performing the user-specified action with the data objects identified by the group identifier.

15. The machine-readable medium of claim 14, wherein the user-specified action comprises a modification of the first group, wherein the modification includes at least one of a group union, a group intersection, or a group split.

16. The machine-readable medium of claim 13, wherein the operations further comprise:

determining a suggested modification of the first group based on an analysis of the data objects included in the first group;

providing an option to perform the suggested modification of the first group, the option to be displayed on the user interface of the user device;

receiving a selection of the option to perform the suggested modification of the first group; and

updating the visualization according to the suggested modification of the first group.

17. The machine-readable medium of claim 13, wherein the operations further comprise:

receiving user input indicating a user-specified modification to the visualization;

during a first session at a first time, storing a visualization configuration comprising the user-specified modifications; and

during a second session at a second time after the first time, generating the visualization according to the stored visualization configuration.

18. The machine-readable medium of claim 13, wherein the operations further comprise:

identifying a relationship between the first group and a second group of data objects from among the plurality of data objects; and

generating the visualization to include the first node and a second node that represents the second group, wherein the visualization includes a visual indication of the identified relationship between the first node and the second node.

19. The machine-readable medium of claim 18, wherein the first node and the second node are arranged in the visualization according to a layout specifying rule for placing nodes within the visualization.

20. The machine-readable medium of claim 13, wherein the operations further comprise:

generating summary information for the first group, wherein the first node that represents the first group includes a visual indication of the summary information.