Fast approximate results and slow precise results

• US 10,552,435 B2
• Filed: 03/08/2017
• Issued: 02/04/2020
• Est. Priority Date: 03/08/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Wang, Chi, Ding, Bolin, Fisher, Danyel A., Moritz, Robyn Dominik
• Primary Examiner(s): Dwivedi, Mahesh H
• Application Number:
  US15/453,690
• Publication Number:
  US 20180260450A1
• Time in Patent Office: 1,063 Days
• CPC Class Codes: G06F 16/248 Presentation of query results

Abstract

Techniques for presenting data visualizations are described. Consistent with some embodiments of the present invention, a data visualization system includes an approximate query engine to derive approximate query results and present approximate data visualizations, in interactive time. The data visualization system also includes a precise query engine, thereby enabling a data analyst to selectively request that a precise query result be generated for a specific query, so that the data analyst can confirm a data observation made when viewing the approximate visualization for that specific query. The precise visualization is presented in a manner that allows the data analyst to view, and thus confirm or disprove, a data observation recorded when viewing the approximate visualization, and also compare the precise visualization with the previously generated and presented approximate visualization.

Claims

1. A method to be performed by a data visualization system, the method comprising:

receiving, from a client application, a query to be executed against a dataset;

processing the query against a representative subset of the dataset to generate an approximate query result, and from the approximate query result, an approximate visualization;

communicating the approximate visualization to the client application for presentation within a user interface;

responsive to receiving a request to generate a precise visualization for the query, processing the query against the entire dataset to generate a precise query result, and from the precise query result, a precise visualization for the query;

communicating the precise visualization for the query to the client application for presentation within the user interface;

subsequent to communicating the approximate visualization for the query and responsive to receiving the request to generate the precise visualization for the query, communicating information to the client application that causes the approximate visualization to be presented, within the user interface, in a list of visualizations corresponding to queries for which requests to generate precise visualizations have been received; and

for each visualization in the list, presenting the visualization in a first color to indicate that the visualization is an approximate visualization, based on an approximate query result, or a second color to indicate that the visualization is a precise visualization, based on a precise query result.

2. The method of claim 1, wherein processing the query against a representative subset of the dataset to generate an approximate query result includes processing the query against a sample of the dataset that has a sample size that has been algorithmically determined to ensure query processing against the sample of the dataset is completed within a predetermined maximum query processing time.

3. The method of claim 1, wherein processing the query against a representative subset of the dataset to generate an approximate query result includes processing the query against a sample of the dataset that has a sample size that has been algorithmically determined to ensure that a measure for the magnitude of possible error in the approximate query result, compared to the precise query result, does not exceed a predetermined error threshold.

4. The method of claim 1, wherein the precise visualization for the query is generated to include the approximate visualization, or some portion thereof, superimposed over the precise visualization, thereby enabling a comparison of query results.

5. The method of claim 1, wherein communicating the precise visualization for the query to the client application for presentation within the user interface includes causing the precise visualization for the query to be presented with the approximate visualization, thereby enabling a side-by-side comparison of query results.

6. The method of claim 1, further comprising:

communicating information, representing an end-user selectable graphical user interface element, to the client application for presentation within the user interface, wherein, upon detecting selection of the end-user selectable graphical user interface element by an end-user at the client application, a request to generate the precise visualization for the query is generated and communicated from the client application to the data visualization system.

7. The method of claim 6, further comprising:

communicating information, representing a text entry box, to the client application for presentation within the user interface, wherein, upon detecting selection of the end-user selectable graphical user interface element by an end-user at the client application, text entered into the text entry box is communicated from the client application to the data visualization system and stored in association with the approximate visualization.

8. The method of claim 1, wherein the approximate visualization and the precise visualization are one of a:

bar chart, histogram, scatter plot, network, streamgraph, or heatmap.

9. A data visualization system comprising:

a data processing unit, and

a computer-readable medium storing instructions, which, when executed by the data processing unit, cause the data visualization system to perform operations that;

receive, from a client application, a query to be executed against a dataset;

process the query against a representative subset of the dataset to generate an approximate query result, and from the approximate query result, an approximate visualization;

communicate the approximate visualization to the client application for presentation within a user interface;

responsive to receipt of a request to generate a precise visualization for the query, process the query against the entire dataset to generate a precise query result, and from the precise query result, a precise visualization for the query;

communicate the precise visualization for the query to the client application for presentation within the user interface;

subsequent to communicating the approximate visualization for the query and responsive to receiving a request to generate a precise visualization for the query, communicate information to the client application that causes the approximate visualization to be presented, within the user interface, in a list of visualizations corresponding to queries for which requests to generate precise visualizations have been received; and

for each visualization in the list, presenting the visualization in a first color to indicate that the visualization is an approximate visualization, based on an approximate query result, or a second color to indicate that the visualization is a precise visualization, based on a precise query result.

10. The data visualization system of claim 9, wherein the operation to process the query against a representative subset of the dataset to generate an approximate query result causes the data visualization system to process the query against a sample of the dataset that has a sample size that has been algorithmically determined to ensure query processing against the sample of the dataset is completed within a predetermined maximum query processing time.

11. The data visualization system of claim 9, wherein the operation to process the query against a representative subset of the dataset to generate an approximate query result causes the data visualization system to process the query against a sample of the dataset that has a sample size that has been algorithmically determined to ensure that a measure for the magnitude of possible error in the approximate query result, compared to the precise query result, does not exceed a predetermined error threshold.

12. The data visualization system of claim 9, wherein the precise visualization for the query is generated to include the approximate visualization, or some portion thereof, superimposed over the precise visualization, to enable a comparison of query results.

13. The data visualization system of claim 9, wherein the operation to communicate the precise visualization for the query to the client application for presentation within the user interface further comprises:

causing the precise visualization for the query to be presented with the approximate visualization, to enable a side-by-side comparison of query results.

14. The data visualization system of claim 9, comprising additional instructions, which, when executed by the data processing unit, cause the data visualization system to perform operations that:

communicate information, representing an end-user selectable graphical user interface element, to the client application for presentation within the user interface, wherein, upon detecting selection of the end-user selectable graphical user interface element by an end-user at the client application, a request o generate a precise visualization for the query is generated and communicated from the client application to the data visualization system.

15. The data visualization system of claim 14, comprising additional instructions, which, when executed by the data processing unit, cause the data visualization system to perform operations that:

communicate information, representing a text entry box, to the client application for presentation within the user interface, wherein, upon detecting selection of the end-user selectable graphical user interface element by an end-user at the client application, text entered into the text entry box is communicated from the client application to the data visualization system and stored in association with the approximate visualization.

16. The data visualization system of claim 9, wherein the approximate visualization and the precise visualization are one of a:

bar chart, histogram, scatter plot, network, streamgraph, or heatmap.

17. A non-transitory computer readable storage medium storing instructions thereon, which, when executed by a processing device of a computer system, cause the computer system to perform operations, the operations comprising:

receiving, from a client application, a query to be executed against a dataset;

processing the query against a representative subset of the dataset to generate an approximate query result, and from the approximate query result, an approximate visualization;

communicating the approximate visualization to the client application for presentation within a user interface;

responsive to receiving a request to generate a precise visualization for the query, processing the query against the entire dataset to generate a precise query result, and from the precise query result, a precise visualization for the query;

communicating the precise visualization for he query to the client application for presentation within the user interface;

subsequent to communicating the approximate visualization for the query and responsive to receiving a request to generate a precise visualization for the query, communicate information to the client application that causes the approximate visualization to be presented, within the user interface, in a list of visualizations corresponding to queries for which requests to generate precise visualizations have been received; and

for each visualization in the list, presenting the visualization in a first color to indicate that the visualization is an approximate visualization, based on an approximate query result, or a second color to indicate that the visualization is a precise visualization, based on a precise query result.

18. The computer readable storage medium of claim 17, storing additional instructions thereon, which, when executed by a processing device of the computer system, cause the computer system to perform additional operations comprising:

communicating information, representing an end-user selectable graphical user interface element, to the client application for presentation within the user interface, wherein, upon detecting selection of the end-user selectable graphical user interface element by an end-user at the client application, a request to generate the precise visualization for the query is generated and communicated from the client application to the data visualization system; and

communicating information, representing a text entry box, to the client application for presentation within the user interface, wherein, upon detecting selection of the end-user selectable graphical user interface element by an end-user at the client application, text entered into the text entry box is communicated from the client application to the data visualization system and stored in association with the approximate visualization.