Automatic enumeration of data analysis options and rapid analysis of statistical models

• US 10,353,890 B2
• Filed: 06/19/2015
• Issued: 07/16/2019
• Est. Priority Date: 10/20/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Khurana, Udayan, Parthasarathy, Srinivasan, Pavuluri, Venkata N., Turaga, Deepak S., Vu, Long H.
• Primary Examiner(s): Richardson, James E
• Application Number:
  US14/744,204
• Publication Number:
  US 20160110410A1
• Time in Patent Office: 1,488 Days
• CPC Class Codes: G06F 16/242 Query formulation
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24553 of query operations
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/3323 using document space presentation or visualization, e.g. category, hierarchy or range presentation and selection

Abstract

Embodiments relate to analyzing dataset. A method of analyzing data is provided. The method obtains a description of a dataset. The method automatically generates a plurality of analysis options from the description of the dataset. The method generates a plurality of queries based on the analysis options. The method deploys the queries on the dataset to build a plurality of statistical models from the dataset.

Claims

1. A computer-implemented method of analyzing date, comprising:

obtaining a description of a dataset;

automatically generating, by a computer, a plurality of analysis options comprising all possible analysis options for the dataset from the description of the dataset, wherein each of the plurality of analysis options comprises one or more of data filtering conditions, database clauses, statistical functions and model-specific functions;

displaying, by a display, to a user, the plurality of analysis options in a tree layout, wherein the tree layout comprises a plurality of nodes including a plurality of roots and a plurality of leaves connected by a plurality of paths; and

wherein each node in the tree layout represents a different one of each of the one or more data filtering conditions, database clauses, statistical functions and model-specific functions and each path from a root to a leaf represents an analysis option from the plurality of analysis options;

upon confirmation of the displayed analysis options by the user, generating a plurality of queries based on the analysis options displayed in the tree layout, wherein one query is generated for each of the plurality of analysis options and includes each of the one or more data filtering conditions, database clauses, statistical functions and model-specific functions for the respective analysis option; and

generating one or more models by deploying the queries on the dataset.

2. The method of claim 1, wherein the dataset is in a database format, and the description of a dataset includes a database schema.

3. The method of claim 1, further comprising allowing a user to remove one or more analysis options before the confirming and the generating the queries from the analysis options.

4. The method of claim 1, wherein the queries comprise database queries.

5. The method of claim 1, further comprising reusing the queries to analyze another dataset.