User Interface for Unified Data Science Platform Including Management of Models, Experiments, Data Sets, Projects, Actions and Features

• US 20160232457A1
• Filed: 02/11/2016
• Published: 08/11/2016
• Est. Priority Date: 02/11/2015
• Status: Active Application

• Current Assignee: Skytree, Inc (Infosys Limited)
• Original Assignee: Skytree, Inc (Infosys Limited)
• Inventors: Nelson, Christopher, Rodeski, Vladimir, Kite, Lawrence, Kumar, Nitesh, Song, Philip, Aditya, Abhimanyu, Gray, Alexander, Gibiansky, Maxsim, Chawla, Sachinder
• Application Number:
  US15/042,086
• Publication Number:
  US 20160232457A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/26 Visual data mining; Browsing structured data
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs

Abstract

A system and method for providing various user interfaces is disclosed. In one embodiment, the various user interfaces include a series of user interfaces that guide a user through the machine learning process. In one embodiment, the various user interfaces are associated with a unified, project-based data scientist workspace to visually prepare, build, deploy, visualize and manage models, their results and datasets.

Claims

1. A method comprising:

generating, using one or more processors, a data import interface for presentation to a user, the data import interface including a first set of one or more graphical elements that receive user interaction defining a dataset to be imported;

generating, using the one or more processors, a machine learning model creation interface for presentation to the user, the machine learning model creation interface including a second set of one or more graphical elements that receive user interaction defining a model to be generated;

generating, using the one or more processors, a model testing interface for presentation to the user, the model testing interface including a third set of one or more graphical elements defining a model to be tested and a test dataset; and

generating, using the one or more processors, a results interface for presentation to the user, the results interface including a fourth set of graphical elements informing the user of results obtained by testing the model to be tested with the test dataset.

2. The method of claim 1, wherein the first set of one or more graphical elements includes a first graphical element, a second graphical element and one or more of a third and a fourth graphical element, and the method further comprises:

receiving, via the user interacting with the first graphical element of the data import interface a user-defined source of the dataset to be imported;

receiving, via the user interacting with the second graphical element of the data import interface, a user-defined file including the dataset to be imported;

dynamically updating the data import interface for the user to preview at least a sample of the dataset to be imported;

receiving, via user interaction with one or more of the third graphical element and the fourth graphical element of the data import interface, a selection of one or more of a text blob and identifier columns from the user, wherein the third graphical element, when interacted with by the user, selects a text blob column and the fourth graphical element, when interacted with by the user, selects an identifier column; and

importing the dataset based on the user'"'"'s interaction with the first graphical element, the second graphical element and one or more of the third graphical element and the fourth graphical element.

3. The method of claim 1, the second set of one or more graphical elements includes a first graphical element, a second graphical element, a third graphical element, a fourth graphical element and a fifth graphical element, and the method further comprises:

presenting to the user, via the first graphical element, a dataset used in generating the model to be generated;

dynamically modifying the second graphical element based on one or more columns of the dataset to be used in generating the model;

receiving, via user interaction with the second graphical element, a user-selected objective column to be used to generate the model, the objective column associated with the dataset to be used in generating the model;

dynamically modifying a third graphical element to identify a type of machine learning task based on the received, user-selected objective column;

dynamically modifying a fourth graphical element to include a set of one or more machine learning methods associated with the identified machine learning task;

the set of machine learning methods omitting machine learning methods not associated with the machine learning task;

dynamically modifying a fifth graphical element such that the fifth graphical element is associated with a user-definable parameter set that is associated with a current selection from the set of a machine learning methods of the fourth graphical element; and

generating, responsive to user input, the currently selected model using the user-definable parameter set for the user-selected objective column of the dataset to be used for model generation.

4. The method of claim 3, wherein the machine learning task is one of classification and regression.

5. The method of claim 3, wherein the machine learning task is classification when the objective column is categorical and the machine learning task is regression when the objective column is continuous.

6. The method of claim 3, wherein the machine learning task is one of classification and regression and the set of machine learning methods includes a plurality of machine learning methods associated with classification when the learning task is classification and the set of machine learning methods includes a plurality of machine learning methods associated with regression when the machine learning task is regression.

7. The method of claim 1, wherein the fourth set of one or more graphical elements includes one or more of a confusion matrix, a cost/benefit weighting, a score, and an interactive visualization of the results, wherein:

the confusion matrix includes information about predicted positives and negatives and actual positives and negatives obtained when testing the model to be tested using the test dataset;

the cost/benefit weighting, responsive to user interaction, changes the reward or penalty associated with one of more of a true positive, a true negative, a false positive and a false negative, the confusion matrix dynamically updated based on the cost/benefit weighting

the score includes one or more scoring metrics describing performance of the model to be tested subsequent to testing; and

the interactive visualization presenting a visual representation of a portion of the results obtained by the testing.

8. The method of claim 7, wherein the fourth set of one or more graphical elements includes one or more of a graphical element associated with downloading one or more targets or labels, a graphical element associated with downloading one or more probabilities, and a graphical element that adjusts the probability threshold, wherein adjusting the probability threshold dynamically updates the score and the interactive visualization.

9. The method of claim 1, comprising:

generating a visualization for presentation to the user, including one or more of a visualization of tuning results, a visualization of a tree, a visualization of importances, and a plot visualization, wherein the plot visualization includes one or more plots associated with one or more of a dataset, a model and a result.

10. A system comprising:

one or more processors; and

a memory including instructions that, when executed by the one or more processors, cause the system to;

generate a data import interface for presentation to a user, the data import interface including a first set of one or more graphical elements that receive user interaction defining a dataset to be imported;

generate a machine learning model creation interface for presentation to the user, the machine learning model creation interface including a second set of one or more graphical elements that receive user interaction defining a model to be generated;

generate a model testing interface for presentation to the user, the model testing interface including a third set of one or more graphical elements defining a model to be tested and a test dataset; and

generate a results interface for presentation to the user, the results interface including a fourth set of graphical elements informing the user of results obtained by testing the model to be tested with the test dataset.

11. The system of claim 10, wherein the first set of one or more graphical elements includes a first graphical element, a second graphical element and one or more of a third and a fourth graphical element, and the instructions, when executed by the one or more processors, cause the system to:

receive, via the user interacting with the first graphical element of the data import interface a user-defined source of the dataset to be imported;

receive, via the user interacting with the second graphical element of the data import interface, a user-defined file including the dataset to be imported;

dynamically update the data import interface for the user to preview at least a sample of the dataset to be imported;

receive, via user interaction with one or more of the third graphical element and the fourth graphical element of the data import interface, a selection of one or more of a text blob and identifier columns from the user, wherein the third graphical element, when interacted with by the user, selects a text blob column and the fourth graphical element, when interacted with by the user, selects an identifier column; and

import the dataset based on the user'"'"'s interaction with the first graphical element, the second graphical element and one or more of the third graphical element and the fourth graphical element.

12. The system of claim 10, the second set of one or more graphical elements includes a first graphical element, a second graphical element, a third graphical element, a fourth element and a fifth graphical element, and the instructions, when executed by the one or more processors, cause the system to:

present to the user, via the first graphical element, a dataset used in generating the model to be generated;

dynamically modify the second graphical element based on one or more columns of the dataset to be used in generating the model;

receive, via user interaction with the second graphical element, a user-selected objective column to be used to generate the model, the objective column associated with the dataset to be used in generating the model;

dynamically modify a third graphical element to identify a type of machine learning task based on the received, user-selected objective column;

dynamically modify a fourth graphical element to include a set of one or more machine learning methods associated with the identified machine learning task;

the set of machine learning methods omitting machine learning methods not associated with the machine learning task;

dynamically modify a fifth graphical element such that the fifth graphical element is associated with a user-definable parameter set that is associated with a current selection from the set of a machine learning methods of the fourth graphical element; and

generate, responsive to user input, the currently selected model using the user-definable parameter set for the user-selected objective column of the dataset to be used for model generation.

13. The system of claim 12, wherein the machine learning task is one of classification and regression.

14. The system of claim 12, wherein the machine learning task is classification when the objective column is categorical and the machine learning task is regression when the objective column is continuous.

15. The system of claim 12, wherein the machine learning task is one of classification and regression and the set of machine learning methods includes a plurality of machine learning methods associated with classification when the learning task is classification and the set of machine learning methods includes a plurality of machine learning methods associated with regression when the machine learning task is regression.

16. The system of claim 10, wherein the fourth set of one or more graphical elements includes one or more of a confusion matrix, a cost/benefit weighting, a score, and an interactive visualization of the results, wherein:

the confusion matrix includes information about predicted positives and negatives and actual positives and negatives obtained when testing the model to be tested using the test dataset;

the cost/benefit weighting, responsive to user interaction, changes the reward or penalty associated with one of more of a true positive, a true negative, a false positive and a false negative, the confusion matrix dynamically updated based on the cost/benefit weighting

the score includes one or more scoring metrics describing performance of the model to be tested; and

the interactive visualization presenting a visual representation of a portion of the results obtained by the testing.

17. The system of claim 16, wherein the fourth set of one or more graphical elements includes one or more of a graphical element associated with downloading one or more targets or labels, a graphical element associated with downloading one or more probabilities, and a graphical element that adjusts the probability threshold, wherein adjusting the probability threshold dynamically updates the score and the interactive visualization.

18. The system of claim 10, wherein the instructions, when executed by the one or more processors, cause the system to:

generate a visualization for presentation to the user, including one or more of a visualization of tuning results, a visualization of a tree, a visualization of importances, and a plot visualization, wherein the plot visualization includes one or more plots associated with one or more of a dataset, a model and a result.

19. A system comprising:

one or more processors; and

a memory including instructions that, when executed by the one or more processors, cause the system to;

generate a user interface associated with a machine learning project for presentation to a user,

the user interface including a first graphical element, a second graphical element, a third graphical element, and a fourth graphical element, a data import interface for presentation to a user,

wherein the first, second, third and fourth graphical elements are user selectable and a first portion of the user interface is modified based on which graphical element the user selects,

the first, second, third and fourth graphical elements presented in a second portion of the user interface and the presentation of the first, second, third and fourth graphical elements is persistent regardless of which graphical element is selected except a selected graphical element is visually differentiated as the selected graphical element,

the first graphical element associated with datasets for the machine learning project, and, when selected, the first portion of the user interface is modified to present a table of any datasets associated with the machine learning project and the first portion includes a graphical element to import a dataset,

the second graphical element associated with models for the machine learning project, and, when selected, the first portion of the user interface is modified to present a table of any models associated with the machine learning project and the first portion includes a graphical element to create a new model,

the third graphical element associated with results for the machine learning project, and, when selected, the first portion of the user interface is modified to present a table of any result sets associated with the machine learning project and the first portion includes a graphical element to create new results, and

the fourth graphical element associated with plots for the machine learning project, and, when selected, the first portion of the user interface is modified to present any plots associated with the machine learning project and the first portion includes a graphical element to create a plot.

20. A system of claim 19, wherein:

the first portion of the user interface, when modified to present the table of any datasets associated with the machine learning project, includes one or more datasets used for one or more of training and testing a first model associated with the machine learning project and information about the one or more datasets,

the first portion of the user interface, when modified to present the table of any models associated with the machine learning project and the first portion, includes the first model and information about the first model,

the first portion of the user interface, when modified to present the table of any result sets associated with the machine learning project, includes a first set of results associated with a test of the first model and a test dataset and information about the first set of results, and

the first portion of the user interface, when modified to present any plots associated with the machine learning project, includes a first set of one or more plots associated with one or more of a dataset, a model and a result.