Guided data exploration

• US 10,387,494 B2
• Filed: 04/03/2015
• Issued: 08/20/2019
• Est. Priority Date: 09/24/2014
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Sheffer, Uri, Pocock, Adam Craig, Stevens, Brook, Ishaque, Mashhood, Zelevinsky, Vladimir, Spaulding, Tristan R.
• Primary Examiner(s): Leroux, Etienne P
• Assistant Examiner(s): Samara, Husam Turki
• Application Number:
  US14/678,218
• Publication Number:
  US 20160085851A1
• Time in Patent Office: 1,600 Days
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/26 Visual data mining; Browsing structured data
• CPC Class Codes: G06F 16/3331 Query processing
• CPC Class Codes: G06F 16/901 Indexing; Data structures therefor; Storage structures for retrieval from the web G06F16/951
• CPC Class Codes: G06F 16/904 Browsing; Visualisation therefor for navigating the web G06F16/954; browsing optimisation for the web G06F16/957

Abstract

A system for exploring data receives the data from a database and indexes the data in a server. The system displays one or more selectable datasets from the indexed data, where the selected dataset includes one or more attributes. The system then sorts the one or more attributes by level of interestingness and displays the sorted attributes.

Claims

1. A method of exploring data, the method comprising:

receiving the data from a database;

indexing the data in a server to generate a plurality of database datasets and generate corresponding metadata for each of the database datasets, the metadata comprising at least one of a name and a description of each of the database datasets, each of the database datasets corresponding to a database table that comprises a plurality of database table columns, each with a corresponding attribute, and a plurality of database table rows;

displaying one or more individually selectable database datasets of the plurality of database datasets from the indexed data, the displaying the selectable database datasets including at least the name and the description of each dataset based on the metadata;

in response to a selection of a database dataset, sorting the database table columns that correspond to the selected database dataset by level of interestingness using entropy;

displaying the sorted database table columns of the selected database dataset as individually selectable database table columns comprising sorted visualization elements for each of the columns, the visualization elements displaying each corresponding attribute;

receiving a selection of one or more of the corresponding attributes; and

based on the selection of the one or more of the corresponding attributes, repeating the sorting the database table columns by level of interestingness using entropy.

2. The method of claim 1, wherein at least some of the data in the database is unstructured data.

3. The method of claim 1, wherein the using entropy comprises calculating the entropy of each of the corresponding attributes and normalizing the entropy to a 0-1 range.

4. The method of claim 1, wherein the displaying the sorted database table columns comprises displaying a tile for each sorted database table column, the tile comprising a visualization of the database table column.

5. The method of claim 1, further comprising:

receiving a selection of a refinement from the display of sorted database table columns and, in response;

applying the selected refinement to the data; and

re-sorting the database table columns of the refined data.

6. The method of claim 3, wherein the calculating the entropy comprises a Shannon entropy.

7. The method of claim 1, further comprising receiving a dynamic modification of the sorted database table columns using user interface elements to exclude or promote sorted database table columns.

8. The method of claim 1, wherein the displaying one or more selectable database datasets is automatically generated without any user input of search terms.

9. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to provided guided data exploration, the providing comprising:

receiving the data from a database;

indexing the data in a server to generate a plurality of database datasets and generate corresponding metadata for each of the database datasets, the metadata comprising at least one of a name and a description of each of the database datasets, each of the database datasets corresponding to a database table that comprises a plurality of database table columns, each with a corresponding attribute, and a plurality of database table rows;

displaying one or more individually selectable database datasets of the plurality of database datasets from the indexed data, the displaying the selectable database datasets including at least the name and the description of each dataset based on the metadata;

in response to a selection of a database dataset, sorting the database table columns that correspond to the selected database dataset by level of interestingness using entropy;

displaying the sorted database table columns of the selected database dataset as individually selectable database table columns comprising sorted visualization elements for each of the columns, the visualization elements displaying each corresponding attribute;

receiving a selection of one or more of the corresponding attributes; and

based on the selection of the one or more of the corresponding attributes, repeating the sorting the database table columns by level of interestingness using entropy.

10. The computer readable medium of claim 9, wherein at least some of the data in the database is unstructured data.

11. The computer readable medium of claim 9, wherein the using entropy comprises calculating the entropy of each of the corresponding attributes and normalizing the entropy to a 0-1 range.

12. The computer readable medium of claim 9, wherein the displaying the sorted database table columns comprises displaying a tile for each sorted database table column, the tile comprising a visualization of the database table column.

13. The computer readable medium of claim 9, the providing further comprising receiving a selection of a refinement from the display of sorted database table columns and, in response:

applying the selected refinement to the data; and

re-sorting the database table columns of the refined data.

14. The computer readable medium of claim 11, wherein the calculating the entropy comprises a Shannon entropy.

15. The computer readable medium of claim 9, the providing further comprising receiving a dynamic modification of the sorted database table columns using user interface elements to exclude or promote sorted database table columns.

16. The computer readable medium of claim 9, wherein the displaying one or more selectable database datasets is automatically generated without any user input of search terms.

17. A guided data exploration system comprising:

one or more processors executing instructions to implement modules, the modules comprising;

an indexing module that receives data from a database and indexes the data in a server to generate a plurality of database datasets and generates corresponding metadata for each of the database datasets, the metadata comprising at least one of a name and a description of each of the database datasets, each of the database datasets corresponding to a database table that comprises a plurality of database table columns, each with a corresponding attribute, and a plurality of database table rows;

a display module that displays one or more individually selectable database datasets of the plurality of database datasets from the indexed data, the displaying the selectable database datasets including at least the name and the description of each dataset based on the metadata;

a sorting module that in response to a selection of a database dataset sorts the database table columns that correspond to the selected database dataset by level of interestingness using entropy;

wherein the display module further displays the sorted database table columns of the selected database dataset as individually selectable database table columns comprising sorted visualization elements for each of the columns, the visualization elements displaying each corresponding attribute;

the sorting module further receiving a selection of one or more of the corresponding attributes and based on the selection of the one or more of the corresponding attributes, repeating the sorting the database table columns by level of interestingness using entropy.

18. The system of claim 17, wherein the using entropy comprises calculating the entropy of each of the corresponding attributes and normalizing the entropy to a 0-1 range.

19. The system of claim 17, wherein the sorting module further receives a selection of a refinement from the display of sorted database table columns and, in response:

applies the selected refinement to the data; and

re-sorts the database table columns of the refined data.

20. The system of claim 17, wherein the displaying one or more selectable database datasets is automatically generated without any user input of search terms.