DATA SOURCE ANALYTICS

• US 20130311454A1
• Filed: 03/17/2011
• Published: 11/21/2013
• Est. Priority Date: 03/17/2011
• Status: Abandoned Application

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Inventors: Ezzat, Ahmed K.
• Application Number:
  US13/981,724
• Publication Number:
  US 20130311454A1
• Time in Patent Office: Days
• US Class Current: 707/722
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: G06F 16/256 in federated or virtual databases
• CPC Class Codes: G06F 16/338 Presentation of query results

Abstract

Systems and methods for providing data source analytics are provided. Results of a query of an unstructured data source and a query of a structured data source are merged. The merged results are stored at an in-memory database that is local to an analytics component. The analytics component is executed to access the merged results from the in-memory database and provide an output corresponding to contents of the structured data source and the unstructured data source.

Claims

1. A method for providing data source analytics comprising:

merging results of a query of an unstructured data source and a query of a structured data source;

storing the merged results at an in-memory database, the in-memory database being local to an analytics component; and

executing the analytics component to access the merged results from the in- memory database and provide an output corresponding to contents of the structured data source and the unstructured data source.

2. The method of claim 1, wherein merging the results of comprises merging the results at a federation component that comprises a Table-valued User Defined Function (TVUDF), and generating the query of the unstructured data source comprises calling the TVUDF as part of the query of the structured data source.

3. The method of claim 2, further comprising passing a predicate associated with the query of the structured data source to the TVUDF, such that the query of the unstructured data source includes the predicate, as to limit a set of results returned by the query of the unstructured data source.

4. The method of claim 2, further comprising mapping the results of the query of the unstructured data source to a virtual SQL table.

5. The method of claim 4, wherein merging the results of the query of the unstructured data source and the query of the structured data source comprises joining the virtual SQL table with the results of the query of the structured data source to produce a SQL table representing both the structured and the unstructured data source, such that the merging of the results occurs transparently to the analytics component.

6. The method of claim 1, wherein merging comprises merging the results at a federation component that comprises a Uniform Information Access Layer (UIAL) local to the in-memory database and the analytics component.

7. A non-transitory computer readable medium storing executable instructions comprising:

a virtual cache comprising a uniform information access layer (UIAL) to query, in response to an analytics request, a structured data source and an unstructured data source, and an in-memory database to store data returned from the UIAL; and

an analytics component to provide the analytics request to the UIAL and generate an analytics output representing the contents of the structured data source and the unstructured data source from the data stored in the in-memory database.

8. The non-transitory computer readable medium of claim 7, the UIAL comprising inverted indices representing each of the structured data source and the unstructured data source, and the UIAL to execute the analytics request on the inverted indices managed by the UIAL.

9. The non-transitory computer readable medium of claim 7, the in-memory database to store historical data from the structured data source, incremental updates of dynamic data from the structured data source, and real-time data provided from the unstructured data source by the uniform information access layer.

10. An analytics system, comprising:

a non-transitory computer readable medium to store machine readable instructions and a processor to execute the machine readable instructions to provide a data warehouse comprising;

a data table to store data relevant to the analytics process;

a database engine to provide a SQL table representing data responsive to a SQL query; and

a table-valued user defined function (TVUDF) to query an unstructured data source in response to the SQL query and to map the results of the query of the unstructured data source to a virtual SQL table, the TVUDF to generate the virtual SQL table.

11. The system of claim 10, the TVUDF instructing the database engine to join the virtual SQL table and the SQL table and return a resulting new SQL table to an analytics component.

12. The system of claim 10, further comprising a UIAL to invoke the SQL query against the data warehouse with a call to the TVUDF embedded in the SQL query, the SQL query including TVUDF parameters corresponding to an expected schema for the virtual table.

13. The system of claim 12, the data warehouse further comprising an SQL compiler to pass, when calling the TVUDF, any relevant predicate in the SQL query to be incorporated as part of a web services call from the TVUDF to an unstructured federation engine.

14. The system of claim 12, the TVUDF parameters comprising an attribute name associated with the virtual table.

15. The system of claim 14, the TVUDF parameters comprising a data type associated with the attribute names for the virtual table.