Cloud analytics marketplace

• US 9,824,133 B1
• Filed: 09/23/2014
• Issued: 11/21/2017
• Est. Priority Date: 06/20/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Kalki, Santosh, Raghavan, Srinivasan Sundar, Rath, Timothy Andrew, Karnik, Mukul Vijay, Devgan, Amol, Sivasubramanian, Swaminathan
• Primary Examiner(s): Herndon, Heather
• Assistant Examiner(s): Vo, Cecile
• Application Number:
  US14/494,473
• Time in Patent Office: 1,155 Days
• Field of Search: 707E17014, 707602, 707E17044, 707705, 707756, 707803, 7079991, 707999102, 707E17001, 707636, 707687, 707E17056, 707793, 707802
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Abstract

A multi-tenant system for providing hosted analytic services may be dynamically configured in response to a request from a user. A request for analytic services may comprise an indication of at least one data source to be incorporated into an n-dimensional cube. A data source connector and transformation pipeline may transform data received from the data source to a format compatible with a dimension and hierarchy model of the n-dimensional cube.

Claims

1. A system comprising:

one or more computing nodes;

one or more memories having stored thereon computer-readable instructions that, upon execution, cause the system at least to;

receive a request to create a hosted service to provide analytical operations on a data source indicated by the request;

associate one or more computing nodes with the service by reserving resources of the one or more computing nodes for providing the analytical operations;

receive a dimension and hierarchy model representative of data to be obtained from the data source, the dimension and hierarchy model comprising information indicative of a plurality of dimensions for identifying data points of an n-dimensional cube and information indicative of aggregated data to be stored in the data points of the n-dimensional cube, the dimension and hierarchy model selected based at least in part on the request;

form the n-dimensional cube based at least in part on the dimension and hierarchy model;

configure the one or more computing nodes to receive data from the data source;

configure the one or more computing nodes to apply a transformation to data received from the data source to a format suitable for incorporation into aggregated data to be stored in data points of the n-dimensional cube;

receive a first data from the data source, apply the transformation to the first data, and incorporate the transformed first data into the n-dimensional cube; and

perform an analytical operation based at least in part on the transformed first data incorporated into the n-dimensional cube.

2. The system of claim 1, wherein the data source indicated by the request corresponds to a selection of a data source made subsequent to displaying, in a marketplace application, information indicative of a plurality of data sources including the data source.

3. The system of claim 1, further comprising one or more memories having stored thereon computer-readable instructions that, upon execution by the one or more computing nodes, cause the system at least to:

configure the one or more computing nodes to receive data from the data source by at least establishing a connection between at least one of the one or more computing nodes and a database maintained by an operator of the one or more computing nodes.

4. The system of claim 1, further comprising one or more memories having stored thereon computer-readable instructions that, upon execution by the one or more computing nodes, cause the system at least to:

provide information for display to a customer of an analytics marketplace, the provided information indicative of information for evaluating at least one of a third-party data source, a third-party data connector, and a third-party dimension and hierarchy model.

5. A computer-implemented method comprising:

receiving a request to create a hosted service to provide analytical operations on data obtained from a data source indicated by the request, wherein the request is based at least in part on a feature of the analytical operations identified in a marketplace for analytical operations;

associating one or more computing nodes with the service by reserving resources of the one or more computing nodes for providing the analytical operations;

forming, on the one or more computing nodes associated with the hosted service, an n-dimensional cube based at least in part on a dimension and hierarchy model comprising information indicative of a plurality of dimensions for identifying data points of the n-dimensional cube and information indicative of aggregated data to be stored at the data points, the dimension and hierarchy model identified based at least in part on the request;

configuring the one or more computing nodes to receive data from the data source; and

configuring the one or more computing nodes to transform data received from the data source to a format suitable for incorporation into the n-dimensional cube.

6. The method of claim 5, further comprising:

selecting the dimension and hierarchy model from a plurality of dimension and hierarchy models maintained in a marketplace, the selecting based at least in part on comparing dimensional values associated with the data source with the selected dimension and hierarchy model.

7. The method of claim 5, further comprising:

associating the n-dimensional cube with a unique identifier;

associating the unique identifier with access rights to data points in the n-dimensional cube; and

distributing the unique identifier with an application sold in a marketplace, wherein the application is configured to transmit requests for data analysis operations, the requests comprising the unique identifier.

8. The method of claim 5, further comprising:

transmitting information indicative of the data source for display in a marketplace application;

transmitting information indicative of a connector compatible with the data source; and

receiving information indicative of a selection of the data source and the connector compatible with the data source.

9. The method of claim 5, further comprising:

providing information for display to a user of an analytics marketplace, the provided information suitable for evaluating at least one of the data source, the dimension and hierarchy model, and a connector for transforming data received from the data source to the format suitable for incorporation into the n-dimensional cube.

10. The method of claim 5, wherein the dimension and hierarchy model was published to a marketplace by a third party.

11. The method of claim 5, further comprising:

receiving information indicative of a visualization selected in an analytics marketplace, the visualization associated with a dimension and a hierarchy; and

selecting the dimension and hierarchy model based at least in part on the dimension and the hierarchy associated with the visualization.

12. The method of claim 5, wherein creating the service comprising creating a token indicative of access to the n-dimensional cube and restricting requests to access data in the n-dimensional cube based at least in part on the token.

13. The method of claim 5, wherein incorporating data into the n-dimensional cube comprises calculating aggregates involving the transformed data.

14. A non-transitory computer-readable storage medium having stored thereon instructions that, upon execution by a computing device, cause the computing device at least to:

receive a request to configure a hosted service to provide analytical operations on data obtained from a data source indicated by the request, wherein the request is based at least in part on a feature of the analytical operations identified in a marketplace for analytical operations;

associating one or more computing nodes with the service by reserving resources of the one or more computing nodes for providing the analytical operations;

form, on the one or more computing nodes associated with the hosted service, an n-dimensional cube based at least in part on a dimension and hierarchy model comprising information indicative of a plurality of dimensions for identifying data points of the n-dimensional cube and information indicative of aggregated data to be stored at the data points, the dimension and hierarchy model identified based at least in part on the request;

configure the one or more computing nodes to receive data from the data source; and

configure the one or more computing nodes to transform data received from the data source to a format suitable for incorporation into aggregated data values to be stored in data points of the n-dimensional cube.

15. The non-transitory computer-readable storage medium of claim 14, comprising further instructions that, upon execution by the one or more computing devices, cause the one or more computing devices to at least:

receive information indicative of a visualization selected in an analytics marketplace, the visualization associated with a dimension and a hierarchy; and

select the dimension and hierarchy model based at least in part on the dimension and the hierarchy associated with the visualization.

16. The non-transitory computer-readable storage medium of claim 14, comprising further instructions that, upon execution by the one or more computing devices, cause the one or more computing devices to at least:

associate the n-dimensional cube with a unique identifier;

associate the unique identifier with access rights to data points in the n-dimensional cube; and

distribute the unique identifier with an application sold in a marketplace, wherein the application is configured to transmit requests for data analysis operations, the requests comprising the unique identifier.

17. The non-transitory computer-readable storage medium of claim 14, comprising further instructions that, upon execution by the one or more computing devices, cause the one or more computing devices to at least:

transmit information indicative of the data source for display in a marketplace application;

transmit information indicative of a connector compatible with the data source; and

receive information indicative of a selection of the data source and the connector compatible with the data source.

18. The non-transitory computer-readable storage medium of claim 14, comprising further instructions that, upon execution by the one or more computing devices, cause the one or more computing devices to at least:

provide information for display to a user of an analytics marketplace, the provided information indicative of a criteria for evaluating at least one of the data source, the dimension and hierarchy model, and a connector for transforming data received from the data source to the format suitable for incorporation into the n-dimensional cube.

19. The non-transitory computer-readable storage medium of claim 14, wherein the aggregated data values are based on hierarchies of the dimension and hierarchy model.

20. The non-transitory computer-readable storage medium of claim 14, wherein creating the service comprising creating a token indicative of access to the n-dimensional cube and restricting requests to access data in the n-dimensional cube based at least in part on the token.