Unified data source management

• US 8,799,207 B1
• Filed: 10/08/2011
• Issued: 08/05/2014
• Est. Priority Date: 10/08/2011
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: Bay Dynamics, Inc. (Broadcom, Inc.)
• Inventors: Stolte, Ryan G., Rifai, Firas S.
• Primary Examiner(s): Ruiz, Angelica
• Application Number:
  US13/269,570
• Time in Patent Office: 1,032 Days
• Field of Search: None
• US Class Current: 707/602
• CPC Class Codes: G06F 16/212 with details for data modelling support
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Abstract

Some embodiments provide a program that identifies a set of data storages that includes data for a set of data consuming entities. For each data storage, the program identifies a set of data source objects that represents data in the data storage. The program provisions a unified data source that includes the identified sets of data source objects. The program provides the identified sets of data source objects through the unified data source to the data consuming entities in order for the data consuming entities to access the data in the set of data storages.

Claims

1. A non-transitory computer readable medium storing a program executable by at least one processing unit, the program comprising sets of instructions for:

identifying a set of data sources comprising data specified for a set of multidimensional data storage (MDDS) cubes;

for each data source, identifying a set of data source objects that represents data in the data source;

provisioning a unified data source comprising the identified sets of data source objects, the unified data source serving as a single data source through which the sets of data source objects provide the data in the set of data sources to the set of MDDS cubes for populating the MDDS cubes when the MDDS cubes are instantiated;

receiving a request to add a particular data source to the set of data sources;

identifying a particular set of data source objects that represents data in the particular data source;

establishing a source linker that links the particular data source to the particular set of data source objects in the unified data source; and

provisioning the unified data source to include the particular set of data source objects.

2. The non-transitory computer readable medium of claim 1, wherein the program further comprises a set of instructions for establishing, for each data source in the set of data sources, a particular source linker that links the data source to the corresponding set of data source objects in the unified data source.

3. The non-transitory computer readable medium of claim 1, wherein the program further comprises a set of instructions for receiving a request for data in the unified data source for a particular MDDS cube in the set of MDDS cubes.

4. The non-transitory computer readable medium of claim 3, wherein the particular set of data source objects is a first set of data source objects, wherein the program further comprises sets of instructions for:

identifying a second set of data source objects in the unified data source based on the request;

obtaining the requested data from a subset of the set of data sources based on the second set of data source objects; and

providing the requested data for the particular MDDS cube through the unified data source.

5. The non-transitory computer readable medium of claim 4, wherein the second set of data source objects comprises a set of database views that each stores a query for querying data from the subset of data sources, each database view for accessing as a virtual table comprising results of the stored query, wherein the set of instructions for obtaining the requested data from the subset of the set of data sources comprises a set of instructions for performing the query of each database view in the set of database views in order to access the results of the stored query.

6. The non-transitory computer readable medium of claim 1, wherein the unified data source is a relational database.

7. The non-transitory computer readable medium of claim 1, wherein the set of MDDS cubes comprises an online analytical processing cube.

8. The non-transitory computer readable medium of claim 1, wherein the set of instructions for identifying the set of data sources comprises a set of instructions for establishing a connection to each of the data sources to verify that the data source is valid.

9. The non-transitory computer readable medium of claim 1, wherein the set of data sources comprises a text file.

10. The non-transitory computer readable medium of claim 1, wherein the set of data sources comprises a spreadsheet file.

11. The non-transitory computer readable medium of claim 1, wherein the program further comprises a set of instructions for receiving a request to remove the particular data source from the set of data sources.

12. The non-transitory computer readable medium of claim 11, wherein the program further comprises a set of instructions for:

identifying the particular set of data source objects that represents data in the particular data source; and

provisioning the unified data source without the particular set of data source objects.

13. The non-transitory computer readable medium of claim 12, wherein the program further comprises a set of instructions for removing the source linker that links the particular data source to the particular set of data source objects in the unified data source.

14. A non-transitory computer readable medium storing a program executable by at least one processing unit, the program comprising sets of instructions for:

identifying a set of data sources comprising data specified for a set of multidimensional data storage (MDDS) cubes;

for each data source, identifying a set of data source objects that represents data in the data source;

provisioning a unified data source comprising the identified sets of data source objects, the unified data source serving as a single data source through which the sets of data source objects provide the data in the set of data sources to the set of MDDS cubes for populating the MDDS cubes when the MDDS cubes are instantiated;

receiving a request for data in the unified data source for a particular MDDS cube in the set of MDDS cubes;

identifying a particular set of data source objects in the unified data source based on the request;

obtaining the requested data from a subset of the set of data sources based on the particular set of data source objects; and

providing the requested data to the particular MDDS cube through the unified data source,

wherein the particular set of data source objects comprises a set of database functions for retrieving data from the subset of data sources, each database view for accessing as a virtual table comprising results of the stored query, wherein the set of instructions for obtaining the requested data from the subset of the set of data sources comprises a set of instructions for performing each database function in the set of database functions in order to retrieve data from the subset of data sources.

15. The non-transitory computer readable medium of claim 14, wherein the program further comprises a set of instructions for receiving a request to add a particular data source to the set of data sources.

16. The non-transitory computer readable medium of claim 14, wherein the particular set of data source objects is a first set of data source objects, wherein the program further comprises a set of instructions for:

identifying a second set of data source objects that represents data in the particular data source;

establishing a particular source linker that links the particular data source to the second set of data source objects in the unified data source; and

provisioning the unified data source to include the second set of data source objects.

17. A method comprising:

identifying a set of data sources comprising data for a set of multidimensional data storage (MDDS) cubes according to a set of MDDS cube definitions, each MDDS cube definition specifying data for the MDDS cube and data attributes for categorizing the data along a set of dimensions;

for each data source, identifying a set of data source objects that represents data in the data source;

provisioning a unified data source comprising the identified sets of data source objects, the unified data source serving as a single data source through which the sets of data source objects provide the data and data attributes for the set of MDDS cubes when the MDDS cubes are generated;

receiving a request for data in the unified data source for a particular MDDS cube in the set of MDDS cubes;

identifying a particular set of data source objects in the unified data source based on the request;

obtaining the requested data from a subset of the set of data sources based on the particular set of data source objects; and

providing the requested data for the particular MDDS cube through the unified data source,

wherein the particular set of data source objects comprises a set of database views that each stores a query for querying data from the subset of data sources, each database view for accessing as a virtual table comprising results of the stored query, wherein the set of instructions for obtaining the requested data from the subset of the set of data sources comprises a set of instructions for performing the query of each database view in the set of database views in order to access the results of the stored query.

18. The method of claim 17, wherein each MDDS cube in the set of MDDS cubes is associated with a set of data source view objects, wherein each MDDS cube in the set of MDDS cubes accesses data in the set of data sources through the MDDS cube'"'"'s associated set of data source view objects.

19. The method of claim 17 further comprising establishing, for each data source in the set of data sources, a particular source liner that links the data source to the corresponding set of data source objects in the unified data source.

20. The method of claim 17, wherein identifying the set of data source objects comprises establishing a connection to each data source and verifying that the data source is valid.