Managing sparsity in a multidimensional data structure

• US 10,275,484 B2
• Filed: 07/22/2013
• Issued: 04/30/2019
• Est. Priority Date: 07/22/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bharti, Vijay, Joseph, Jeremiah, Sivaswamy, Hemant K., Sapna, Kamalpreet, Jain, Rohit
• Primary Examiner(s): Vital, Pierre M
• Assistant Examiner(s): Sultana, Nargis
• Application Number:
  US13/947,223
• Publication Number:
  US 20150026207A1
• Time in Patent Office: 2,108 Days
• Field of Search: 707769, 707713, 707957, 707958
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
• CPC Class Codes: G06F 16/284 Relational databases

Abstract

Embodiments of the present invention relate to a method, program product, and system for managing the percentage of unpopulated cells in a multidimensional data structure during the servicing of multidimensional analytical queries. In an embodiment, a multidimensional data structure is stored in a memory location of a computing device, wherein the multidimensional data structure includes a dimension that is a subset of a plurality of dimensions included in a relational database. The computing device determines a frequency of utilization of a dimension to service a multidimensional query request. The computing device combines the dimension with the multidimensional data structure responsive to the frequency of utilization.

Claims

1. A computer program product, the computer program product comprising a non-transitory computer readable storage medium having program code embodied therewith, the program code executable by a processor to:

determine a set of dimensions within a relational database to be stored in a cache, the set of dimensions having a historical access frequency meeting a pre-defined cardinality threshold of data-containing cells;

responsive to determining the set of dimensions, restricting an initial load to a size below a threshold size by causing a multidimensional database management system to generate the initial load using only the set of dimensions having a historical access frequency meeting a pre-defined cardinality threshold of data-containing cells;

at predetermined time intervals, retrieve log files including usage information for individual dimensions in the set of dimensions stored in a cache and in uncached dimensions stored in a relational database, the usage information corresponding to a level of usage of the individual dimensions;

at the predetermined time intervals, determine at least one relatively high usage dimension in the uncached dimensions based, at least in part, upon the usage information; and

at the predetermined time intervals, causing the multidimensional database management system to refresh, in a memory device, the initial load using only a portion of the set of dimensions and the at least one relatively high usage dimension in the uncached dimensions from the usage information in the log files, the refreshing action generating an incremental load to be stored in the cache.

2. The computer program product of claim 1 wherein:

the initial load and the incremental load are in the form of online analytical processing (OLAP) structure; and

the program code is further executable by a processor to;

selectively provide access to the OLAP structure and to the relational database.

3. The computer program product of claim 2 wherein the selective provision of access to the OLAP structure and to the relational database includes:

on condition that the data sought to be accessed is included exclusively in the at least one relatively high usage dimension, access is provided by accessing the OLAP structure using a Multidimensional Expressions mode query; and

on condition that the data sought to be accessed is not included exclusively in the at least one relatively high usage dimension, access is provided by accessing the relational database using an SQL (structured query language) mode query.

7. The computer program product of claim 1, wherein the initial load is an initial online analytics processing (OLAP) cube.

9. The computer program product of claim 2, wherein the historical access frequency is based on log files including usage information that reflects how many times dimensions in the set of dimensions has been accessed since the OLAP structure was last generated.

4. A system comprising:

a processor(s) set; and

a storage device;

wherein;

the processor set(s) is operatively connected to the storage device so that the processor(s) set can execute program code stored on and/or in the storage device;

the program code is executable by the processor(s) set to;

determine a set of dimensions within a relational database to be stored in a cache, the set of dimensions having a historical access frequency meeting a pre-defined cardinality threshold of data-containing cells;

responsive to determining the set of dimensions, restricting an initial load to a size below a threshold size by causing a multidimensional database management system to generate the initial load using only the set of dimensions having a historical access frequency meeting a pre-defined cardinality threshold of data-containing cells;

at predetermined time intervals, retrieve log files including usage information for individual dimensions in the set of dimensions stored in a cache and in uncached dimensions stored in a relational database, the usage information corresponding to a level of usage of the individual dimensions;

at the predetermined time intervals, determine at least one relatively high usage dimension in the uncached dimensions based, at least in part, upon the usage information; and

at the predetermined time intervals, causing the multidimensional database management system to refresh, in a memory device, the initial load using only a portion of the set of dimensions and the at least one relatively high usage dimension in the uncached dimensions from the usage information in the log files, the refreshing action generating an incremental load to be stored in the cache.

5. The system of claim 4 wherein:

the initial load and the incremental load are in the form of online analytical processing (OLAP) structure; and

the program code is further executable by the processor(s) set to;

selectively provide access to the OLAP structure and to the relational database.

6. The system of claim 5 wherein the selective provision of access to the OLAP structure and to the relational database includes:

on condition that the data sought to be accessed is included exclusively in the at least one relatively high usage dimension, access is provided by accessing the OLAP structure using a Multidimensional Expressions mode query; and

on condition that the data sought to be accessed is not included exclusively in the at least one relatively high usage dimension, access is provided by accessing the relational database using an SQL (structured query language) mode query.

8. The computer system of claim 4, wherein the initial load in an initial online analytics processing (OLAP) cube.

10. The computer system of claim 5, wherein the historical access frequency is based on log files including usage information that reflects how many times dimensions in the set of dimensions has been accessed since the OLAP structure was last generated.