Column oriented in-memory page caching

• US 9,262,330 B2
• Filed: 11/04/2009
• Issued: 02/16/2016
• Est. Priority Date: 11/04/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Muthukumarasamy, Devarajan Kaladipet
• Primary Examiner(s): Li, Aimee
• Assistant Examiner(s): SIMONETTI, NICHOLAS J
• Application Number:
  US12/612,325
• Publication Number:
  US 20110107021A1
• Time in Patent Office: 2,295 Days
• Field of Search: 711/118, 711/170, 707/713, 707/715, 707/736, 707/737, 707/752, 707/756, 707/801
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0207 with multidimensional access, e.g. row/column, matrix
• CPC Class Codes: G06F 12/0882 Page mode
• CPC Class Codes: G06F 16/221 Column-oriented storage; Management thereof

Abstract

A one-dimensional array is allocated in an in-memory cache for each column in a set of tabular data. The data type of each one-dimensional array is set to be the same as the data type of the corresponding column in the tabular data. Once the one-dimensional arrays have been allocated in memory, a portion of the data from each column in the tabular data is stored in a corresponding one-dimensional array. The tabular data stored in the one-dimensional arrays in the cache may then be utilized to generate an on-screen display of a portion of the tabular data.

Claims

1. A computer-implemented method for column oriented in-memory page caching, the computer-implemented method comprising performing computer-implemented operations for:

receiving tabular data comprising a plurality of columns and a plurality of rows;

receiving a request to display a portion of the tabular data;

in response to receiving the request, allocating a one-dimensional array in a memory for each column of the tabular data requested to be displayed;

setting a data type of each of the one-dimensional arrays to be the same as a data type for a corresponding column of tabular data;

organizing each of the one-dimensional arrays into pages;

configuring the one-dimensional arrays to store all or a portion of the tabular data from a plurality of the rows of each column of the tabular data;

storing the data from the plurality of the rows of each column of the tabular data in the allocated one-dimensional arrays; and

utilizing the data stored in the one-dimensional arrays to display the portion of the tabular data.

2. The computer-implemented method of claim 1, further comprising prior to allocating the one-dimensional arrays:

determining whether sufficient memory is available to allocate the one-dimensional arrays; and

in response to determining that sufficient memory is not available to allocate the one-dimensional arrays, flushing one or more of the pages.

3. The computer-implemented method of claim 2, further comprising in response to determining that sufficient memory is available to allocate the one-dimensional arrays, allocating a one-dimensional array in the memory for each column of the tabular data.

4. The computer-implemented method of claim 3, wherein the tabular data is received from an in-process data analysis server.

5. The computer-implemented method of claim 4, wherein the in-process data analysis server executes in process with a spreadsheet application program.

6. The computer-implemented method of claim 5, wherein the memory comprises a random access memory (RAM).

7. The computer-implemented method of claim 1, further comprising allocating an additional one-dimensional array in the memory for a remaining portion of the rows of each column of the tabular data.

8. An optical disk, magnetic storage device, or solid state storage device having computer-readable instructions stored thereupon which, when executed by a computer, cause the computer to:

receive tabular data comprising a plurality of columns and a plurality of rows;

receive a request to display a portion of the tabular data;

in response to receiving the request, allocate a one-dimensional array in a random access memory (RAM) of the computer for a portion of the rows of each column of the tabular data requested to be displayed;

set a data type of each of the one-dimensional arrays to be the same as a data type for the corresponding column of tabular data;

organize the one-dimensional arrays into pages;

configure the one-dimensional arrays to store all or a portion of data from a plurality of the rows of each column of the tabular data;

store the data from the plurality of the rows of each column of the tabular data in the allocated one-dimensional arrays; and

utilize the data stored in the one-dimensional arrays to display the portion of the tabular data requested to be displayed.

9. The optical disk, magnetic storage device, or solid state storage device of claim 8, having further computer-readable instructions stored thereupon which, when executed by the computer, cause the computer to determine whether sufficient memory is available to allocate the one-dimensional arrays and to flush one or more of the pages in response to determining that sufficient memory is not available prior.

10. The optical disk, magnetic storage device, or solid state storage device of claim 9, having further computer-readable instructions stored thereupon which, when executed by the computer, cause the computer to allocate the one-dimensional arrays in the memory for each column of the tabular data in response to determining that sufficient memory is available to allocate the one-dimensional arrays.

11. The optical disk, magnetic storage device, or solid state storage device of claim 10, wherein the tabular data is received from an in-process data analysis server.

12. The optical disk, magnetic storage device, or solid state storage device of claim 11, wherein the in-process data analysis server executes in process with a spreadsheet application program.

13. A computer, comprising:

a processor; and

a computer-readable storage medium in communication with the processor, the computer-readable storage medium having computer-readable instructions stored thereupon which, when executed by the processor, cause the processor to

receive tabular data comprising a plurality of columns and a plurality of rows from an in-process data analysis server,

receive a request to display a portion of the tabular data,

in response to receiving the request, allocate a one-dimensional array in a random access memory of the computer for a portion of the rows of each column of the tabular data,

set a data type of each of the one-dimensional arrays to be the same as a data type for the corresponding column of tabular data,

organize the one-dimensional arrays into pages,

configure the one-dimensional array to store all or a portion of data from a plurality of the rows of each column of the tabular data,

store the data from the plurality of the rows of each column of the tabular data in the allocated one-dimensional arrays, and

utilize the data stored in the one-dimensional arrays to display a portion of the tabular data.

14. The computer of claim 13, wherein the in-process data analysis server executes in process with a spreadsheet application program.

15. The computer of claim 13, having further computer-readable instructions stored thereupon which, when executed by the processor, cause the processor to determine whether sufficient memory is available to allocate the one-dimensional arrays and to flush one or more of the pages in response to determining that sufficient memory is not available prior.

16. The computer of claim 15, having further computer-readable instructions stored thereupon which, when executed by the processor, cause the processor to allocate the one-dimensional arrays in the memory for each column of the tabular data in response to determining that sufficient memory is available to allocate the one-dimensional arrays.