Data access performance using decompression maps

• US 20170255679A1
• Filed: 05/24/2017
• Published: 09/07/2017
• Est. Priority Date: 09/19/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lyle, Robert W.
• Granted Patent: US 10,437,827 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/1744 using compression, e.g. sparse files
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24561 Intermediate data storage techniques for performance improvement

Abstract

Methods and apparatus, including computer program products, implementing and using techniques for decompressing data in a database system. A query is received, which pertains to a subset of data within a compressed set of data. One or more decompression strategies are evaluated using a cost model. The cost model includes an estimated filter factor. A low cost decompression strategy is selected based on the results of the evaluation of the one or more decompression strategies. One or more bytes representing the requested subset of data are located within the compressed set of data. Only a portion of the compressed data that corresponds to the subset of data is decompressed, using the selected decompression strategy, while leaving the remaining set of data in a compressed state.

Claims

1. A computer-implemented method for decompressing data in a database system, comprising:

receiving a query pertaining to a subset of data within a compressed set of data;

evaluating one or more decompression strategies using a cost model, the cost model including an estimated filter factor;

selecting a low cost decompression strategy based on the results of the evaluation of the one or more decompression strategies;

locating one or more bytes representing the requested subset of data within the compressed set of data; and

decompressing only a portion of the compressed data that corresponds to the subset of data, using the selected decompression strategy, while leaving the remaining set of data in a compressed state.

2. The method of claim 1, wherein the subset of data includes one of:

a subset of columns in a row of a database table, a subset of columns or bytes within a row of the database table, and a subset of rows within a page of the database table.

3. The method of claim 1, wherein the decompression strategy includes two or more decompression phases.

4. The method of claim 1, wherein evaluating one or more decompression strategies includes calculating a cost for decompressing only a subset of columns within a row and comparing the calculated cost with decompressing all columns within the row.

5. The method of claim 1, wherein locating one or more bytes representing the requested subset of data within the compressed set of data includes:

determining a unit representing a certain number of bytes of compressed data; and

determining what units need to be decompressed to get to the one or more bytes representing the requested subset of data within the compressed set of data.

6. The method of claim 5, further comprising:

storing a map for each row, the map describing offsets to the start of every unit.

7. The method of claim 6, wherein the map is stored as an array in a memory buffer of the database system.

8. The method of claim 5, wherein every variable length column is preceded by a number describing the length of the variable length column.

9. The method of claim 1, wherein decompressing starts at the beginning of a row.

10. The method of claim 1, wherein decompressing starts at the end of a row.