OFFLOADING PROJECTION OF FIXED AND VARIABLE LENGTH DATABASE COLUMNS

• US 20160019262A1
• Filed: 09/29/2015
• Published: 01/21/2016
• Est. Priority Date: 07/19/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Asaad, Sameh W., Dube, Parijat, Min, Hong, Sukhwani, Bharat, Thoennes, Matthew S.
• Granted Patent: US 9,535,947 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/221 Column-oriented storage; Management thereof
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/2453 Query optimisation
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 40/205 Parsing

Abstract

In some embodiments, a query recipient is configured to determine that a database query warrants a first projection operation to project a plurality of input rows to a plurality of projected rows. Each of the input rows has one or more variable-length columns. A projection controller is configured to construct a first projection control block to describe the first projection operation. For this construction, the projection controller is configured to construct a plurality of projection control elements, each one corresponding to a corresponding column in the input rows, and a header to specify the order of the projection control elements. The projection controller is further configured to offload the first projection operation to a hardware accelerator, and to provide the first projection control block to the hardware accelerator, where the first projection control block enables the hardware accelerator to perform the first projection operation at streaming rate.

Claims

1. A system comprising:

a query recipient configured to determine that a database query warrants a first projection operation to project a plurality of input rows to a plurality of projected rows, wherein each of the plurality of input rows has one or more variable-length columns;

a projection controller configured to;

construct a first projection control block to describe the first projection operation, wherein to construct the first projection control block, the projection controller is further configured to;

construct a plurality of projection control elements, each projection control element corresponding to a corresponding column in the plurality of input rows; and

construct a header to specify the order of the projection control elements in the first projection control block;

offload the first projection operation to a hardware accelerator; and

provide the first projection control block to the hardware accelerator, wherein the first projection control block enables the hardware accelerator to perform the first projection operation at streaming rate.

5. The system of claim 1, wherein the projection control elements represent variable-length columns and are arranged in the first projection control block according to a column order of the plurality of projected rows.

6. The system of claim 1, the projection controller being further configured to:

soft-configure the hardware accelerator with the first projection control block, to perform the first projection operation; and

construct a second projection control block to describe a second projection operation, wherein the second projection control block soft-configures the hardware accelerator to perform the second projection operation.

7. A computer program product comprising a computer readable storage medium having computer readable program code embodied thereon, the computer readable program code executable by a processor to perform a method comprising:

determining that a database query warrants a first projection operation to project a plurality of input rows to a plurality of projected rows, wherein each of the plurality of input rows has one or more variable-length columns;

constructing, by a computer processor, a first projection control block to describe the first projection operation, wherein constructing the first projection control block comprises;

constructing a plurality of projection control elements, each projection control element corresponding to a distinct column in the plurality of input rows; and

constructing a header to specify the order of the projection control elements in the first projection control block;

offloading the first projection operation to a hardware accelerator; and

providing the first projection control block to the hardware accelerator, wherein the first projection control block enables the hardware accelerator to perform the first projection operation at streaming rate.

2. The system of claim 8, wherein the first projection control block specifies a sort key for the plurality of projected rows.

3. The system of claim 2, the projection controller being further configured to construct the first projection control block by providing a sort key padding template that specifies a character for padding each column in the sort key.

4. The system of claim 2, the projection controller being further configured to construct the first projection control block by constructing a projection control element corresponding to a variable-length column in the plurality of input rows, wherein the projection control element specifies information about the variable offsets and the lengths of the variable-length column in the plurality of input rows.

8. The computer program product of claim 7, wherein the first projection control block specifies a sort key for the plurality of projected rows.

9. The computer program product of claim 8, wherein constructing the first projection control block comprises providing a sort key padding template, specifying a character for padding each column in the sort key.

10. The computer program product of claim 7, wherein constructing the first projection control block comprises constructing a projection control element corresponding to a variable-length column in the plurality of input rows, wherein the projection control element specifies information about the variable offsets and the lengths of the variable-length column in the plurality of input rows.

11. The computer program product of claim 7, wherein the projection control elements represent variable-length columns and are arranged in the first projection control block according to a column order of the plurality of projected rows.

12. The computer program product of claim 7, wherein providing the first projection control block to the hardware accelerator soft-configures the hardware accelerator to perform the first projection operation, the method further comprising:

constructing a second projection control block to describe a second projection operation, wherein the second projection control block soft-configures the hardware accelerator to perform the second projection operation.