Offloading projection of fixed and variable length database columns

• US 9,535,947 B2
• Filed: 09/29/2015
• Issued: 01/03/2017
• Est. Priority Date: 07/19/2013
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Asaad, Sameh W., Dube, Parijat, Min, Hong, Sukhwani, Bharat, Thoennes, Mathew S.
• Primary Examiner(s): Ly, Anh
• Application Number:
  US14/868,678
• Publication Number:
  US 20160019262A1
• Time in Patent Office: 462 Days
• Field of Search: 707/714, 707/713, 707/716, 707/760, 707/755, 707/754, 707/758, 707/705, 707/736, 707/756, 707/737, 707/722, 707/752, 707/753, 707/712, 707/718, 707/719, 707/769, 707/717, 707/780, 707/802, 707/803, 707/693, 707/793, 707/E17.002, 707/E17.014, 707/E17.005, 707/E17.017, 707/E17.009, 707/E17.044, 707/E17.089, 707/E17.051, 707/E17.082, 707/E17.104
• US Class Current: 1/1
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/221 Column-oriented storage; Management thereof
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/2453 Query optimisation
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 40/205 Parsing

Abstract

In some embodiments, a query recipient is configured to determine that a database query warrants a first projection operation to project a plurality of input rows to a plurality of projected rows. Each of the input rows has one or more variable-length columns. A projection controller is configured to construct a first projection control block to describe the first projection operation. For this construction, the projection controller is configured to construct a plurality of projection control elements, each one corresponding to a corresponding column in the input rows, and a header to specify the order of the projection control elements. The projection controller is further configured to offload the first projection operation to a hardware accelerator, and to provide the first projection control block to the hardware accelerator, where the first projection control block enables the hardware accelerator to perform the first projection operation at streaming rate.

Claims

1. A system comprising:

a query recipient configured to determine that a database query warrants a first projection operation to project a plurality of input rows to a plurality of projected rows, wherein each of the plurality of input rows has one or more variable-length columns;

a projection controller configured to;

construct a first projection control block to describe the first projection operation, wherein to construct the first projection control block, the projection controller is further configured to;

construct a plurality of projection control elements, each projection control element corresponding to a corresponding column in the plurality of input rows, wherein the projection control elements represent variable-length columns and are arranged in the first projection control block according to a column order of the plurality of projected rows; and

construct a header to specify the order of the projection control elements in the first projection control block;

offload the first projection operation to a hardware accelerator;

provide the first projection control block to the hardware accelerator to soft-configure the hardware accelerator with the first projection control block, to perform the first projection operation, wherein the first projection control block enables the hardware accelerator to perform the first projection operation at streaming rate; and

construct a second projection control block to describe a second projection operation, wherein the second projection control block soft-configures the hardware accelerator to perform the second projection operation.

2. The system of claim 1, wherein the first projection control block specifies a sort key for the plurality of projected rows.

3. The system of claim 2, the projection controller being further configured to construct the first projection control block by providing a sort key padding template that specifies a character for padding each column in the sort key.

4. The system of claim 2, the projection controller being further configured to construct the first projection control block by constructing a projection control element corresponding to a variable-length column in the plurality of input rows, wherein the projection control element specifies information about the variable offsets and the lengths of the variable-length column in the plurality of input rows.

5. A computer program product comprising a computer readable storage medium having computer readable program code embodied thereon, the computer readable program code executable by a processor to perform a method comprising:

determining that a database query warrants a first projection operation to project a plurality of input rows to a plurality of projected rows, wherein each of the plurality of input rows has one or more variable-length columns;

constructing, by a computer processor, a first projection control block to describe the first projection operation, wherein constructing the first projection control block comprises;

constructing a plurality of projection control elements, each projection control element corresponding to a distinct column in the plurality of input rows; and

constructing a header to specify the order of the projection, wherein the projection control elements represent variable-length columns and are arranged in the first projection control block according to a column order of the plurality of projected rows control elements in the first projection control block;

offloading the first projection operation to a hardware accelerator;

providing the first projection control block to the hardware accelerator to soft-configure the hardware accelerator with the first projection control block, to perform the first projection operation, wherein the first projection control block enables the hardware accelerator to perform the first projection operation at streaming rate; and

constructing a second projection control block to describe a second projection operation, wherein the second projection control block soft-configures the hardware accelerator to perform the second projection operation.

6. The computer program product of claim 5, wherein the first projection control block specifies a sort key for the plurality of projected rows.

7. The computer program product of claim 6, wherein constructing the first projection control block comprises providing a sort key padding template, specifying a character for padding each column in the sort key.

8. The computer program product of claim 5, wherein constructing the first projection control block comprises constructing a projection control element corresponding to a variable-length column in the plurality of input rows, wherein the projection control element specifies information about the variable offsets and the lengths of the variable-length column in the plurality of input rows.