Dual overlay query processing

• US 10,698,890 B2
• Filed: 09/17/2018
• Issued: 06/30/2020
• Est. Priority Date: 10/29/2014
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Nguyen, Filip, Elia{hacek over (s)}, Filip
• Primary Examiner(s): Bowen, Richard L
• Application Number:
  US16/132,724
• Publication Number:
  US 20190018878A1
• Time in Patent Office: 652 Days
• CPC Class Codes: G06F 16/24532 of parallel queries

Abstract

An example method of processing a query at a plurality of storage devices includes receiving a dual query from a client and generating a synchronous query and an asynchronous query based on the dual query. The dual query includes a set of conditions for selecting data from a set of database tables. The method further includes sending the synchronous query to a first storage device, sending the asynchronous query to a second storage device, and receiving a result set of the synchronous query. The result set of the synchronous query includes data selected from a set of database records in a set of primary database tables, which is stored in the first storage device and is a subset of the set of database tables. The method further includes marking a database record. A marked database record indicates usage of the data selected from the database record within a time period.

Claims

1. A method of processing a query at a plurality of storage devices, comprising:

receiving a dual query from a client;

executing the dual query at a first storage device and a second storage device;

receiving a result set of the dual query, wherein the result set includes a first set of database records from the first storage device and a second set of database records from the second storage device;

identifying a first set of database records that has not been used above a first threshold number of times within a first time period;

copying the first set stored in the first storage device to a second storage device;

removing the copied database records of the first set from the first storage device;

identifying a second set of database records that has been used above a second threshold number of times within a second time period, wherein the second set is stored in the second storage device;

copying the second set stored in the second storage device to the first storage device; and

removing the copied database records of the second set from the second storage device.

2. The method of claim 1,

wherein the executing a dual query includes executing a first instance of the dual query at the first storage device and executing a second instance of the dual query at the second storage device.

3. The method of claim 2, wherein a query format of the first instance is different from a query format of the second instance.

4. The method of claim 2, wherein the first instance is a synchronous query, and the second instance is an asynchronous query.

5. The method of claim 1,

wherein first data stored in the first set of database records is different from second data stored in the second set of database records, and the result set includes the first and second data.

6. The method of claim 1, wherein the identified first set of database records is stored in a primary table in the first storage device, the method further including:

creating a secondary table in the second storage device, wherein the secondary table has the same name as the primary table, and wherein the copying the first set includes copying the first set to the secondary table.

7. The method of claim 1, further including:

sending the result set to the client, wherein the first set of database records is mutually exclusive of the second set of database records.

8. The method of claim 1, further comprising:

executing the dual query at a third storage device, wherein the result set includes a third set of database records from the third storage device;

identifying one or more database records of the second set of database records, wherein the one or more database records of the second set have not been used above a third threshold number of times within a third time period;

copying one or more identified database records of the second set stored in the second storage device to the third storage device; and

removing the copied database records of the second set from the second storage device.

9. The method of claim 1, wherein removing the copied database records of the first set from the first storage device includes removing the copied database records of the first set from the first storage device after copying the first set to the second storage device.

10. A system for processing a query at a plurality of storage devices, comprising:

a query proxy that receives a dual query from a client, executes the dual query at a first storage device and a second storage device, and receives a result set of the dual query, wherein the result set includes a first set of database records from the first storage device and a second set of database records from the second storage device,

wherein the query proxy that identifies a first set of database records that has not been used above a first threshold number of times within a first time period, copies the first set stored in the first storage device to a second storage device, and removes the copied database records of the first set from the first storage device, and

wherein the query proxy identifies a second set of database records that has been used above a second threshold number of times within a second time period, copies the second set stored in the second storage device to the first storage device, and removes the copied database records of the second set from the second storage device.

11. The system of claim 10, wherein the query proxy modifies one or more pointers to reference data that are stored in the first storage device and that have been accessed above the first threshold number of times within the first time period.

12. The system of claim 11, wherein a table stores the one or more pointers to data stored in the first storage device.

13. The system of claim 10, further comprising:

a dual query notifier that sends the first set of database records to the client via a first channel and sends the second set of database records to the client via a second channel.

14. The system of claim 13, wherein the first channel is a synchronous channel, and the second channel is an asynchronous channel.

15. The system of claim 14, wherein the first set of database records and the second set of database records are mutually exclusive.

16. The system of claim 13, wherein the dual query notifier notifies the client that the result set of the dual query includes data from both the synchronous channel and the asynchronous channel.

17. The system of claim 16,

wherein the dual query notifier sends via the asynchronous channel to the client a notification that the second set of database records has a size of zero.

18. The system of claim 16, wherein the dual query notifier registers the client for notifications of one or more result sets from the second storage device.

19. A machine-readable medium comprising a plurality of machine-readable instructions that when executed by one or more processors is adapted to cause the one or more processors to perform a method comprising:

receiving a dual query from a client;

executing the dual query at a first storage device and a second storage device;

receiving a result set of the dual query, wherein the result set includes a first set of database records from the first storage device and a second set of database records from the second storage device;

identifying a first set of database records that has not been used above a first threshold number of times within a first time period, wherein the first set is stored in a first storage device;

copying the first set stored in the first storage device to a second storage device;

removing the copied database records of the first set from the first storage device;

identifying a second set of database records that has been used above a second threshold number of times within a second time period, wherein the second set is stored in the second storage device;

copying the second set stored in the second storage device to the first storage device; and

removing the copied database records of the second set from the second storage device.

20. The machine-readable medium of claim 19, wherein removing the copied database records of the first set from the first storage device includes removing the copied database records of the first set from the first storage device after copying the first set to the second storage device.