DYNAMIC DATA PARTITIONING FOR HOT SPOT ACTIVE DATA AND OTHER DATA

• US 20100262687A1
• Filed: 04/10/2009
• Published: 10/14/2010
• Est. Priority Date: 04/10/2009
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Wang, Hao, Shen, Jinmei
• Application Number:
  US12/421,697
• Publication Number:
  US 20100262687A1
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning

Abstract

A computer readable medium having executable instructions stored thereon to execute a database partitioning method during a current period of time is provided. The database partition method includes picking current hot spot data keys according to available data, creating hot spot partitions, respectively associated with the hot spot data keys, into which hot spot data is loaded before a start time of the current period of time and creating non-hot spot partitions into which non-hot spot data is loaded before the start time, routing hot spot data requests to the hot spot partitions and non-hot spot data requests to the non-hot spot partitions, and monitoring computing resources to determine if a number of the hot spot partitions is to be increased or decreased and, accordingly, increasing or decreasing the number of the hot spot partitions.

Claims

1. A computer readable medium having executable instructions stored thereon to execute a database partitioning method during a current period of time, the database partition method comprising:

picking current hot spot data keys according to available data;

creating hot spot partitions, respectively associated with the hot spot data keys, into which hot spot data is loaded before a start time of the current period of time and creating non-hot spot partitions into which non-hot spot data is loaded before the start time;

routing hot spot data requests to the hot spot partitions and non-hot spot data requests to the non-hot spot partitions; and

monitoring computing resources to determine if a number of the hot spot partitions is to be increased or decreased and, accordingly, increasing or decreasing the number of the hot spot partitions.

2. The method according to claim 1, wherein the picking of the current hot spot data keys is periodic.

3. The method according to claim 1, wherein the current hot spot data keys are picked in accordance with a configurable percentage of most active keys.

4. The method according to claim 1, wherein the current hot spot data keys are picked in accordance with historical request records.

5. The method according to claim 1, wherein the current hot spot data keys are picked in accordance with anticipated events.

6. The method according to claim 1, wherein the current hot spot data keys are picked by a system administrator.

7. The method according to claim 1, wherein computing operations relating to the hot spot partitions are undertaken by preselected computing devices.

8. The method according to claim 1, further comprising partitioning the hot spot data and the non-hot spot data according to first and second different partitioning schemes.

9. The method according to claim 1, wherein the computing resources comprise processing resources and input/output (I/O) resources.

10. The method according to claim 1, further comprising:

merging data of the hot spot partitions and the non-hot spot partitions subsequent to an end time of the current period of time; and

adding traffic and/or performance data recorded during the current period of time to traffic and/or performance data recorded during previous periods of time.

11. A computer readable medium having executable instructions stored thereon to execute a database partition method for application thereof before and during a current period of time, the database partition method comprising dynamically assigning differing partitioning schemes for correspondingly differing data and data key values based on previous and current traffic and performance data.

12. A computing system, comprising:

a plurality of computing devices, including a first set of one or more computing devices and a second set of one or more computing devices;

a host computing device having executable instructions stored thereon to cause the host device to dynamically set up and/or update, based on traffic and performance data, numbers of hot spot and non-hot spot data partitions, into each of which hot spot and non-hot spot data are respectively loaded, to be handled by the first and second sets of the computing devices, respectively; and

at least one router to route hot spot data requests to the first set of computing devices and to route non-hot spot data requests to the second set of computing devices.

13. The computing system according to claim 12, wherein the host device comprises a server.

14. The computing system according to claim 12, wherein the host computing device comprises:

a networking unit by which the host computing device and each one of the first and second sets of computing devices communicate with one another;

a first memory unit on which at the executable instructions are stored;

a second memory unit on which the traffic and performance data are stored;

a processing unit configured to dynamically set up the hot spot and non-hot spot data partitions; and

a system by which the networking unit, the first and second memory units and the processing unit are coupled to one another.

15. The computing system according to claim 14, wherein the host computing device further comprises a timer to determine when a current period of time begins, before which the loading of the hot spot and non-hot spot data occurs, and ends, after which the traffic and performance data are updated.

16. The computing system according to claim 14, wherein the host computing device further comprises input/output (I/O) resources by which hot spot and non-hot spot data requests are received by the host computing device.

17. The computing system according to claim 16, wherein the host computing device further comprises a monitoring unit to monitor at least processing resources and input/output (I/O) resources.

18. The computing system according to claim 12, wherein the at least one router comprises an on-demand router.

19. The computing system according to claim 12, wherein the host device dynamically sets up the hot spot and non-hot spot data partitions in accordance with first and second different partitioning schemes.

20. The computing system according to claim 12, wherein the host device dynamically updates the numbers of the hot spot and non-hot spot data partitions based on current measurements of at least processing resources and input/output (I/O) resources.