Method and system for data disaggregation

• US 7,890,454 B2
• Filed: 05/08/2008
• Issued: 02/15/2011
• Est. Priority Date: 05/08/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Stahl, Elisabeth R., Salve, Vivek, Hamilton, Rick A. II, Sand, Anne R., Li, Jenny S.
• Primary Examiner(s): Wong; Don
• Assistant Examiner(s): Nguyen; Merilyn P
• Application Number:
  US12/117,393
• Publication Number:
  US 20090281847A1
• Time in Patent Office: 1,013 Days
• Field of Search: 707/609, 707/693, 707/694, 707/720, 707/721, 707/755, 707/812, 707/825
• US Class Current: 707/609
• CPC Class Codes: G06F 16/214 Database migration support
• CPC Class Codes: G06Q 10/0637 Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A method and system for migrating source data from a source database to a destination database based on energy efficiency and conservation. A migration server evaluates the source data for usage and requirements and defines data usage and requirement tags for the source data. The source data is disaggregated into one or more source data sets based on the data usage and requirement tags. The migration server then identifies candidate destinations for the source data, wherein each candidate destination has stored data identified with usage and requirement tags. The data migration server compares the first usage and requirement tags of the source data with the second usage and requirement tags of the stored data and identifies an optimal destination database based on the comparing step. The data migration server migrates the source data to the optimal destination database.

Claims

1. A method for migrating source data from a source database to a destination database comprising:

identifying source data to be moved from a current database;

evaluating the source data for usage and requirements;

defining first data usage and requirement tags for the source data;

disaggregating the source data into one or more source data sets based on the first data usage and requirement tags;

identifying candidate destinations for the one or more source data sets, wherein the candidate destinations comprise stored data having second usage and requirement tags;

comparing the first usage and requirement tags of the one or more source data sets with the second usage and requirement tags of the stored data;

identifying an optimal destination database based on the comparing step and based on energy efficiency;

computing a payback period to determine the length of time as defined by x, measured by a predefined time period, required before savings are realized for migrating the one or more source data sets from the source database to the optimal destination database comprising;

estimating ownership cost per predefined time period of the source database defined as T₀;

estimating energy consumption cost per predefined time period of the source database defined as E₀;

estimating cost of migrating the one or more source data sets to the optimal destination database defined as M_i;

estimating the ownership cost per predefined time period of the optimal destination database T_i;

estimating the energy consumption cost per predefined period of the source database E_i;

whereby (T₀+E₀)x=M_i+(T_i÷

E_i)x; and

migrating, using a data migration server, the one or more source data sets to the optimal destination database.

2. The method of claim 1 wherein evaluating source data for usage and requirements comprises:

asking one or more of the following queries comprising;

(i) frequency of use of the source data, (ii) time restrictions on the source data, (iii) usefulness of the source data, (iv) response time for retrieving the source data, (v) the geography of users accessing the source data, (vi) the time of day users access the source data, and (vii) the number of users accessing the source data;

receiving answers from the queries; and

categorizing the answers received from the queries.

3. The method of claim 2 wherein defining first data usage and requirement tags comprises categorizing the tags based on the answers received from the queries.

4. The method of claim 3 wherein identifying candidate destinations comprises:

listing destination databases and parameters of the destination databases, wherein the parameters comprise one or more of i) location of the destination database;

ii) storage type of the destination database;

iii) storage identification of the destination database;

iv) space available on the destination database;

v) power use per operation in the destination database;

vi) power used in the destination database;

vii) maximum power consumption of the destination database; and

viii) evaluation of stored data in the destination database.

5. The method of claim 4 wherein evaluating the stored data comprises:

asking one or more of the following queries comprising;

(i) frequency of use of the data, (ii) time restrictions on the data, (iii) usefulness of the data, (iv) response time for retrieving the data, (v) the geography of users accessing the data, (vi) the time of day users access the data, and (vii) number of users accessing the data;

receiving answers from the queries; and

categorizing the answers received from the queries.

6. The method of claim 5 wherein the second usage and requirement tags are defined by categorizing the tags based on the answers received from the queries.

7. The method of claim 6 wherein comparing the first usage and requirement tags of the one or more source data sets with second usage and requirement tags of the stored data comprises:

narrowing down candidate destinations by selecting destinations with one or more second usage and requirement tags comprising one or more of (i) a different time of day users access the data than set forth in the first usage and requirement tags;

(ii) a different geography of users accessing the data than set forth in the first usage and requirement tags;

(iii) a low number of users accessing the data;

(iv) a short response time for retrieving data;

(v) location of destination database;

(vi) storage type of the destination database;

(vii) storage identification of the destination database;

(viii) space available on the destination database;

(ix) power use per operation in the destination database;

(x) power used in the destination database;

(xi) maximum power consumption of the destination database; and

(xii) the type of stored data of the destination database.

8. The method of claim 1 wherein the predefined time period is measured in minutes, hours, days, months or years.

9. The method of claim 8, prior to the step of migrating the one or more source data sets to the optimal destination database, further comprising determining if migrating the one or more source data sets to the optimal destination database will create a delay in accessing the source data from the optimal destination database.

10. The method of claim 9 wherein determining if migrating the one or more source data sets to the optimal destination database will create a delay in accessing the one or more source data sets comprises copying each data set into a staging server, performing a query using joins to gather data from each data set, measuring query transmission time to determine if there is a delay.

11. The method of claim 10 further comprising maintaining the one or more source data sets in current location if the migration is not cost-beneficial.

12. The method of claim 1 further comprising:

creating a table listing candidate destination databases and the second usage and requirement tags for each destination database; and

updating the table after one or more source data sets has been moved to the optimal destination database.

13. A system including a processor for migrating source data from one or more source databases to a destination database comprising:

one or more source databases having source data;

a plurality of candidate destination databases;

a data migration server;

whereby the data migration server a) evaluates the source data for usage and requirements;

b) defines first data usage and requirement tags for the source data;

c) disaggregates the source data into one or more data sets based on the first data usage and requirement tags;

d) identifies candidate destinations for the one or more source data sets, wherein the candidate destinations comprise stored data having second usage and requirement tags;

e) compares the first usage and requirement tags of the one or more source data sets with the second usage and requirement tags of the stored data;

f) identifies an optimal destination database based on the comparing step and based on energy efficiency;

g) computes a payback period to determine the length of time as defined by x, measured by a predefined time period, required before savings are realized for migrating the one or more source data sets from the source database to the optimal destination database comprising;

estimating ownership cost per predefined time period of the source database defined as T₀;

estimating energy consumption cost per predefined time period of the source database defined as E₀;

estimating cost of migrating the one or more source data sets to the optimal destination database defined as M_i;

estimating the ownership cost per predefined time period of the optimal destination Database T_i;

estimating the energy consumption cost per predefined period of the source database E_i;

whereby (T₀+E₀)x=M_i+(T_i÷

E_i)x; and

h) migrates the one or more source data sets to the optimal destination database.

14. The system of claim 13 wherein the data migration server evaluates source data by one or more of:

(i) frequency of use of the source data, (ii) time restrictions on the source data, (iii) usefulness of the source data, (iv) response time for retrieving the source data, (v) the geography of users accessing the source data, (vi) the time of day users access the source data, and (vii) number of users accessing the source data.

15. The system of claim 14 wherein the data migration server identifies candidate destinations by listing destination databases and parameters of the destination databases, wherein the parameters comprise one or more of i) location of the destination database;

ii) storage type of the destination database;

iii) storage identification of the destination database;

iv) space available on the destination database;

v) power use per operation in the destination database;

vi) power used in the destination database;

vii) maximum power consumption of the destination database; and

viii) evaluation of stored data in the destination database.

16. The system of claim 15 wherein the data migration server evaluates the stored data by asking one or more of the following queries comprising:

(i) frequency of use of the data, (ii) time restrictions on the data, (iii) usefulness of the data, (iv) response time for retrieving the data, (v) the geography of users accessing the data, (vi) the time of day users access the data, and (vii) number of users accessing the data.

17. The system of claim 13 wherein the data migration server determines if migrating the one or more source data sets to the optimal destination database will create a delay in accessing the one or more source data sets from the optimal destination database.

18. The system of claim 17 wherein the data migration server creates a table listing candidate destination databases and the second usage and requirement tags for each destination database and updates the table after the one or more data sets has been moved to the optimal destination database.

19. A computer program product encoded in a computer readable storage medium for instructing a data migration server to migrate source data from a source database to a destination database comprising:

instructing the data migration server to evaluate the source data by defining a first set of data usage and requirement tags for the source data;

instructing the data migration server to disaggregate the source data into one or more source data sets based on the first set of data usage and requirement tags;

instructing the data migration server to identify candidate destinations for the one or more source data sets, wherein the candidate destinations comprise stored data having a second set of usage and requirement tags;

instructing the data migration server to compare the first set of usage and requirement tags with the second set of usage and requirement tags;

instructing the data migration server to identify an optimal destination database based on the comparing step and based on energy efficiency;

instructing the data migration server to compute a payback period to determine the length of time as defined by x, measured by a predefined time period, required before savings are realized for migrating the one or more source data sets from the source database to the optimal destination database comprising;

estimating ownership cost per predefined time period of the source database defined as T₀;

estimating energy consumption cost per predefined time period of the source database defined as E₀;

estimating cost of migrating the one or more source data sets to the optimal destination database defined as M_i;

estimating the ownership cost per predefined time period of the optimal destination database T_i;

estimating the energy consumption cost per predefined period of the source database E_i;

whereby (T₀+E₀)x=M_i+(T_i÷

E_i)x; and

instructing the data migration server to migrate the one or more source data sets to the optimal destination database.

20. The computer program product of claim 19 wherein the predefined time period is measured in minutes, hours, days, months, or years.

21. The computer program product of claim 20 further instructing the data migration server to determine if migrating the one or more source data sets to the optimal destination database will create a delay in accessing the one or more source data sets from the optimal destination database.

22. The computer program product of claim 21 further instructing the data migration server to create a table listing candidate destination databases and the second set of usage and requirement tags for each destination database and to update the table after the one or more data sets has been moved to the optimal destination database.