Systems, methods, and physical computer storage media to optimize data placement in multi-tiered storage systems

• US 8,838,927 B2
• Filed: 05/27/2011
• Issued: 09/16/2014
• Est. Priority Date: 05/27/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chiu, Lawrence Y., Guo, Yong, Li, Chao G., Liu, Yang, Seshadri, Sangeetha, Muench, Paul
• Primary Examiner(s): Alsip, Michael
• Application Number:
  US13/117,236
• Publication Number:
  US 20120303917A1
• Time in Patent Office: 1,208 Days
• Field of Search: 711/165
• US Class Current: 711/165
• CPC Class Codes: G06F 12/02 Addressing or allocation; Relocation program address sequencing G06F9/00; arrangements for selecting an address in a digital store G11C8/00
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06

Abstract

A system includes a data collector, a plurality of data placement optimizers, a data placement arbitrator, and a data mover. The data collector is configured to collect system configuration data and system performance data. The plurality of data placement optimizers are each configured to analyze the system configuration data and the system performance data for developing a corresponding data movement plan. The data placement arbitrator is configured to arbitrate conflicts between at least two data movement plans of generated by the plurality of data placement optimizers to form an execution plan. The data mover is configured to perform the data movement plans according to the execution plan.

Claims

1. A system to optimize data placement for a multi-tiered storage system comprising:

a data collector configured to collect system configuration data and system performance data;

a plurality of data placement optimizers each configures to analyze the system configuration data and the system performance data for developing a corresponding data movement plan for execution;

a data placement arbitrator configured to arbitrate potential conflicts between at least two of the data movement plans slated to access the same data in the multi-tiered storage system to form an execution plan, wherein arbitration of the potential conflicts is performed prior to execution of the data movement plans and all of the data movement plans generated by the plurality of data placement optimizers are included in the execution plan or removed as a result of the arbitration; and

a data mover configured to, after receiving the execution plan from the data placement arbitrator, perform the data movement plans according to the execution plan, wherein;

the data mover is further configured to maintain a plurality of priority queues,

each priority queue has a different priority;

each data migration plan has a priority and is entered into a priority queue having a corresponding priority; and

the data mover is further configured to execute the data migration plans in a higher priority queue more frequently than the data migration plans in a lower priority queue.

2. The system of claim 1, wherein:

each data placement optimizer is further configured to generate the corresponding data migration plan based, in part, on the system configuration data and the system performance data.

3. The system of claim 2, wherein:

the data placement arbitrator comprises a plurality of in-cycle conflict resolution modules, each in-cycle conflict resolution module configured to determine whether a first data migration plan has a higher priority than another data migration plan.

4. The system of claim 3, wherein:

the first data migration plan has a priority; and

the data placement arbitrator comprises a plurality of out-cycle conflict resolution modules, each out-cycle conflict resolution module configured to prevent execution of data migration plans other than the first data migration plan for a predetermined length of time, if the data migration plans have an equal or lower priority than the priority of the first data migration plan.

5. The system of claim 4, wherein:

each out-cycle conflict resolution module is further configured to execute data migration plans having a higher priority than the priority of the first data migration plan to be executed over the first data migration plan.

6. The system of claim 1, wherein:

the data mover is further configured to detect system resource utilization to optimize performance of the data movement plans according to the execution plan.

7. A non-transitory physical computer storage medium comprising a computer program product method for controlling a multi-tiered storage system, the physical computer storage medium comprising:

computer code for collecting system configuration data and system performance data;

computer code for generating a plurality of data movement plans for execution, based in part on the system configuration data and the system performance data;

computer code for arbitrating potential conflicts between the plurality of data movement plans slated to access the same data in the multi-tiered storage system to form an execution plan, wherein arbitrating of the potential conflicts is performed prior to execution of the data movement plans and all of the data movement plans generated by a plurality of data placement optimizers are included in the execution plan or removed as a result of the arbitrating; and

computer code for performing the data movement plans according to the execution plan, wherein;

the computer code for arbitrating further includes maintaining a plurality of priority queues, each priority queue having a different priority, each data movement plan having priority and being entered into a priority queue having a corresponding priority; and

the computer code for performing the data movement plans includes executing the data movement plans in a higher priority queue more frequently than the data movement plans in a lower priority queue.

8. The physical computer storage medium of claim 7, further comprising:

computer code for updating the execution plan after receiving a result of the performance of the data movement plans.

9. The physical computer storage medium of claim 7, further comprising:

computer code for collecting updated system configuration data and updated system performance data as a result of the step of performing.

10. The physical computer storage medium of claim 7, further comprising:

computer code for receiving input/output requests to form a plurality of data migration plans based, in part, on the system configuration data and the system performance data.

11. The physical computer storage medium of claim 10, further comprising:

computer code for determining whether a first data migration plan has a higher priority than another data migration plan.

12. The physical computer storage medium of claim 7, wherein:

the computer code for performing the data movement plans further comprises computer code for detecting system resource utilization to optimize performance of the data movement plans according to the execution plan.

13. A multi-tiered storage system comprising:

a plurality of servers;

a storage controller in communication with each server of the plurality of servers; and

a processing unit in communication with the storage controller and the plurality of servers, wherein;

the storage controller is adapted to collect system configuration data and system performance data,

each of the servers of the plurality of servers includes one or more data placement optimizers each configured to analyze the system configuration data and the system performance data for developing a corresponding data movement plan for execution,

each of the servers of the plurality of servers is configured to arbitrate potential conflicts between at least two of the data movement plans slated to access the same data in the multi-tiered storage system to form an execution plan, wherein arbitration of the potential conflicts is performed prior to execution of the data movement plans and all of the data movement plans generated by the plurality of data placement optimizers are included in the execution plan or removed as a result of the arbitration, and

the storage controller is further adapted to, after receiving the execution plan, perform the data movement plans according to the execution plan,

maintain a plurality of priority queues, each priority queue having a different priority, each data movement plan having a priority and entered into a priority queue having corresponding priority, and

execute the data movement plans in a higher priority queue more frequently than the data movement plans in a lower priority queue.

14. The multi-tiered storage system of claim 13, wherein:

each data placement optimizer is further configured to generate of the corresponding data migration plan based, in part, on the system configuration data and the system performance data.