System, Method and Program Product to Schedule Transfer of Data

• US 20120278512A1
• Filed: 04/29/2011
• Published: 11/01/2012
• Est. Priority Date: 04/29/2011
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Alatorre, Gabriel, Singh, Aameek, Richardson, Laura
• Granted Patent: US 9,285,991 B2
• Time in Patent Office: Days
• US Class Current: 710/33
• CPC Class Codes: G06F 2209/5019 Workload prediction
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: G06F 9/505 considering the load

Abstract

Scheduling a proposed additional data transfer from one or more source storage devices to one or more target storage devices. A computer receives a request for the proposed additional data transfer, and in response, determines a measure of the proposed additional data transfer. The computer determines a measure of recent actual data transfers. The recent actual data transfers involve one or more of the source storage devices and one or more of the target storage devices. In response to the request for the proposed additional data transfer, the computer estimates performance of one or more of the source storage devices and one or more of the target storage devices that would occur during the proposed additional data transfer based on the measure of recent actual data transfers combined with the measure of the proposed additional data transfer. The computer compares the estimated performance to a corresponding performance threshold, and if less, the computer postpones execution of the proposed additional data transfer.

Claims

1. A method for scheduling a proposed additional data transfer from a source storage system to a target storage system, the method comprising the steps of:

a computer receiving a request for the proposed additional data transfer, and in response, the computer estimating an I/O request rate for the source storage system and the target storage system for the proposed additional data transfer;

a computer determining an I/O request rate for the source storage system and the target storage system for recent actual data transfers involving the source storage system and the target storage system;

in response to the request for the proposed additional data transfer, a computer estimating utilization of one or more data transfer components of the source storage system and the target storage system that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on the I/O request rates for the recent actual data transfers combined with the estimated I/O request rates for the proposed additional data transfer;

a computer comparing the estimated utilization to a corresponding utilization threshold, and

if the estimated utilization is less than the corresponding utilization threshold, a computer initiating execution of the proposed data transfer, and

if the estimated utilization is greater than the corresponding utilization threshold, a computer postponing execution of the proposed additional data transfer.

2. The method of claim 1 wherein the estimated utilization is less than the corresponding utilization threshold, and in response, a computer initiating execution of the proposed data transfer.

3. The method of claim 1 wherein the estimated utilization is greater than the corresponding utilization threshold, and in response,

a computer postponing execution of the proposed additional data transfer;

and

a computer subsequently estimating utilization of the one or more data transfer components of the source storage system and the target storage system that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on I/O request rates for subsequent actual data transfers from the source storage system to the target storage system and the estimated I/O request rates for the proposed additional data transfer, and

a computer comparing the subsequent estimated utilization to the corresponding utilization threshold, and

if the subsequent estimated utilization is less than the corresponding utilization threshold, a computer initiating execution of the proposed additional data transfer, and

if the subsequent estimated utilization is greater than the corresponding utilization threshold, a computer postponing execution of the proposed additional data transfer.

4. The method of claim 1 further comprising the steps of:

a computer estimating an average data transfer size for the proposed additional data transfer;

a computer determining an average data transfer size for the recent actual data transfers; and

a computer estimating the utilization of the one or more data transfer components that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on the average data transfer size for the recent actual data transfers and the estimated average data transfer size for the proposed additional data transfer.

5. A computer program product comprising one or more computer-readable tangible storage devices and computer-readable program instructions which are stored on the one or more storage devices and when executed by one or more processors of the one or more computers of claim 1 perform the method of claim 1.

6. The one or more computers of claim 1, the one or more computers comprising one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices and program instructions which are stored on the one or more storage devices for execution by the one or more processors via the one or more memories and when executed by the one or more processors perform the method of claim 1.

13. The method of claim 1 wherein the one or more data transfer components for the source storage system and the target storage system comprise a device adapter for data transfers, a host adapter for data transfers or a processor for managing data transfers.

7-12. -12. (canceled)

14. A computer program product for scheduling a proposed additional data transfer from a source storage system to a target storage system, the computer program product comprising:

one or more computer-readable tangible storage devices and program instructions stored on at least one of the one or more storage devices, the program instructions comprising;

program instructions, responsive to a request for the proposed additional data transfer, to estimate an I/O request rate for the source storage system and the target storage system for the proposed additional data transfer;

program instructions to determine an I/O request rate for the source storage system and the target storage system for recent actual data transfers involving the source storage system and the target storage system;

program instructions, responsive to the request for the proposed additional data transfer, to estimate utilization of one or more data transfer components of the source storage system and the target storage system that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on the I/O request rates for the recent actual data transfers combined with the estimated I/O request rates for the proposed additional data transfer; and

program instructions, responsive to the estimated utilization being less than a corresponding utilization threshold, to initiate execution of the proposed data transfer, and responsive to the estimated utilization being greater than the corresponding utilization threshold, to postpone execution of the proposed additional data transfer.

15. The computer program product of claim 14 wherein the program instructions responsive to the estimated utilization being greater than the corresponding utilization threshold, subsequently estimate utilization of the one or more data transfer components of the source storage system and the target storage system that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on I/O request rates for subsequent actual data transfers from the source storage system to the target storage system and the estimated I/O request rates for the proposed additional data transfer, and responsive to the subsequently estimated utilization being less than a corresponding utilization threshold, to initiate execution of the proposed data transfer, and responsive to the subsequently estimated utilization being greater than the corresponding utilization threshold, to postpone execution of the proposed additional data transfer.

16. The computer program product of claim 14 further comprising:

program instructions, stored on at least one of the one or more storage devices, to estimate an average data transfer size for the proposed additional data transfer and an average data transfer size for the recent actual data transfers; and

wherein

the program instructions to estimate the utilization of the one or more data transfer components that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, estimates the utilization based in part on the average data transfer size for the recent actual data transfers and the estimated average data transfer size for the proposed additional data transfer.

17. The computer program product of claim 14 wherein the one or more data transfer components for the source storage system and the target storage system comprise a device adapter for data transfers, a host adapter for data transfers or a processor for managing data transfers.

18. A computer program product for scheduling a proposed additional data transfer from a source storage system to a target storage system, the computer program product comprising:

one or more computer-readable tangible storage devices and program instructions stored on at least one of the one or more storage devices, the program instructions comprising;

program instructions, responsive to a request for the proposed additional data transfer, to estimate an amount of a type of utilization for the source storage system and the target storage system for the proposed additional data transfer;

program instructions to determine an amount of the type of utilization for the source storage system and the target storage system for recent actual data transfers involving the source storage system and the target storage system;

program instructions, responsive to the request for the proposed additional data transfer, to estimate utilization of one or more data transfer components of the source storage system and the target storage system that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on the amount of the utilization for the recent actual data transfers combined with the estimated amount of the utilization for the proposed additional data transfer; and

program instructions, responsive to the estimated utilization of the one or more data transfer components being less than a corresponding utilization threshold, to initiate execution of the proposed data transfer, and responsive to the estimated utilization of the one or more data transfer components being greater than the corresponding utilization threshold, to postpone execution of the proposed additional data transfer.

19. The computer program product of claim 18 wherein the program instructions responsive to the estimated utilization of the one or more data transfer components being greater than the corresponding utilization threshold, subsequently estimate utilization of the one or more data transfer components of the source storage system and the target storage system that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on an amount of the type of utilization for subsequent actual data transfers from the source storage system to the target storage system and the estimated amount of the type of utilization for the proposed additional data transfer, and responsive to the subsequently estimated utilization of the one or more data transfer components being less than a corresponding utilization threshold, to initiate execution of the proposed data transfer, and responsive to the subsequently estimated utilization of the one or more data transfer components being greater than the corresponding utilization threshold, to postpone execution of the proposed additional data transfer.

20. The computer program product of claim 18 further comprising:

program instructions, stored on at least one of the one or more storage devices, to estimate an average data transfer size for the proposed additional data transfer and an average data transfer size for the recent actual data transfers; and

wherein

the program instructions to estimate the utilization of the one or more data transfer components that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, estimates the utilization of the one or more data transfer components based in part on the average data transfer size for the recent actual data transfers and the estimated average data transfer size for the proposed additional data transfer.

21. The computer program product of claim 18 wherein the one or more data transfer components for the source storage system and the target storage system comprise a device adapter for data transfers, a host adapter for data transfers or a processor for managing data transfers.

22. A method for scheduling a proposed additional data transfer from a source storage system to a target storage system, the method comprising the steps of:

estimating an amount of a type of utilization for the source storage system and the target storage system for the proposed additional data transfer;

determining an amount of the type of utilization for the source storage system and the target storage system for recent actual data transfers involving the source storage system and the target storage system;

estimating utilization of one or more data transfer components of the source storage system and the target storage system that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on the amount of the utilization for the recent actual data transfers combined with the estimated amount of the utilization for the proposed additional data transfer; and

if the estimated utilization of the one or more data transfer components is less than a corresponding utilization threshold, initiating execution of the proposed data transfer, and if the estimated utilization of the one or more data transfer components is greater than the corresponding utilization threshold, postponing execution of the proposed additional data transfer.

23. The method of claim 22 wherein responsive to the estimated utilization of the one or more data transfer components being greater than the corresponding utilization threshold, subsequently estimating utilization of the one or more data transfer components of the source storage system and the target storage system that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, based in part on an amount of the type of utilization for subsequent actual data transfers from the source storage system to the target storage system and the estimated amount of the type of utilization for the proposed additional data transfer, and responsive to the subsequently estimated utilization of the one or more data transfer components being less than a corresponding utilization threshold, initiating execution of the proposed data transfer, and responsive to the subsequently estimated utilization of the one or more data transfer components being greater than the corresponding utilization threshold, postponing execution of the proposed additional data transfer.

24. The method of claim 22 further comprising the step of estimating an average data transfer size for the proposed additional data transfer and an average data transfer size for the recent actual data transfers;

and wherein

the step of estimating the utilization of the one or more data transfer components that would occur during the proposed additional data transfer combined with other scheduled data transfers involving the source storage system and the target storage system, is based in part on the average data transfer size for the recent actual data transfers and the estimated average data transfer size for the proposed additional data transfer.

25. The method of claim 22 wherein the one or more data transfer components for the source storage system and the target storage system comprise a device adapter for data transfers, a host adapter for data transfers or a processor for managing data transfers.