Addressing usage of shared SSD resources in volatile and unpredictable operating environments

• US 10,394,461 B2
• Filed: 09/05/2018
• Issued: 08/27/2019
• Est. Priority Date: 05/31/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bernal, Edward R., Heninger, Ivan M.
• Primary Examiner(s): Rojas, Midys
• Application Number:
  US16/122,402
• Publication Number:
  US 20190004711A1
• Time in Patent Office: Days
• Field of Search: None
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/0616 in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Systems and methods for optimizing storage system performance are disclosed. A method includes: determining an expected lifetime of each of at least one computing instance; determining a disk data extent evaluation period for each of the at least one computing instance based on the determined expected lifetime; determining an input/output (I/O) wait time threshold for each of the at least one computing instance; determining an I/O wait time of each of the at least one computing instance using the determined disk data extent evaluation period; and in response to the determined I/O wait time of one or more of the at least one computing instance exceeding the determined I/O wait time threshold of the computing instance, moving at least one data extent associated with the one or more computing instance exceeding the determined I/O wait time threshold from hard disk drive storage to solid state drive storage.

Claims

1. A method comprising:

determining, by a computer device, an input/output (I/O) wait time threshold for a computing instance;

determining, by the computer device, an I/O wait time of the computing instance; and

in response to the determined I/O wait time of the computing instance exceeding the determined I/O wait time threshold of the computing instance, moving, by the computer device, a data extent associated with the computing instance exceeding the determined I/O wait time threshold from hard disk drive (HDD) storage to solid state drive (SSD) storage.

2. The method according to claim 1, further comprising determining, by the computer device, a disk data extent evaluation period for the computing instance,

wherein the I/O wait time of the computing instance is determined using the disk data extent evaluation period for the computing instance.

3. The method according to claim 1, further comprising receiving a job priority for the computing instance exceeding the determined I/O wait time threshold, and

wherein the moving the data extent comprises determining the data extent to be moved using the received job priority for the computing instance exceeding the determined I/O wait time threshold.

4. The method according to claim 3, further comprising receiving a customer priority for the computing instance exceeding the determined I/O wait time threshold, and

wherein the moving the data extent further comprises using the received customer priority in the determining the data extent to be moved.

5. The method according to claim 1, further comprising receiving an estimated storage amount accessed for the computing instance exceeding the determined I/O wait time threshold, and

wherein the moving the data extent comprises determining the data extent to be moved using the received estimated storage amount accessed for the computing instance exceeding the determined I/O wait time threshold.

6. The method according to claim 1, further comprising determining a data extent movement rate for each of a plurality of data extents, the data extent movement rate indicating a time required to move the data extent from HDD storage to SSD storage, and

wherein the moving the data extent comprises determining the data extent to be moved using the determined data extent movement rate and a data extent size for the data extent.

7. The method according to claim 6, wherein the data extent movement rate is determined using information about one of a current load and an expected load of the storage system.

8. The method according to claim 1, wherein the moving the data extent comprises a cloud controller sending a request to move the data extent from HDD storage to SSD storage to a storage controller.

9. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer device to cause the computing device to:

determine an input/output (I/O) wait time threshold for each of at least one data extent associated with at least one computing instance;

determine an I/O wait time of each of the at least one data extent associated with the at least one computing instance; and

in response to the determined I/O wait time of one or more of the at least one data extent associated with the at least one computing instance exceeding the determined I/O wait time threshold of the data extent, move at least one of the one or more of the at least one data extent associated with the at least one computing instance exceeding the determined I/O wait time threshold from hard disk drive (HDD) storage to solid state drive (SSD) storage.

10. The computer program product according to claim 9, the program instructions further causing the computing device to receive a job priority for each of the at least one computing instance, and

wherein the moving the at least one of the one or more of the at least one data extent associated with the at least one computing instance exceeding the determined I/O wait time threshold comprises determining the at least one data extent to be moved using the received job priority for each of the at least one computing instance.

11. The computer program product according to claim 9, the program instructions further causing the computing device to receive an estimated storage amount accessed for each of the one or more computing instance exceeding the determined I/O wait time threshold, and

wherein the moving the at least one of the one or more of the at least one data extent associated with the at least one computing instance exceeding the determined I/O wait time threshold comprises determining the at least one data extent to be moved using the received estimated storage amount accessed for each of the one or more computing instance exceeding the determined I/O wait time threshold.

12. The computer program product according to claim 9, the program instructions further causing the computing device to determine a data extent movement rate for each of a plurality of data extents, the data extent movement rate indicating a time required to move the data extent from HDD storage to SSD storage, and

wherein the moving the at least one of the one or more of the at least one data extent associated with the at least one computing instance exceeding the determined I/O wait time threshold comprises determining the at least one data extent to be moved using the determined data extent movement rate and a data extent size for each of the plurality of data extents.

13. The computer program product according to claim 12, wherein the data extent movement rate is determined using information about one of a current load and an expected load of the storage system.

14. The computer program product according to claim 9, wherein the moving the at least one data extent comprises a cloud controller sending a request to move the at least one data extent from HDD storage to SSD storage to a storage controller.

15. A system comprising:

a storage system comprising hard disk drive (HDD) storage and solid state drive (SSD) storage; and

a controller comprising;

at least one hardware processor;

an input/output (I/O) wait time threshold determiner configured to determine an I/O wait time threshold for each of at least one computing instance using the at least one hardware processor;

an I/O wait time determiner configured to determine an I/O wait time of each of the at least one computing instance using the at least one hardware processor; and

a data extent mover configured to, in response to the I/O wait time of one or more of the at least one computing instance determined by the I/O wait time determiner exceeding the I/O wait time threshold of the computing instance determined by the I/O wait time threshold determiner, move at least one data extent associated with the one or more computing instance exceeding the determined I/O wait time threshold from the HDD storage in the storage system to the SSD storage in the storage system.

16. The system according to claim 15, wherein the data extent mover is further configured to:

receive a job priority for each of the one or more computing instance exceeding the determined I/O wait time threshold; and

determine the at least one data extent to be moved using the received job priority for each of the one or more computing instance exceeding the determined I/O wait time threshold.

17. The system according to claim 15, wherein the data extent mover is further configured to:

receive an estimated storage amount accessed for each of the one or more computing instance exceeding the determined I/O wait time threshold; and

determine the at least one data extent to be moved using the received estimated storage amount accessed for each of the one or more computing instance exceeding the determined I/O wait time threshold.

18. The system according to claim 15, wherein the data extent mover is further configured to:

determine a data extent movement rate for each of a plurality of data extents, the data extent movement rate indicating a time required to move the data extent from HDD storage to SSD storage; and

determine the at least one data extent to be moved using the determined data extent movement rate and a data extent size for each of the plurality of data extents.

19. The system according to claim 18, wherein the data extent mover determines the data extent movement rate using information about one of a current load and an expected load of the storage system.

20. The system according to claim 15, wherein the storage system further comprises a storage controller, and

wherein the data extent mover is configured to send a request to the storage controller in the storage system to move the at least one data extent from the HDD storage in the storage system to the SSD storage in the storage system.