METHOD, APPARATUS AND COMPUTER PROGRAM PRODUCT FOR MANAGING STORAGE SYSTEM

• US 20190332286A1
• Filed: 12/11/2018
• Published: 10/31/2019
• Est. Priority Date: 04/28/2018
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Zhuo, Baote, Gao, Jian, Dong, Jibing, Han, Geng, Xu, Xinlei, Kang, Jianbin
• Granted Patent: US 10,705,742 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0622 in relation to access
• CPC Class Codes: G06F 3/0629 Configuration or reconfiguration of storage systems
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Techniques manage a storage system. Such techniques involve: determining an expected input/output (I/O) concurrency number of an access request for a storage system, the access request being associated with a first one of a plurality of redundant arrays of independent disks (RAIDs) comprised in the storage system; in response to a current available I/O concurrency number of the first RAID being less than the expected I/O concurrency number, increasing the available I/O concurrency number of the first RAID based on a reserved I/O concurrency number of the storage system; and performing the access request using the first RAID having the increased available I/O concurrency number.

Claims

1. A method of managing a storage system, comprising:

determining an expected input/output (I/O) concurrency number of an access request for a storage system, the access request being associated with a first one of a plurality of redundant arrays of independent disks (RAIDs) comprised in the storage system;

in response to a current available I/O concurrency number of the first RAID being less than the expected I/O concurrency number, increasing the available I/O concurrency number of the first RAID based on a reserved I/O concurrency number of the storage system; and

performing the access request using the first RAID having the increased available I/O concurrency number.

2. The method according to claim 1, wherein increasing the available I/O concurrency number of the first RAID comprises:

comparing the reserved I/O concurrency number with the expected I/O concurrency number;

in response to determining that the reserved I/O concurrency number is not less than the expected I/O concurrency number, subtracting the expected I/O concurrency number from the reserved I/O concurrency number of the storage system; and

increasing the available I/O concurrency number of the first RAID by the expected I/O concurrency number.

3. The method according to claim 1, wherein increasing the available I/O concurrency number of the first RAID comprises:

determining a difference between the expected I/O concurrency number and the available I/O concurrency number;

comparing the reserved I/O concurrency number with the difference;

in response to determining that the reserved I/O concurrency number is not less than the difference, subtracting the difference from the reserved I/O concurrency number of the storage system;

increasing the available I/O concurrency number of the first RAID by the difference.

4. The method according to claim 1, further comprising:

determining whether a storage device associated with the access request in the first RAID reaches an I/O concurrency number upper limit;

in response to determining that the storage device reaches the I/O concurrency number upper limit, suspending the access request; and

maintaining the available I/O concurrency number of the first RAID.

5. The method according to claim 1, further comprising:

in response to completion of the access request, determining a sum of an I/O concurrency number allocated from the available I/O concurrency number for access requests occurring currently and a first I/O concurrency number allocated from the available I/O concurrency number for the completed access request;

comparing the sum with a concurrency number threshold, the concurrency number threshold being at least based on a number of RAIDs in the storage system and a number of storage devices in the storage system;

in response to the sum being greater than the concurrency number threshold, determining whether a second RAID is present in the plurality of RAIDs, the second RAID having an I/O concurrency number currently occurring therein less than the concurrency number threshold and having a pending access request; and

in response to the second RAID being present, increasing the current available I/O concurrency number of the second RAID by the first I/O concurrency number.

6. The method according to claim 5, further comprising:

in response to the second RAID being absent, identifying a third RAID from the plurality of RAIDs, a number of pending access requests of the third RAID exceeding a request threshold; and

increasing a current available I/O concurrency number of the third RAID by the first I/O concurrency number.

7. The method according to claim 5, further comprising:

in response to a change of the number of RAIDs in the storage system, adjusting the concurrency number threshold.

8. The method according to claim 1, further comprising:

in response to completion of the access request, determining a second I/O concurrency number allocated for the access request from the reserved I/O concurrency number of the storage system; and

increasing the reserved I/O concurrency number by the second I/O concurrency number.

9. The method according to claim 1, wherein the access request is an access request pending in the first RAID, and the number of access requests pending in the first RAID exceeds a request threshold.

10. An apparatus for managing a storage system, comprising:

at least one processing unit;

at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the apparatus to perform acts comprising;

determining an expected input/output (I/O) concurrency number of an access request for a storage system, the access request being associated with a first one of a plurality of redundant arrays of independent disks (RAIDs) comprised in the storage system,

in response to a current available I/O concurrency number of the first RAID being less than the expected I/O concurrency number, increasing the available I/O concurrency number of the first RAID based on a reserved I/O concurrency number of the storage system, and

performing the access request using the first RAID having the increased available I/O concurrency number.

11. The apparatus according to claim 10, wherein increasing the available I/O concurrency number of the first RAID comprises:

comparing the reserved I/O concurrency number with the expected I/O concurrency number;

in response to determining that the reserved I/O concurrency number is not less than the expected I/O concurrency number, subtracting the expected I/O concurrency number from the reserved I/O concurrency number of the storage system; and

increasing the available I/O concurrency number of the first RAID by the expected I/O concurrency number.

12. The apparatus according to claim 10, wherein increasing the available I/O concurrency number of the first RAID comprises:

determining a difference between the expected I/O concurrency number and the available I/O concurrency number;

comparing the reserved I/O concurrency number with the difference;

in response to determining that the reserved I/O concurrency number is not less than the difference, subtracting the difference from the reserved I/O concurrency number of the storage system;

increasing the available I/O concurrency number of the first RAID by the difference.

13. The apparatus according to claim 10, wherein the acts further comprise:

determining whether a storage device associated with the access request in the first RAID reaches an I/O concurrency number upper limit;

in response to determining that the storage device reaches the I/O concurrency number upper limit, suspending the access request; and

maintaining the available I/O concurrency number of the first RAID.

14. The apparatus according to claim 10, wherein the acts further comprise:

in response to completion of the access request, determining a sum of an I/O concurrency number allocated from the available I/O concurrency number for access requests occurring currently and a first I/O concurrency number allocated from the I/O concurrency number for the completed access request;

comparing the sum with a concurrency number threshold, the concurrency number threshold being at least based on a number of RAIDs in the storage system and a number of storage devices in the storage system;

in response to the sum being greater than the concurrency number threshold, determining whether a second RAID is present in the plurality of RAIDs, the second RAID having an I/O concurrency number currently occurring therein less than the concurrency number threshold and the second RAID having a pending access request; and

in response to the second RAID being present, increasing the current available I/O concurrency number of the second RAID by the first I/O concurrency number.

15. The apparatus according to claim 14, wherein the acts further comprise:

in response to the second RAID being absent, identifying a third RAID from the plurality of RAIDs, a number of pending access requests of the third RAID exceeding a request threshold; and

increasing a current available I/O concurrency number of the third RAID by the first I/O concurrency number.

16. The apparatus according to claim 14, wherein the acts further comprise:

in response to a change of the number of RAIDs in the storage system, adjusting the concurrency number threshold.

17. The apparatus according to claim 10, wherein the acts further comprise:

in response to completion of the access request, determining a second I/O concurrency number allocated for the access request from the reserved I/O concurrency number of the storage system; and

increasing the reserved I/O concurrency number by the second I/O concurrency number.

18. The apparatus according to claim 10, wherein the access request is an access request pending in the first RAID, and the number of access requests pending in the first RAID exceeds a request threshold.

19. A computer program product having a non-transitory computer readable medium which stores a set of instructions to manage a storage system;

the set of instructions, when carried out by computerized circuitry, causing the computerized circuitry to perform a method of;

determining an expected input/output (I/O) concurrency number of an access request for the storage system, the access request being associated with a redundant array of independent disks (RAID) structure of the storage system;

in response to a current available I/O concurrency number of the RAID structure being less than the expected I/O concurrency number, increasing the available I/O concurrency number of the RAID structure based on a reserved I/O concurrency number of the storage system; and

performing the access request using the RAID structure having the increased available I/O concurrency number.

20. A computer program product as in claim 19 wherein the RAID structure is a RAID extent residing in a mapped RAID environment, the RAID extent having a set of data segments and a set of parity segments;

wherein the access request is a write request including host data to be written to the RAID extent; and

wherein performing the access request using the RAID structure includes;

reading original parity from the set of parity segments of the RAID extent,

generating new parity based on the original parity and the host data, and

writing the host data to the set of data segments of the RAID extent and the new parity to the set of parity segments of the RAID extent.