Splitting a group of physical data storage drives into partnership groups to limit the risk of data loss during drive rebuilds in a mapped RAID (redundant array of independent disks) data storage system

• US 10,678,643 B1
• Filed: 04/26/2017
• Issued: 06/09/2020
• Est. Priority Date: 04/26/2017
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Gao, Jian, Usvyatsky, Ilya, Li, Wayne, Han, Geng, Gao, Hongpo, Dong, Jibing
• Primary Examiner(s): Truong, Loan L. T.
• Application Number:
  US15/497,984
• Time in Patent Office: 1,140 Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

In response to detecting that a total number of physical data storage drives in a group of physical data storage drives exceeds a maximum drive group size, the group of physical data storage drives is divided into a multiple partnership groups, and RAID extents in a RAID mapping table are divided into multiple RAID extent groups. Each one of the RAID extent groups contains multiple RAID extents and corresponds to one of the partnership groups of physical data storage drives. The RAID extents in each RAID extent group only indicate physical data storage drives contained in the corresponding partnership group of physical data storage drives, in order to ensure that data recovery and RAID extent rebuilding after a drive failure involve only the physical data storage drives within the same partnership group as the failed physical data storage drive.

Claims

1. A method of providing RAID (Redundant Array of Independent Disks) data protection for a storage object in a data storage system, wherein the data storage system includes a storage processor and a group of physical data storage drives communicably coupled to the storage processor, the method comprising:

generating a RAID mapping table, wherein the RAID mapping table contains a plurality of RAID extents, wherein each RAID extent contained in the RAID mapping table represents a single data stripe and contains indications of a plurality of drive extents for persistently storing host data written to the storage object, and wherein each drive extent comprises a contiguous region of non-volatile data storage in one of the physical data storage drives;

detecting the addition of a new physical data storage drive to the group of physical data storage drives;

in response to detecting the addition of the new physical data storage drive to the group of physical data storage drives, comparing a total number of physical data storage drives in the group of physical data storage drives to a predetermined maximum drive group size, wherein the predetermined maximum drive group size is equal to a maximum number of physical data storage drives that may be contained in the group of physical data storage drives before a level of concurrent processing available during a rebuild process becomes limited by performance of at least one resource in the data storage system other than the physical data storage drives; and

in response to detecting that the total number of physical data storage drives in the group of physical data storage drives exceeds the maximum drive group size, i) dividing the group of physical data storage drives into a plurality of partnership groups of physical data storage drives, wherein each physical data storage drive from the group of physical data storage drives is contained in only one of the partnership groups of physical data storage drives, and wherein each partnership group of physical data storage drives contains a number of physical data storage drives that is less than the maximum drive group size, and ii) dividing the RAID extents in the RAID mapping table into a plurality of RAID extent groups, wherein each one of the RAID extent groups is stored in the RAID mapping table and contains multiple RAID extents and corresponds to one of the partnership groups of physical data storage drives, and wherein the RAID extents in each RAID extent group contain indications only of drive extents that are located in physical data storage drives contained in the corresponding one of the partnership groups of physical drives.

2. The method of claim 1, wherein dividing the RAID extents in the RAID mapping table into the plurality of RAID extent groups comprises:

assigning each RAID extent in the RAID mapping table to a corresponding one of the RAID extent groups;

identifying at least one RAID extent that contains at least one indication of a drive extent that is located in a physical data storage drive that is contained in a partnership group of physical data storage drives other than the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned; and

modifying each RAID extent that contains at least one indication of a drive extent that is located in a physical data storage drive that is contained in a partnership group of physical data storage drives other than the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned to contain only indications of drive extents that are located in physical data storage drives that are contained in the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned.

3. The method of claim 2, wherein each RAID extent in the RAID mapping table contains indications of the same number of drive extents;

wherein a minimum number of physical data storage drives required to provide RAID data protection for the storage object in the data storage system is greater than the number of drive extents indicated by each RAID extent in the RAID mapping table; and

wherein the maximum drive group size is at least twice as large as the minimum number of physical data storage drives required to provide RAID data protection for the storage object in a data storage system.

4. The method claim 3, wherein dividing the group of physical data storage drives into a plurality of partnership groups of physical data storage drives comprises dividing the group of physical data storage drives into two partnership groups of physical data storage drives, wherein a first partnership group of physical data storage drives comprises a first half of the physical data storage drives in the group of physical data storage drives and a second partnership group of physical data storage drives comprises a second half of the physical data storage drives in the group of physical data storage drives.

5. The method of claim 4, wherein a plurality of unallocated drive extents located in physical data storage drives contained in the first partnership group of physical data storage drives are available as spare drive extents to be allocated, in response to detecting a failure of a physical data storage drive contained in the first partnership group of physical data storage drives, to one or more RAID extents in the RAID mapping table, to replace drive extents located in the failed physical data storage drive contained in the first partnership group of physical data storage devices;

and

wherein a plurality of unallocated drive extents located in physical data storage drives contained in the second partnership group of physical storage drives are available as spare drive extents to be allocated, in response to detecting a failure of a physical data storage drive contained in the second partnership group of physical data storage drives, to one or more RAID extents in the RAID mapping table, to replace drive extents located in the failed physical data storage drive contained in the second partnership group of physical data storage drives.

6. The method of claim 5, wherein drive extents are allocated to RAID extents in the RAID mapping table such that no two drive extents indicated by any single RAID extent are located on the same physical data storage drive.

19. The method of claim 1, wherein for each one of the RAID extents contained in the RAID mapping table, i) at least one of the plurality of drive extents indicated by the RAID extent is used to store parity information, and ii) the remainder of the plurality of drive extents indicated by the RAID extent are used for persistently storing host data written to the storage object.

20. The method of claim 1, further comprising:

wherein the maximum drive group size is at least twice as large as a minimum number of physical data storage drives that is required to provide RAID data protection for the storage object in a data storage system.

21. The method of claim 1, further comprising:

wherein the predetermined maximum drive group size is equal to a maximum number of physical data storage drives that may be contained in the group of physical data storage drives before a level of concurrent processing available during the rebuild process becomes limited by performance of processing circuitry in the data storage system.

7. A data storage system that provides RAID (Redundant Array of Independent Disks) data protection for a storage object, comprising:

at least one storage processor including processing circuitry and a memory;

a set of physical data storage drives communicably coupled to the storage processor; and

wherein the storage processor is configured and arranged to;

generate a RAID mapping table, wherein the RAID mapping table contains a plurality of RAID extents, wherein each RAID extent contained in the RAID mapping table represents a single data stripe and contains indications of a plurality of drive extents for persistently storing host data written to the storage object, and wherein each drive extent comprises a contiguous region of non-volatile data storage in one of the physical data storage drives;

detect the addition of a new physical data storage drive to the group of physical data storage drives;

in response to detecting the addition of the new physical data storage drive to the group of physical data storage drives, compare a total number of physical data storage drives in the group of physical data storage drives to a predetermined maximum drive group size, wherein the predetermined maximum drive group size is equal to a maximum number of physical data storage drives that may be contained in the group of physical data storage drives before a level of concurrent processing available during a rebuild process becomes limited by performance of at least one resource in the data storage system other than the physical data storage drives; and

in response to detecting that the total number of physical data storage drives in the group of physical data storage drives exceeds the maximum drive group size, i) divide the group of physical data storage drives into a plurality of partnership groups of physical data storage drives, wherein each physical data storage drive from the group of physical data storage drives is contained in only one of the partnership groups of physical data storage drives, and wherein each partnership group of physical data storage drives contains a number of physical data storage drives that is less than the maximum drive group size, and ii) divide the RAID extents in the RAID mapping table into a plurality of RAID extent groups, wherein each one of the RAID extent groups is stored in the RAID mapping table and contains multiple RAID extents and corresponds to one of the partnership groups of physical data storage drives, and wherein the RAID extents in each RAID extent group contain indications only of drive extents that are located in physical data storage drives contained in the corresponding one of the partnership groups of physical drives.

8. The data storage system of claim 7, wherein to divide the RAID extents in the RAID mapping table into the plurality of RAID extent groups the storage processor is further configured and arranged to:

assign each RAID extent in the RAID mapping table to a corresponding one of the RAID extent groups;

identify at least one RAID extent that contains at least one indication of a drive extent that is located in a physical data storage drive that is contained in a partnership group of physical data storage drives other than the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned; and

modify each RAID extent that contains at least one indication of a drive extent that is located in a physical data storage drive that is contained in a partnership group of physical data storage drives other than the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned to contain only indications of drive extents that are located in physical data storage drives that are contained in the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned.

9. The data storage system of claim 8, wherein each RAID extent in the RAID mapping table contains indications of the same number of drive extents;

wherein a minimum number of physical data storage drives required to provide RAID data protection for the storage object in the data storage system is greater than the number of drive extents indicated by each RAID extent in the RAID mapping table; and

wherein the maximum drive group size is at least twice as large as the minimum number of physical data storage drives required to provide RAID data protection for the storage object in a data storage system.

10. The data storage system of claim 9, wherein to divide the group of physical data storage drives into a plurality of partnership groups of physical data storage drives, the storage processor is further configured and arranged to divide the group of physical data storage drives into two partnership groups of physical data storage drives, wherein a first partnership group of physical data storage drives comprises a first half of the physical data storage drives in the group of physical data storage drives and a second partnership group of physical data storage drives comprises a second half of the physical data storage drives in the group of physical data storage drives.

11. The data storage system of claim 10, wherein a plurality of unallocated drive extents located in physical data storage drives contained in the first partnership group of physical data storage drives are available as spare drive extents to be allocated, in response to detecting a failure of a physical data storage drive contained in the first partnership group of physical data storage drives, to one or more RAID extents in the RAID mapping table, to replace drive extents located in the failed physical data storage drive contained in the first partnership group of physical data storage devices;

and

wherein a plurality of unallocated drive extents located in physical data storage drives contained in the second partnership group of physical storage drives are available as spare drive extents to be allocated, in response to detecting a failure of a physical data storage drive contained in the second partnership group of physical data storage drives, to one or more RAID extents in the RAID mapping table, to replace drive extents located in the failed physical data storage drive contained in the second partnership group of physical data storage drives.

12. The data storage system of claim 11, wherein the storage processor is further configured and arranged to allocate drive extents to RAID extents in the RAID mapping table such that no two drive extents indicated by any single RAID extent are located on the same physical data storage drive.

13. A computer program product, comprising:

a non-transitory computer readable medium storing program code for providing RAID (Redundant Array of Independent Disks) data protection for a storage object in a data storage system, wherein the data storage system includes a storage processor and a set of non-volatile data storage devices communicably coupled to the storage processor, the set of instructions, when carried out by at least one processor in the storage processor, causing the storage processor to perform a method of;

generating a RAID mapping table, wherein the RAID mapping table contains a plurality of RAID extents, wherein each RAID extent contained in the RAID mapping table represents a single data stripe and contains indications of a plurality of drive extents for persistently storing host data written to the storage object, and wherein each drive extent comprises a contiguous region of non-volatile data storage in one of the physical data storage drives;

detecting the addition of a new physical data storage drive to the group of physical data storage drives;

in response to detecting the addition of the new physical data storage drive to the group of physical data storage drives, comparing a total number of physical data storage drives in the group of physical data storage drives to a predetermined maximum drive group size, wherein the predetermined maximum drive group size is equal to a maximum number of physical data storage drives that may be contained in the group of physical data storage drives before a level of concurrent processing available during a rebuild process becomes limited by performance of at least one resource in the data storage system other than the physical data storage drives; and

in response to detecting that the total number of physical data storage drives in the group of physical data storage drives exceeds the maximum drive group size, i) dividing the group of physical data storage drives into a plurality of partnership groups of physical data storage drives, wherein each physical data storage drive from the group of physical data storage drives is contained in only one of the partnership groups of physical data storage drives, and wherein each partnership group of physical data storage drives contains a number of physical data storage drives that is less than the maximum drive group size, and ii) dividing the RAID extents in the RAID mapping table into a plurality of RAID extent groups, wherein each one of the RAID extent groups is stored in the RAID mapping table and contains multiple RAID extents and corresponds to one of the partnership groups of physical data storage drives, and wherein the RAID extents in each RAID extent group contains indications only of drive extents that are located in physical data storage drives contained in the corresponding one of the partnership groups of physical drives.

14. The computer program product of claim 13, wherein the method performed by the storage processor when the set of instructions is carried out by at least one processor in the storage processor further comprises dividing the RAID extents in the RAID mapping table into the plurality of RAID extent groups at least in part by:

assigning each RAID extent in the RAID mapping table to a corresponding one of the RAID extent groups;

identifying at least one RAID extent that contains at least one indication of a drive extent that is located in a physical data storage drive that is contained in a partnership group of physical data storage drives other than the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned; and

modifying each RAID extent that contains at least one indication of a drive extent that is located in a physical data storage drive that is contained in a partnership group of physical data storage drives other than the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned to contain only indications of drive extents that are located in physical data storage drives that are contained in the partnership group of physical data storage drives that corresponds to the RAID extent group to which that RAID extent is assigned.

15. The computer program product of claim 14, further comprising:

wherein each RAID extent in the RAID mapping table contains indications of the same number of drive extents;

wherein a minimum number of physical data storage drives required to provide RAID data protection for the storage object in the data storage system is greater than the number of drive extents indicated by each RAID extent in the RAID mapping table; and

wherein the maximum drive group size is at least twice as large as the minimum number of physical data storage drives required to provide RAID data protection for the storage object in a data storage system.

16. The computer program product of claim 15, wherein dividing the group of physical data storage drives into a plurality of partnership groups of physical data storage drives comprises dividing the group of physical data storage drives into two partnership groups of physical data storage drives, wherein a first partnership group of physical data storage drives comprises a first half of the physical data storage drives in the group of physical data storage drives and a second partnership group of physical data storage drives comprises a second half of the physical data storage drives in the group of physical data storage drives.

17. The computer program product of claim 16, wherein a plurality of unallocated drive extents located in physical data storage drives contained in the first partnership group of physical data storage drives are available as spare drive extents to be allocated, in response to detecting a failure of a physical data storage drive contained in the first partnership group of physical data storage drives, to one or more RAID extents in the RAID mapping table, to replace drive extents located in the failed physical data storage drive contained in the first partnership group of physical data storage devices;

and

wherein a plurality of unallocated drive extents located in physical data storage drives contained in the second partnership group of physical storage drives are available as spare drive extents to be allocated, in response to detecting a failure of a physical data storage drive contained in the second partnership group of physical data storage drives, to one or more RAID extents in the RAID mapping table, to replace drive extents located in the failed physical data storage drive contained in the second partnership group of physical data storage drives.

18. The computer program product of claim 17, wherein drive extents are allocated to RAID extents in the RAID mapping table such that no two drive extents indicated by any single RAID extent are located on the same physical data storage drive.