Balancing I/O load on data storage systems

• US 9,513,814 B1
• Filed: 03/29/2011
• Issued: 12/06/2016
• Est. Priority Date: 03/29/2011
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Can, Khang, Chen, Xiangping, Jiang, Kevin Bangyen, Tao, Qin, Ku, Mark
• Primary Examiner(s): Rigol, Yaima
• Assistant Examiner(s): Matin, Tasnima
• Application Number:
  US13/074,164
• Time in Patent Office: 2,079 Days
• Field of Search: 711/114, 711/165, 711/E12.001
• US Class Current: 1/1
• CPC Class Codes: G06F 12/00 Accessing, addressing or allocating within memory systems or architectures digital input from, or digital output to record carriers, e.g. to disk storage units, G06F3/06
• CPC Class Codes: G06F 12/08 in hierarchically structured memory systems, e.g. virtual memory systems
• CPC Class Codes: G06F 2212/1016 Performance improvement
• CPC Class Codes: G06F 2212/601 Reconfiguration of cache memory
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

A method is used in balancing I/O load on data storage systems. A slice is selected from a first storage container of a storage tier. The storage tier includes a second storage container. The slice is relocated from the first storage container of the storage tier to the second storage container of the storage tier, where I/O load of the first storage container is greater than I/O load of the second storage container.

Claims

1. A method for use in balancing I/O load on data storage systems, the method comprising:

determining storage capability of each storage container of a set of storage containers included in a storage tier, wherein the storage capability of a storage container indicates a maximum I/O load enabled for the storage container based on storage performance characteristics of the storage container, wherein the set of storage containers include first and second storage containers configured such that storage characteristics associated with the first storage container is different from storage characteristics associated with the second storage container, wherein each storage container includes a set of slices;

evaluating I/O load of each storage container of the set of storage containers, wherein evaluating the I/O load includes determining current I/O load and desired I/O load of each storage container, wherein the desired I/O load for a storage container is determined based on a storage utilization ratio of the storage tier and the storage capability of the storage container; and

based on the evaluation, relocating a slice from the first storage container to the second storage container based on storage capabilities of the first and second storage containers, wherein the slice is relocated from the first storage container to the second storage container upon determining that the current I/O load of the first storage container is greater than the desired I/O load for the first storage container and the current I/O load of the second storage container is less than the desired I/O load for the second storage container indicating that the first storage container is over-utilized and the second storage container is under-utilized, wherein the slice is relocated by using a temporary slice relocation list, wherein the temporary slice relocation list includes a set of slices identified for relocation and temporarily holds the set of slices prior to relocating the set of slices from a source storage container to a destination storage container, wherein the current I/O load of each storage container is managed by relocating slices among the set of storage containers in order for each storage container to achieve similar storage utilization, wherein storage utilization of each storage container of the set of storage containers is changed by relocation of the slices among the set of storage containers for balancing I/O load across the storage containers, wherein storage utilization of a storage container is determined based on total I/O load and storage capability of the storage container.

2. The method of claim 1, further comprising:

determining a storage utilization ratio of the storage tier, wherein the storage utilization ratio is derived using total I/O load of the storage tier and total storage capability of the storage tier.

3. The method of claim 1, further comprising:

tracking I/O activity for each storage container of the set of storage containers of the storage tier;

determining the desired I/O load for each storage container of the set of storage containers of the storage tier, wherein the desired I/O load of a storage container is derived using a storage utilization ratio of the storage tier and a storage capability of the storage container; and

selecting a slice for relocation from a first storage container of the set of storage containers to a second storage container of the set of storage containers based on I/O activities and desired I/O loads of the first and second storage containers.

4. The method of claim 1, wherein a storage container comprises a set of slices, each slice of the set of slices is a logical representation of a subset of physical disk storage.

5. The method of claim 1, wherein I/O load of a slice in a storage container of a storage tier is based on I/O activity of the slice, wherein I/O load of the slice is derived using total slice I/O counts as I/O activity.

6. The method of claim 1, wherein a storage container includes a disk drive system comprising a plurality of Redundant Array of Inexpensive Disks (RAID) systems, each RAID system of the plurality of RAID systems having a first disk drive and a second disk drive.

7. The method of claim 1, further comprising:

creating an object in memory of a data storage system for each storage container of the set of storage containers of the storage tier, wherein the object includes information regarding slices of the storage container.

8. The method of claim 1, further comprising:

creating a slice holder object for storing information regarding slices to be relocated from the first storage container of the storage tier to the second storage container of the storage tier.

9. The method of claim 1, further comprising:

a) comparing total I/O load of a storage container of the set of storage containers of the storage tier with a desired I/O load of the storage container;

b) determining, based on whether total I/O load of the storage container is greater than the desired I/O load of the storage container, whether to select a slice from the storage container for relocation; and

repeating steps a-b until each storage container of the set of storage containers of the storage tier are evaluated.

10. The method of claim 1, further comprising;

a) comparing total I/O load of a storage container of the set of storage containers of the storage tier with a desired I/O load of the storage container;

b) determining, based on whether total I/O load of the storage container is less than the desired I/O load of the storage container, whether to relocate a slice from a slice holder object to the storage container; and

repeating steps a-b until each storage container of the set of storage containers of the storage tier are evaluated.

11. A system for use in balancing I/O load on data storage systems, the system comprising a processor configured to:

determine storage capability of each storage container of a set of storage containers included in a storage tier, wherein the storage capability of a storage container indicates a maximum I/O load enabled for the storage container based on storage performance characteristics of the storage container, wherein the set of storage containers include first and second storage containers configured such that storage characteristics associated with the first storage container is different from storage characteristics associated with the second storage container, wherein each storage container includes a set of slices;

evaluate I/O load of each storage container of the set of storage containers, wherein evaluating the I/O load includes determining current I/O load and desired I/O load of each storage container, wherein the desired I/O load for a storage container is determined based on a storage utilization ratio of the storage tier and the storage capability of the storage container; and

based on the evaluation, relocate a slice from the first storage container to the second storage container based on storage capabilities of the first and second storage containers, wherein the slice is relocated from the first storage container to the second storage container upon determining that the current I/O load of the first storage container is greater than the desired I/O load for the first storage container and the current I/O load of the second storage container is less than the desired I/O load for the second storage container indicating that the first storage container is over-utilized and the second storage container is under-utilized, wherein the slice is relocated by using a temporary slice relocation list, wherein the temporary slice relocation list includes a set of slices identified for relocation and temporarily holds the set of slices prior to relocating the set of slices from a source storage container to a destination storage container, wherein the current I/O load of each storage container is managed by relocating slices among the set of storage containers in order for each storage container to achieve similar storage utilization, wherein storage utilization of each storage container of the set of storage containers is changed by relocation of the slices among the set of storage containers for balancing I/O load across the storage containers, wherein storage utilization of a storage container is determined based on total I/O load and storage capability of the storage container.

12. The system of claim 11, further comprising:

determine a storage utilization ratio of the storage tier, wherein the storage utilization ratio is derived using total I/O load of the storage tier and total storage capability of the storage tier.

13. The system of claim 11, further comprising:

track I/O activity for each storage container of the set of storage containers of the storage tier;

determine the desired I/O load for each storage container of the set of storage containers of the storage tier, wherein the desired I/O load of a storage container is derived using a storage utilization ratio of the storage tier and a storage capability of the storage container; and

select a slice for relocation from a first storage container of the set of storage containers to a second storage container of the set of storage containers based on I/O activities and desired I/O loads of the first and second storage containers.

14. The system of claim 11, wherein a storage container comprises a set of slices, each slice of the set of slices is a logical representation of a subset of physical disk storage.

15. The system of claim 11, wherein I/O load of a slice in a storage container of a storage tier is based on I/O activity of the slice, wherein I/O load of the slice is derived using total slice I/O counts as I/O activity.

16. The system of claim 11, wherein a storage container includes a disk drive system comprising a plurality of Redundant Array of Inexpensive Disks (RAID) systems, each RAID system of the plurality of RAID systems having a first disk drive and a second disk drive.

17. The system of claim 11, further comprising:

create an object in memory of a data storage system for each storage container of the set of storage containers of the storage tier, wherein the object includes information regarding slices of the storage container.

18. The system of claim 11, further comprising:

create a slice holder object for storing information regarding slices to be relocated from the first storage container of the storage tier to the second storage container of the storage tier.

19. The system of claim 11, further comprising:

a) compare total I/O load of a storage container of the set of storage containers of the storage tier with a desired I/O load of the storage container;

b) determine, based on whether total I/O load of the storage container is greater than the desired I/O load of the storage container, whether to select a slice from the storage container for relocation; and

repeating a) and b) until each storage container of the set of storage containers of the storage tier are evaluated.

20. The system of claim 11, further comprising;

a) compare total I/O load of a storage container of the set of storage containers of the storage tier with a desired I/O load of the storage container;

b) determine, based on whether total I/O load of the storage container is less than the desired I/O load of the storage container, whether to relocate a slice from a slice holder object to the storage container; and

repeating a) and b) until each storage container of the set of storage containers of the storage tier are evaluated.