Adaptive data migration

• US 10,776,034 B2
• Filed: 01/31/2019
• Issued: 09/15/2020
• Est. Priority Date: 07/26/2016
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Feigin, Boris, Kleinerman, Andrew, Tumanova, Svitlana, Vohra, Taher, Wang, Xiaohui
• Primary Examiner(s): Chan, Tracy C.
• Application Number:
  US16/264,459
• Publication Number:
  US 20190171388A1
• Time in Patent Office: 593 Days
• Field of Search: None
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 12/0253 Garbage collection, i.e. reclamation of unreferenced memory
• CPC Class Codes: G06F 2212/7205 Cleaning, compaction, garbage collection, erase control
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays

Abstract

A method for migration of data is provided. The method includes triggering a rebuild of data according to a first migration mechanism from a first storage drive to a second storage drive. Monitoring space utilization associated with the second storage drive, and adaptively switching the migration of the data from the first migration mechanism to a second migration mechanism based on the monitoring.

Claims

1. A method, comprising:

switching, in an dynamic manner, between a first migration mechanism and a second migration mechanism, the first migration mechanism comprises migrating first data with segments of the first data being unchanged during the data migration, and the second migration mechanism comprises revising segments of second data during the data migration.

2. The method of claim 1, further comprising:

determining an amount of storage memory space that is used or available in a plurality of portions of storage memory of a storage system, relative to a threshold value, the determining comprising;

comparing a value associated with an imbalance of one or more of the portions of storage memory with the threshold value;

adjusting relative utilization of the first migration mechanism and the second migration mechanism based on the comparing.

3. The method of claim 2, wherein each of the plurality of portions of storage memory comprises a write group.

4. The method of claim 2, wherein each of the plurality of portions of storage memory comprises a solid state drive (SSD).

5. The method of claim 1, wherein the revising includes deduplicating the segments of the second data.

6. The method of claim 1, wherein the first mechanism is a RAID (redundant array of independent disks) rebuild and the second mechanism is a garbage collection operation.

7. The method of claim 1, further comprising:

determining an amount of compatible write groups and an amount of incompatible write groups, wherein the switching is based on the determining.

8. The method of claim 1, further comprising:

adjusting a percentage of moves of the second migration based on a relative amount of fullness of compatible write groups with fullness of incompatible write groups.

9. A tangible, non-transitory, computer-readable media having instructions thereupon which, when executed by a processor, cause the processor to perform a method comprising:

switching, in an dynamic manner, between a first migration mechanism and a second migration mechanism, the first migration mechanism comprises;

migrating first data with segments of the first data being unchanged during the data migration, and the second migration mechanism comprises;

revising segments of second data during the data migration.

10. The tangible, non-transitory, computer-readable media of claim 9, wherein the method further comprises:

determining an amount of storage memory space that is used or available in a plurality of portions of storage memory of a storage system, relative to a threshold value, the determining comprising;

comparing a value associated with an imbalance of one or more of the portions of storage memory with the threshold value;

adjusting relative utilization of the first migration mechanism and the second migration mechanism based on the comparing.

11. The tangible, non-transitory, computer-readable media of claim 10, wherein each of the plurality of portions of storage memory comprises a write group.

12. The tangible, non-transitory, computer-readable media of claim 10, wherein each of the plurality of portions of storage memory comprises a solid state drive.

13. The tangible, non-transitory, computer-readable media of claim 9, wherein the revising includes deduplicating the segments of the second data.

14. The tangible, non-transitory, computer-readable media of claim 9, wherein the first mechanism is a RAID (redundant array of independent disks) rebuild and the second mechanism is a garbage collection operation.

15. A storage system, comprising:

storage memory;

one or more processors;

a space monitor, implemented in hardware, firmware or software executing on the one or more processors, the space monitor configurable to track storage memory space used for writing in a plurality of portions of the storage memory; and

a migration module, implemented in hardware, firmware or software executing on the one or more processors, the migration module configurable to perform a rebuild, an evacuation, or a targeted remap, using data migration switching between migrating live data and dead data and migrating only live data in a dynamic manner based on an amount of compatible write groups and an amount of incompatible write groups.

16. The storage system of claim 15, further comprising:

the one or more processors including at least two processors arranged as a high-availability controller; and

each of the plurality of portions of the storage memory including a write group that has a specified level of redundancy or error correction for data and acts as a failure domain.

17. The storage system of claim 15, further comprising:

a plurality of blades each having a node and having solid-state memory as one of the plurality of portions of the storage memory, with multiple nodes coupled together as a storage cluster.

18. The storage system of claim 15, wherein:

each of the plurality of portions of storage memory comprises a solid-state drive or solid-state storage, and wherein an amount of compatible write groups and an amount of incompatible write groups indicates an amount of imbalance across solid-state drives or solid-state storages.

19. The storage system of claim 15, wherein the migrating the live data and the dead data is a RAID (redundant array of independent disks) rebuild and the migrating the live data only is a garbage collection data move.

20. The storage system of claim 15, wherein the migration module adjusts a percentage of moves for migrating only live data based on a relative amount of fullness of compatible write groups with fullness of incompatible write groups.