Distributed host copy migration in a cluster environment using changed block tracking

• US 10,838,648 B2
• Filed: 12/12/2018
• Issued: 11/17/2020
• Est. Priority Date: 12/12/2018
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Sharma, Shubham, Gokam, Kurumurthy, Kumar, Kundan
• Primary Examiner(s): Bragdon, Reginald G
• Assistant Examiner(s): Ho, Aaron D
• Application Number:
  US16/217,987
• Publication Number:
  US 20200192593A1
• Time in Patent Office: 706 Days
• Field of Search: 711154
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

An apparatus in one embodiment comprises a first host device comprising a processor coupled to a memory. The first host device is configured to assign to additional host devices different portions of a source logical unit designated for migration to a target logical unit. In conjunction with migration of the assigned portions of the source logical unit to the target logical unit by the additional host devices, the first host device is configured to receive from the additional host devices respective sets of information each characterizing one or more writes directed to the corresponding assigned portion during the migration. The first host device is further configured to update the target logical unit based at least in part on the received sets of information. In some embodiments, the first host device is configured to assign to itself a portion of the source logical unit designated for migration to the target logical unit.

Claims

1. An apparatus comprising:

a first host device comprising a processor coupled to a memory, the first host device being configured to communicate with a storage system over a network, the storage system comprising a plurality of storage devices, one or more of the storage devices comprising a source logical unit that is designated for migration to a target logical unit;

the first host device being configured;

to assign to additional host devices different portions of the source logical unit designated for migration to the target logical unit, each of the additional host devices being configured to migrate the corresponding assigned portion of the source logical unit to the target logical unit;

in conjunction with migration of the assigned portions of the source logical unit to the target logical unit by the corresponding additional host devices, to receive from the additional host devices respective sets of information each characterizing one or more writes directed to their corresponding assigned portions of the source logical unit during the migration of their corresponding assigned portions of the source logical unit to the target logical unit; and

to update the target logical unit based at least in part on the received sets of information.

2. The apparatus of claim 1 wherein the portions assigned to each of the additional host devices are equal in size.

3. The apparatus of claim 1 wherein the first host device is configured to assign to itself a portion of the source logical unit designated for migration to the target logical unit.

4. The apparatus of claim 1 wherein the portions are determined based at least in part on a storage capacity of the source logical unit.

5. The apparatus of claim 1 wherein the first host device is configured to determine a number of host devices that are associated with the source logical unit, and wherein the portions are determined based at least in part on the determined number of host devices.

6. The apparatus of claim 1 wherein the sets of information each characterizing one or more writes directed to the corresponding assigned portion during the migration are generated by the additional host devices based at least in part on changed block tracking in which the additional host devices track writes directed to the corresponding assigned portions of the source logical unit during the migration.

7. The apparatus of claim 1 wherein the first host device is further configured, in conjunction with updating the target logical unit based at least in part on the received sets of information, to generate one or more additional sets of information characterizing one or more new writes directed to the source logical unit.

8. The apparatus of claim 7 wherein the first host device is further configured to iteratively:

update the target logical unit based at least in part on the one or more additional sets of information characterizing the one or more new writes; and

in conjunction with updating the target logical unit based at least in part on the one or more additional sets of information characterizing the one or more new writes, to generate one or more additional sets of information characterizing one or more new writes directed to the source logical unit.

9. The apparatus of claim 8 wherein the first host device is configured to iterate the updating of the target logical unit based at least in part on the one or more additional sets of information and the generating of one or more additional sets of information until a predetermined condition is met.

10. The apparatus of claim 9 wherein responsive to the predetermined condition being met, the first host device is further configured to cause a suspension of input-output operations, to complete updating of the target logical unit based at least in part on any of the remaining one or more additional sets of information, to cause a re-direction of new input-output operations from the source logical unit to the target logical unit, and to cause a resumption of input-output operations.

11. A method comprising:

assigning, by a first host device that is configured to communicate with a storage system over a network, the storage system comprising a plurality of storage devices, one or more of the storage devices comprising a source logical unit that is designated for migration to a target logical unit, to additional host devices different portions of the source logical unit designated for migration to the target logical unit, each of the additional host devices being configured to migrate the corresponding assigned portion of the source logical unit to the target logical unit;

in conjunction with migration of the assigned portions of the source logical unit to the target logical unit by the corresponding additional host devices, receiving, by the first host device, from the additional host devices respective sets of information each characterizing one or more writes directed to their corresponding assigned portions of the source logical unit during the migration of their corresponding assigned portions of the source logical unit to the target logical unit; and

updating the target logical unit based at least in part on the received sets of information;

wherein the first host device comprises a processor coupled to a memory.

12. The method of claim 11 further comprising determining, by the first host device, a storage capacity of the source logical unit, wherein the portions are determined based at least in part on the determined storage capacity of the source logical unit.

13. The method of claim 11 further comprising determining, by the first host device, a number of host devices that are associated with the source logical unit, wherein the portions are determined based at least in part on the determined number of host devices.

14. The method of claim 11 wherein the sets of information each characterizing one or more writes directed to the corresponding assigned portion during the migration are generated by the additional host devices based at least in part on changed block tracking in which the additional host devices track writes directed to the corresponding assigned portions of the source logical unit during the migration.

15. The method of claim 11 further comprising generating, by the first host device, in conjunction with updating the target logical unit based at least in part on the received sets of information, one or more additional sets of information characterizing one or more new writes directed to the source logical unit.

16. The method of claim 15 further comprising iteratively, by the first host device:

updating the target logical unit based at least in part on the one or more additional sets of information characterizing the one or more new writes; and

in conjunction with updating the target logical unit based at least in part on the one or more additional sets of information characterizing the one or more new writes, generating one or more additional sets of information characterizing one or more new writes directed to the source logical unit.

17. The method of claim 16 further comprising, by the first host device:

iterating the updating of the target logical unit based at least in part on the one or more additional sets of information and the generating of one or more additional sets of information until a predetermined condition is met; and

responsive to the predetermined condition being met, causing a suspension of input-output operations, completing updating of the target logical unit based at least in part on any of the remaining one or more additional sets of information, causing a re-direction of new input-output operations from the source logical unit to the target logical unit, and causing a resumption of input-output operations.

18. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code, when executed by a first host device comprising a processor coupled to a memory, the first host device being configured to communicate with a storage system over a network, the storage system comprising a plurality of storage devices, one or more of the storage devices comprising a source logical unit that is designated for migration to a target logical unit, causes the first host device:

to assign to additional host devices different portions of the source logical unit designated for migration to the target logical unit, each of the additional host devices being configured to migrate the corresponding assigned portion of the source logical unit to the target logical unit;

in conjunction with migration of the assigned portions of the source logical unit to the target logical unit by the corresponding additional host devices, to receive from the additional host devices respective sets of information each characterizing one or more writes directed to their corresponding assigned portions of the source logical unit during the migration of their corresponding assigned portions of the source logical unit to the target logical unit; and

to update the target logical unit based at least in part on the received sets of information.

19. The computer program product of claim 18 wherein the first host device is configured to determine a number of host devices that are associated with the source logical unit, and wherein the portions are determined based at least in part on the determined number of host devices.

20. The computer program product of claim 18 wherein the sets of information each characterizing one or more writes directed to the corresponding assigned portion during the migration are generated by the additional host devices based at least in part on changed block tracking in which the additional host devices track writes directed to the corresponding assigned portions of the source logical unit during the migration.