Migration and transformation of data storage in a replicated environment

• US 10,318,191 B1
• Filed: 07/18/2017
• Issued: 06/11/2019
• Est. Priority Date: 07/18/2017
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Danilov, Mikhail, O'Connell, Mark A.
• Primary Examiner(s): Giardino, Jr., Mark A
• Application Number:
  US15/653,052
• Time in Patent Office: 693 Days
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Facilitating parallel migration and transformation of data storage in a replicated environment is provided herein. A method can comprise determining, by a system comprising a processor, that first data of a first storage device and second data of a second storage device are scheduled to be migrated to a third storage device and a fourth storage device in a replicated storage environment. The method can also comprise mapping, by the system, the third storage device to the first storage device, and the fourth storage device to the second storage device. Further, the method can comprise facilitating, by the system, a parallel migration/transformation of the first data to the third storage device and the second data to the fourth storage device.

Claims

1. A method, comprising:

determining, by a system comprising a processor, that first data of a first storage device and second data of a second storage device are scheduled to be migrated to a third storage device and a fourth storage device in a replicated storage environment;

mapping, by the system, the third storage device to the first storage device, and the fourth storage device to the second storage device;

facilitating, by the system, a parallel migration of the first data to the third storage device and the second data to the fourth storage device;

receiving, by the system, a data structure comprising an identification of one or more objects stored in the first storage device and the second storage device; and

synchronizing, by the system, a storage of the one or more objects between the third storage device and the fourth storage device based on a first enumeration of the first data and a second enumeration of the second data.

2. The method of claim 1, further comprising:

during the parallel migration, facilitating, by the system, reading of the first data from the first storage device in response to a request for the first data, wherein the reading the first data comprises reading the first data via the third storage device.

3. The method of claim 2, further comprising:

during the parallel migration, facilitating, by the system, reading of the second data from the second storage device in response to another request for the second data, wherein the reading the second data comprises reading the second data via the fourth storage device.

4. The method of claim 1, further comprising:

receiving, by the system, a first write request from a first client device; and

instructing, by the system, the first write request to be processed by the third storage device, wherein the first write request is for data not previously received, and wherein the first storage device is not accessed during a time period when the first write request is being processed.

5. The method of claim 1, further comprising:

receiving, by the system, a first read request from a first client device; and

instructing, by the system, the first read request to be processed by the third storage device, wherein the first read request is for reading of new data, and wherein the first storage device is not accessed during a time period when the first read request is being processed.

6. The method of claim 1, further comprising:

synchronizing, by the system, the parallel migration of the first data and the second data between the third storage device and the fourth storage device.

7. The method of claim 1, wherein the first data comprises a first object and the second data comprises a second object, and wherein the method further comprises:

determining, by the system, a first primary location for the first object based on an application of a hash function to a first identification of the first object, wherein the first primary location is selected from the third storage device and the fourth storage device; and

determining, by the system, a second primary location for the second object based on another application of the hash function to a second identification of the second object, wherein the second primary location is selected from the third storage device and the fourth storage device.

8. The method of claim 1, further comprising:

facilitating, by the system, the first enumeration of the first data at the third storage device and the second enumeration of the second data at the fourth storage device.

9. The method of claim 1, further comprising:

facilitating, by the system, a first replication of the first data and the second data between the first storage device and the second storage device; and

facilitating, by the system, a second replication of the first data and the second data between the third storage device and the fourth storage device.

10. The method of claim 1, wherein the replicated storage environment is an environment where two or more storage devices are connected with replication.

11. The method of claim 1, further comprising:

facilitating, by the system, at least one failover mechanism for a read request from a first requesting device.

12. The method of claim 11, further comprising:

in response to a determination that data responsive to the read request is not included in the third storage device, accessing, by the system, the data at the fourth storage device; and

in response to another determination that the data responsive to the read request is not included in the fourth storage device, accessing, by the system, the data at the second storage device.

13. The method of claim 11, further comprising:

in response to a determination that data responsive to the read request is not included in the fourth storage device, accessing, by the system, the data at the third storage device; and

in response to another determination that the data responsive to the read request is not included in the third storage device, accessing, by the system, the data at the first storage device.

14. A system, comprising:

a processor; and

a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising;

initiating a transformation of first data from a first group of data storage devices to a second group of data storage devices and second data from a third group of data storage devices to a fourth group of data storage devices, wherein a first data replication is established between first data storage devices in the first group of data storage devices and second data storage devices in the second group of data storage devices, and wherein a second data replication is established between third data storage devices in the third group of data storage devices and fourth data storage devices in the fourth group of data storage devices;

mapping the first data storage devices in the first group of data storage devices to the second data storage devices in the second group of data storage devices, and the third data storage devices in the third group of data storage devices to the fourth data storage devices in the fourth group of data storage devices; and

facilitating a parallel transformation of the first data from the first group of data storage devices to the second group of data storage devices, and the second data from the third group of data storage devices to the fourth group of data storage devices;

receiving a data structure comprising an identification of one or more objects stored in the first data storage devices and the third data storage devices; and

synchronizing a storage of the one or more objects between the second data storage devices and the fourth data storage devices based on a first enumeration of the first data and a second enumeration of the second data.

15. The system of claim 14, wherein the operations further comprise:

during the facilitating the parallel transformation of the first data, responding to read requests and write requests by the first group of data storage devices for data previously stored by the first group of data storage devices.

16. The system of claim 15, wherein the operations further comprise:

responding to read requests and write requests by the second group of data storage devices for data not previously stored by the first group of data storage devices.

17. A computer-readable storage medium comprising instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:

mapping a first device to a second device based on a first determination that first data contained in the first device is to be migrated to the second device;

mapping a third device to a fourth device based on a second determination that second data contained in the third device is to be migrated to the fourth device;

facilitating a first migration of the first data from the first device to the second device; and

facilitating a second migration of the second data from the third device to the fourth device, wherein the first migration and the second migration are performed concurrently;

receiving a data structure comprising an identification of one or more objects stored in the first device and the third device; and

synchronizing a storage of the one or more objects between the second device and the fourth device based on a first enumeration of the first data and a second enumeration of the second data.

18. The computer-readable storage medium of claim 17, wherein the operations further comprise:

during the first migration and the second migration, facilitating reading of the first data from the first device in response to a request for the first data, and wherein the reading the first data comprises reading the first data via the second device.

19. The computer-readable storage medium of claim 17, wherein the operations further comprise:

receiving a read request or a write request for data not retained by the first device and the third device; and

utilizing the second device or the fourth device to respond to the read request or the write request.

20. The computer-readable storage medium of claim 17, wherein the first data comprises a first object and the second data comprises a second object, and wherein the operations further comprise:

determining a first primary location for the first object based on a first application of a hash function to a first identification of the first object, wherein the first primary location is selected from the second device and the fourth device; and

determining, by the system, a second primary location for the second object based on a second application of the hash function to a second identification of the second object, wherein the second primary location is selected from the second device and the fourth device.