Method and system for using host driver for flexible allocation fast-sideways data movements

• US 10,235,053 B1
• Filed: 03/31/2014
• Issued: 03/19/2019
• Est. Priority Date: 03/31/2014
• Status: Active Grant

• Current Assignee: EMC Corporation (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Derbeko, Philip, Marshak, Marik, Veprinsky, Alexandr, Benhanokh, Zvi Gabriel, Don, Arieh
• Primary Examiner(s): Rones, Charles
• Assistant Examiner(s): Li, Hewy H
• Application Number:
  US14/231,159
• Time in Patent Office: 1,814 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

Example embodiments of the present invention relate to a method, an apparatus, and a computer program product for directing I/Os for a chunk of data to a data storage system on which the chunk of data is stored. The host method includes receiving an I/O for a chunk of data, identifying to which data storage system the I/O should be sent to access the chunk of data, and sending the I/O for the chunk of data to the identified data storage system. Other example embodiments of the present invention relate to a method, an apparatus, and a computer program product for handling received I/Os during a migration of the chunk of data. The data storage system method includes migrating the chunk of data, queuing an I/O for the chunk of data received from a host during the migration, and rejecting the queued I/O as a result of the migration.

Claims

1. A method for servicing I/O requests in a distributed system including a host system, a first data storage system, and a second data storage system, the method comprising:

receiving an I/O request associated with a chunk of data that is at least in part stored in the first data storage system, the I/O request being received at the first data storage system from the host system;

detecting whether a migration of the chunk of data from the first data storage system to the second data storage system is currently in progress;

when the migration is not currently in progress;

fulfilling the I/O request; and

when the migration is currently in progress;

(i) adding the I/O request to a queue and keeping the I/O request in the queue while the migration remains in progress, and (ii) releasing the I/O request from the queue and rejecting the I/O request after the migration is completed and an acknowledgement is transmitted to the host system indicating that the migration is completed

wherein the detecting of whether the migration of the chunk of data from the first data storage system to the second data storage system is currently in progress is performed by the first data storage system based on a moving map that is stored on the host system, the moving map including an indication of whether the chunk of data is being migrated.

2. The method of claim 1, wherein the first data storage system and the second data storage system, in combination, provide a virtual storage unit on which the chunk of data is stored, wherein the virtual storage unit is accessible by the host system.

3. The method of claim 1, further comprising migrating the chunk of data from the first data storage system to the second data storage system, wherein migrating the chunk of data comprises:

receiving, at the first data storage system, a command to migrate the chunk of data to the second data storage system; and

transmitting the chunk of data from the first data storage system to the second data storage system.

4. The method of claim 1, further comprising, after the migration is completed, transmitting the acknowledgement to the host system indicating that the migration of the chunk of data from the first data storage system to the second data storage system is completed.

5. The method of claim 1, wherein the first data storage system has a first latency and the second data storage system has a second latency.

6. A data storage system comprising:

one or more processors; and

a computer readable storage medium having processor-executable code stored thereon, which when executed by the one or more processors, causes the data storage system to perform a method comprising;

receiving, from a host system, an I/O request associated with a chunk of data that is at least in part stored in the data storage system;

detecting whether a migration of the chunk of data to another data storage system is currently in progress;

when the migration is not currently in progress;

fulfilling the I/O request; and

when the migration is currently in progress;

(i) adding the I/O request to a queue and keeping the I/O request in the queue while the migration remains in progress, and (ii) releasing the I/O request from the queue and rejecting the I/O request after the migration is completed and an acknowledgement is transmitted to the host system indicating that the migration is completed,

wherein the detecting whether the migration is in progress is performed by based on a moving map that is stored on the host system, the moving map including an indication of whether the chunk of data is being migrated.

7. The data storage system claim 6, wherein the data storage system and the other data storage system provide a virtual storage unit on which the chunk of data is stored and wherein the virtual storage unit is accessible by the host system.

8. The data storage system of claim 6, wherein the method further comprises migrating the chunk of data to the other data storage system, the migrating comprising receiving a command to migrate the chunk of data to the other storage system, and transmitting the chunk of data to the other data storage system.

14. The data storage system of claim 6, wherein the method further comprises, after the migration is completed transmitting the acknowledgement to the host system indicating that the migration of the chunk of data is completed.

15. The data storage system of claim 6, wherein the data storage system has a first latency and the other data storage system has a second latency.

9. A non-transitory computer readable storage medium having computer program code encoded thereon, the computer program code comprising:

computer program code for receiving an I/O request associated with a chunk of data that is at least in part stored on a first data storage system, the I/O request being received at the first data storage system from a host system;

computer program code for detecting whether a migration of the chunk of data from the first data storage system to a second data storage system is currently in progress;

computer program code for fulfilling the I/O request when the migration is not currently in progress; and

computer program code for;

(i) adding the I/O request to a queue when the migration is currently in progress and keeping the I/O request in the queue while the migration remains in progress, and (ii) releasing the I/O request from the queue and rejecting the I/O request after the migration of the chunk of data is completed and an acknowledgement is transmitted to the host system indicating that the migration is completed

wherein the detecting of whether the migration of the chunk of data from the first data storage system to the second data storage system is currently in progress is performed by the first data storage system based on a moving map that is stored on the host system, the moving map including an indication of whether the chunk of data is being migrated.

10. The non-transitory computer readable storage medium of claim 9, wherein the first data storage system and the second data storage system, in combination, provide a virtual storage unit on which the chunk of data is stored, wherein the virtual storage unit is accessible by the host system.

11. The non-transitory computer readable storage medium of claim 9, wherein:

the computer program code further comprises computer program code for migrating the chunk of data from the first data storage system to the second data storage system, and

migrating the chunk of data comprises;

receiving, at the first data storage system, a command to migrate the chunk of data to the second data storage system, and transmitting the chunk of data from the first data storage system to the second data storage system.

12. The non-transitory computer readable storage medium of claim 9, wherein the computer program code further comprises computer program code for transmitting the acknowledgement to the host system indicating that the migration of the chunk of data from the first data storage system to the second data storage system is completed, the acknowledgement being transmitted after the migration is completed.

13. The non-transitory computer readable storage medium of claim 9, wherein the first data storage system has a first latency and the second data storage system has a second latency.