System iteratively reducing I/O requests during migration of virtual storage system

• US 9,083,724 B2
• Filed: 05/30/2013
• Issued: 07/14/2015
• Est. Priority Date: 05/30/2013
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Karnawat, Rakshit, Sridhara, Harsha, Ramani, Balaji
• Primary Examiner(s): Luu, Le H
• Application Number:
  US13/905,920
• Publication Number:
  US 20140359058A1
• Time in Patent Office: 775 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/13 in a LAN segment, e.g. ring or bus
• CPC Class Codes: H04L 47/225 Determination of shaping rate, e.g. using a moving window
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Method and system for a non-disruptive migration of a source virtual storage system from a source cluster to a destination cluster is provided. The method includes monitoring a current transfer rate for migrating information from the source cluster to the destination cluster during a migration operation; iteratively reducing a rate at which I/O requests are processed until a transfer rate for transferring the information from the source cluster to the destination cluster within the duration is reached; and entering a cutover phase for the migration operation when the virtual storage system presented by the source cluster is taken offline for the duration and after the information is migrated to the destination cluster, the virtual storage system is presented by the destination cluster.

Claims

1. A machine implemented method for a non-disruptive migration of a source virtual storage system from a source cluster to a destination cluster, the source cluster and the destination cluster having a plurality of nodes executing instructions for a storage operating system, comprising:

monitoring a current transfer rate for migrating information from the source cluster to the destination cluster during a migration operation;

iteratively reducing a rate at which I/O requests are processed until a transfer rate for transferring the information from the source cluster to the destination cluster within the duration is reached; and

entering a cutover phase for the migration operation when the virtual storage system presented by the source cluster is taken offline for the duration and after the information is migrated to the destination cluster, the virtual storage system is presented by the destination cluster.

2. The method of claim 1, wherein the migration operation begins after a setup phase when a destination virtual storage system is created to mirror the virtual storage system presented by the source cluster.

3. The method of claim 1, wherein to initiate the migration operation, a point in time copy of storage volumes managed by the virtual storage system is first taken as a baseline image and transferred to the destination cluster.

4. The method of claim 3, wherein any changes after the baseline image are incrementally replicated at the destination cluster during an update phase, while a client system continues to use the virtual storage system via the source cluster.

5. The method of claim 1, wherein a timer is used to monitor if the cutover phase can be completed within the duration, before providing access to the virtual storage system via the destination cluster.

6. The method of claim 1, wherein a state machine monitors a plurality of phases for the migration operation and if the cutover phase cannot be completed within the duration, the migration operation is aborted.

7. The method of claim 1, wherein a state machine monitors a plurality of phases for the migration operation and if the cutover phase cannot be completed within the duration, then the migration operation reverts to an update phase where any changes since a baseline image of the source storage volumes is taken are incrementally replicated at the destination cluster.

8. The method of claim 1, wherein a master migration agent interfaces with a plurality of migration agents executed at a plurality of nodes for migrating information at source volumes managed by the plurality of nodes for the virtual storage system presented by the source cluster.

9. A machine implemented method for a non-disruptive migration operation for migrating a source virtual storage system from a source cluster to a destination cluster, the source cluster and the destination cluster having a plurality of nodes executing instructions for a storage operating system, comprising:

generating a destination virtual storage system during a setup phase of the migration operation such that storage space can be presented to a client after completing the migration operation;

generating a plurality of storage volumes at the destination cluster that are similar in size and attributes as a plurality of source storage volumes used by the virtual storage system presented by the source cluster to the client;

taking a baseline point in time copy of the plurality of source storage volumes and replicating the baseline point in time copy at the destination storage volumes during a baseline phase of the migration operation;

during an update phase, taking incremental point in time image of the plurality of source storage volumes for any changes after the baseline point in time copy was taken;

during an administrative cutover phase, monitoring a current transfer rate at which information from the source cluster is being migrated to the destination cluster;

iteratively reducing a rate at which I/O requests for a client are processed until a desired transfer rate for transferring information from the source cluster to the destination cluster within a duration is reached; and

executing a cutover phase when the virtual storage system presented by the source cluster is taken offline for the duration and after the information is migrated to the destination cluster, the destination virtual storage system with destination storage volumes is presented by the destination cluster to the client to read and write data.

10. The method of claim 9, wherein during the update phase, a client system continues to use the virtual storage system via the source cluster.

11. The method of claim 9, wherein a timer is used to monitor if the cutover phase can be completed within the duration, before providing access to the virtual storage system via the destination cluster.

12. The method of claim 9, wherein a state machine monitors a plurality of phases for the migration operation and if the cutover phase cannot be completed within the duration, the migration operation is aborted.

13. The method of claim 9, wherein a state machine monitors various phases of the migration operation and if the cutover phase cannot be completed within the duration, then the migration operation reverts to the update phase.

14. The method of claim 9, wherein a master migration agent interfaces with a plurality of migration agents executed at a plurality of nodes for migrating information at source volumes managed by the plurality of nodes for the virtual storage system presented by the source cluster.

15. A system for a non-disruptive migration operation, comprising:

a memory having machine readable medium comprising machine executable code having instructions stored thereon; and

a processor module coupled to the memory configured to execute the machine executable code to;

generate a destination virtual storage system during a setup phase of a migration operation such that storage space can be presented to a client after completing the migration operation;

generate a plurality of storage volumes at a destination cluster that are similar in size and attributes as a plurality of source storage volumes used by a virtual storage system presented by a source cluster to the client;

take a baseline point in time copy of the plurality of source storage volumes and replicating the baseline point in time copy at the destination storage volumes during a baseline phase of the migration operation;

during an update phase, take incremental point in time image of the plurality of source storage volumes for any changes after the baseline point in time copy was taken;

during an administrative cutover phase, monitor a current transfer rate at which information from the source cluster is being migrated to the destination cluster;

iteratively reduce a rate at which I/O requests for a client are processed until a desired transfer rate for transferring information from the source cluster to the destination cluster within a duration is reached; and

execute a cutover phase when the virtual storage system presented by the source cluster is taken offline for the duration and after the information is migrated to the destination cluster, the destination virtual storage system with destination storage volumes is presented by the destination cluster to the client to read and write data.

16. The system of claim 15, wherein during the update phase, a client system continues to use the virtual storage system via the source cluster.

17. The system of claim 15, wherein a timer is used to monitor if the cutover phase can be completed within the duration, before providing access to the virtual storage system via the destination cluster.

18. The system of claim 15, wherein a state machine monitors a plurality of phases for the migration operation and if the cutover phase cannot be completed within the duration, the migration operation is aborted.

19. The system of claim 15, wherein a state machine monitors various phases of the migration operation and if the cutover phase cannot be completed within the duration, then the migration operation reverts to the update phase.

20. The system of claim 15, wherein a master migration agent interfaces with a plurality of migration agents executed at a plurality of nodes for migrating information at source volumes managed by the plurality of nodes for the virtual storage system presented by the source cluster.

21. A non-transitory, machine readable storage medium having stored thereon instructions for performing a method for a non-disruptive migration operation, comprising machine executable code which when executed by at least one machine, causes the machine to:

generate a destination virtual storage system during a setup phase of the migration operation such that storage space can be presented to a client after completing the migration operation;

generate a plurality of storage volumes at a destination cluster that are similar in size and attributes as a plurality of source storage volumes used by a virtual storage system presented by a source cluster to the client;

take a baseline point in time copy of the plurality of source storage volumes and replicating the baseline point in time copy at the destination storage volumes during a baseline phase of the migration operation;

during an update phase, take incremental point in time image of the plurality of source storage volumes for any changes after the baseline point in time copy was taken;

during an administrative cutover phase, monitor a current transfer rate at which information from the source cluster is being migrated to the destination cluster;

iteratively reduce a rate at which I/O requests for a client are processed until a desired transfer rate for transferring information from the source cluster to the destination cluster within a duration is reached; and

execute a cutover phase when the virtual storage system presented by the source cluster is taken offline for the duration and after the information is migrated to the destination cluster, the destination virtual storage system with destination storage volumes is presented by the destination cluster to the client to read and write data.

22. The storage medium of claim 21, wherein a timer is used to monitor if the cutover phase can be completed within the duration, before providing access to the virtual storage system via the destination cluster.

23. The storage medium of claim 21, wherein a state machine monitors a plurality of phases for the migration operation and if the cutover phase cannot be completed within the duration, the migration operation is aborted or reverts to the update phase.

24. The storage medium of claim 21, wherein a master migration agent interfaces with a plurality of migration agents executed at a plurality of nodes for migrating information at source volumes managed by the plurality of nodes for the virtual storage system presented by the source cluster.