Transparently migrating a storage object between nodes in a clustered storage system

• US 9,846,734 B2
• Filed: 09/22/2015
• Issued: 12/19/2017
• Est. Priority Date: 11/25/2009
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Dhavale, Poonam, Coatney, Susan M., Watanabe, Steven S.
• Primary Examiner(s): Lu, Kuen S
• Application Number:
  US14/861,699
• Publication Number:
  US 20160012117A1
• Time in Patent Office: 819 Days
• CPC Class Codes: G06F 11/2005 using redundant communication controllers
• CPC Class Codes: G06F 11/2033 switching over of hardware resources
• CPC Class Codes: G06F 11/2046 where the redundant components share persistent storage G06F11/2043 takes precedence
• CPC Class Codes: G06F 11/2092 Techniques of failing over between control units
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/289 Object oriented databases
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 7/00 Methods or arrangements for processing data by operating upon the order or content of the data handled logic circuits H03K19/00

Abstract

A storage object is migrated between nodes by a source node automatically verifying that another node is configured to service the storage object and changing ownership of the storage object based on the verifying. A cluster manager for the clustered storage system receives a request and provides the request to the source which owns the storage object. The source verifies that the destination is configured according to a predetermined configuration for servicing the storage object. Based on the verifying, the source offlines the storage object and updates ownership information of the storage object, thereafter allowing the destination to online the storage object. The cluster manager further provides the updated ownership information to all the nodes in the cluster, so an access request intended for the storage object may be received by any node and forwarded to the destination using the updated ownership information to effect a transparent migration.

Claims

1. A method comprising:

receiving, by a computing device, a request to migrate servicing for a logical organization of a plurality of storage objects to a destination storage server;

querying, by the computing device, the destination storage server to identify one or more operating characteristics of the destination storage server prior to migrating servicing of logical organization of the plurality of storage objects, wherein the one or more operating characteristics is associated with one or more configurations of the destination storage server;

verifying, by the computing device, when the one or more operating characteristics satisfy one or more conditions required to migrate the logical organization of the plurality of storage objects to the destination storage server;

determining, by the computing device, when the destination storage server is capable to migrate the logical organization of the plurality of storage objects, when the verifying indicates that the one or more operating characteristics satisfy the one or more conditions required to migrate the logical organization; and

halting, by the computing device, any process associated with the logical organization of the plurality of storage objects and modifying ownership metadata for the logical organization to indicate ownership of the logical organization by the destination storage server, when the determination indicates that the destination storage server is capable to migrate the logical organization.

2. The method of claim 1 further comprising receiving, by the computing device, the request to migrate servicing for the logical organization from a cluster manager device.

3. The method of claim 1 further comprising determining, by the computing device, when one or more specified operations are not being performed on the logical organization prior to halting the migrate servicing for the logical organization, wherein the specified operations comprise a fault tolerance operation, a maintenance operation, or an access request servicing operation.

4. The method of claim 1, further comprising:

starting, by the computing device, any halted processes associated with the logical organization of the plurality of storage objects at the destination storage server upon determining the ownership metadata for the logical organization indicates ownership of the logical organization by the destination storage server.

5. The method of claim 1, wherein the one or more operating characteristics of the destination storage server comprises an operating mode of the destination storage server, a storage limit of the destination storage server, or a software version of the another computing device and wherein the one or more conditions required to migrate the logical organization of the plurality of storage objects to the destination storage server comprises operating with a particular operating system version.

6. The method of claim 1, further comprising communicating, by the computing device, to a cluster manager device, that the migrate servicing for the logical organization has changed to the destination storage server, when the determining indicates that the destination storage server is capable of servicing the storage requests that target the logical organization.

7. A non-transitory machine readable medium having stored thereon instructions for performing a method comprising machine executable code which when executed by at least one machine, causes the machine to:

receive a request to migrate servicing for a logical organization of a plurality of storage objects to a destination storage server;

query the destination storage server to identify one or more operating characteristics of the destination storage server prior to migrating servicing of logical organization of the plurality of storage objects, wherein the one or more operating characteristics is associated-with one or more configurations of the destination storage server;

verify when the one or more operating characteristics satisfy one or more conditions required to migrate the logical organization of the plurality of storage objects to the destination storage server;

determine of when the destination storage server is capable to migrate the logical organization of the plurality of storage objects, when the verifying indicates that the one or more operating characteristics satisfy the one or more conditions required to migrate the logical organization; and

halt any process associated with the logical organization of the plurality of storage objects and modifying ownership metadata for the logical organization to indicate ownership of the logical organization by the destination storage server, when the determination indicates that the destination storage server is capable to migrate the logical organization.

8. The non-transitory machine readable medium of claim 7, wherein the machine executable code when executed by the machine further causes the machine to receive the request to migrate servicing for the logical organization from a cluster manager device.

9. The non-transitory machine readable medium of claim 7, wherein the machine executable code when executed by the machine further causes the machine to determine when one or more specified operations are not being performed on the logical organization prior to halting the migrate servicing for the logical organization, wherein the specified operations comprise a fault tolerance operation, a maintenance operation, or an access request servicing operation.

10. The non-transitory machine readable medium of claim 7, wherein the machine executable code when executed by the machine further causes the machine to:

start any halted processes associated with the logical organization of the plurality of storage objects at the destination storage server upon determining the ownership metadata for the logical organization indicates ownership of the logical organization by the destination storage server.

11. The non-transitory machine readable medium of claim 7, wherein the one or more operating characteristics of the destination storage server comprises an operating mode of the destination storage server, a storage limit of the destination storage server, or a software version of the another computing device and wherein the one or more conditions required to migrate the logical organization of the plurality of storage objects to the destination storage server comprises operating with a particular operating system version.

12. The non-transitory machine readable medium of claim 7, wherein the machine executable code when executed by the machine further causes the machine to communicate, to a cluster manager device, that the migrate servicing for the logical organization has changed to the destination storage server, when the determining indicates that the destination storage server is capable of servicing the storage requests that target the logical organization.

13. A computing device comprising:

a memory containing machine readable medium comprising machine executable code having stored thereon instructions for performing a method of migrating storage objects in a clustered storage system; and

a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to;

receive a request to migrate servicing for a logical organization of a plurality of storage objects to a destination storage server;

query the destination storage server to identify one or more operating characteristics of the destination storage server prior to migrating servicing of logical organization of the plurality of storage objects, wherein the one or more operating characteristics is associated-with one or more configurations of the destination storage server;

verify when the one or more operating characteristics satisfy one or more conditions required to migrate the logical organization of the plurality of storage objects to the destination storage server;

determine when the destination storage server is capable to migrate the logical organization of the plurality of storage objects, when the verifying indicates that the one or more operating characteristics satisfy the one or more conditions required to migrate the logical organization; and

halt any process associated with the logical organization of the plurality of storage objects and modifying ownership metadata for the logical organization to indicate ownership of the logical organization by the destination storage server, when the determination indicates that the destination storage server is capable to migrate the logical organization.

14. The computing device of claim 13, wherein the processor is further configured to execute the machine executable code to further cause the processor to receive the request to migrate servicing for the logical organization from a cluster manager device.

15. The computing device of claim 13, wherein the processor is further configured to execute the machine executable code to further cause the processor to determine when one or more specified operations are not being performed on the logical organization prior to halting the migrate servicing for the logical organization, wherein the specified operations comprise a fault tolerance operation, a maintenance operation, or an access request servicing operation.

16. The computing device of claim 13, wherein the processor is further configured to execute the machine executable code to further cause the processor to:

start any halted processes associated with the logical organization of the plurality of storage objects at the destination storage server upon determining the ownership metadata for the logical organization indicates ownership of the logical organization by the destination storage server.

17. The computing device of claim 13, wherein the one or more operating characteristics of the destination storage server comprises an operating mode of the destination storage server, a storage limit of the destination storage server, or a software version of the another computing device and wherein the one or more conditions required to migrate the logical organization of the plurality of storage objects to the destination storage server comprises operating with a particular operating system version.

18. The computing device of claim 13, wherein the processor is further configured to execute the machine executable code to further cause the processor to communicate, to a cluster manager device, that the migrate servicing for the logical organization has changed to the destination storage server, when the determining indicates that the destination storage server is capable of servicing the storage requests that target the logical organization.