System and method for migrating data from a source file system to a destination file system with use of attribute manipulation

• US 9,311,314 B2
• Filed: 08/27/2013
• Issued: 04/12/2016
• Est. Priority Date: 08/27/2013
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Beard, Derek, Althaus, Gregory, Hsiao, Duen-Wen, Preston, Jason, Fleury, Damon
• Primary Examiner(s): Ly, Anh
• Application Number:
  US14/011,719
• Publication Number:
  US 20150066847A1
• Time in Patent Office: 959 Days
• Field of Search: 707/796, 707/737, 707/791, 707/795, 707/625, 707/657, 707/637, 707/639, 707/640, 707/649, 707/692, 707/827, 707/613, 707/661, 707/610, 707/822, 707/E17.01, 707/E17.002, 707/E17.032, 707/E17.005, 711/100, 711/103, 711/122, 711/123, 711/135, 711/141, 711/154, 711/156, 711/162, 711/163, 711/E12.001, 711/E12.093, 711/171, 711/E12.002, 709/203, 709/205, 709/213, 709/216, 709/217, 709/218, 709/219, 709/220, 709/226, 709/229, 709/230, 709/232, 709/239
• US Class Current: 1/1
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647

Abstract

A system for migrating data from a source file system to a destination file system while the source file system is in active use, in part by transitioning the client'"'"'s use of the source file system to that of the destination file system without unmounting the client from the source file system.

Claims

1. A data migration system comprising:

a server positioned in-line as between a plurality of clients and a source file system, and between the plurality of clients and a destination file system, the server performing operations that include;

during a first duration in which the plurality of clients request use of the source file system;

replicate individual file system objects that are part of the source file system with the destination file system;

forward requests from individual clients in the plurality of clients to the source file system;

signal the destination file system to perform a set of file system operations that are specified in the requests from the individual clients in the plurality of clients and which affect the source file system;

determine when one of the requests specifies a creation of a new file system object;

communicate an operation to each of the source file system and the destination file system to create the new file system object on each of the source and destination file systems; and

receive and forward responses from the source file system to the individual clients who made the requests that specified the set of file system operations;

during a second duration in which clients in the plurality of clients request use of the source file system;

forward requests from individual clients in the plurality of clients to the destination file system;

receive responses from the destination file system to the forwarded requests;

for one or more of the responses, manipulate one or more attributes of a file system object provided at the destination file system as specified in the response, so that the one or more attributes each match an attribute for a corresponding file system object in the source file system; and

forward each of the responses to the individual clients that made the requests, the forwarded responses including the one or more responses in which one or more attributes of the specified file system object of the destination file system are manipulated.

2. The data migration system of claim 1, wherein the one or more attributes correspond to one or more attributes selected from a group consisting of a time stamp, file identifier, file system identifier and user identifier.

3. The data migration system of claim 1, wherein the server manipulates the one or more attributes by manipulating a time stamp of when the file system object was modified.

4. The data migration system of claim 3, wherein the server manipulates the time stamp to reflect a time stamp of the file system object provided at the source file system only if the file system object was last modified during the first duration.

5. The data migration system of claim 1, wherein the server manipulates the one or more attributes when it is specified in the response by manipulating a change time of when the file system object was created.

6. The data migration system of claim 1, wherein the server manipulates the one or more attributes by mapping a user attribute of the destination file system to one of the source file system.

7. The data migration system of claim 1, wherein the server receives and forwards client requests and responses using a Network File System protocol.

8. A method for migrating data from a source file system to a destination file system, the method being implemented by one or more processors at a server that is positioned in-line as between a plurality of clients and the source file system, and between the plurality of clients and the destination file system, the method comprising:

during a first duration in which the plurality of clients request use of the source file system;

replicating individual file system objects that are part of the source file system with the destination file system;

forwarding requests from individual clients in the plurality of clients to the source file system;

signaling the destination file system to perform a set of file system operations that are specified in the requests from the individual clients in the plurality of clients and which affect the source file system;

determining when one of the requests specifies a creation of a new file system object;

communicating an operation to each of the source file system and the destination file system to create the new file system object on each of the source and destination file systems; and

receiving and forwarding responses from the source file system to the individual clients who made the requests that specified the set of file system operations;

during a second duration in which clients in the plurality of clients request use of the source file system;

forwarding requests from individual clients in the plurality of clients to the destination file system;

receiving responses from the destination file system to the forwarded requests;

for one or more of the responses, manipulating one or more attributes of a file system object provided at the destination file system as specified in the response, so that the one or more attributes each match an attribute for a corresponding file system object in the source file system; and

forwarding each of the responses to the individual clients that made the requests, the forwarded responses including the one or more responses in which one or more attributes of the specified file system objects of the destination file system are manipulated.

9. The method of claim 8, wherein the one or more attributes correspond to one or more attributes selected from a group consisting of a time stamp, file identifier, file system identifier and user identifier.

10. The method of claim 8, wherein manipulating the one or more attributes includes manipulating a time stamp of when the file system object was modified when the time stamp is specified in the response.

11. The method of claim 10, wherein manipulating the time stamp includes providing the time stamp from the source file system in the response only when the file system object was last modified during the first duration.

12. The method of claim 8, wherein manipulating the one or more attributes includes manipulating a change time of when the file system object was created when specifying the change time in the response.

13. The method of claim 8, wherein manipulating the one or more attributes includes mapping a user attribute of the destination file system to one of the source file system.

14. The method of claim 8, wherein the method is performed using a Network File Method protocol.

15. A non-transitory computer-readable medium that stores instructions for migrating data from a source file system to a destination file system, the instructions being executable by one or more processors, at a server that is positioned in-line as between a plurality of clients and the source file system, and between the plurality of clients and the destination file system, to perform operations that comprise:

during a first duration in which the plurality of clients request use of the source file system;

replicating individual file system objects that are part of the source file system with the destination file system;

forwarding requests from individual clients in the plurality of clients to the source file system;

signaling the destination file system to perform a set of file system operations that are specified in the requests from the individual clients in the plurality of clients and which affect the source file system;

determining when one of the requests specifies a creation of a new file system object;

communicating an operation to each of the source file system and the destination file system to create the new file system object on each of the source and destination file systems; and

receiving and forwarding responses from the source file system to the individual clients who made the requests that specified the set of file system operations;

during a second duration in which clients in the plurality of clients request use of the source file system;

forwarding requests from individual clients in the plurality of clients to the destination file system;

receiving responses from the destination file system to the forwarded requests;

for one or more of the responses, manipulating one or more attributes of a file system object provided at the destination file system as specified in the response, so that the one or more attributes each match an attribute for a corresponding file system object in the source file system; and

forwarding each of the responses to the individual clients that made the requests, the forwarded responses including the one or more responses in which one or more attributes of the specified file system objects of the destination file system are manipulated.

16. The non-transitory computer-readable medium of claim 15, wherein the one or more attributes correspond to one or more attributes selected from a group consisting of a time stamp, file identifier, file system identifier and user identifier.

17. The non-transitory computer-readable medium of claim 15, wherein instructions for manipulating a time stamp include instructions for providing the time stamp from the source file system only when the file system object was last modified during the first duration.