Efficient migration of replicated files from a file server having a file de-duplication facility

• US 9,323,758 B1
• Filed: 12/22/2009
• Issued: 04/26/2016
• Est. Priority Date: 12/22/2009
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: LeMahieu, Paul, Stacey, Christopher H.
• Primary Examiner(s): Huang, Miranda
• Application Number:
  US12/644,849
• Time in Patent Office: 2,317 Days
• Field of Search: 707/602, 707/610, 707/624, 707/625, 707/626, 707/637
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1446 Point-in-time backing up or restoration of persistent data
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/137 Hash-based content-based indexing of textual data G06F16/31
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641

Abstract

Needless migration of duplicate file data is avoided by recording in a database a record of migration of a first instance of a replicated file from a source file server to a target file server. When migrating a subsequent instance of a replicated file to the target file server, the database is searched for a record of replication of a first instance of the replicated file to the target file server. If such a record is found, the subsequent instance is replicated by sending from the source file server to the target file server attributes of the subsequent instance of the replicated file and an identification of the previously migrated data of the replicated file without re-transmission of the previously migrated data of the replicated file.

Claims

1. A computer-implemented method of at least one data processor executing a file migration program in memory in response to a request for migration of a specified file from a source file server to a target file server in a data network, said method comprising the steps of:

(a) searching storage in the data network for a record indicating that the target file server contains a replica of the specified file, the replica of the specified file having data of the specified file, and the replica of the specified file having attributes different from attributes of the specified file; and

(b) in response to finding a record indicating that the target file server contains a replica of the specified file, creating a copy of the specified file in the target file server by copying the attributes but not the data of the specified file from the source file server to the target file server and associating the copied attributes of the specified file in the target file server with the data of the replica of the specified file in the target file server.

2. The computer-implemented method as claimed in claim 1, wherein the method further includes storing the record indicating that the target file server contains a replica of the specified file when the execution of the file migration program determines that a first instance of a replicated file is being migrated to the target file server.

3. The computer-implemented method as claimed in claim 1, wherein the record indicating that the target file server contains a replica of the specified file includes a file identifier of the replica and an identifier of the data of the replica, and wherein the step (a) of searching storage includes searching the storage for a record containing a specified identifier of data in the specified file and finding the file identifier of the replica associated with the specified identifier of the data of the replica.

4. The computer-implemented method as claimed in claim 3, wherein the method further includes searching storage of the source file server to find the specified identifier of the data in the specified file.

5. The computer-implemented method as claimed in claim 3, wherein the method further includes searching the storage of the source file server to determine whether storage of the source file server contains more than one replica of the specified file, and in response to determining that the storage of the source file server contains more than one replica of the specified file, obtaining the specified identifier of the data in the specified file from the storage of the source file server in order to perform the copying of the attributes but not the data of the specified file from the source file server to the target file server and the associating of the copied attributes of the specified file in the target file server with the data of the replica of the specified file in the target file server, and otherwise copying the attributes and the data of the specified file to the target file server when the storage of the source file server does not contain more than one replica of the specified file.

6. A computer-implemented method of at least one data processor executing a file migration program in memory to migrate instances of a replicated file from a source file server to a target file server, each of the instances of the replicated file having the same file data but having different file attributes, said method comprising:

upon migration of attributes and data of a first instance of the replicated file from the source file server to the target file server, recording in a database a record of migration of the first instance of the replicated file from the source file server to the target file server; and

upon migration of a second instance of the replicated file, searching the database for a record of a prior migration of an instance of the replicated file, and in response to finding the record of the migration of the first instance of the replicated file in the database, migrating the second instance of the replicated file from the source file server to the target file server by sending from the source file server to the target file server attributes of the second instance of the replicated file and an identification of the previously migrated data of the replicated file so that the second instance of the replicated file is migrated from the source file server to the target file server without re-transmission of the previously migrated data of the replicated file;

which further includes said at least one data processor executing a file de-duplication program in memory in order to de-duplicate instances of the replicated file to produce file inodes sharing data of the replicated file in storage of the source file server, the execution of the file de-duplication program producing a reference count of the file inodes sharing the data of the replicated file in the storage of the source file server, and the recording in the database of the migration of the first instance of the replicated file from the source file server to the target file server being performed in response to execution of the migration program finding that the reference count is greater than one upon migrating the first instance of the replicated file.

7. A computer-implemented method of at least one data processor executing a file migration program in memory to migrate instances of a replicated file from a source file server to a target file server, each of the instances of the replicated file having the same file data but having different file attributes, said method comprising:

upon migration of attributes and data of a first instance of the replicated file from the source file server to the target file server, recording in a database a record of migration of the first instance of the replicated file from the source file server to the target file server; and

upon migration of a second instance of the replicated file, searching the database for a record of a prior migration of an instance of the replicated file, and in response to finding the record of the migration of the first instance of the replicated file in the database, migrating the second instance of the replicated file from the source file server to the target file server by sending from the source file server to the target file server attributes of the second instance of the replicated file and an identification of the previously migrated data of the replicated file so that the second instance of the replicated file is migrated from the source file server to the target file server without re-transmission of the previously migrated data of the replicated file;

which further includes said at least one data processor executing a file de-duplication program in memory in order to de-duplicate instances of the replicated file to produce file inodes sharing data of the replicated file in storage of the source file server, the execution of the file de-duplication program producing a reference count of the file inodes sharing the data of the replicated file in the storage of the source file server, and the searching of the database for a record of a prior migration of an instance of the replicated file being performed in response to execution of the migration program finding that the reference count is greater than one upon migrating the second instance of the replicated file.

8. A data processing system comprising:

a source file server and a target file server in a data network; and

memory containing a file migration program, the file migration program being executed by at least one data processor in the data processing system to migrate instances of a replicated file from the source file server to the target file server, each of the instances of the replicated file having the same file data but different file attributes;

wherein

upon migration of attributes and data of a first instance of the replicated file from the source file server to the target file server, execution of the file migration program includes recording in a database a record of migration of the first instance of the replicated file from the source file server to the target file server; and

upon migration of a second instance of the replicated file, execution of the migration program includes searching the database for a record of a prior migration of an instance of the replicated file, and in response to finding the record of migration of the first instance of the replicated file in the database, migrating the second instance of the replicated file from the source file server to the target file server by sending from the source file server to the target file server attributes of the second instance of the replicated file and an identification of the previously migrated data of the replicated file so that the second instance of the replicated file is migrated from the source file server to the target file server without re-transmission of the previously migrated data of the replicated file;

which further includes a file de-duplication program in memory and executed by said at least one data processor in order to de-duplicate instances of the replicated file to produce file inodes sharing data of the replicated file in storage of the source file server, execution of the file de-duplication program producing a reference count of the file inodes sharing the data of the replicated file in the storage of the source file server, and the recording in the database of the migration of the first instance of the replicated file from the source file server to the target file server is performed in response to execution of the migration program finding that the reference count is greater than one upon migrating the first instance of the replicated file.

9. A data processing system comprising:

a source file server and a target file server in a data network; and

memory containing a file migration program, the file migration program being executed by at least one data processor in the data processing system to migrate instances of a replicated file from the source file server to the target file server, each of the instances of the replicated file having the same file data but different file attributes;

wherein

upon migration of attributes and data of a first instance of the replicated file from the source file server to the target file server, execution of the file migration program includes recording in a database a record of migration of the first instance of the replicated file from the source file server to the target file server; and

upon migration of a second instance of the replicated file, execution of the migration program includes searching the database for a record of a prior migration of an instance of the replicated file, and in response to finding the record of migration of the first instance of the replicated file in the database, migrating the second instance of the replicated file from the source file server to the target file server by sending from the source file server to the target file server attributes of the second instance of the replicated file and an identification of the previously migrated data of the replicated file so that the second instance of the replicated file is migrated from the source file server to the target file server without re-transmission of the previously migrated data of the replicated file;

which further includes a file de-duplication program in memory and executed by said at least one data processor in order to de-duplicate instances of the replicated file to produce file inodes sharing data of the replicated file in storage of the source file server, execution of the file de-duplication program producing a reference count of the file inodes sharing the data of the replicated file in the storage of the source file server, and the searching of the database for a record of a prior migration of an instance of the replicated file being performed in response to execution of the migration program finding that the reference count is greater than one upon migrating the second instance of the replicated file.