Storage device data migration

• US 9,607,004 B2
• Filed: 06/18/2014
• Issued: 03/28/2017
• Est. Priority Date: 06/18/2014
• Status: Expired due to Fees

• Current Assignee: AirBNB Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Haustein, Nils, Saupp, Alexander
• Primary Examiner(s): BOWEN, RICHARD L
• Application Number:
  US14/308,046
• Publication Number:
  US 20150370845A1
• Time in Patent Office: 1,014 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067

Abstract

A method for migrating files from a source server to a target server are disclosed. The method includes determining file property information for one or more data files on the source server. One or more data file entries are created in a file property table with the file property information for each data file. A data file entry is selected from the file property table. The file property information of the selected data file entry from the file property table is compared to the file property information of the corresponding data file stored in the source server to determine whether there is a match. In response to determining a mismatch, the data file in the source server is copied to the target server. The data file copied to the target server is verified to be the same as the data file of the source server.

Claims

1. A computer-implemented method for migrating files from a source server to a target server, comprising:

determining file property information for one or more data files on the source server;

creating one or more data file entries in a file property table with the file property information for each data file;

selecting a data file entry from the file property table;

comparing the file property information of the selected data file entry from the file property table to the file property information of the corresponding data file stored in the source server to determine whether there is a match;

in response to determining a mismatch between the file property information of the data file entry to the file property information of the corresponding data file, copying the data file in the source server to the target server;

verifying the data file copied to the target server is the same as the data file of the source server;

determining a first metadata checksum from metadata of the selected data file in the source server;

comparing the first metadata checksum to a file property table metadata checksum of the selected data file in the file property table to determine whether there is a match;

in response to determining a mismatch between the first metadata checksum and the file property table metadata checksum for the selected data file, copying the source server metadata of the selected data file to the target server; and

verifying the metadata copied to the target server is the same as the metadata of the source server.

2. The method of claim 1, further comprising:

updating the file property table with file property information of the copied data file when the data file copied to the target server is the same as the data file of the source server, such that the file property information in the file property table is the current file property information of the copied data file, and

stores an indication that the file has been copied to the target server.

3. The method of claim 1, wherein the metadata and the metadata checksum is an access control list (ACL) and an ACL checksum respectively.

4. The method of claim 1, further comprising:

sorting the data file entries of the file property table based one or more sorting criteria, wherein the sorting criteria is based on at least one of the file property information.

5. The method of claim 4, wherein the file property information for each data file entry includes at least one of a file size, a modification time, a creation time, an access time, a path and file name extension, a data file checksum, the metadata checksum, a data file copy indicator, and an metadata copy indicator.

6. The method of claim 1, wherein the copying of the data file from the source server to the target server and verifying the data file copied to the target server is the same as the data file of the source server include:

reading the data file from source server;

calculating a first data file checksum of the data file from the source server;

writing the data file to the target server;

reading the data file from the target server;

calculating a second data file checksum of the data file from the target server;

comparing the second data file checksum to first data file checksum to determine whether the first data file checksum and the second data file checksum match; and

updating the file property table with the file property information of the data file in the target server when the first and second checksums match.

7. The method of claim 6, further comprising:

when the first data file checksum and the second data file checksum are a mismatch, copying of the data file from the source server to the target server; and

verifying the data file copied to the target server is the same as the data file of the source server.

8. The method of claim 6, wherein the checksums are at least one of a cyclic redundancy code (CRC), a message digest five (MD5) hash function, and a secure hash algorithm 256 (SHA256) hash function.

9. The method of claim 1, wherein the source server and the target server are network attached storage (NAS) servers.

10. The method of claim 1, wherein the copying of the metadata from the source server to the target server and verifying the metadata copied to the target server is the same as the metadata of the source server include:

reading the metadata from source server;

writing the metadata to the target server,

reading the metadata from the target server;

calculating a second metadata checksum of the metadata from the target server;

comparing the second metadata checksum to the first metadata checksum to determine whether the first, metadata checksum and the second metadata checksum match; and

updating the file property table with the second metadata checksum of the metadata in the target server and indicting the metadata has been copied when the first metadata checksum and second metadata checksums match.

11. A computer system for migrating files from a source server to a target server, comprising:

a processor; and

a memory communicatively coupled to the processor, wherein the memory is encoded with instructions and wherein the instructions when executed by the processor include;

determining file property information for one or more data files on the source server;

creating one or more data file entries in a file property table with the file property information for each data file;

selecting a data file entry from the file property table;

comparing the file property information of the selected data file entry from the file property table to the file property information of the corresponding data file stored in the source server to determine whether there is a match;

in response to determining a mismatch between the file property information of the data file entry to the file property information of the corresponding data file, copying the data file in the source server to the target server;

verifying the data file copied to the target server is the same as the data file of the source server;

determining a first metadata checksum from metadata of the selected data file in the source server;

comparing the first metadata checksum to a file property table metadata checksum of the selected data file in the file property table to determine whether there is a match,

in response to determining a mismatch between the first metadata checksum and the file property table metadata checksum for the selected data file, copying the source server metadata of the selected data file to the target server; and

verifying the metadata copied to the target server is the same as the metadata of the source server.

12. The computer system of claim 11, wherein the instructions when executed include, updating the file property table with file property information of the copied data file when the data file copied to the target server is the same as the data file of the source server, such that the file property information in the file property table is the current file property information of the copied data file, and

stores an indication that the file has been copied to the target server.

13. The computer system of claim 12, wherein the copying of the data file from the source server to the target server and verifying the data file copied to the target server is the same as the data file of the source server include:

reading the data file from source server;

calculating a first data file checksum of the data file from the source server;

writing the data file to the target server;

reading the data file from the target server;

calculating a second data file checksum of the data file from the target server;

comparing the second data file checksum to first data file checksum to determine whether the first data file checksum and the second data file checksum match; and

updating the file property table with the file property information of the data file in the target server when the first and second checksums match.

14. A computer program product for migrating files from a source server to a target server, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable by a computer system to perform a method comprising:

determining file property information for one or more data files on the source server;

creating one or more data file entries in a file property table with the file property information for each data file;

selecting a data file entry from the file property table;

comparing the file property information of the selected data file entry from the file property table to the file property information of the corresponding data file stored in the source server to determine whether there is a match;

in response to determining a mismatch between the file property information of the data file entry to the file property information of the corresponding data file, copying the data file in the source server to the target server; and

verifying the data file copied to the target server is the same as the data file of the source server;

determining a first metadata checksum from metadata of the selected data file in the source server;

comparing the first metadata checksum to a file property table metadata checksum of the selected data file in the file property table to determine whether there is a match;

in response to determining a mismatch between the first metadata checksum and the file property table metadata checksum for the selected data file, copying the source server metadata of the selected data file to the target server; and

verifying the metadata copied to the target server is the same as the metadata of the source server.

15. The computer program product of claim 14, wherein the program code executable by a computer system further includes, updating the file property table with file property information of the copied data file when the data file copied to the target server is the same as the data file of the source server, such that the file property information in the file property table is the current file property information of the copied data file, and

stores an indication that the file has been copied to the target server.

16. The computer program product of claim 14, wherein the copying of the data file from the source server to the target server and verifying the data file copied to the target server is the same as the data file of the source server include:

reading the data file from source server;

calculating a first data file checksum of the data file from the source server;

writing the data file to the target server;

reading the data file from the target server;

calculating a second data file checksum of the data file from the target server;

comparing the second data file checksum to first data file checksum to determine whether the first data file checksum and the second data file checksum match; and

updating the file property table with the file property information of the data file in the target server when the first and second checksums match.

17. The computer program product of claim 14, wherein the copying of the metadata from the source server to the target server and verifying the metadata copied to the target server is the same as the metadata of the source server include:

reading the metadata from source server;

writing the metadata to the target sewer;

reading the metadata from the target server;

calculating a second metadata checksum of the metadata from the target server;

comparing the second metadata checksum to the first metadata checksum to determine whether the first metadata checksum and the second metadata checksum match; and

updating the file property table with the second metadata checksum of the metadata in the target server and indicting the metadata has been copied when the first metadata checksum and second metadata checksums match.