REMOTE DATA PROTECTION IN A NETWORKED STORAGE COMPUTING ENVIRONMENT

• US 20120203742A1
• Filed: 02/08/2011
• Published: 08/09/2012
• Est. Priority Date: 02/08/2011
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated (Kyndryl Holdings, Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Gopisetty, Sandeep, Routray, Ramani Ranjan, Goodman, David P., Nadgowda, Shripad
• Granted Patent: US 8,676,763 B2
• Time in Patent Office: Days
• US Class Current: 707/646
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

Embodiments of the present invention provide an approach for protecting and restoring data within a networked (e.g. cloud) storage computing environment through asynchronous replication and remote backup of data and its associated metadata. Under embodiments of the present invention, data backup and recovery functionality provides data backups by detecting incremental updates to the data and its associated metadata at specific points in time determined by policies. The policies are configurable based on user requirements. Multiple copies of the data backups can be made and stored in separate compressed files at backup/disaster recovery locations. The backups of data and its associated metadata, which includes file system configuration information can be used to restore the state of a computer file system to that of a given point-in-time. Accordingly, a data protection approach is disclosed for protecting data at both the file system level and application level.

Claims

1. A computer implemented method for remote protection of data in a networked storage computing environment, the method comprising the steps of:

determining if a remote data protection process may be performed;

recording file system data and associated metadata at specific points-in-time, wherein the recording is based on policies that enforce a recovery point objective and recovery time objective for a scale out network attached storage compatible appliance;

copying the file system data and associated metadata into backup files;

generating a file-list with pointers to the backup files at one or more backup locations; and

transferring the backup files to the one or more backup locations for storage on an electronic storage device utilizing at least one of the following;

rsync protocol, file transfer protocol (ftp), and hypertext transfer protocol (http).

2. The method of claim 1, wherein the step of determining comprises determining whether a maximum snapshot limit has been exceeded, whether a previously created snapshot exists, and whether there is network connectivity to the one or more backup locations.

3. The method of claim 1, wherein the step of recording comprises performing an application specific write-suspend, a scale out network attached storage (SONAS) write-suspend, recording General Parallel File System (GPFS) file system snapshot, recording a GPFS configuration, performing a SONAS write-resume, and performing application specific write-resume.

4. The method of claim 1, wherein the step of copying further comprises compressing a full backup copy of file system data created at a first time that the step of copying is performed, and thereafter compressing an incremental backup copy of file system data created when the step of copying is not being performed for the first time.

5. The method of claim 4, wherein one or more of additional compressed copies of file system data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies can be adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

6. The method of claim 1, wherein the metadata comprises quota, filesets, policies, and access-control-lists.

7. The method of claim 1, wherein the step of generating the file-list with pointers to the files further comprises associating a file path with a status and snapshot ID, wherein subsequent file-lists can be generated by utilizing GPFS policy and a previous file-list, and wherein snapshot ID prevents re-copying of file system data that has not been modified since a previous file-list was generated.

8. The method of claim 7, wherein the file-list is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, simple text files, delimiter based files, XML files, and other in-memory structured/semi-structured documents or data structures.

9. A computer implemented method for restoration of remotely protected data in a networked storage computing environment, the method comprising the steps of:

requesting one or more restore-points from a user;

extracting backup files from one or more backup locations by utilizing a file-list with pointers to the backup files;

transferring the backup files from the one or more backup locations to one or more restore locations; and

restoring data and its associated metadata at the one or more restore locations, based on the one or more restore-points from the user.

10. The method of claim 9, wherein the step of extracting includes extracting only the backup files needed for a restore of data.

11. The method of claim 9, wherein the method of restoring can be performed incrementally in a forward manner from a restore-point or in a reverse manner from one or more restore-points, wherein a complete application restoration can be performed if a complete set of application data logs is available, and wherein if a complete set of application data is not available, then only restoration can be performed from the file system level onward.

12. A system for remote protection and restoration of data in a networked storage computing environment, the system comprising:

a bus;

a processor coupled to a bus;

a memory medium coupled to the bus, the memory medium comprising instructions to;

determine if a remote data protection process may be performed;

record file system data and associated metadata at specific points-in-time, wherein the recording is based on policies that enforce a recovery point objective and recovery time objective for a scale out network attached storage compatible appliance;

copy the file system data and associated metadata into backup files;

generate a file-list with pointers to the backup files at one or more backup locations;

transfer the backup files to the one or more backup locations for storage on an electronic storage device utilizing at least one of the following;

rsync protocol, file transfer protocol (ftp), and hypertext transfer protocol (http);

request one or more restore-points from a user;

extract backup files from one or more backup locations by utilizing a file-list with pointers to the backup files;

transfer the backup files from the one or more backup locations to one or more restore locations; and

restore data and its associated metadata at the one or more restore locations, based on the one or more restore-points from the user.

13. The system of claim 12, wherein the step of determining comprises determining whether a maximum snapshot limit has been exceeded, whether a previously created snapshot exists, and whether there is network connectivity to the one or more backup locations.

14. The system of claim 12, wherein the step of recording comprises performing an application specific write-suspend, a scale out network attached storage (SONAS) write-suspend, recording General Parallel File System (GPFS) file system snapshot, recording a GPFS configuration, performing a SONAS write-resume, and performing application specific write-resume.

15. The system of claim 12, wherein the step of copying further comprises compressing a full backup copy of file system data created at a first time that the step of copying is performed, and thereafter compressing an incremental backup copy of file system data created when the step of copying is not being performed for the first time.

16. The system of claim 15, wherein one or more of additional compressed copies of file system data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies can be adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

17. The system of claim 12, wherein the metadata comprises quota, filesets, policies, and access-control-lists.

18. The system of claim 12, wherein the step of generating the file-list with pointers to the files further comprises associating a file path with a status and snapshot ID, wherein subsequent file-lists can be generated by utilizing GPFS policy and a previous file-list, and wherein snapshot ID prevents re-copying of file system data that has not been modified since a previous file-list was generated.

19. The system of claim 18, wherein the file-list is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, simple text files, delimiter based files, XML files, and other in-memory structured/semi-structured documents or data structures.

20. The system of claim 12, wherein the step of extracting includes extracting only the backup files needed for a restore of data.

21. The system of claim 12, wherein the method of restoring can be performed incrementally in a forward manner from a restore-point or in a reverse manner from one or more restore-points, wherein a complete application restoration can be performed if a complete set of application data logs is available, and wherein if a complete set of application data is not available, then only restoration can be performed from the file system level onward.

22. A computer program product for remote protection and restoration of data in a networked storage computing environment, the computer program product comprising a computer readable storage media, and program instructions stored on the computer readable storage media, to:

determine if a remote data protection process may be performed;

record file system data and associated metadata at specific points-in-time, wherein the recording is based on policies that enforce a recovery point objective and recovery time objective for a scale out network attached storage compatible appliance;

copy the file system data and associated metadata into backup files;

generate a file-list with pointers to the backup files at one or more backup locations;

transfer the backup files to the one or more backup locations for storage on an electronic storage device utilizing at least one of the following;

rsync protocol, file transfer protocol (ftp), and hypertext transfer protocol (http);

request one or more restore-points from a user;

extract backup files from one or more backup locations by utilizing a file-list with pointers to the backup files;

transfer the backup files from the one or more backup locations to one or more restore locations; and

restore data and its associated metadata at the one or more restore locations, based on the one or more restore-points from the user.

23. The computer program product of claim 22, wherein the step of determining comprises determining whether a maximum snapshot limit has been exceeded, whether a previously created snapshot exists, and whether there is network connectivity to the one or more backup locations.

24. The computer program product of claim 22, wherein the step of recording comprises performing an application specific write-suspend, a scale out network attached storage (SONAS) write-suspend, recording General Parallel File System (GPFS) file system snapshot, recording a GPFS configuration, performing a SONAS write-resume, and performing application specific write-resume.

25. The computer program product of claim 22, wherein the step of copying further comprises compressing a full backup copy of file system data created at a first time that the step of copying is performed, and thereafter compressing an incremental backup copy of file system data created when the step of copying is not being performed for the first time.

26. The computer program product of claim 25, wherein one or more of additional compressed copies of file system data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies can be adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

27. The computer program product of claim 22, wherein the metadata comprises quota, filesets, policies, and access-control-lists.

28. The computer program product of claim 22, wherein the step of generating the file-list with pointers to the files further comprises associating a file path with a status and snapshot ID, wherein subsequent file-lists can be generated by utilizing GPFS policy and a previous file-list, and wherein snapshot ID prevents re-copying of file system data that has not been modified since a previous file-list was generated.

29. The computer program product of claim 28, wherein the file-list is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, simple text files, delimiter based files, XML files, and other in-memory structured/semi-structured documents or data structures.

30. The computer program product of claim 22, wherein the step of extracting includes extracting only the backup files needed for a restore of data.

31. The computer program product of claim 22, wherein the method of restoring can be performed incrementally in a forward manner from a restore-point or in a reverse manner from one or more restore-points, wherein a complete application restoration can be performed if a complete set of application data logs is available, and wherein if a complete set of application data is not available, then only restoration can be performed from the file system level onward.

32. A method for deploying a system for remote protection and restoration of data in a networked storage computing environment, comprising:

deploying a computer infrastructure being operable to;

determine if a remote data protection process may be performed;

record file system data and associated metadata at specific points-in time, wherein the recording is based on policies that enforce a recovery point objective and recovery time objective for a scale out network attached storage compatible appliance;

copy the file system data and associated metadata into backup files;

generate a file-list with pointers to the backup files at one or more backup locations;

transfer the backup files to the one or more backup locations for storage on an electronic storage device utilizing at least one of the following;

rsync protocol, file transfer protocol (ftp), and hypertext transfer protocol (http);

request one or more restore-points from a user;

extract backup files from one or more backup locations by utilizing a file-list with pointers to the backup files;

transfer the backup files from the one or more backup locations to one or more restore locations; and

restore data and its associated metadata at the one or more restore locations, based on the one or more restore-points from the user.