Remote data protection in a networked storage computing environment

• US 8,676,763 B2
• Filed: 02/08/2011
• Issued: 03/18/2014
• Est. Priority Date: 02/08/2011
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Gopisetty, Sandeep, Nadgowda, Shripad, Routray, Ramani Ranjan, Goodman, David P
• Primary Examiner(s): MENG, JAU SHYA
• Application Number:
  US13/023,240
• Publication Number:
  US 20120203742A1
• Time in Patent Office: 1,134 Days
• Field of Search: None
• US Class Current: 707/654
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

A method, system, and program product are provided for protecting and restoring data within a networked (e.g. cloud) storage computing environment through asynchronous replication and remote backup of data and its associated metadata. Data backup and recovery functionality provides data backups by detecting incremental updates to the data and its associated metadata at specific points in time determined by policies. The policies are configurable based on user requirements. Multiple copies of the data backups can be made and stored in separate compressed files at backup/disaster recovery locations. The backups of data and its associated metadata, which includes file system configuration information can be used to restore the state of a computer file system to that of a given point-in-time. Accordingly, a data protection approach is disclosed for protecting data at both the file system level and application level.

Claims

1. A system for remote protection and restoration of data in a networked storage computing environment, the system comprising:

a bus;

a processor coupled to a bus;

a memory medium coupled to the bus, the memory medium comprising instructions, the instructions executed by the processor to;

determine whether to perform a remote data protection process based at least on whether a maximum number of snapshots has been exceeded and whether a previously created snapshot exists;

record data and associated metadata at specific points-in-time based on policies that enforce both a recovery point objective (RPO) that defines a maximum time period in which loss of the data is allowed and a recovery time objective (RTO) that defines a duration of time in which the data must be restored after a disruption to a network attached storage appliance, wherein the network attached storage appliance is part of a storage cluster that provides computing storage services and offers a computing device access to a common set of data consolidated from a plurality of user systems;

copy the data and the associated metadata into backup files;

generate a data structure with pointers to the backup files, based on a schedule configured to achieve the RPO and the RTO, wherein the data structure with pointers to the backup files comprises a file path associated with a status and at least one of the pointers to the backup files, wherein the status indicates whether data at a location specified by the file path is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed;

transfer the backup files to one or more backup locations for storage on an electronic storage device;

request one or more restore-points from a user;

extract backup files from one or more backup locations by utilizing the data structure with pointers to the backup files;

transfer the backup files from the one or more backup locations to one or more restore locations; and

restore data and its associated metadata at the one or more restore locations, based on the one or more restore-points from the user.

2. The system of claim 1, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume.

3. The system of claim 1, wherein the step of copying further comprises compressing a full backup copy of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of data.

4. The system of claim 3, wherein one or more of additional compressed copies of data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies is adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

5. The system of claim 1, wherein the metadata comprises quota, filesets, and access control lists.

6. The system of claim 1, wherein the step of generating the data structure with pointers to the backup files further comprises generating subsequent data structures by utilizing an existing data structure, and wherein the pointers to the backup files prevent re-copying of data that has not been modified since a previous data structure was generated.

7. The system of claim 6, wherein the data structure is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, and other in-memory data structures.

8. A computer program product for remote protection and restoration of data in a networked storage computing environment, the computer program product comprising a non-transitory computer readable storage media, and program instructions stored on the non-transitory computer readable storage media, the program instruction executed by a processor to:

determine whether to perform a remote data protection process based at least on whether a maximum number of snapshots has been exceeded and whether a previously created snapshot exists;

record data and associated metadata at specific points-in-time based on policies that enforce both a recovery point objective (RPO) that defines a maximum time period in which loss of the data is allowed and a recovery time objective (RTO) that defines a duration of time in which the data must be restored after a disruption to a network attached storage appliance, wherein the network attached storage appliance is part of a storage cluster that provides computing storage services and offers a computing device access to a common set of data consolidated from a plurality of user systems;

copy the data and the associated metadata into backup files;

generate a data structure with pointers to the backup files, based on a schedule configured to achieve the RPO and the RTO, wherein the data structure with pointers to the backup files comprises a file path associated with a status and at least one of the pointers to the backup files, wherein the status indicates whether data at a location specified by the file path is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed;

transfer the backup files to one or more backup locations for storage on an electronic storage device utilizing;

request one or more restore-points from a user;

extract backup files from one or more backup locations by utilizing the a file list data structure with pointers to the backup files;

transfer the backup files from the one or more backup locations to one or more restore locations; and

restore data and its associated metadata at the one or more restore locations, based on the one or more restore-points from the user.

9. The computer program product of claim 8, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume; and

the file management system consolidating many network attached storage devices into one centrally managed storage cluster.

10. The computer program product of claim 8, wherein the step of copying further comprises compressing a full backup copy of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of data.

11. The computer program product of claim 10, wherein one or more of additional compressed copies of data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies is adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

12. The computer program product of claim 8, wherein the metadata comprises quota, filesets, and access control lists.

13. The computer program product of claim 8, wherein the step of generating the data structure with pointers to the backup files further comprises generating subsequent data structures by utilizing an existing data structure, and wherein the pointers to the backup files prevent re-copying of data that has not been modified since a previous data structure was generated.

14. The computer program product of claim 13, wherein the data structure is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, and other in-memory data structures.

15. A method for deploying a system for remote protection and restoration of data in a networked storage computing environment, comprising:

deploying a computer infrastructure to;

determine whether to perform a remote data protection process based at least on whether a maximum number of snapshots has been exceeded and whether a previously created snapshot exists;

record data and associated metadata at specific points-in-time based on policies that enforce both a recovery point objective (RPO) that defines a maximum time period in which loss of the data is allowed and a recovery time objective (RTO) that defines a duration of time in which the data must be restored after a disruption to a network attached storage appliance, wherein the network attached storage appliance is part of a storage cluster that provides computing storage services, and offers a computing device access to a common set of data consolidated from a plurality of user systems;

copy the data and the associated metadata into backup files;

generate a data structure with pointers to the backup files, based on a schedule configured to achieve the RPO and the RTO, wherein the data structure with pointers to the backup files comprises a file path associated with a status and at least one of the pointers to the backup files, wherein the status indicates whether data at a location specified by the file path is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed;

transfer the backup files to the one or more backup locations for storage on an electronic storage device;

request one or more restore-points from a user;

extract backup files from one or more backup locations by utilizing the data structure with pointers to the backup files;

transfer the backup files from the one or more backup locations to one or more restore locations; and

restore data and its associated metadata at the one or more restore locations, based on the one or more restore-points from the user.

16. The method of claim 15, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume.

17. The method of claim 15, wherein the step of copying further comprises compressing a full backup copy of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of data.

18. The method of claim 17, wherein one or more of additional compressed copies of data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies is adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

19. The method of claim 15, wherein the metadata comprises quota, filesets, and access control lists.

20. The method of claim 15, wherein the step of generating the data structure with pointers to the backup files further comprises generating subsequent data structures by utilizing an existing data structure, and wherein the pointers to the backup files prevent re-copying of data that has not been modified since a previous data structure was generated.

21. The method of claim 20, wherein the data structure is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, and other in-memory data structures.