Remote data protection in a networked storage computing environment

• US 10,229,125 B2
• Filed: 11/15/2016
• Issued: 03/12/2019
• Est. Priority Date: 02/08/2011
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Goodman, David P., Gopisetty, Sandeep, Nadgowda, Shripad, Routray, Ramani R.
• Primary Examiner(s): Meng, Jau Shya
• Application Number:
  US15/352,010
• Publication Number:
  US 20170060884A1
• Time in Patent Office: 847 Days
• Field of Search: None
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

Protecting and restoring data within a networked (e.g. cloud) storage computing environment through asynchronous replication and remote backup of data and its associated metadata. Data backup and recovery functionality provides data backups by detecting incremental updates to the data and its associated metadata at specific points in time determined by policies. The policies are configurable based on user requirements. Multiple copies of the data backups can be made and stored in separate compressed files at backup/disaster recovery locations. The backups of data and its associated metadata, which includes file system configuration information can be used to restore the state of a computer file system to that of a given point-in-time. Accordingly, a data protection approach is disclosed for protecting data at both the file system level and application level.

Claims

1. A computer implemented method for remote protection of data in a networked storage computing environment, the method comprising the steps of:

determining a remote data protection action for data and associated metadata according to a policy framework;

recording, by a processor, the data and the associated metadata at specific points-in-time based on the policy framework enforcing a recovery point objective (RPO) that defines a maximum time period in which loss of the data and the associated metadata is allowed and a recovery time objective (RTO) that defines a duration of time in which the data and the associated metadata must be restored after a disruption to a network attached storage appliance, the associated metadata including file system configuration information, and the network attached storage appliance being part of a storage cluster providing computing storage services and offering a computing device access to a common set of data consolidated from a plurality of user systems;

copying, by the processor, the data and the associated metadata into backup files; and

generating, by the processor, a first data structure with pointers to the backup files, based on a schedule configured to achieve the RPO and the RTO according to the policy framework, wherein the first data structure with the pointers to the backup files comprises;

a file path associated with a status corresponding to a set of data stored at a location specified by the file path, the set of data including the data and the associated metadata copied into the backup files; and

at least one of the pointers to the backup files of the set of data stored at the location, the status indicating whether the set of data is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed; and

generating subsequent data structures by utilizing the first data structure;

wherein;

the pointers to the backup files of the first data structure prevent re-copying of unmodified data of the first data structure, the unmodified data having not been modified since the first data structure was generated.

2. The method of claim 1, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume.

3. The method of claim 1, wherein the step of copying further comprises:

compressing a full backup copy of the set of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of the data and the associated metadata.

4. The method of claim 1, wherein:

the remote data protection action is a pre-determined action corresponding to whether the data and the associated metadata is newly created, the data and associated metadata is modified from a previously stored version;

the data and associated metadata is unchanged from a previously stored version.

5. The method of claim 4, wherein:

the pre-determined action corresponding to the data being newly created is, for the file path having newly created data, create a corresponding entry for a snapshot status and an entry for a snapshot ID, the snapshot ID including a value corresponding to a new location containing a compressed copy of the data at a specified point in time.

6. The method of claim 1, wherein the file system configuration information includes file system quotas, filesets, and access-control-lists.

7. The method of claim 1, further comprising:

transferring the backup files and the first data structure to a backup location for storage on a storage device.

8. A system for remote protection and restoration of data in a networked storage computing environment, the system comprising:

a bus;

a processor coupled to a bus;

a memory medium coupled to the bus, the memory medium comprising instructions, the instructions executed by the processor to;

determine a remote data protection action for data and associated metadata according to a policy framework;

record the data and the associated metadata at specific points-in-time based on the policy framework enforcing a recovery point objective (RPO) that defines a maximum time period in which loss of the data and the associated metadata is allowed and a recovery time objective (RTO) that defines a duration of time in which the data and the associated metadata must be restored after a disruption to a network attached storage appliance, the associated metadata including file system configuration information, and the network attached storage appliance being part of a storage cluster providing computing storage services and offering a computing device access to a common set of data consolidated from a plurality of user systems;

copy the data and associated metadata into backup files; and

generate a first data structure with pointers to the backup files, based on a schedule configured to achieve the RPO and the RTO according to the policy framework, wherein the first data structure with the pointers to the backup files comprises;

a file path associated with a status corresponding to a set of data stored at a location specified by the file path, the set of data including the data and the associated metadata copied into the backup files; and

at least one of the pointers to the backup files of the set of data stored at the location, the status indicating whether the set of data is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed; and

generate subsequent data structures by utilizing the first data structure;

wherein;

the pointers to the backup tiles of the first data structure prevent re-copying of unmodified data of the first data structure, the unmodified data having not been modified since the first data structure was generated.

9. The system of claim 8, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume.

10. The system of claim 8, wherein the step of copying further comprises:

compressing a full backup copy of the set of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of the data and the associated metadata.

11. The system of claim 8, further comprising instructions to:

determine to perform a remote data protection process responsive to exceeding a maximum number of snapshots and an existence of a previously created snapshot.

12. The system of claim 8, wherein the file system configuration information includes file system quotas, filesets, and access-control-lists.

13. The system of claim 8, wherein the first data structure is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, and other in-memory data structures.

14. A computer program product for remote protection and restoration of data in a networked storage computing environment, the computer program product comprising a non-transitory computer readable storage media, and program instructions stored on the non-transitory computer readable storage media, to:

determine a remote data protection action for data and associated metadata according to a policy framework;

record the data and the associated metadata at specific points-in-time based on the policy framework enforcing a recovery point objective (RPO) that defines a maximum time period in which loss of the data and the associated metadata is allowed and a recovery time objective (RTO) that defines a duration of time in which the data and the associated metadata must be restored after a disruption to a network attached storage appliance, the associated metadata including file system configuration information, and the network attached storage appliance being part of a storage cluster providing computing storage services and offering a computing device access to a common set of data consolidated from a plurality of user systems;

copy the data and the associated metadata into backup files; and

generate a first data structure with pointers to the backup files, based on a schedule configured to achieve the RPO and the RTO according to the policy framework, wherein the first data structure with the pointers to the backup files comprises;

a file path associated with a status corresponding to a set of data stored at a location specified by the file path, the set of data including the data and the associated metadata copied into the backup files; and

at least one of the pointers to the backup files of the set of data stored at the location, the status indicating whether the set of data is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed; and

generating subsequent data structures by utilizing the first data structure;

wherein;

the pointers to the backup files of the first data structure prevent re-copying of unmodified data of the first data structure, the unmodified data having not been modified since the first data structure was generated.

15. The computer program product of claim 14, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume.

16. The computer program product of claim 14, wherein the step of copying further comprises:

compressing a full backup copy of the set of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of the data and the associated metadata.

17. The computer program product of claim 14, further comprising instructions to:

determine to perform a remote data protection process responsive to exceeding a maximum number of snapshots and an existence of a previously created snapshot.

18. The computer program product of claim 14, wherein the file system configuration information includes file system quotas, filesets, and access-control-lists.