Remote data protection in a networked storage computing environment

• US 9,575,848 B2
• Filed: 01/29/2014
• Issued: 02/21/2017
• Est. Priority Date: 02/08/2011
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Goodman, David P., Gopisetty, Sandeep, Nadgowda, Shripad, Routray, Ramani R.
• Primary Examiner(s): Meng, Jau-Shya
• Application Number:
  US14/167,345
• Publication Number:
  US 20140149791A1
• Time in Patent Office: 1,119 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

Embodiments of the present invention provide an approach for protecting and restoring data within a networked (e.g. cloud) storage computing environment through asynchronous replication and remote backup of data and its associated metadata. Under embodiments of the present invention, data backup and recovery functionality provides data backups by detecting incremental updates to the data and its associated metadata at specific points in time determined by policies. The policies are configurable based on user requirements. Multiple copies of the data backups can be made and stored in separate compressed files at backup/disaster recovery locations. The backups of data and its associated metadata, which includes file system configuration information can be used to restore the state of a computer file system to that of a given point-in-time. Accordingly, a data protection approach is disclosed for protecting data at both the file system level and application level.

Claims

1. A computer implemented method for remote protection of data in a networked storage computing environment, the method comprising the steps of:

determining whether to perform a remote data protection process based at least on whether a maximum number of snapshots has been exceeded and whether a previously created snapshot exists;

recording, by a processor, data and associated metadata at specific points-in-time based on policies that enforce both a recovery point objective (RPO) that defines a maximum time period in which loss of the data is allowed and a recovery time objective (RTO) that defines a duration of time in which the data must be restored after a disruption to a network attached storage appliance, wherein the network attached storage appliance is part of a storage cluster that provides computing storage services and offers a computing device access to a common set of data consolidated from a plurality of user systems;

copying the data and the associated metadata into backup files;

generating a data structure with pointers to the backup files, based on a schedule configured to achieve the RPO and the RTO, wherein the data structure with pointers to the backup files comprises a file path associated with a status and at least one of the pointers to the backup files, wherein the status indicates whether data at a location specified by the file path is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed; and

transferring the backup files and the data structure to one or more backup locations for storage on an electronic storage device.

2. The method of claim 1, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume.

3. The method of claim 1, wherein the step of copying further comprises:

compressing a full backup copy of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of data.

4. The method of claim 3, wherein one or more of additional compressed copies of data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies is adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

5. The method of claim 1, wherein the metadata comprises quota, filesets, and access-control-lists.

6. The method of claim 1, wherein the step of generating the data structure with pointers to the backup files further comprises generating subsequent data structures by utilizing an existing data structure, and wherein the pointers to the backup files prevent re-copying of data that has not been modified since the previous backup copy was performed.

7. The method of claim 6, wherein the data structure is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, and other in-memory data structures.

8. A system for remote protection and restoration of data in a networked storage computing environment, the system comprising:

a bus;

a processor coupled to the bus;

a memory medium coupled to the bus, the memory medium comprising instructions wherein the instructions are executed by the processor to;

determine whether to perform a remote data protection process based at least on whether a maximum number of snapshots has been exceeded and whether a previously created snapshot exists;

record data and associated metadata at specific points-in-time based on policies that enforce both a recovery point objective (RPO) that defines a maximum time period in which loss of the data is allowed and a recovery time objective (RTO) that defines a duration of time in which the data must be restored after a disruption to a network attached storage appliance, wherein the network attached storage appliance is part of a storage cluster that provides computing storage services and offers a computing device access to a common set of data consolidated from a plurality of user systems;

copy the data and associated metadata into backup files;

generate a data structure, based on a schedule configured to achieve the RPO and the RTO, wherein the data structure with pointers to the backup files comprises a file path associated with a status and at least one of the pointers to the backup files, wherein the status indicates whether data at a location specified by the file path is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed; and

transfer the backup files and the data structure to the one or more backup locations for storage on an electronic storage device.

9. The system of claim 8, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume; and

the file management system consolidating many network attached storage devices into one centrally managed storage cluster.

10. The system of claim 8, wherein the step of copying further comprises compressing a full backup copy of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of data.

11. The system of claim 10, wherein one or more of additional compressed copies of data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies is adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

12. The system of claim 8, wherein the metadata comprises quota, filesets, and access-control-lists.

13. The system of claim 8, wherein the step of generating the data structure with pointers to the backup files further comprises generating subsequent data structures by utilizing an existing data structure, and wherein the pointers to the backup files prevent re-copying of data that has not been modified since the previous backup copy was performed.

14. The system of claim 13, wherein the data structure is implemented by utilizing at least one of the following:

a hash map based data structure, database tables, and other in-memory data structures.

15. A computer program product for remote protection and restoration of data in a networked storage computing environment, the computer program product comprising a non-transitory computer readable storage media, and program instructions stored on the non-transitory computer readable storage media, the program instructions, when executed by a processor, cause the processor to:

determine whether to perform a remote data protection process based at least on whether a maximum number of snapshots has been exceeded and whether a previously created snapshot exists;

record data and associated metadata at specific points-in-time based on policies that enforce both a recovery point objective (RPO) that defines a maximum time period in which loss of the data is allowed and a recovery time objective (RTO) that defines a duration of time in which the data must be restored after a disruption to a network attached storage appliance, wherein the network attached storage appliance is part of a storage cluster that provides computing storage services and offers a computing device access to a common set of data consolidated from a plurality of user systems;

copy the data and the associated metadata into backup files;

generate a data structure with pointers to the backup files, based on a schedule configured to achieve the RPO and the RTO, wherein the data structure with pointers to the backup files comprises a file path associated with a status and at least one of the pointers to the backup files, wherein the status indicates whether data at a location specified by the file path is newly created, has been modified since a previous backup copy was performed, or is unchanged since the previous backup copy was performed; and

transfer the backup files and the data structure to the one or more backup locations for storage on an electronic storage device.

16. The computer program product of claim 15, wherein the step of recording comprises:

performing an application specific write-suspend, a General Parallel File System (GPFS) write-suspend, recording a GPFS file system snapshot, recording a GPFS configuration, performing a GPFS specific write-resume, and performing an application specific write-resume; and

the file management system consolidating many network attached storage devices into one centrally managed storage cluster.

17. The computer program product of claim 15, wherein the step of copying further comprises compressing a full backup copy of data created at a first time that the step of copying is performed, and subsequently compressing an incremental backup copy of data.

18. The computer program product of claim 17, wherein one or more of additional compressed copies of data are generated, thereby eliminating a single point of failure for a given backup file, and wherein the number of additional compressed backup copies is adjusted according to a user'"'"'s policy of not spanning more than a given number of backup copies.

19. The computer program product of claim 15, wherein the metadata comprises quota, filesets, and access-control-lists.

20. The computer program product of claim 15, wherein the step of generating the data structure with pointers to the backup files further comprises generating subsequent data structures by utilizing an existing data structure, and wherein the pointers to the backup files prevent re-copying of data that has not been modified since the previous backup copy was performed.