Systems and methods for performing data replication

• US 9,020,898 B2
• Filed: 07/09/2014
• Issued: 04/28/2015
• Est. Priority Date: 12/19/2005
• Status: Expired due to Fees

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Prahlad, Anand, Ngo, David
• Primary Examiner(s): To, Baoquoc N
• Application Number:
  US14/326,855
• Publication Number:
  US 20140324772A1
• Time in Patent Office: 293 Days
• Field of Search: 707/640, 707/672
• US Class Current: 707/640
• CPC Class Codes: G06F 11/1446 Point-in-time backing up or restoration of persistent data
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/1794 Details of file format conversion
• CPC Class Codes: G06F 16/184 implemented as replicated file system
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/0673 Single storage device
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

Performing data management operations on replicated data in a computer network. Log entries are generated for data management operations of an application executing on a source system. Consistency point entries are used to indicate a time of a known good, or recoverable, state of the application. A destination system is configured to process a copy of the log and consistency point entries to replicate data in a replication volume, the replicated data being a copy of the application data on the source system. When the replicated data represents a known good state of the application, as determined by the consistency point entries, the destination system(s) may perform a storage operation (e.g., snapshot, backup) to copy the replicated data and to logically associate the copied data with a time information (e.g., time stamp) indicative of the source system time when the application was in the known good state.

Claims

1. A method for performing data management operations, the method comprising:

storing in a first log, file information about data operations occurring at a first time to first data stored on one or more first storage devices;

copying at least a portion of the first log file to a second log file;

processing the second log file to create replicated data of the first data on one or more second storage devices;

generating a backup copy of the replicated data at a second time after the second log file has been copied to the one or more second storage devices; and

associating the backup copy of the replicated data with the first data stored on the one or more first storage devices wherein after the associating, the backup copy of the replicated data appears to be a backup of the first data existing at the first time on the one or more first storage devices.

2. The method of claim 1 further comprising monitoring the data operations with a filter driver.

3. The method of claim 1 generating the backup copy stores the backup copy in a backup format that is different than a native format of either the first or second data.

4. The method of claim 1 further comprising identifying a third time that data operations occur to the first data and replicating the data operations on the one or more second storage devices.

5. The method of claim 4 further comprising generating at a fourth time, a differential backup of the replicated data on the one or more second storage devices.

6. The method of claim 5 further comprising associating the differential backup of the replicated data occurring at the fourth time with the first data existing on the one or more first storage devices at the third time.

7. The method of claim 1 further comprising quiescing a computer application associated with the data operations at a time of a known good state of the computer application.

8. The method of claim 1 wherein processing the second log file comprises instantiating a plurality of threads that process data entries in the second log file and replay the data operations associated therewith to the one or more second storage devices.

9. The method of claim 8 wherein each of the plurality of threads process a particular type of data operation.

10. The method. of claim 1 wherein processing the second log file comprises replaying at least a first portion of data operations associated with data entries in the second log file.

11. A system for performing data management operations, the system comprising:

a first log file that stores information about data operations occurring at a first time to first data stored one or more first storage devices;

a replication module comprising computer hardware configured to copy at least a portion of the first log file to a second log file, the replication module processes the second log file to create replicated data of the first data on one or more second storage devices;

a backup module comprising computer hardware configured to create a backup copy of the replicated data at a second time after the second log file has been copied to the one or more second storage devices; and

a storage module comprising computer hardware configured to associate the replicated data with the first data stored on the one or more first storage devices wherein after the associating, the backup copy of the replicated data appears to be a backup of the first data existing at the first time on the one or more first storage devices.

12. The system of claim 11 further comprising a filter driver that monitors the data operations.

13. The system of claim 11 wherein the backup copy stores the backup copy in a backup format that is different than a native format of either the first or second data.

14. The system of claim 11 wherein the replication module replicates data operations that occur to the first data at a third time on the one or more second storage devices.

15. The system of claim 14 wherein the backup module generates at a fourth time, a differential backup of the replicated data on the one or more second storage devices.

16. The system of claim 15 wherein the storage module associates the differential backup of the replicated data occurring at the fourth time with the first data existing on the one or more first storage devices at the third time.

17. The system of claim 11 wherein a computer application associated with the data operations is quiesced at a time of a known good state of the computer application.

18. The system of claim 11 wherein the replication module further comprises plurality of threads that process data entries in the second log file and replay the data operations associated therewith to the one or more second storage devices.

19. The system of claim 18 wherein each of the plurality of threads process a particular type of data operation.

20. The method of claim 11 wherein the replication module replays at least a first portion of data operations associated with data entries in the second log file.