Management of data replication and storage apparatuses, methods and systems

• US 10,515,057 B2
• Filed: 07/11/2018
• Issued: 12/24/2019
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Datto LLC
• Original Assignee: Datto, Inc. (Kaseya Limited)
• Inventors: Mortensen, Spencer, Giacobbi, Justin
• Primary Examiner(s): Le, Hung D
• Application Number:
  US16/032,756
• Publication Number:
  US 20180322140A1
• Time in Patent Office: 531 Days
• Field of Search: None
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 11/14 Error detection or correction of the data by redundancy in operation G06F11/16 takes precedence
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency ensuring consistency in mirrored systems G06F11/2064
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The MANAGEMENT OF DATA REPLICATION AND STORAGE APPARATUSES, METHODS AND SYSTEMS (“BDR”) transform machine datasets using BDR components into replications over a network distributing redundant ready-to-use backup files. In some implementations, the disclosure provides a processor-implemented method for managing the replication and storage of data sets.

Claims

1. A processor implemented method for managing the replication and storage of data sets comprising:

sending a backup request according to a backup and snapshot schedule;

receiving at a host of a first file system a backup response comprising image enabled backup data reflecting the state and content of a computer device;

capturing a snapshot of the image enabled backup data, and storing the snapshot in the first file system;

validating according to a remote backup schedule a vector comprising a data set indicator corresponding to the computer device, and a mirroring relationship between the first file system and a second file system;

sending a task processing assistance request to a master server comprising a vector identifier, wherein the task processing assistance request comprises at least one of;

a first plurality of metrics related to the operational state of the first file system, and

a first plurality of metrics related to the operational state of the second file system; and

synchronizing the first file system with the second file system only after receiving a task processing assistance response from the master server validating the mirroring relationship.

2. The method of claim 1, wherein the captured snapshot comprises an incremental relation mirroring data blocks that have been modified in the computer system from the time when a previously received image enabled backup data was generated to the time when the current image enabled backup data was generated, and associating the snapshot with the time when the current image enabled backup data was generated.

3. The method of claim 2, wherein each snapshot can serve as a restore point for the computer device corresponding to its associated time.

4. The method of claim 3, wherein the host of the first file system is different from a host of the second file system.

5. The method of claim 4, wherein the task processing assistance request further comprises at least one new cryptographic key generated by the host of the first file system and a plurality of metrics related to the operational state of the host of the first file system.

6. The method of claim 5, further comprising a step wherein said master server sends an assisting node processing request to the host of the second file system comprising at least one new cryptographic key generated by the host of the first file system.

7. The method of claim 1, further comprising performing at least one task associated with the task processing assistance request in accordance with a prioritization order, wherein the prioritization order is based on at least one action type of the at least one task.

8. The method of claim 7, wherein the at least one action type comprises at least one of a building action, a sending action, and a receiving action.

9. A processor implemented method for managing the replication and storage of data sets comprising:

sending a backup request according to a backup and snapshot schedule;

receiving at a host of a first file system a backup response comprising image enabled backup data reflecting the state and content of a computer device;

capturing a snapshot of the image enabled backup data, and storing the snapshot in the first file system;

validating according to a remote backup schedule a vector comprising a data set indicator corresponding to the computer device, and a mirroring relationship between the first file system and a second file system;

sending a task processing assistance request to a master server comprising a vector identifier, the task processing assistance request being associated with at least one task having at least one action type;

receiving by the master server a network reconfiguration request comprising at least one of;

a command to disable the vector describing the mirroring relationship between the first file system and the second file system, and

a command to enable the vector describing the mirroring relationship between the first file system and the second file system;

synchronizing the first file system with the second file system only after receiving a task processing assistance response from the master server validating the mirroring relationship; and

performing the at least one task associated with the task processing assistance request in accordance with a prioritization order, wherein the prioritization order is based on the at least one action type of the at least one task.

10. The method of claim 9, wherein the captured snapshot comprises an incremental relation mirroring data blocks that have been modified in the computer system from the time when a previously received image enabled backup data was generated to the time when the current image enabled backup data was generated, and associating the snapshot with the time when the current image enabled backup data was generated.

11. The method of claim 10, wherein each snapshot can serve as a restore point for the computer device corresponding to its associated time.

12. The method of claim 11, wherein the host of the first file system is different from a host of the second file system.

13. The method of claim 12, wherein the task processing assistance request further comprises at least one new cryptographic key generated by the host of the first file system and a plurality of metrics related to the operational state of the host of the first file system.

14. The method of claim 13, further comprising a step wherein said master server sends an assisting node processing request to the host of the second file system comprising at least one new cryptographic key generated by the host of the first file system.

15. A processor implemented method for managing the replication and storage of data sets comprising:

sending a backup request according to a backup and snapshot schedule;

receiving at a host of a first file system a backup response comprising image enabled backup data reflecting the state and content of a computer device;

capturing a snapshot of the image enabled backup data, and storing the snapshot in the first file system;

validating according to a remote backup schedule a vector comprising a data set indicator corresponding to the computer device, and a mirroring relationship between the first file system and a second file system;

sending a task processing assistance request to a master server comprising a vector identifier, the task processing assistance request being associated with at least one task having at least one action type;

sending by the master server a network reconfiguration request comprising at least one of;

a command to disable the vector describing the mirroring relationship between the first file system and the second file system, and

a command to enable the vector describing the mirroring relationship between the first file system and the second file system;

synchronizing the first file system with the second file system only after receiving a task processing assistance response from the master server validating the mirroring relationship; and

performing the at least one task associated with the task processing assistance request in accordance with a prioritization order, wherein the prioritization order is based on the at least one action type of the at least one task.

16. The method of claim 15, wherein the captured snapshot comprises an incremental relation mirroring data blocks that have been modified in the computer system from the time when a previously received image enabled backup data was generated to the time when the current image enabled backup data was generated, and associating the snapshot with the time when the current image enabled backup data was generated.

17. The method of claim 16, wherein each snapshot can serve as a restore point for the computer device corresponding to its associated time.

18. The method of claim 17, wherein the host of the first file system is different from a host of the second file system.

19. The method of claim 18, wherein the task processing assistance request further comprises at least one new cryptographic key generated by the host of the first file system and a plurality of metrics related to the operational state of the host of the first file system.

20. The method of claim 19, further comprising a step wherein said master server sends an assisting node processing request to the host of the second file system comprising at least one new cryptographic key generated by the host of the first file system.