Maintaining backup snapshots using continuous replication from multiple sources

• US 9,720,618 B1
• Filed: 12/16/2013
• Issued: 08/01/2017
• Est. Priority Date: 12/16/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Panidis, Anestis, Natanzon, Assaf, Cohen, Saar
• Primary Examiner(s): Yi, David X
• Assistant Examiner(s): GOLDSCHMIDT, CRAIG S
• Application Number:
  US14/108,060
• Time in Patent Office: 1,324 Days
• Field of Search: None
• CPC Class Codes: G06F 11/14 Error detection or correction of the data by redundancy in operation G06F11/16 takes precedence
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/16 Error detection or correction of the data by redundancy in hardware
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0683 Plurality of storage devices

Abstract

A method and system for synthesizing backup snapshots is discussed. IO'"'"'s may be streamed from multiple locations, and placed in journal files. These journal files may thereafter be used to synthesize the backup snapshot.

Claims

1. A method for synthesizing snapshots from multiple sources, the method comprising:

dividing a logical storage unit (“

LUN”

) on a common storage array into at least a first portion and a second portion;

assigning responsibility for protecting the first portion of the LUN to a first data protection appliance;

assigning responsibility for protecting the second portion of the LUN to a second data protection appliance;

receiving, at the first data protection appliance, a first set of input/output operations (“

IOs”

) made to the first portion of the LUN on the common storage array as the first set of IOs are made to the first portion of the LUN;

sending the first set of IOs from the first data protection appliance to a deduplicated storage;

receiving, at the second data protection appliance, a second set of IOs made to the second portion of the LUN as the second set of IOs are made to the second portion of the LUN;

sending the second set of IOs from the second data protection appliance to the deduplicated storage; and

synthesizing a backup snapshot comprising data associated with the first set of IOs and the second set of IOs, wherein the first set of IOs are received at the first data protection appliance because the first data protection appliance was assigned responsibility for protecting the first portion of the LUN, and

wherein the second set of IOs are received at the second data protection appliance because the second data protection appliance was assigned responsibility for protecting the second portion of the LUN.

2. The method of claim 1, wherein the first set of IOs is written to a first journal and the second set of IOs is written to a second journal.

3. The method of claim 2, wherein the backup snapshot is synthesized from the first journal and the second journal.

4. The method of claim 2, further comprising:

synthesizing a first snapshot from the first journal; and

synthesizing a second snapshot from the second journal.

5. The method of claim 4, wherein synthesizing the backup snapshot comprises merging the first snapshot and the second snapshot.

6. The method of claim 1, wherein the first set of IOs and the second set of IOs are both applied to the common storage array.

7. The method of claim 6, wherein the backup snapshot is a backup of the common storage array.

8. The method of claim 1 comprising:

assigning responsibility for protecting the first portion of the LUN to the second data protection appliance, thereby overlapping the protection of the first portion of the LUN by the first and second data protection appliances.

9. The method of claim 1 comprising:

after the sending the first set of IOs from the first data protection appliance to a deduplicated storage, synthesizing, at the deduplicated storage, a first snapshot, wherein the second set of IOs are excluded from the first snapshot, and

wherein both the first snapshot and backup snapshot are synthesized at the same deduplicated storage.

10. A computer program product for synthesizing snapshots from multiple sources, the computer program product comprising a non-transitory computer readable medium encoded with computer executable program, the code enabling:

dividing a logical storage unit (“

LUN”

) on a common storage array into at least a first portion and a second portion;

assigning responsibility for protecting the first portion of the LUN to a first data protection appliance;

assigning responsibility for protecting the second portion of the LUN to a second data protection appliance;

receiving, at the first data protection appliance, a first set of input/output operations (“

IOs”

) made to the first portion of the LUN on the common storage array as the first set of IOs are made to the first portion of the LUN;

sending the first set of IOs from the first data protection appliance to a deduplicated storage;

receiving, at the second data protection appliance, a second set of IOs made to the second portion of the LUN as the second set of IOs are made to the second portion of the LUN;

sending the second set of IOs from the second data protection appliance to the deduplicated storage; and

synthesizing a backup snapshot comprising data associated with the first set of IOs and the second set of IOs, wherein the first set of IOs are received at the first data protection appliance because the first data protection appliance was assigned responsibility for protecting the first portion of the LUN, and

wherein the second set of IOs are received at the second data protection appliance because the second data protection appliance was assigned responsibility for protecting the second portion of the LUN.

11. The computer program product of claim 10, wherein the first set of IOs is written to a first journal and the second set of IOs is written to a second journal.

12. The computer program product of claim 11, wherein the backup snapshot is synthesized from the first journal and the second journal.

13. The computer program product of claim 11, further comprising:

synthesizing a first snapshot shot from the first journal; and

synthesizing a second snapshot from the second journal.

14. The computer program product of claim 13, wherein synthesizing the backup snapshot comprises merging the first snapshot and the second snapshot.

15. A system for synthesizing snapshots from multiple sources, the system comprising a computer processor configured to execute instructions comprising:

dividing a logical storage unit (“

LUN”

) on a common storage array into at least a first portion and a second portion;

assigning responsibility for protecting the first portion of the LUN to a first data protection appliance;

assigning responsibility for protecting the second portion of the LUN to a second data protection appliance;

receiving, at the first data protection appliance, a first set of input/output operations (“

IOs”

) made to the first portion of the LUN on the common storage array as the first set of IOs are made to the first portion of the LUN;

sending the first set of IOs from the first data protection appliance to a deduplicated storage;

receiving, at the second data protection appliance, a second set of IOs made to the second portion of the LUN as the second set of IOs are made to the second portion of the LUN;

sending the second set of IOs from the second data protection appliance to the deduplicated storage; and

synthesizing a backup snapshot comprising data associated with the first set of IOs and the second set of IOs, wherein the first set of IOs are received at the first data protection appliance because the first data protection appliance was assigned responsibility for protecting the first portion of the LUN, and

wherein the second set of IOs are received at the second data protection appliance because the second data protection appliance was assigned responsibility for protecting the second portion of the LUN.

16. The system of claim 15, wherein the first set of IOs is written to a first journal and the second set of IOs is written to a second journal.

17. The system of claim 16, wherein the backup snapshot is synthesized from the first journal and the second journal.

18. The system of claim 16, further comprising:

synthesizing a first snapshot shot from the first journal; and

synthesizing a second snapshot from the second journal.

19. The system of claim 18, wherein synthesizing the backup snapshot comprises merging the first snapshot and the second snapshot.