Data backup management on distributed storage systems

• US 10,114,580 B1
• Filed: 06/30/2014
• Issued: 10/30/2018
• Est. Priority Date: 05/05/2014
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Srivastav, Shashwat, Sankaran, Sriram, Shah, Vishrut, Zhang, Qi, Luo, Jun, Wang, Chen, Gaddamadugu, Subba R., Musial, Peter M., Robertson, Andrew D., Yuan, Huapeng
• Primary Examiner(s): Chappell, Daniel C
• Application Number:
  US14/319,383
• Time in Patent Office: 1,583 Days
• CPC Class Codes: G06F 12/0831 using a bus scheme, e.g. with bus monitoring or watching means
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/2246 Trees, e.g. B+trees
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0626 Reducing size or complexity of storage systems
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

A computer-executable method, computer program product, and system for managing backups in a distributed data storage system including a first zone, a second zone, and a third zone, the computer-executable method, computer program product, and system comprising processing, at the third zone, a first portion of data of the first zone and a second portion of data of the second zone to create a combined portion of data, and removing the first portion and second portion from the third zone.

Claims

1. A computer-executable method of managing backups in a distributed data storage system including one or more zones which includes a first zone, a second zone, and a third zone, the computer-executable method comprising:

providing access to a first portion of data from the first zone, a second portion of data from the second zone, and a third portion of data from the third zone;

processing, at the third zone, the first portion of data of the first zone and the second portion of data of the second zone to create a combined portion of data, wherein the first zone, the second zone, and the third zone exist in separate locations, wherein each zone includes one or more data storage arrays;

wherein the first zone manages a primary backup of the first portion of data within the first zone and the second zone manages a primary backup of the second portion of data within the second zone; and

removing the first portion of data of the first zone and the second portion of data of the second zone from the third zone, to reduce an amount of backup data stored, wherein the processing comprises;

executing an exclusive or (XOR) operation on the first portion of data of the first zone and the second portion of data of the second zone, wherein the combined portion of data is the first portion of data of the first zone XOR the second portion of data of the second zone.

2. The computer-executable method of claim 1, further comprising:

receiving a request for the first portion of data, wherein a failure event has occurred at the first zone;

retrieving the second portion of data from the second zone; and

processing the second portion of data and the combined portion of data to restore the first portion of data.

3. The computer-executable method of claim 2, wherein the failure event comprises losing an ability to communicate with the first zone.

4. The computer-executable method of claim 2, further comprising responding to the request for the first portion of data.

5. The computer-executable method of claim 1, wherein the first zone includes one or more compute nodes and one or more data storage arrays.

6. A system, comprising:

a distributed data storage system including one or more zones which includes a first zone, a second zone, and a third zone; and

computer-executable program logic encoded in memory of one or more computers in communication with the distributed data storage system to enable management of backups in the distributed data storage system, wherein the computer-executable program logic is configured for the execution of;

providing access to a first portion of data from the first zone, a second portion of data from the second zone, and a third portion of data from the third zone;

processing, at the third zone, the first portion of data of the first zone and the second portion of data of the second zone to create a combined portion of data, wherein the first zone, the second zone, and the third zone exist in separate locations, wherein each zone includes one or more data storage arrays;

wherein the first zone manages a primary backup of the first portion of data within the first zone and the second zone manages a primary backup of the second portion of data within the second zone; and

removing the first portion of data of the first zone and the second portion of data of the second zone from the third zone, to reduce an amount of backup data stored, wherein the processing comprises;

executing an exclusive or (XOR) operation on the first portion of data of the first zone and the second portion of data of the second zone, wherein the combined portion of data is the first portion of data of the first zone XOR the second portion of data of the second zone.

7. The system of claim 6, wherein the computer-executable program logic is further configured for the execution of:

receiving a request for the first portion of data, wherein a failure event has occurred at the first zone;

retrieving the second portion of data from the second zone; and

processing the second portion of data and the combined portion of data to restore the first portion of data.

8. The system of claim 7, wherein the failure event comprises losing an ability to communicate with the first zone.

9. The system of claim 7, wherein the computer-executable program logic is further configured for the execution of responding to the request for the first portion of data.

10. The system of claim 6, wherein the first zone includes one or more compute nodes and one or more data storage arrays.

11. A non-transitory computer-readable storage medium, comprising

computer executable program code for managing backups in a distributed data storage system including one or more zones which includes a first zone, a second zone, and a third zone, the computer-executable program code configured to enable the execution of:

providing access to a first portion of data from the first zone, a second portion of data from the second zone, and a third portion of data from the third zone;

processing, at the third zone, the first portion of data of the first zone and the second portion of data of the second zone to create a combined portion of data, wherein the first zone, the second zone, and the third zone exist in separate locations, wherein each zone includes one or more data storage arrays;

wherein the first zone manages a primary backup of the first portion of data within the first zone and the second zone manages a primary backup of the second portion of data within the second zone; and

removing the first portion of data of the first zone and the second portion of data of the second zone from the third zone, to reduce an amount of backup data stored, wherein the processing comprises;

executing an exclusive or (XOR) operation on the first portion of data of the first zone and the second portion of data of the second zone, wherein the combined portion of data is the first portion of data of the first zone XOR the second portion of data of the second zone.

12. The non-transitory computer-readable storage medium of claim 11, wherein the code is further configured to enable the execution of:

receiving a request for the first portion of data, wherein a failure event has occurred at the first zone;

retrieving the second portion of data from the second zone; and

processing the second portion of data and the combined portion of data to restore the first portion of data.

13. The non-transitory computer-readable storage medium of claim 12, wherein the failure event comprises losing an ability to communicate with the first zone.

14. The non-transitory computer-readable storage medium of claim 12, wherein the code is further configured to enable the execution of responding to the request for the first portion of data.

15. The non-transitory computer-readable storage medium of claim 11, wherein the first zone includes one or more compute nodes and one or more data storage arrays.