Browsing federated backups

• US 10,474,539 B1
• Filed: 12/18/2015
• Issued: 11/12/2019
• Est. Priority Date: 12/18/2015
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Yadav, Sunil, Anappa, Pradeep, Chokalingam, Elango, Buchman, Matthew D., Tokuri, Suman, Mandic, Vladimir
• Primary Examiner(s): Lin, Shew Fen
• Application Number:
  US14/975,483
• Time in Patent Office: 1,425 Days
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/2041 with more than one idle spare processing component
• CPC Class Codes: G06F 11/2046 where the redundant components share persistent storage G06F11/2043 takes precedence
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/815 Virtual

Abstract

Embodiments described herein provide for a system and associated logic to enable browsing of a federated backup having a plurality of portions, each portion separately generated and indexed by a plurality of nodes. In one embodiment, the system performs a federated backup by generating a unique identifier on a primary node and providing the unique identifier to each secondary node tasked with generating the plurality of portions. The secondary nodes associate the unique identifier with each of the plurality of portions. The unique identifier can then be used by a recovery UI to generate and display a consolidated view of the plurality of portions.

Claims

1. A non-transitory computer readable medium comprising instructions, which when executed by a processing system, cause the processing system to perform backup operations comprising:

receiving a request to back up data from a plurality of nodes of a source storage system, the plurality of nodes communicatively coupled to a backup server configured to manage backup of a plurality of storage devices associated with the source storage system, the plurality of nodes including a primary node and a plurality of secondary nodes, the plurality of storage devices including a first availability group and a second availability group;

in response to the request, selecting a first set of backup nodes from the plurality of secondary nodes to create a first backup of a first dataset on the first availability group on the plurality of storage devices, and selecting a second set of backup nodes from the plurality of secondary nodes to create a second backup of a second dataset on the second availability group on the plurality of storage devices;

initializing a backup session for each of the first backup and the second backup and generating a unique identifier associated with the backup session;

assigning, using a backup algorithm, a portion of the first backup to each node in the first set of backup nodes, and assigning, using the backup algorithm, a portion of the second backup to each node in the second set of backup nodes, wherein the backup algorithm is based on a plurality of criteria including a specified backup schedule and a size of data associated with the backup, wherein each node in the first set of backup nodes and the second set of backup nodes stores the unique identifier associated with their respective backup session in an index of the portion of the backup performed by the each node of the first set backup nodes and the second set of backup nodes; and

performing the first backup and the second backup concurrently, wherein the second backup for the plurality of storage devices is performed via the first set of backup nodes before completing the first backup, wherein each of the first backup and the second backup when completed includes a plurality of separately indexed backups of selected data on the first data set or the second data set on the plurality of storage devices;

displaying a consolidated view of the first backup or the second backup based on the respective unique identifier, the consolidated view representing separate backups generated by the first set of backup nodes or the second set of backup nodes.

2. The non-transitory computer readable medium as in claim 1, additionally comprising:

storing the separately indexed backups of the backup sessions to a target storage system.

3. The non-transitory computer readable medium as in claim 1, wherein the plurality of storage devices includes data associated with one or more virtual machines of a virtual machine cluster.

4. The non-transitory computer readable medium as in claim 1, wherein the plurality of storage devices includes data associated with one or more email servers.

5. The non-transitory computer readable medium as in claim 1, wherein the plurality of storage devices includes data associated with a distributed storage and collaboration system.

6. The non-transitory computer readable medium as in claim 1, further comprising launching primary backup logic on the primary node and, via the primary backup logic, selecting the set of backup nodes, initializing the backup session, generating the unique identifier associated with the backup session, passing the unique identifier to each node in the set of backup nodes, and directing the backup nodes to perform the backup operation.

7. The non-transitory computer readable medium as in claim 1, wherein each portion of the backups is a distinct subset of the first dataset or the second dataset to be backed up, each of first set of backup nodes and the second backup nodes is assigned a unique portion of the first backup or the second backup, and each portion of the backups is associated with a different save time.

8. A data backup and recovery system for performing federated backups, the system comprising:

a source storage system including a plurality of storage devices, the plurality of storage devices coupled to a plurality of nodes including a primary node and a plurality of secondary nodes, the plurality of storage devices including a first availability group and a second availability group;

a backup server configured to manage backing up of the plurality of storage devices associated with the source storage system, the backup server to initiate the backing up of the plurality of storage devices via primary backup logic on the primary node, wherein the primary backup logic initializes a backup session for each of a first backup on the first availability group and a second backup on the second availability group, and direct a first set of backup nodes selected from the plurality of secondary nodes to create the first backup of a first dataset on the first availability group on the plurality of storage devices and direct a second set of backup nodes from the plurality of secondary nodes to create the second backup of a second dataset on the second availability group on the plurality of storage devices to perform backup operations and to generate a unique identifier associated with the backup session;

wherein the backup server uses a backup algorithm to assign a portion of the first backup to each node in the first set of backup nodes, and assign a portion of the second backup to each node in the second set of backup nodes, wherein the backup algorithm is based on one or more of a plurality of criteria including a specified backup schedule and a size of data associated with the backup;

wherein each node in the first set of backup nodes and the second set of backup nodes stores the unique identifier associated with their respective backup session in an index of the portion of the backup performed by the each node of the first set of backup nodes and the second set of backup nodes; and

wherein the first backup and the second backup are performed concurrently, wherein the second backup for the plurality of storage devices is performed before the first backup for the plurality of storage devices is completed, wherein each of the first backup and the second backup when completed includes a plurality of separately indexed backups of data on the plurality of storage devices;

displaying a consolidated view of the first backup or the second backup based on the respective unique identifier, the consolidated view representing separate backups generated by the first set of backup nodes or the second set of backup nodes.

9. The backup and recovery system as in claim 8, wherein the backup server is additionally configured to generate the unique identifier for the backup session and associate the unique identifier with the plurality of separately indexed backups.

10. The backup and recovery system as in claim 8, wherein the primary backup logic on the primary node is additionally configured to generate the unique identifier for the backup session and transmit the unique identifier to each node in the first set of backup nodes or the second set of backup nodes, wherein first set of backup nodes or the second set of backup nodes is configured to associate the plurality of separately indexed backups with the unique identifier.

11. The backup and recovery system as in claim 8, additionally comprising a management console to display a user interface (UI) of a backup recovery utility, the UI to provide a consolidated view of the backup session including data from each of the plurality of separately indexed backups, each of the separately indexed backups having a different save time associated with the backup.

12. The backup and recovery system as in claim 11, wherein the management console is to generate the consolidated view of the backup session in response to receiving a request to browse back up data associated with a requested browse time.

13. The method of performing federated backups, the method comprising:

receiving a request to back up data from a plurality of nodes of a source storage system, the plurality of nodes communicatively coupled to a backup server configured to manage backup of a plurality of storage devices associated with the source storage system, the plurality of nodes including a primary node and a plurality of secondary nodes, the plurality of storage devices including a first availability group and a second availability group;

in response to the request, selecting a first set of backup nodes from the plurality of secondary nodes to create a first backup of a first dataset on the first availability group on the plurality of storage devices, and selecting a second set of backup nodes from the plurality of secondary nodes to create a second backup of a second dataset on the second availability group on the plurality of storage devices;

initializing a backup session for each of the first backup and the second backup and generating a unique identifier associated with the backup session;

assigning, using a backup algorithm, a portion of the first backup to each node in the first set of backup nodes, and assigning, using the backup algorithm, a portion of the second backup to each node in the second set of backup nodes, wherein the backup algorithm is based on a plurality of criteria including a specified backup schedule and a size of data associated with the backup, wherein each node in the first set of backup nodes and the second set of backup nodes stores the unique identifier associated with their respective backup session in an index of the portion of the backup performed by the each node of the first set backup nodes and the second set of backup nodes; and

performing the first backup and the second backup concurrently, wherein the second backup for the plurality of storage devices is performed via the first set of backup nodes before completing the first backup, wherein each of the first backup and the second backup when completed includes a plurality of separately indexed backups of selected data on the first data set or the second data set on the plurality of storage devices;

displaying a consolidated view of the first backup or the second backup based on the respective unique identifier, the consolidated view representing separate backups generated by the first set of backup nodes or the second set of backup nodes.

14. The method of claim 13, further comprising:

storing the separately indexed backups of the backup sessions to a target storage system.

15. The method of claim 13, wherein the plurality of storage devices includes data associated with one or more virtual machines of a virtual machine cluster.

16. The method of claim 13, wherein the plurality of storage devices includes data associated with one or more email servers.

17. The method of claim 13, wherein the plurality of storage devices includes data associated with a distributed storage and collaboration system.

18. The method of claim 13, further comprising:

launching primary backup logic on the primary node and, via the primary backup logic, selecting the set of backup nodes;

initializing the backup session, generating the unique identifier associated with the backup session; and

passing the unique identifier to each node in the set of backup nodes, and directing the backup nodes to perform the backup operation.