Systems and methods for doing agentless backup in scale-out fashion

• US 9,690,670 B1
• Filed: 06/30/2014
• Issued: 06/27/2017
• Est. Priority Date: 06/30/2014
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Inventors: Paulzagade, Sudhakar W., Kulkarni, Pradip M., Jain, Saurabh, Karandikar, Siddharth S.
• Primary Examiner(s): Fleurantin, Jean B
• Application Number:
  US14/319,977
• Time in Patent Office: 1,093 Days
• Field of Search: 707640, 707644, 707652, 707651, 711162
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70

Abstract

Various systems, methods and apparatuses for intelligently and dynamically allocating proxy backup clients to back up and restore vast amounts of data distributed across a network are presented. One method involves identify distributed data stored in a computer system, requesting the data, and performing a backup or restore operation on the data. Other aspects include intelligently dynamically allocating proxy backup clients to perform backup and restore operations on data distributed across a network, and intelligently and dynamically balancing, or re-balancing or otherwise managing the workload among the proxy backup clients.

Claims

1. A computer-implemented method of backing up data, the method comprising:

identifying data stored in a plurality of computer systems, wherein

the plurality of computer systems comprises a plurality of data nodes,

the data is stored at one or more data nodes of the plurality of data nodes, and

the identifying identifies at least one of the one or more data nodes;

requesting the data, wherein

the requesting is performed by a proxy backup client of a plurality of proxy backup clients; and

performing a backup operation on the data, wherein

the backup operation is performed by at least two proxy backup clients of the plurality of proxy backup clients,

the backup operation is distributed among the at least two proxy backup clients based on two or more criteria among a plurality of criteria, wherein the criteria comprises at least two of

available bandwidth,

available processing power, or

proximity to one or more of the data nodes, and

the performing comprises

receiving at least a portion of the data at each of the at least two proxy backup clients, and

storing the portion of the data in a memory in each of the at least two proxy backup clients.

2. The method of claim 1, wherein the identifying further comprises:

requesting information about a location of the data, wherein

the information identifies at least one of the data nodes.

3. The method of claim 2, wherein

the requesting the information further comprises

the data is stored at a plurality of the data nodes in a cluster,

a first data node among the plurality of data nodes comprises a first operating system,

a second data node among the plurality of data nodes comprises a second operating system, and

the information identifies the first data node and the second data node;

and

the requesting the data further comprises

requesting data substantially simultaneously from the first data node and the second data node.

4. The method of claim 1, further comprising:

invoking the plurality of proxy backup clients, wherein

the plurality of proxy backup clients are associated with a cluster, and

the cluster comprises a storage management system and the one or more data nodes.

5. The method of claim 4, wherein the invoking further comprises:

determining a number of proxy backup clients to invoke, wherein

the data comprises a plurality of data blocks; and

the determining is based on at least one of

a volume of the data, and

a number of data nodes upon which at least one of the data blocks is stored.

6. The method of claim 1, wherein the requesting the data further comprises:

the data comprises a plurality of data blocks, and

at least two of the plurality of proxy backup clients each request at least one of the data blocks at substantially the same time.

7. The method of claim 1, wherein the performing the backup operation further comprises:

the data comprises a plurality of data blocks, and

the data blocks are de-duplicated prior to storing the data in the memory.

8. A system comprising

one or more processors;

a memory coupled to the one or more processors, wherein the memory stores program instructions executable by the one or more processors to;

identify data stored in a plurality of computer systems, wherein

the plurality of computer systems comprises a plurality of data nodes,

the data is stored at one or more data nodes of the plurality of data nodes, and

at least one of the one or more data nodes are identified;

request the data, wherein

the request is performed by a proxy backup client of a plurality of proxy backup clients; and

perform a backup operation on the data, wherein

the backup operation is performed by at least two proxy backup clients of the plurality of proxy backup clients,

the backup operation is distributed among the at least two proxy backup clients based on two or more criteria among a plurality of criteria, wherein the criteria comprises at least two of

available bandwidth,

available processing power, or

proximity to one or more of the data nodes, and

the backup operation performed comprises

receiving at least a portion of the data at each of the at least two proxy backup clients, and

storing the portion of the data in a memory in each of the at least two proxy backup clients.

9. The system of claim 8, wherein identifying the data comprises:

request information about a location of the data, wherein the information identifies at least one of the data nodes.

10. The system of claim 8, further comprising:

invoke the plurality of proxy backup clients, wherein

the plurality of proxy backup clients are associated with a cluster, and

the cluster comprises a storage management system and the one or more data nodes.

11. The system of claim 10, wherein invoking the plurality of proxy backup clients comprises:

determine a number of proxy backup clients to invoke, wherein

the data comprises a plurality of data blocks; and

the number of proxy backup clients to invoke is determined based on at least one of

a volume of the data, and

a number of data nodes upon which at least one of the data blocks is stored.

12. The system of claim 8, wherein the request further comprises:

the data comprises a plurality of data blocks, and

at least two of the plurality of proxy backup clients each request at least one of the data blocks at substantially the same time.

13. The system of claim 9, wherein

the request of the information further comprises

the data is stored at a plurality of the data nodes in a cluster,

a first data node among the plurality of data nodes comprises a first operating system,

a second data node among the plurality of data nodes comprises a second operating system, and

the information identifies the first data node and the second data node;

and

the request of the data further comprises

request data substantially simultaneously from a first data node and a second data node.

14. A non-transitory computer-readable storage medium storing programming instructions executable to

identify data stored in a plurality of computer systems, wherein

the plurality of computer systems comprises a plurality of data nodes,

the data is stored at one or more data nodes of the plurality of data nodes, and

at least one of the one or more data nodes are identified;

request the data, wherein

the request is performed by a proxy backup client of a plurality of proxy backup clients; and

perform a backup operation on the data, wherein

the backup operation is performed by at least two proxy backup clients of the plurality of proxy backup clients,

the backup operation is distributed among the at least two proxy backup clients based on two or more criteria among a plurality of criteria, wherein the criteria comprises at least two of

available bandwidth,

available processing power, or

proximity to one or more of the data nodes, and

the backup operation performed comprises

receiving at least a portion of the data at each of the at least two proxy backup clients, and

storing the portion of the data in a memory in each of the at least two proxy backup clients.

15. The non-transitory computer-readable storage medium of claim 14, wherein the programming instructions are further configured to:

request information about a location of the data, wherein the information identifies at least one of the data nodes.

16. The non-transitory computer-readable storage medium of claim 14, wherein the programming instructions are further configured to:

invoke the plurality of proxy backup clients, wherein

the plurality of proxy backup clients are associated with a cluster, and

the cluster comprises a storage management system and the one or more data nodes.

17. The non-transitory computer-readable storage medium of claim 16, wherein the programming instructions are further configured to:

determine a number of proxy backup clients to invoke, wherein

the data comprises a plurality of data blocks; and

the number of proxy backup clients to invoke is determined based on at least one of

a volume of the data, and

a number of data nodes upon which at least one of the data blocks is stored.