Unified interface for cloud-based backup and restoration

• US 9,940,203 B1
• Filed: 06/11/2015
• Issued: 04/10/2018
• Est. Priority Date: 06/11/2015
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Ghatnekar, Anand S., Patwardhan, Kedar S.
• Primary Examiner(s): Ly, Anh
• Application Number:
  US14/737,286
• Time in Patent Office: 1,034 Days
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A cloud gateway (GW) device receives a first request for incremental backup from a client device over a LAN, where the first request includes a first file representing a difference between the incremental backup in view of a prior backup. In response, the cloud GW identifies a first base backup previously backed up to a cloud storage server over a WAN. A second request is transmitted to the cloud storage server over the WAN to copy the first base backup into a second base backup. A third request is transmitted to the cloud storage server over the WAN to replace a second file within the second base backup. The third request includes a second backup ID, a descriptor describing the file to be replaced, and content of the file received from the client without modifying the first file.

Claims

1. A computer-implemented method for cloud-based backup, the method comprising:

receiving, at a cloud gateway (GW) device which manages backups and restores to and from cloud storage servers of two or more cloud storage providers, a first request for incremental backup from a client device over a local area network (LAN), wherein the first request includes a first file representing a difference between the incremental backup in view of a prior backup;

in response to the first request, identifying by a cloud backup manager running within the cloud GW, a first base backup that has been previously backed up to a cloud storage server over a wide area network (WAN), including constructing a first descriptor having a plurality of tags to specify the first base backup, the plurality of tags including a client tag identifying the client, a file system tag identifying a file system associated with the first base backup, and a timestamp tag indicating time at which the first base backup was made;

transmitting a second request to the cloud storage server over the WAN requesting the cloud storage server to copy the first base backup into a second base backup, wherein the second request includes a first backup identifier (ID) identifying the first base backup and wherein the second request is transmitted by at least transmitting a first command to the cloud storage server to select a root object of the first base backup, the first command including the first descriptor, wherein the first backup ID is represented by the first descriptor, wherein the cloud storage server selects the first base backup based on the first descriptor; and

transmitting a third request to the cloud storage server over the WAN to replace a second file within the second base backup, the third request including a second backup ID identifying the second base backup, a descriptor describing which of a plurality of files of the second base backup to be replaced, and content of the file received from the client such that a backup would not have to be locked-in with a particular cloud storage provider.

2. The method of claim 1, wherein transmitting a second request to the cloud storage server comprises:

transmitting a second command to the cloud storage server to copy the selected first base backup into the second base backup, wherein the cloud storage server copies the selected root object and a plurality of child objects to create the second base backup.

3. The method of claim 2, wherein transmitting a third request to the cloud storage server over the WAN to replace a file comprises:

constructing a second descriptor having a plurality of tags to specify the second file of the second base backup;

transmitting a third command to the cloud storage server to select a second object representing the second file of the second base backup, wherein the third command includes the second descriptor; and

transmitting a fourth command to the cloud storage server to remove the selected second object representing the second file from the second base backup.

4. The method of claim 3, further comprising:

transmitting a fifth command to the cloud storage server to create a third object, the fifth command including a third descriptor having a plurality of tags to identify a parent object of the removed second object in the second base backup, wherein the third object is created as a child object to the parent object; and

transmitting a sixth command to the cloud storage server to associate content of the first file to the third object.

5. The method of claim 1, further comprising:

receiving a fourth request from the client to restore a second incremental backup, the fourth request including a directory identifier of a directory representing the second incremental backup;

in response to the fourth request, transmitting a second command to the cloud storage server to select a root object of a third base backup, the second command including one or more tags identifying the root object of the third base backup;

transmitting a third command to the cloud storage server to select a directory object representing the directory of the third base backup, the third command including one or more tags specifying the directory identifier;

transmitting a fourth command to the cloud storage server to download data associated with a plurality of child objects of the directory object; and

transmitting the data to the client over the LAN.

6. The method of claim 5, further comprising:

receiving a first identifier identifying the root object of the third base backup from the cloud storage server in response to the second command, wherein the third command includes the first identifier to identifier a parent object to the directory object; and

receiving a second identifier identifying the directory object from the cloud storage server in response to the third command, wherein the fourth command includes the second identifier to identify the directory object.

7. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations of cloud-based backup, the operations comprising:

receiving, at a cloud gateway (GW) device which manages backups and restores to and from cloud storage servers of two or more cloud storage providers, a first request for incremental backup from a client device over a local area network (LAN), wherein the first request includes a first file representing a difference between the incremental backup in view of a prior backup;

in response to the first request, identifying by a cloud backup manager running within the cloud GW, a first base backup that has been previously backed up to a cloud storage server over a wide area network (WAN), including constructing a first descriptor having a plurality of tags to specify the first base backup, the plurality of tags including a client tag identifying the client, a file system tag identifying a file system associated with the first base backup, and a timestamp tag indicating time at which the first base backup was made;

transmitting a second request to the cloud storage server over the WAN requesting the cloud storage server to copy the first base backup into a second base backup, wherein the second request includes a first backup identifier (ID) identifying the first base backup and wherein the second request is transmitted by at least transmitting a first command to the cloud storage server to select a root object of the first base backup, the first command including the first descriptor, wherein the first backup ID is represented by the first descriptor, wherein the cloud storage server selects the first base backup based on the first descriptor; and

transmitting a third request to the cloud storage server over the WAN to replace a second file within the second base backup, the third request including a second backup ID identifying the second base backup, a descriptor describing which of a plurality of files of the second base backup to be replaced, and content of the file received from the client such that a backup would not have to be locked-in with a particular cloud storage provider.

8. The non-transitory machine-readable medium of claim 7, wherein transmitting a second request to the cloud storage server comprises:

transmitting a second command to the cloud storage server to copy the selected first base backup into the second base backup, wherein the cloud storage server copies the selected root object and a plurality of child objects to create the second base backup.

9. The non-transitory machine-readable medium of claim 8, wherein transmitting a third request to the cloud storage server over the WAN to replace a file comprises:

constructing a second descriptor having a plurality of tags to specify the second file of the second base backup;

transmitting a third command to the cloud storage server to select a second object representing the second file of the second base backup, wherein the third command includes the second descriptor; and

transmitting a fourth command to the cloud storage server to remove the selected second object representing the second file from the second base backup.

10. The non-transitory machine-readable medium of claim 9, wherein the operations further comprise:

transmitting a fifth command to the cloud storage server to create a third object, the fifth command including a third descriptor having a plurality of tags to identify a parent object of the removed second object in the second base backup, wherein the third object is created as a child object to the parent object; and

transmitting a sixth command to the cloud storage server to associate content of the first file to the third object.

11. The non-transitory machine-readable medium of claim 7, wherein the operations further comprise:

receiving a fourth request from the client to restore a second incremental backup, the fourth request including a directory identifier of a directory representing the second incremental backup;

in response to the fourth request, transmitting a second command to the cloud storage server to select a root object of a third base backup, the second command including one or more tags identifying the root object of the third base backup;

transmitting a third command to the cloud storage server to select a directory object representing the directory of the third base backup, the third command including one or more tags specifying the directory identifier;

transmitting a fourth command to the cloud storage server to download data associated with a plurality of child objects of the directory object; and

transmitting the data to the client over the LAN.

12. The non-transitory machine-readable medium of claim 11, wherein the operations further comprise:

receiving a first identifier identifying the root object of the third base backup from the cloud storage server in response to the second command, wherein the third command includes the first identifier to identifier a parent object to the directory object; and

receiving a second identifier identifying the directory object from the cloud storage server in response to the third command, wherein the fourth command includes the second identifier to identify the directory object.

13. A cloud gateway (GW) device which manages backups and restores to and from cloud storage servers of two or more cloud storage providers, comprising:

a processor; and

a memory coupled to the processor storing instructions, which when executed by the processor, cause the processor to perform operations, the operations including

receiving a first request for incremental backup from a client device over a local area network (LAN), wherein the first request includes a first file representing a difference between the incremental backup in view of a prior backup,

in response to the first request, identifying a first base backup that has been previously backed up to a cloud storage server over a wide area network (WAN), including constructing a first descriptor having a plurality of tags to specify the first base backup, the plurality of tags including a client tag identifying the client, a file system tag identifying a file system associated with the first base backup, and a timestamp tag indicating time at which the first base backup was made,

transmitting a second request to the cloud storage server over the WAN requesting the cloud storage server to copy the first base backup into a second base backup, wherein the second request includes a first backup identifier (ID) identifying the first base backup and wherein the second request is transmitted by at least transmitting a first command to the cloud storage server to select a root object of the first base backup, the first command including the first descriptor, wherein the first backup ID is represented by the first descriptor, wherein the cloud storage server selects the first base backup based on the first descriptor, and

transmitting a third request to the cloud storage server over the WAN to replace a second file within the second base backup, the third request including a second backup ID identifying the second base backup, a descriptor describing which of a plurality of files of the second base backup to be replaced, and content of the file received from the client such that a backup would not have to be locked-in with a particular cloud storage provider.

14. The system of claim 13, wherein transmitting a second request to the cloud storage server comprises:

transmitting a second command to the cloud storage server to copy the selected first base backup into the second base backup, wherein the cloud storage server copies the selected root object and a plurality of child objects to create the second base backup.

15. The system of claim 14, wherein transmitting a third request to the cloud storage server over the WAN to replace a file comprises:

constructing a second descriptor having a plurality of tags to specify the second file of the second base backup;

transmitting a third command to the cloud storage server to select a second object representing the second file of the second base backup, wherein the third command includes the second descriptor; and

transmitting a fourth command to the cloud storage server to remove the selected second object representing the second file from the second base backup.

16. The system of claim 15, wherein the operations further comprise:

transmitting a fifth command to the cloud storage server to create a third object, the fifth command including a third descriptor having a plurality of tags to identify a parent object of the removed second object in the second base backup, wherein the third object is created as a child object to the parent object; and

transmitting a sixth command to the cloud storage server to associate content of the first file to the third object.

17. The system of claim 13, wherein the operations further comprise:

receiving a fourth request from the client to restore a second incremental backup, the fourth request including a directory identifier of a directory representing the second incremental backup;

in response to the fourth request, transmitting a second command to the cloud storage server to select a root object of a third base backup, the second command including one or more tags identifying the root object of the third base backup;

transmitting a third command to the cloud storage server to select a directory object representing the directory of the third base backup, the third command including one or more tags specifying the directory identifier;

transmitting a fourth command to the cloud storage server to download data associated with a plurality of child objects of the directory object; and

transmitting the data to the client over the LAN.

18. The system of claim 17, wherein the operations further comprise:

receiving a first identifier identifying the root object of the third base backup from the cloud storage server in response to the second command, wherein the third command includes the first identifier to identifier a parent object to the directory object; and

receiving a second identifier identifying the directory object from the cloud storage server in response to the third command, wherein the fourth command includes the second identifier to identify the directory object.