SYSTEMS AND METHODS FOR AGGREGATION OF CLOUD STORAGE

• US 20170331880A1
• Filed: 05/16/2016
• Published: 11/16/2017
• Est. Priority Date: 05/16/2016
• Status: Active Grant

• Current Assignee: Carbonite LLC (Open Text Corporation)
• Original Assignee: Carbonite Incorporated (Open Text Corporation)
• Inventors: Crofton, Teo Winton, Raissipour, David
• Granted Patent: US 10,356,158 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata

Abstract

The present disclosure describes systems and methods for aggregation and management of cloud storage among a plurality of providers. In a first aspect, the invention is directed to file distribution and management across multiple cloud services via a storage manager. The storage manager may aggregate third-party cloud storage provider accounts into a single cloud storage space and load balance files among the third party-accounts as necessary. In one implementation, the storage manager may act as an intermediary, and files may be transferred by the client to the storage manager, which may select and forward the files to a third-party storage provider. File retrieval may be performed similarly, with the client requesting a file from the intermediary storage manager, which may retrieve the file from the corresponding third-party storage provider and forward the file to the client device.

Claims

1. A method for aggregation of a plurality of cloud storage locations, comprising:

receiving, by a storage manager from a client device, metadata of a file stored at the client device and designated for synchronization;

selecting, by the storage manager, an account associated with the client device at a first cloud storage provider of a plurality of cloud storage providers;

storing, by the storage manager, the metadata of the file and an identification of the selected account in a storage device associated with the storage manager;

transmitting, by the storage manager to the client device, the identification of the selected account, receipt of the identification causing the client device to transmit the file to the first cloud storage provider;

subsequently receiving, by the storage manager from the client device, a request for the file;

retrieving, by the storage manager, the metadata of the file stored in the storage device and the identification of the selected account, responsive to receipt of the request; and

transmitting, by the storage manager to the client device, the identification of the selected account and the metadata of the file, receipt of the identification and the metadata causing the client device to transmit a request for the file to the first cloud storage provider.

2. The method of claim 1, wherein the metadata of the file comprises a directory path for the file in a storage device of the client device, and wherein receipt of the identification of the selected account further causes the client device to modify the directory path for the file according to a policy associated with the first cloud storage provider.

3. The method of claim 2, wherein receipt of the identification of the selected account further causes the client device to copy the file from a first directory to a second directory associated with the first cloud storage provider.

4. The method of claim 1, wherein selecting the account associated with the client device at the first cloud storage provider further comprises comparing a storage level of accounts associated with the client device at each of the plurality of cloud storage providers.

5. The method of claim 4, further comprising selecting the account associated with the client device at the first cloud storage provider, responsive to a storage level of the account associated with the client device at the first cloud storage provider being below an average storage level of the accounts associated with the client device at each of the plurality of cloud storage providers.

6. The method of claim 4, further comprising selecting the account associated with the client device at the first cloud storage provider, responsive to determining that an account associated with the client device at a second cloud storage provider has a larger amount of free space than the account associated with the client device at the first cloud storage provider.

7. The method of claim 1, wherein transmitting the identification of the selected account and the metadata of the file further comprises transmitting a command to initiate retrieval of the file from the first cloud storage provider.

8. The method of claim 1, further comprising:

determining, by the storage manager, that a storage utilization of the account associated with the client device at the first cloud storage provider exceeds a threshold;

identifying, by the storage manager, a second cloud storage provider of the plurality of cloud storage providers having an account associated with the client device with a storage utilization under the threshold;

responsive to the determination, transmitting, by the storage manager to the client device, the identification of the account at the first cloud storage provider and metadata of at least one file stored at the first cloud storage provider, receipt of the identification of the account at the first cloud storage provider and metadata of the at least one file causing the client device to retrieve the at least one file from the first cloud storage provider; and

transmitting, by the storage manager to the client device, an identification of the account at the second cloud storage provider and metadata of the at least one file, receipt of the identification of the account at the second cloud storage provider and metadata of the at least one file causing the client device to transmit the at least one file to the second cloud storage provider.

9. A system for aggregation of a plurality of cloud storage locations, comprising:

a server, in communication with a client device, comprising a processor executing a storage manager and a metadata storage device;

wherein the storage manager is configured for;

receiving, from the client device, metadata of a file stored at the client device and designated for synchronization,

selecting an account associated with the client device at a first cloud storage provider of a plurality of cloud storage providers,

storing, in the metadata storage device, the metadata of the file and an identification of the selected account,

transmitting, to the client device, the identification of the selected account, receipt of the identification causing the client device to transmit the file to the first cloud storage provider,

subsequently receiving, from the client device, a request for the file,

retrieving the metadata of the file and the identification of the selected account from the metadata storage device, responsive to receipt of the request, and

transmitting, to the client device, the identification of the selected account and the metadata of the file, receipt of the identification and the metadata causing the client device to transmit a request for the file to the first cloud storage provider.

10. The system of claim 9, wherein the metadata of the file comprises a directory path for the file in a storage device of the client device, and wherein receipt of the identification of the selected account further causes the client device to modify the directory path for the file according to a policy associated with the first cloud storage provider.

11. The system of claim 10, wherein receipt of the identification of the selected account further causes the client device to copy the file from a first directory to a second directory associated with the first cloud storage provider.

12. The system of claim 9, wherein the storage manager is further configured for comparing a storage level of accounts associated with the client device at each of the plurality of cloud storage providers.

13. The system of claim 12, wherein the storage manager is further configured for selecting the account associated with the client device at the first cloud storage provider, responsive to a storage level of the account associated with the client device at the first cloud storage provider being below an average storage level of the accounts associated with the client device at each of the plurality of cloud storage providers.

14. The system of claim 12, wherein the storage manager is further configured for selecting the account associated with the client device at the first cloud storage provider, responsive to determining that an account associated with the client device at a second cloud storage provider has a larger amount of free space than the account associated with the client device at the first cloud storage provider.

15. The system of claim 9, wherein the storage manager is further configured for transmitting a command to the client device to initiate retrieval of the file from the first cloud storage provider.

16. The system of claim 9, wherein the storage manager is further configured for:

determining that a storage utilization of the account associated with the client device at the first cloud storage provider exceeds a threshold,

identifying a second cloud storage provider of the plurality of cloud storage providers having an account associated with the client device with a storage utilization under the threshold,

responsive to the determination, transmitting, to the client device, the identification of the account at the first cloud storage provider and metadata of at least one file stored at the first cloud storage provider, receipt of the identification of the account at the first cloud storage provider and metadata of the at least one file causing the client device to retrieve the at least one file from the first cloud storage provider; and

transmitting, by the storage manager to the client device, an identification of the account at the second cloud storage provider and metadata of the at least one file, receipt of the identification of the account at the second cloud storage provider and metadata of the at least one file causing the client device to transmit the at least one file to the second cloud storage provider.

17. A method for aggregation of a plurality of cloud storage locations, comprising:

transmitting, by a client device to a storage manager executed by a server, metadata of a file stored at the client device and designated for synchronization;

receiving, by the client device from the storage manager, an identification of an account associated with the client device at a first cloud storage provider of a plurality of cloud storage providers, the account selected by the storage manager;

transmitting the file, by the client device, to the first cloud storage provider for backup;

subsequently transmitting, by the client device to the storage manager, a request for the file;

receiving, by the client device from the storage manager, the identification of the selected account and the metadata of the file; and

transmitting a request for the file to the first cloud storage provider, by the client device, responsive to receipt of the identification and the metadata.

18. The method of claim 17, wherein transmitting the metadata of the file to the storage manager further comprises transmitting a directory path for the file in a storage device of the client device to the storage manager;

and wherein transmitting the file to the first cloud storage provider for backup further comprises modifying the directory path for the file from a first directory to a second directory associated with the first cloud storage provider.

19. The method of claim 18, further comprising:

receiving the file, by the client device from the first cloud storage provider;

storing the received file, by the client device, in the second directory associated with the first cloud storage provider; and

modifying the directory path for the file from the second directory to the first directory according to the metadata of the file received from the storage manager.

20. The method of claim 17, further comprising:

receiving, by the client device from the storage manager to the client device, the identification of the account at the first cloud storage provider and metadata of at least one file stored at the first cloud storage provider, transmitted by the storage manager responsive to a determination that a storage utilization of the account associated with the client device at the first cloud storage provider exceeds a threshold;

retrieving, by the client device, the at least one file from the first cloud storage provider responsive to the receipt of the identification of the account at the first cloud storage provider and metadata of the at least one file;

receiving, by the client device from the storage manager, metadata of the at least one file and an identification of an account associated with the client device at a second cloud storage provider of the plurality of cloud storage providers selected by the storage manager responsive to having a storage utilization under the threshold; and

transmitting, by the client device to the second cloud storage provider, the at least one file for backup.