Systems and methods for aggregation of cloud storage

• US 10,356,158 B2
• Filed: 05/16/2016
• Issued: 07/16/2019
• Est. Priority Date: 05/16/2016
• Status: Active Grant

• Current Assignee: Carbonite LLC (Open Text Corporation)
• Original Assignee: Carbonite Incorporated (Open Text Corporation)
• Inventors: Crofton, Teo Winton, Raissipour, David
• Primary Examiner(s): Alam, Uzma
• Application Number:
  US15/155,998
• Publication Number:
  US 20170331880A1
• Time in Patent Office: 1,156 Days
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata

Abstract

The present disclosure describes systems and methods for aggregation and management of cloud storage among a plurality of providers. In a first aspect, the invention is directed to file distribution and management across multiple cloud services via a storage manager. The storage manager may aggregate third-party cloud storage provider accounts into a single cloud storage space and load balance files among the third party-accounts as necessary. In one implementation, the storage manager may act as an intermediary, and files may be transferred by the client to the storage manager, which may select and forward the files to a third-party storage provider. File retrieval may be performed similarly, with the client requesting a file from the intermediary storage manager, which may retrieve the file from the corresponding third-party storage provider and forward the file to the client device.

Claims

1. A method for aggregation of a plurality of cloud storage locations for a client device in communication with a storage manager through a network, comprising:

displaying at the client device a virtual folder that includes subfolders of stored items that are synchronized with corresponding stored items in respective storage locations of a plurality of cloud storage providers in communication with the client device through the network;

receiving, by the storage manager from the client device, metadata, without additional file information, of a file stored at the client device and designated for synchronization with one or more of the cloud storage providers, the file being designated for synchronization by interaction with the virtual folder on the client device;

selecting, by the storage manager, a first cloud storage provider of the cloud storage providers based on the metadata of the file;

storing, by the storage manager, the metadata of the file and an identification of the first cloud storage provider in a storage device associated with the storage manager;

transmitting, by the storage manager to the client device, the identification of the first cloud storage provider, receipt of the identification causing the client device to transmit the file directly to the first cloud storage provider and avoid using the storage manager as an intermediary for file transfers between the client device and the first cloud storage provider;

subsequently receiving, by the storage manager from the client device, a request for the file through interaction with the virtual folder on the client device;

retrieving, by the storage manager, the metadata of the file stored in the storage device and the identification of the first cloud storage provider, responsive to receipt of the request; and

transmitting, by the storage manager to the client device, the identification of the first cloud storage provider and the metadata of the file, receipt of the identification and the metadata causing the client device to transmit a request for the file directly to the first cloud storage provider.

2. The method of claim 1, wherein the metadata of the file comprises a directory path for the file in a storage device of the client device, and wherein receipt of the identification of the first cloud storage provider further causes the client device to modify the directory path for the file according to a policy associated with the first cloud storage provider.

3. The method of claim 2, wherein receipt of the identification of the first cloud storage provider further causes the client device to copy the file from a first directory to a second directory associated with the first cloud storage provider.

4. The method of claim 1, wherein selecting the first cloud storage provider further comprises comparing a storage level of accounts associated with the client device at each of the plurality of cloud storage providers.

5. The method of claim 4, further comprising selecting the first cloud storage provider, responsive to a storage level of an account associated with the client device at the first cloud storage provider being below an average storage level of the accounts associated with the client device at each of the plurality of cloud storage providers.

6. The method of claim 4, further comprising selecting the first cloud storage provider, responsive to determining that an account associated with the client device at a second cloud storage provider has a larger amount of free space than an account associated with the client device at the first cloud storage provider.

7. The method of claim 1, wherein transmitting the identification of the first cloud storage provider and the metadata of the file further comprises transmitting a command to initiate retrieval of the file from the first cloud storage provider.

8. The method of claim 1, further comprising:

determining, by the storage manager, that a storage utilization of an account associated with the client device at the first cloud storage provider exceeds a storage capacity threshold;

identifying, by the storage manager, a second cloud storage provider of the plurality of cloud storage providers having an account associated with the client device with a storage utilization under the storage capacity threshold;

responsive to the determination, transmitting, by the storage manager to the client device, the identification of the first cloud storage provider and metadata of at least one file stored at the first cloud storage provider, receipt of the identification of the first cloud storage provider and metadata of the at least one file causing the client device to retrieve the at least one file from the first cloud storage provider; and

transmitting, by the storage manager to the client device, an identification of the second cloud storage provider and metadata of the at least one file, receipt of the identification of the second cloud storage provider and metadata of the at least one file causing the client device to transmit the at least one file to the second cloud storage provider.

9. A system for aggregation of a plurality of cloud storage locations, comprising:

a server, in communication with a client device, comprising a processor executing a storage manager and a metadata storage device,

wherein the storage manager is configured for;

displaying at the client device a virtual folder that includes subfolders of stored items that are synchronized with corresponding stored items in respective storage locations of a plurality of cloud storage providers in communication with the client device through a network;

receiving, from the client device, metadata, without additional file information, of a file stored at the client device and designated for synchronization with one or more of the cloud storage providers, the file being designated for synchronization by interaction with the virtual folder on the client device;

selecting a first cloud storage provider of the cloud storage providers based on the metadata of the file,

storing, in the metadata storage device, the metadata of the file and an identification of the first cloud storage provider;

transmitting, to the client device, the identification of the first cloud storage provider, receipt of the identification causing the client device to transmit the file directly to the first cloud storage provider and avoid using the storage manager as an intermediary for file transfers between the client device and the first cloud storage provider;

subsequently receiving, from the client device, a request for the file, through interaction with the virtual folder on the client device;

retrieving the metadata of the file and the identification of the first cloud storage provider from the metadata storage device, responsive to receipt of the request; and

transmitting, to the client device, the identification of the first cloud storage provider and the metadata of the file, receipt of the identification and the metadata causing the client device to transmit a request for the file directly to the first cloud storage provider.

10. The system of claim 9, wherein the metadata of the file comprises a directory path for the file in a storage device of the client device, and wherein receipt of the identification of the first cloud storage provider further causes the client device to modify the directory path for the file according to a policy associated with the first cloud storage provider.

11. The system of claim 10, wherein receipt of the identification of the first cloud storage provider further causes the client device to copy the file from a first directory to a second directory associated with the first cloud storage provider.

12. The system of claim 9, wherein the storage manager is further configured for comparing a storage level of accounts associated with the client device at each of the plurality of cloud storage providers.

13. The system of claim 12, wherein the storage manager is further configured for selecting the first cloud storage provider, responsive to a storage level of an account associated with the client device at the first cloud storage provider being below an average storage level of the accounts associated with the client device at each of the plurality of cloud storage providers.

14. The system of claim 12, wherein the storage manager is further configured for selecting the first cloud storage provider, responsive to determining that an account associated with the client device at a second cloud storage provider has a larger amount of free space than an account associated with the client device at the first cloud storage provider.

15. The system of claim 9, wherein the storage manager is further configured for transmitting a command to the client device to initiate retrieval of the file from the first cloud storage provider.

16. The system of claim 9, wherein the storage manager is further configured for:

determining that a storage utilization of an account associated with the client device at the first cloud storage provider exceeds a storage capacity threshold,

identifying a second cloud storage provider of the plurality of cloud storage providers having an account associated with the client device with a storage utilization under the storage capacity threshold,

responsive to the determination, transmitting, to the client device, the identification of the first cloud storage provider and metadata of at least one file stored at the first cloud storage provider, receipt of the identification of the first cloud storage provider and metadata of the at least one file causing the client device to retrieve the at least one file from the first cloud storage provider; and

transmitting, by the storage manager to the client device, an identification of the second cloud storage provider and metadata of the at least one file, receipt of the identification of the second cloud storage provider and metadata of the at least one file causing the client device to transmit the at least one file to the second cloud storage provider.

17. A method for aggregation of a plurality of cloud storage locations for a client device in communication with a storage manager through a network, comprising:

displaying at the client device a virtual folder that includes subfolders of stored items that are synchronized with corresponding stored items in respective storage locations of a plurality of cloud storage providers in communication with the client device through the network;

transmitting, by the client device to the storage manager executed by a server, metadata, without additional file information, of a file stored at the client device and designated for synchronization with one or more of the cloud storage providers, the file being designated for synchronization by interaction with the virtual folder on the client device;

receiving, by the client device from the storage manager, an identification of a first cloud storage provider of the cloud storage providers, the first cloud storage provider being selected by the storage manager based on the metadata of the file;

transmitting the file, by the client device, directly to the first cloud storage provider for backup without using the storage manager as an intermediary for file transfers between the client device and the first cloud storage provider;

subsequently transmitting, by the client device to the storage manager, a request for the file through interaction with the virtual folder on the client device;

receiving, by the client device from the storage manager, the identification of the first cloud storage provider and the metadata of the file; and

transmitting a request for the file directly to the first cloud storage provider, by the client device, responsive to receipt of the identification and the metadata.

18. The method of claim 17, wherein transmitting the metadata of the file to the storage manager further comprises transmitting a directory path for the file in a storage device of the client device to the storage manager;

and wherein transmitting the file to the first cloud storage provider for backup further comprises modifying the directory path for the file from a first directory to a second directory associated with the first cloud storage provider.

19. The method of claim 18, further comprising:

receiving the file, by the client device from the first cloud storage provider;

storing the received file, by the client device, in the second directory associated with the first cloud storage provider; and

modifying the directory path for the file from the second directory to the first directory according to the metadata of the file received from the storage manager.

20. The method of claim 17, further comprising:

receiving, by the client device from the storage manager to the client device, the identification of the first cloud storage provider and metadata of at least one file stored at the first cloud storage provider, transmitted by the storage manager responsive to a determination that a storage utilization of an account associated with the client device at the first cloud storage provider exceeds a storage capacity threshold;

retrieving, by the client device, the at least one file from the first cloud storage provider responsive to the receipt of the identification of the first cloud storage provider and metadata of the at least one file;

receiving, by the client device from the storage manager, metadata of the at least one file and an identification of a second cloud storage provider of the plurality of cloud storage providers selected by the storage manager responsive to having a storage utilization under the storage capacity threshold; and

transmitting, by the client device to the second cloud storage provider, the at least one file for backup.