SYSTEMS AND METHODS FOR PROCESSING-BASED FILE DISTRIBUTION IN AN AGGREGATION OF CLOUD STORAGE SERVICES

• US 20170331892A1
• Filed: 05/16/2016
• Published: 11/16/2017
• Est. Priority Date: 05/16/2016
• Status: Active Grant

• Current Assignee: Carbonite LLC (Open Text Corporation)
• Original Assignee: Carbonite Incorporated (Open Text Corporation)
• Inventors: Crofton, Teo Winton, Raissipour, David
• Granted Patent: US 10,264,072 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

The present disclosure describes systems and methods for aggregation and management of cloud storage to leverage processing provided by a cloud provider with aggregation of cloud storage services. Files may be pipelined to the processing provider and then resynchronized to an alternate storage service, with processing or metadata retained. In one implementation, files may be provided for processing, retrieved, and then separately provided for storage. In another implementation, files may be simultaneously provided for processing and storage at different cloud storage providers. After processing, the metadata of the file may be retrieved, and the file deleted from storage of the processing provider. The metadata may be synchronized with the stored file, or may be retained in metadata storage and retrieved by the client device during synchronization or file retrieval operations.

Claims

1. A method for pipelined processing via an aggregation of cloud storage services, comprising:

identifying, by a synchronization client of a client device, a first file in storage of the client device;

transmitting, by the synchronization client, the first file to a first cloud storage service, the first cloud storage service generating new metadata for the first file;

retrieving, by the synchronization client, the generated metadata from the first cloud storage service;

transmitting, by the synchronization client, the first file to a second cloud storage service; and

transmitting, by the synchronization client to the first cloud storage service, a request to delete the first file.

2. The method of claim 1, wherein identifying the first file further comprises identifying a new or modified file.

3. The method of claim 1, wherein the generated metadata comprises geolocation metadata for the file.

4. The method of claim 1, wherein the generated metadata comprises facial recognition tagging metadata for the file.

5. The method of claim 1, wherein transmitting the first file to the first cloud storage service and second cloud storage service are performed prior to retrieving the generated metadata from the first cloud storage service.

6. The method of claim 1, further comprising transmitting the generated metadata to the second cloud storage service for association with the first file.

7. The method of claim 1, further comprising transmitting the generated metadata to a third cloud storage service.

8. The method of claim 1, wherein transmitting the request to delete the first file is performed responsive to retrieval, by the synchronization client, of the generated metadata for the first file.

9. The method of claim 1, further comprising maintaining, by the synchronization client, a queue of files for transmission to the first cloud storage service;

and

for each file of the queue of files;

transmitting, by the synchronization client, said file to the first cloud storage service, the first cloud storage service generating new metadata for said file,

retrieving, by the synchronization client, the generated metadata for said file from the first cloud storage service, and

transmitting, by the synchronization client to the first cloud storage service, a request to delete said file.

10. A method for pipelined processing via an aggregation of cloud storage services, comprising:

receiving, by a storage manager from a client device, an identification of a first file stored at the client device and designated for synchronization;

selecting, by the storage manager responsive to a file type of the first file, a first cloud storage provider;

transmitting, by the storage manager to the client device, an identification of the first cloud storage provider, receipt of the identification of the first cloud storage provider triggering the client device to transmit the first file to the first cloud storage provider, receipt of the first file triggering the first cloud storage provider to generate new metadata for the first file;

retrieving, by the storage manager from the first cloud storage provider, the generated metadata for the first file;

selecting, by the storage manager responsive to a storage policy associated with the client device, a second cloud storage provider;

transmitting, by the storage manager to the client device, an identification of the second cloud storage provider, receipt of the identification of the second cloud storage provider triggering the client device to transmit the first file to the second cloud storage provider; and

transmitting, by the storage manager to the first cloud storage provider, a request to delete the first file.

11. The method of claim 10, further comprising transmitting, by the storage manager, the generated metadata to the client device.

12. The method of claim 10, wherein transmitting the request to delete the first file further comprises transmitting the request, by the storage manager, via the client device.

13. A system for pipelined processing via an aggregation of cloud storage services, comprising:

a client device, comprising a storage device and a processor executing a synchronization client, the client device in communication with a plurality of cloud storage services;

wherein the synchronization client is configured for;

identifying a first file in the storage device,

transmitting the first file to a first cloud storage service, the first cloud storage service generating new metadata for the first file,

retrieving the generated metadata from the first cloud storage service of the plurality of cloud storage services,

transmitting the first file to a second cloud storage service of the plurality of cloud storage services; and

transmitting, to the first cloud storage service, a request to delete the first file.

14. The system of claim 13, wherein the synchronization client is further configured for identifying a new or modified file.

15. The system of claim 13, wherein the generated metadata comprises geolocation metadata for the file or facial recognition tagging metadata for the file.

16. The system of claim 13, wherein the synchronization client is further configured for transmitting the first file to the first cloud storage service and second cloud storage service prior to retrieving the generated metadata from the first cloud storage service.

17. The system of claim 13, wherein the synchronization client is further configured for transmitting the generated metadata to the second cloud storage service for association with the first file.

18. The system of claim 13, wherein the synchronization client is further configured for transmitting the generated metadata to a third cloud storage service.

19. The system of claim 13, wherein the synchronization client is further configured for transmitting the request to delete the first file responsive to retrieval, by the synchronization client, of the generated metadata for the first file.

20. The system of claim 13, wherein the synchronization client is further configured for:

maintaining a queue of files for transmission to the first cloud storage service; and

for each file of the queue of files;

transmitting said file to the first cloud storage service, the first cloud storage service generating new metadata for said file,

retrieving the generated metadata for said file from the first cloud storage service, and

transmitting, by the synchronization client to the first cloud storage service, a request to delete said file.