CLOUD STORAGE BROKERING SERVICE

• US 20160219109A1
• Filed: 04/05/2016
• Published: 07/28/2016
• Est. Priority Date: 03/12/2013
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Inventors: HOOPER, GARY J., BLAHAERATH, GRANT C.
• Granted Patent: US 9,912,753 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/562 Brokering proxy services

Abstract

Systems and methods for brokering storage services are disclosed. In one embodiment, the brokering system is configured to receive, from a client device, a request indicating a desired configuration for storing target data in at least one of the plurality of cloud storage services. The system can determine a first selection comprising at least one storage service from the plurality of cloud storage services based on the request, provision storage in the plurality of cloud storage services based on the determined first selection and provide, to the client device, a temporary manifest indicating the provisioned storage, wherein the temporary manifest comprises access data that enables the client device to access the provisioned storage in the cloud storage services. The system can then store the temporary manifest and determine whether the client device completed storing the target data on the provisioned storage based on a presence of the temporary manifest.

Claims

1. A method of enabling upload of a file to a cloud storage system, said method comprising:

receiving, from a client device, a request for uploading a file, wherein the request indicates a size of the file;

determining a set of blocks for the file based on the indicated size;

requesting, from at least one storage service of a plurality of storage services, storage space for the set of blocks;

receiving, from each of the at least one storage service, a set of access tokens for accessing the set of blocks when stored in the at least one storage service;

generating a manifest indicating respective access tokens for each of the set of blocks for the file; and

transmitting, to the client device, information for interfacing the at least one storage service and the generated manifest.

2. The method of claim 1, further comprising:

establishing a customer account with the at least one storage service for uploading at least a subset of the set of blocks.

3. The method of claim 2, wherein after the set of blocks are stored using the at least one storage service, the method further comprises:

maintaining a file manifest mapping the stored set of blocks with the corresponding customer account at each of the at least one storage services.

4. The method of claim 3, wherein subsets of the set of blocks are stored at a plurality of storage services, wherein the file manifest comprises cloud platform specific details needed to access each of stored set of blocks using the plurality of storage services.

5. The method of claim 1, further comprising:

requesting storage space from a plurality of storage services;

receiving from each of the plurality of storage services, a set of access tokens for accessing a subset of the set of blocks stored at the corresponding storage service; and

generating a manifest indicating the respective access tokens for each of the subsets of the set of blocks for the file.

6. The method of claim 1, further comprising:

automatically arbitrating with the plurality of storage services; and

automatically initiating migration of at least a portion of the subset of the set of blocks between the plurality of storage services.

7. The method of claim 6, further comprising:

maintaining a file manifest for the set of blocks for the current storage services used to store each of the subsets of the set of blocks.

8. A method of enabling download of a file from a cloud storage system, said method comprising:

receiving, from a client device, a request for downloading of a file, wherein the request comprises a unique identifier for the file;

locating a manifest that indicates respective locations of blocks of the file in at least one storage service based on the unique identifier;

retrieving, from the at least one storage service, access tokens for the blocks of the file; and

transmitting, to the client device, the manifest with the retrieved access tokens for downloading of the file.

9. The method of claim 8, further comprising:

automatically arbitrating with a plurality of storage services; and

automatically initiate migration of at least a portion of the subset of the set of blocks between the plurality of storage services.

10. The method of claim 9, further comprising:

maintaining the manifest for the set of blocks for the current storage services used to store each of the subsets of the set of blocks.

11. A system for enabling upload of a file to a cloud storage system, comprising:

a memory; and

at least one processor coupled to the memory and configured to;

receive, from a client device, a request for uploading a file, wherein the request indicates a size of the file;

determine a set of blocks for the file based on the indicated size;

request, from at least one storage service of a plurality of storage services, storage space for the set of blocks;

receive, from each of the at least one storage service, a set of access tokens for accessing the set of blocks when stored in the at least one storage service;

generate a manifest indicating respective access tokens for each of the set of blocks for the file; and

transmit, to the client device, information for interfacing the at least one storage service and the generated manifest.

12. The system of claim 11, wherein the at least one processor is further configured to:

establish a customer account with the at least one storage service for uploading at least a subset of the set of blocks.

13. The system of claim 12, wherein after the set of blocks are stored using the at least one storage service, and the at least one processor is further configured to:

maintain a file manifest mapping the stored set of blocks with the corresponding customer account at each of the at least one storage services.

14. The system of claim 13, wherein subsets of the set of blocks are stored at a plurality of storage services, wherein the file manifest comprises cloud platform specific details needed to access each of stored set of blocks using the plurality of storage services.

15. The system of claim 11, wherein the at least one processor is further configured to:

request storage space from a plurality of storage services;

receive from each of the plurality of storage services, a set of access tokens for accessing a subset of the set of blocks stored at the corresponding storage service; and

generate a manifest indicating the respective access tokens for each of the subsets of the set of blocks for the file.

16. The system of claim 11, wherein the at least one processor is further configured to:

automatically arbitrate with the plurality of storage services; and

automatically initiate migration of at least a portion of the subset of the set of blocks between the plurality of storage services.

17. The system of claim 16, wherein the at least one processor is further configured to:

maintain a file manifest for the set of blocks for the current storage services used to store each of the subsets of the set of blocks.

18. A system for enabling download of a file from a cloud storage system, comprising:

a memory; and

at least one processor coupled to the memory and configured to;

receive, from a client device, a request for downloading of a file, wherein the request comprises a unique identifier for the file;

locate a manifest that indicates respective locations of blocks of the file in at least one storage service based on the unique identifier;

retrieve, from the at least one storage service, access tokens for the blocks of the file; and

transmit, to the client device, the manifest with the retrieved access tokens for downloading of the file.

19. The system of claim 18, wherein the at least one processor is further configured to:

automatically arbitrate with a plurality of storage services; and

automatically initiate migration of at least a portion of the subset of the set of blocks between the plurality of storage services.

20. The system of claim 19, wherein the at least one processor is further configured to:

maintain the manifest for the set of blocks for the current storage services used to store each of the subsets of the set of blocks.