Methods for managing content stored in cloud-based storages

• US 9,740,435 B2
• Filed: 02/27/2012
• Issued: 08/22/2017
• Est. Priority Date: 02/27/2012
• Status: Active Grant

• Current Assignee: Fujifilm North America Corp (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm North America Corp (Fujifilm Holdings Corporation)
• Inventors: Dolce, James J., Bloom, Jeffery R.
• Primary Examiner(s): Taylor, Nicholas
• Assistant Examiner(s): Kim, Chong G
• Application Number:
  US13/406,085
• Publication Number:
  US 20130227047A1
• Time in Patent Office: 2,003 Days
• Field of Search: 709213
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/192 Implementing virtual folder structures
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A server receives over a network from a client a request for accessing files stored in a plurality of heterogeneous storage devices hosted by a plurality of storage providers over the network, including a first storage device of a first storage provider and a second storage device of a second storage provider. In response, the server accesses, on behalf of a user of the client, the first storage device and the second storage device to retrieve information concerning the files. The server transmits data to the client over the network, the data representing a logical file system view of the files without exposing actual storage locations of the files stored in the first and second storage devices.

Claims

1. A computer-implemented method for managing content stored in a heterogeneous collection of storage devices, the method comprising:

receiving, at a server over a network from a client, a request for accessing files stored in a plurality of heterogeneous storage devices hosted by a plurality of storage providers over the network, including a first storage device of a first storage provider and a second storage device of a second storage provider;

accessing, on behalf of a user of the client, the first storage device and the second storage device to retrieve information concerning the files;

transmitting data to the client over the network, the data representing a logical file system view of the files without exposing actual storage locations of the files stored in the first and second storage devices;

in response to a request for storing a new file from the client, selecting, by the server computer system without notification to the client, a storage space associated with a first user account of the first storage device or a second user account of the second storage device based, at least in part, on a combination of;

a remaining storage capacity of the first storage device and a remaining storage capacity of the second storage device available to the first user account and the second user account, respectively, a type of the new file, a bandwidth of the first storage provider for the first storage device and a bandwidth of the second storage provider for the second storage device, and storage provider access times associated with each of the first storage device and the second storage device when accessing files of the type of the new file;

storing the file in the selected storage space associated with one of the first and second user accounts;

monitoring operating statistics for the first and second storage devices comprising;

monitoring at least storage provider access time and bandwidth provided by the first storage provider for the first storage device and the second storage provider for the second storage device, and client access statistics indicative of a frequency of access by the user to one or more of the files stored in the first and second storage devices; and

migrating at least one file having the type of the new file from the first storage device to the second storage device when;

the at least one file is accessed by the user more frequently than at least one other file of a different type on the first storage device, the second storage device stores one or more files of the type of the new file for the client, and the second storage device has at least one of a higher bandwidth and a shorter access time than the first storage device.

2. The method of claim 1, wherein the first storage device and the second storage device are accessed using first and second credentials that were cached within the server previously, and wherein accessing the first and second storage devices is performed without having to prompt the user for providing the first and second credentials.

3. The method of claim 1, further comprising maintaining within the server for the user a file mapping table logically mapping the logical file system view with physical files stored in the first and second storage devices.

4. The method of claim 3, further comprising:

updating the file mapping table within the server based on the storage of the file in the selected storage space.

5. The method of claim 1, wherein providing the mechanism to acquire more storage space comprises arranging the third storage provider for the user to acquire more storage space from a third storage device.

6. The method of claim 3, further comprising:

updating the file mapping table within the server in response to migrating one or more files from the first storage device to the second storage device based at least in part on the monitored operating statistics and the monitored accesses statistics.

22. The method of claim 1, further comprising:

in response to storing the file in the selected storage space, determining that an available amount of storage at the selected storage space of at least one of the first and second user accounts is below a threshold; and

providing a mechanism to the user to acquire more storage space from a third storage provider, wherein the third storage provider advertises storage services to the user via the mechanism, and wherein at least one of revenue resulting from the user engaging the third storage provider or revenue resulting from providing an advertisement of the third storage provider to the user is shared with a storage management service provided by the server.

7. A computer-readable storage medium having instructions stored therein, which when executed by a computer, cause the computer to perform a method for managing content stored in heterogeneous storage devices, the method comprising:

receiving, at a server over a network from a client, a request for accessing files stored in a plurality of heterogeneous storage devices hosted by a plurality of storage providers over the network, including a first storage device of a first storage provider and a second storage device of a second storage provider;

accessing, on behalf of a user of the client, the first storage device and the second storage device to retrieve information concerning the files;

transmitting data to the client over the network, the data representing a logical file system view of the files without exposing actual storage locations of the files stored in the first and second storage devices;

in response to a request for storing a new file from the client, selecting, by the server computer system without notification to the client, a storage space associated with a first user account of the first storage device or a second user account of the second storage device based, at least in part, on a combination of;

a remaining storage capacity of the first storage device and a remaining storage capacity of the second storage device available to the first user account and the second user account, respectively, a type of the new file, a bandwidth of the first storage provider for the first storage device and a bandwidth of the second storage provider for the second storage device, and storage provider access times associated with each of the first storage device and the second storage device when accessing files of to the type of the new file;

storing the file in the selected storage space associated with one of the first and second user accounts;

monitoring operating statistics for the first and second storage devices comprising;

monitoring at least storage provider access time and bandwidth provided by the first storage provider for the first storage device and the second storage provider for the second storage device, and client access statistics indicative of a frequency of access by the user to one or more of the files stored in the first and second storage devices; and

migrating at least one file having the type of the new file from the first storage device to the second storage device when;

the at least one file is accessed by the user more frequently than at least one other file of a different type on the first storage device, the second storage device stores one or more files of the type of the new file for the client, and the second storage device has at least one of a higher bandwidth and a shorter access time than the first storage device.

8. The computer-readable storage medium of claim 7, wherein the first storage device and the second storage device are accessed using first and second credentials that were cached within the server previously, and wherein accessing the first and second storage devices is performed without having to prompt the user for providing the first and second credentials.

9. The computer-readable storage medium of claim 7, wherein the method further comprises maintaining within the server for the user a file mapping table logically mapping the logical file system view with physical files stored in the first and second storage devices.

10. The computer-readable storage medium of claim 9, wherein the method further comprises:

updating the file mapping table within the server based on the storage of the file in the selected storage space.

11. The computer-readable storage medium of claim 7, wherein providing the mechanism to acquire more storage space comprises arranging the third storage provider for the user to acquire more storage space from a third storage device.

12. The computer-readable storage medium of claim 9, wherein the method further comprises:

updating the file mapping table within the server in response to migrating one or more files from the first storage device to the second storage device based at least in part on the monitored operating statistics and the monitored accesses statistics.

13. A data processing system, comprising:

an application programming interface (API) to receive a request from a client for accessing files stored in a plurality of heterogeneous storage devices hosted by a plurality of storage providers over the network, including a first storage device of a first storage provider and a second storage device of a second storage provider; and

a storage service module to

access, on behalf of a user of the client, the first storage device and the second storage device to retrieve information concerning the files,

transmit data to the client over the network, the data representing a logical file system view of the files without exposing actual storage locations of the files stored in the first and second storage devices,

select, in response to a request for storing a new file from the client without notification to the client, a storage space associated with a first user account of the first storage device or a second user account of the second storage device based, at least in part, on a combination of;

a remaining storage capacity of the first storage device and a remaining storage capacity of the second storage device available to the first user account and the second user account, respectively, a type of the new file, a bandwidth of the first storage provider for the first storage device and a bandwidth of the second storage provider for the second storage device, and storage provider access times associated with each of the first storage device and the second storage device when accessing files of the type of the new file,

store the file in the selected storage space associated with one of the first and second user accounts,

monitor operating statistics for the first and second storage devices comprising;

monitoring at least storage provider access time and bandwidth provided by the first storage provider for the first storage device and the second storage provider for the second storage device, and client access statistics indicative of a frequency of access by the user to one or more of the files stored in the first and second storage devices, and

migrate at least one file having the type of the new file from the first storage device to the second storage device when;

the at least one file is accessed by the user more frequently than at least one other file of a different type on the first storage device, the second storage device stores one or more files of the type of the new file for the client, and the second storage device has at least one of a higher bandwidth and a shorter access time than the first storage device.

14. The system of claim 13, further comprising a database to store first and second credentials associated with the first storage device and second storage device, respectively, wherein accessing the first and second storage devices is performed using the first and second credentials without having to prompt the user for providing the first and second credentials.

15. The system of claim 13, further comprising a file mapping table for the user logically mapping the logical file system view with physical files stored in the first and second storage devices.

16. The system of claim 15, wherein the storage service module is configured to:

update the file mapping table within the server based on the storage of the file in the selected storage space.

17. The system of claim 13, wherein the resource manager is configured to arrange the third storage provider for the user to acquire more storage space from a third storage device.

18. The system of claim 15, further comprising a resource manager configured to:

update the file mapping table within the server in response to migrating one or more files from the first storage device to the second storage device based at least in part on the monitored operating statistics and the monitored accesses statistics.

19. A computer-implemented method for managing content stored in a heterogeneous collection of storage devices, the method comprising:

receiving, at a server, a request for storing a file from a client over a network;

determining, by the server computer system without notification to the client, whether a first storage device of a first storage provider is suitable to store the file based, at least in part, on a combination of;

a remaining storage capacity of the first storage device available to a first user account of the client associated with the first storage provider, a type of the new file, a bandwidth of the first storage provider for the first storage device, and storage provider access times associated with each of the first storage device and when accessing files of the type of the new file;

when the first storage device is determined to be suitable to store the file, storing the file in a first storage space of the first storage device;

when the first storage device is determined not to be suitable to store the file, obtaining a storage space of a second storage device from a second storage provider over the network, and storing the file in the second storage device hosted by the second storage provider;

monitoring operating statistics for the first and second storage devices comprising;

monitoring at least storage provider access time and bandwidth provided by the first storage provider for the first storage device and the second storage provider for the second storage device, and client access statistics indicative of a frequency of access by the user to one or more of the files stored in the first and second storage devices; and

migrating at least one file having the type of the new file from the first storage device to the second storage device when;

the at least one file is accessed by the user more frequently than at least one other file of a different type on the first storage device, the second storage device stores one or more files of the type of the new file for the client, and the second storage device has at least one of a higher bandwidth and a shorter access time than the first storage device.

20. The method of claim 19, further comprising transmitting to the client information representing the second storage provider to enable a user of the client to acquire the storage space, if the first storage device is not suitable to store the file.

21. The method of claim 19, further comprising maintaining within the server for the user a file mapping table logically mapping a logical file system view with physical files stored in the first and second storage devices.