MECHANISM FOR RETRIEVING COMPRESSED DATA FROM A STORAGE CLOUD

• US 20120089781A1
• Filed: 10/11/2010
• Published: 04/12/2012
• Est. Priority Date: 10/11/2010
• Status: Abandoned Application

• Current Assignee: Cirtas Systems, Inc.
• Original Assignee: Cirtas Systems, Inc.
• Inventors: Ranade, Sandeep, Samuels, Allen, Ankam, Shiva Kalyani
• Application Number:
  US12/902,071
• Publication Number:
  US 20120089781A1
• Time in Patent Office: Days
• US Class Current: 711/118
• CPC Class Codes: G06F 16/1744 using compression, e.g. sparse files
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

A cloud storage appliance receives one or more read requests for data stored in a storage cloud. The cloud storage appliance determines, for a time period, a total amount of bandwidth that will be used to retrieve the requested data from the storage cloud. The cloud storage appliance then determines an amount of remaining bandwidth for the time period. The cloud storage appliance retrieves the requested data from the storage cloud in the time period to satisfy the one or more read requests. The cloud storage appliance additionally retrieves a quantity of unrequested data from the storage cloud in the time period, wherein the quantity of retrieved unrequested data is based on the amount of remaining bandwidth for the time period.

Claims

1. A method comprising:

receiving one or more read requests for data stored in a storage cloud;

determining, for a time period, a total amount of bandwidth that will be used to retrieve the requested data from the storage cloud;

determining an amount of remaining bandwidth for the time period;

retrieving the requested data from the storage cloud in the time period to satisfy the one or more read requests; and

retrieving a quantity of unrequested data from the storage cloud in the time period, wherein at least a portion of the retrieved unrequested data has an increased probability of being requested in a future time period, and wherein the quantity of retrieved unrequested data is based on the amount of remaining bandwidth for the time period.

2. The method of claim 1, wherein the requested data comprises a plurality of requested data chunks, each of which is contained within a cloud file stored in the storage cloud.

3. The method of claim 2, wherein:

retrieving the plurality of data chunks comprises performing partial file requests on cloud files that contain the plurality of data chunks; and

retrieving the unrequested data comprises retrieving at least one cloud file containing one or more data chunks that have an increased probability of being requested.

4. The method of claim 3, further comprising:

determining that the at least one cloud file contains one or more data chunks that have an increased probability of being requested based on identifying a plurality of already requested data chunks contained by the at least one cloud file.

5. The method of claim 3, further comprising:

making a first determination that the at least one cloud file has at least a threshold number of data chunks that have been requested;

making a second determination that the network bandwidth is increasing or remaining steady;

making a third determination that the amount of remaining bandwidth for the time period satisfies a bandwidth threshold; and

upon making the first determination, the second determination and the third determination, retrieving the at least one cloud file.

6. The method of claim 3, further comprising:

separating the at least one cloud file into a plurality of unrequested data chunks; and

placing the plurality of unrequested data chunks in a cache.

7. The method of claim 2, further comprising:

determining additional data chunks referenced by the requested data chunks; and

retrieving the additional data chunks before retrieving the requested data.

8. The method of claim 7, further comprising:

placing the requested data chunks and the additional data chunks in a cache;

decompressing the requested data chunks using the additional data chunks;

returning the requested data chunks to a requestor; and

removing the requested data chunks and the additional data chunks from the cache upon returning the requested data chunks to the requestor.

9. The method of claim 1, wherein the requested data is retrieved from the storage cloud using an HTTP partial GET command and the unrequested data is retrieved from the storage cloud using a standard HTTP GET command.

12. The computer readable storage medium of claim 1, wherein:

retrieving the plurality of data chunks comprises performing partial file requests on cloud files that contain the plurality of data chunks; and

retrieving the unrequested data comprises retrieving at least one cloud file containing one or more data chunks that have an increased probability of being requested.

13. The computer readable storage medium of claim 12, the method further comprising:

determining that the at least one cloud file contains one or more data chunks that have an increased probability of being requested based on identifying a plurality of already requested data chunks contained by the at least one cloud file.

14. The computer readable storage medium of claim 12, the method further comprising:

making a first determination that the at least one cloud file has at least a threshold number of data chunks that have been requested;

making a second determination that the network bandwidth is increasing or remaining steady;

making a third determination that the amount of remaining bandwidth for the time period satisfies a bandwidth threshold; and

upon making the first determination, the second determination and the third determination, retrieving the at least one cloud file.

15. The computer readable storage medium of claim 12, the method further comprising:

separating the at least one cloud file into a plurality of unrequested data chunks; and

placing the plurality of unrequested data chunks in a cache.

10. A computer readable storage medium including instructions that, when executed by a processing device, cause the processing device to perform a method comprising:

receiving one or more read requests for data stored in a storage cloud;

determining, for a time period, a total amount of bandwidth that will be used to retrieve the requested data from the storage cloud;

determining an amount of remaining bandwidth for the time period;

retrieving the requested data from the storage cloud in the time period to satisfy the one or more read requests; and

retrieving a quantity of unrequested data from the storage cloud in the time period, wherein at least a portion of the retrieved unrequested data has an increased probability of being requested in a future time period, and wherein the quantity of retrieved unrequested data is based on the amount of remaining bandwidth for the time period.

11. The computer readable storage medium of claim 10, wherein the requested data comprises a plurality of requested data chunks, each of which is contained within a cloud file stored in the storage cloud.

16. The computer readable storage medium of claim 11, the method further comprising:

determining additional data chunks referenced by the requested data chunks; and

retrieving the additional data chunks before retrieving the requested data.

17. The computer readable storage medium of claim 16, the method further comprising:

placing the requested data chunks and the additional data chunks in a cache;

decompressing the requested data chunks using the additional data chunks;

returning the requested data chunks to a requestor; and

removing the requested data chunks and the additional data chunks from the cache upon returning the requested data chunks to the requestor.

18. The computer readable storage medium of claim 10, wherein the requested data is retrieved from the storage cloud using an HTTP partial GET command and the unrequested data is retrieved from the storage cloud using a standard HTTP GET command.

19. A computing device, comprising:

a memory to store instructions for a data fetching module; and

a processing device to execute the instructions, wherein the instructions cause the processing device to;

determine, for a time period, a total amount of bandwidth that will be used to retrieve requested data from a storage cloud after receiving one or more read requests for the requested data stored in the storage cloud;

determine an amount of remaining bandwidth for the time period;

retrieve the requested data from the storage cloud in the time period to satisfy the one or more read requests; and

retrieve a quantity of unrequested data from the storage cloud in the time period, wherein at least a portion of the retrieved unrequested data has an increased probability of being requested in a future time period, and wherein the quantity of retrieved unrequested data is based on the amount of remaining bandwidth for the time period.

20. The computing device of claim 19, wherein:

the requested data comprises a plurality of requested data chunks, each of which is contained within a cloud file stored in the storage cloud.

retrieving the plurality of data chunks comprises performing partial file requests on cloud files that contain the plurality of data chunks; and

retrieving the unrequested data comprises retrieving at least one cloud file containing one or more data chunks that have an increased probability of being requested.

21. The computing device of claim 20, further comprising the instructions to cause the processing device to:

determine that the at least one cloud file contains one or more data chunks that have an increased probability of being requested based on identifying a plurality of already requested data chunks contained by the at least one cloud file.

22. The computing device of claim 20, further comprising the instructions to cause the processing device to:

separate the at least one cloud file into a plurality of unrequested data chunks; and

place the plurality of unrequested data chunks in a cache.

23. The computing device of claim 20, further comprising the instructions to cause the processing device to:

determine additional data chunks referenced by the requested data chunks; and

retrieve the additional data chunks before retrieving the requested data.

24. The computing device of claim 23, further comprising:

a cache;

wherein the instructions cause the processing device to place the requested data chunks and the additional data chunks in the cache, to decompress the requested data chunks using the additional data chunks, to return the requested data chunks to a requestor, and to remove the requested data chunks and the additional data chunks from the cache upon returning the requested data chunks to the requestor.