COMPRESSED STORAGE MANAGEMENT

• US 20090112949A1
• Filed: 10/31/2007
• Published: 04/30/2009
• Est. Priority Date: 10/31/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wang, Landy, Bak, Yevgeniy, Ergan, Cenk, Kirshenbaum, Alexander, Iyigun, Mehmet, Mickle, Benjamin A
• Granted Patent: US 7,895,242 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 12/08 in hierarchically structured memory systems, e.g. virtual memory systems
• CPC Class Codes: G06F 12/0802 Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/401 Compressed data
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems

Abstract

In accordance with one or more aspects, compressed storage management in a system includes determining which of multiple data units stored in an uncompressed portion of the storage resource are to be compressed and stored in a compressed portion of the storage resource. The management can further include returning one or more regions of the compressed portion for use in the uncompressed portion in response to storage resource pressure in the system, as well as compacting regions in the compressed portion to fill empty gaps in the compressed portion.

Claims

1. One or more computer storage media having stored thereon multiple instructions to manage a storage resource in a system, the multiple instructions, when executed by one or more processors in the system, causing the one or more processors to:

determine which one or more data units of multiple data units stored in an uncompressed portion of the storage resource are to be compressed and stored in a compressed portion of the storage resource;

compress the one or more data units;

store the compressed one or more data units in the compressed portion of the storage device;

return one or more regions of the compressed portion for use in the uncompressed portion in response to storage resource pressure in the system; and

compact regions in the compressed portion to fill empty gaps in the compressed portion.

2. One or more computer storage media as recited in claim 1, the multiple instructions further causing the one or more processors to:

retrieve at least one of the one or more data units from the compressed portion; and

decompress the at least one data unit.

3. One or more computer storage media as recited in claim 1, the multiple instructions further causing the one or more processors to maintain a log of all actions taken on the compressed portion.

4. One or more computer storage media as recited in claim 1, the multiple instructions further causing the one or more processors to maintain a data unit map identifying the data units stored in the compressed portion, the data unit map including a record for each data unit stored in the compressed portion, and each record including:

a data unit key field that stores a unique identifier of the data unit; and

one or more location fields that stores an identifier of a location in the compressed portion where the data unit is stored.

5. One or more computer storage media as recited in claim 1, the multiple instructions further causing the one or more processors to maintain a region map identifying the data units stored in the compressed portion, the region map including a record for each data unit stored in the compressed portion, and each record including:

a data unit key field that stores a unique identifier of the data unit;

a region number field that stores an identifier of a region of the compressed portion where the data unit is stored; and

an offset field that stores an identifier of an offset into the region of the compressed portion where the data unit is stored.

6. One or more computer storage media as recited in claim 1, wherein to determine which of multiple data units stored in the uncompressed portion are to be compressed and stored in the compressed portion is to select ones of the multiple data units based at least in part on:

compression ratios of each of the multiple data units;

how recently each of the multiple data units was most recently accessed; and

how frequently each of the multiple data units was most recently accessed.

7. One or more computer storage media as recited in claim 1, wherein to compact regions in the compressed portion is to relocate data units from a first region of the one or more regions into at least a second region of the one or more regions, and return the first region for use in the uncompressed portion if the first region is empty.

8. One or more computer storage media as recited in claim 1, wherein to compact regions in the compressed portion is to relocate data units within a first region of the one or more regions.

9. One or more computer storage media as recited in claim 1, wherein the instructions further cause the one or more processors to:

analyze the empty gaps in the compressed portion;

determine, based on the analysis, whether a compaction threshold has been exceeded; and

compact the regions in the compressed portion to fill the empty gaps in the compressed portion only if the compaction threshold has been exceeded.

10. One or more computer storage media as recited in claim 1, wherein the storage resource is a cache.

11. One or more computer storage media as recited in claim 1, the multiple instructions further causing the one or more processors to reduce a size of the compressed portion by:

analyzing storage resource pressure in the system;

checking whether the storage resource pressure exceeds a threshold amount;

if the storage resource pressure exceeds the threshold amount, then;

releasing one or more data units from the compressed portion; and

returning one or more regions of the compressed portion to a resource manager.

12. One or more computer storage media as recited in claim 11, the multiple instructions further causing the one or more processors to determine the threshold amount based at least in part on a current state of the system.

13. One or more computer storage media as recited in claim 1, the multiple instructions further causing the one or more processors to expose a user interface to receive input from a user to:

control a size of the compressed portion;

describe what data units should be stored in the compressed portion;

identify a compression algorithm to be used to compress the one or more data units; and

identify a compaction threshold value to be used to determine when to compact the regions in the compressed portion.

14. A method comprising:

analyzing data access and usage patterns of multiple data units stored in an uncompressed portion of the storage resource, the analyzing comprising identifying compression ratios of each of the multiple data units, how recently each of the multiple data units was accessed, and how frequently each of the multiple data units was accessed;

selecting, based at least in part on the analyzing, one or more of the multiple data units; and

for each selected data unit;

retrieving the selected data unit from the uncompressed portion;

compressing the selected data unit; and

storing the compressed data unit in the compressed portion.

15. A method as recited in claim 14, the analyzing further comprising identifying a priority level of each of the multiple data units.

16. A method as recited in claim 14, further comprising compacting regions in the compressed portion to fill empty gaps in the compressed portion by:

relocating data units from a first region of the compressed portion into one or more other regions of the compressed portion; and

returning the first region for use in the uncompressed portion.

17. A method as recited in claim 14, wherein the storage resource comprises a buffer pool of a database.

18. A method of reducing a size of a compressed portion of a storage resource in a system, the method comprising:

analyzing storage resource pressure in the system;

checking whether the storage resource pressure exceeds a threshold amount;

if the storage resource pressure exceeds the threshold amount, then;

releasing one or more data units from the compressed portion; and

returning one or more regions of the compressed portion to a resource manager.

19. A method as recited in claim 18, wherein the checking comprises determining that the storage resource pressure exceeds the threshold amount when a request to release some of the storage resource is received from a manager of the storage resource.

20. A method as recited in claim 18, wherein the releasing comprises decompressing the one or more data units and returning the decompressed one or more data units to the resource manager for storage in an uncompressed portion of the storage resource.