Early compression prediction in a storage system with granular block sizes

• US 10,013,200 B1
• Filed: 06/29/2016
• Issued: 07/03/2018
• Est. Priority Date: 06/29/2016
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Shveidel, Vladimir, Shoikhet, Kirill
• Primary Examiner(s): Chappell, Daniel C
• Application Number:
  US15/196,374
• Time in Patent Office: 734 Days
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

Described embodiments may provide methods and systems for receiving an input/output (I/O) request by a storage system having at least one storage volume. The I/O request has associated payload data. The I/O request is performed with early prediction compression by compressing a first portion of the payload data and determining whether one or more remaining portions of the I/O request should be processed in a compressed manner or an uncompressed manner based, at least in part, upon the results of compressing the first portion of the payload data.

Claims

1. A method comprising:

receiving an input/output (I/O) request by a storage system having at least one storage volume, the I/O request having associated payload data;

performing the I/O request with early prediction compression by;

compressing a first portion of the payload data; and

determining whether one or more remaining portions of the I/O request should be processed in a compressed manner or an uncompressed manner based, at least in part, upon the results of compressing the first portion of the payload data,

wherein if a utilization level of the one or more processors is below a processor utilization threshold, setting a compression threshold value to increase compression of the payload data; and

if the utilization level of the one or more processors is at or above a processor utilization threshold, setting the compression threshold value to decrease compression of the payload data; and

performing the I/O request to the at least one storage volume with the payload data uncompressed if an achieved compression ratio of the first portion of the payload data has not reached a compression threshold value, wherein the I/O request comprises a request to write data to the at least one storage volume and wherein determining one or more block sizes of the at least one storage volume and a size of payload data associated with the I/O request further comprises, if the size of the payload data associated with the I/O request is greater than a largest of the one or more block sizes of the at least one storage volume;

segmenting the payload data associated with the I/O request into two or more payload data segments, each payload data segment having a size associated with the largest of the one or more block sizes; and

performing the I/O request with early prediction compression for each of the two or more payload data segments.

2. The method of claim 1, further comprising:

determining one or more block sizes of the at least one storage volume and a size of the payload data associated with the I/O request; and

if the size of the payload data is less than a smallest one of the one or more block sizes, performing the I/O request to the at least one storage volume with the payload data uncompressed.

3. The method of claim 1, further comprising, if an achieved compression ratio of the first portion of the payload data has reached the compression threshold value:

if the payload data is smaller than a given one of the one or more block sizes, performing the I/O request to the at least one storage volume with the first portion of the payload data compressed, and one or more additional portions of the payload data uncompressed.

4. The method of claim 2, further comprising, if the payload data is not smaller than a given one of the one or more block sizes, compressing one or more additional portions of the payload data.

5. The method of claim 1, further comprising, based upon one or more operating conditions of the storage system, adjusting the compression threshold value.

6. The method of claim 5, further comprising:

if a free space level of the at least one storage volume is below a free space threshold, setting the compression threshold value to increase compression of the payload data; and

if the free space level of the at least one storage volume is at or above a free space threshold, setting the compression threshold value to decrease compression of the payload data.

7. The method of claim 1, further comprising, based upon one or more operating conditions of the storage system, adjusting a size of the first portion of the payload data.

8. A system comprising:

a processor; and

memory storing computer program code that when executed on the processor causes the processor to execute an input/output (I/O) request received by a storage system having at least one storage volume operable to perform the operations of;

receiving an input/output (I/O) request by a storage system having at least one storage volume, the I/O request having associated payload data;

performing the I/O request with early prediction compression by;

compressing a first portion of the payload data; and

determining whether one or more remaining portions of the I/O request should be processed in a compressed manner or an uncompressed manner based, at least in part, upon the results of compressing the first portion of the payload data,

wherein if a utilization level of the one or more processors is below a processor utilization threshold, setting a compression threshold value to increase compression of the payload data; and

if the utilization level of the one or more processors is at or above a processor utilization threshold, setting the compression threshold value to decrease compression of the payload data; and

performing the I/O request to the at least one storage volume with the payload data uncompressed if an achieved compression ratio of the first portion of the payload data has not reached a compression threshold value, wherein the I/O request comprises a request to write data to the at least one storage volume and wherein determining one or more block sizes of the at least one storage volume and a size of payload data associated with the I/O request further comprises, if the size of the payload data associated with the I/O request is greater than a largest of the one or more block sizes of the at least one storage volume;

segmenting the payload data associated with the I/O request into two or more payload data segments, each payload data segment having a size associated with the largest of the one or more block sizes; and

performing the I/O request with early prediction compression for each of the two or more payload data segments.

9. The system of claim 8, wherein the computer program code is further operable to perform the operations of, if the achieved compression ratio of the first portion of the payload data has reached the compression threshold value:

if the payload data is smaller than a given one of the one or more block sizes, performing the I/O request to the at least one storage volume with the first portion of the payload data compressed, and one or more additional portions of the payload data uncompressed; and

if the payload data is not smaller than a given one of the one or more block sizes, compressing one or more additional portions of the payload data.

10. The system of claim 8, wherein the computer program code is further operable to perform the operations of:

determining one or more block sizes of the at least one storage volume and a size of the payload data associated with the I/O request;

if the size of the payload data is less than a smallest one of the one or more block sizes, performing the I/O request to the at least one storage volume with the payload data uncompressed; and

if the payload data is not smaller than a given one of the one or more block sizes, compressing one or more additional portions of the payload data.

11. The system of claim 8, wherein the computer program code is further operable to perform the operation of, based upon one or more operating conditions of the storage system, adjusting the compression threshold value.

12. The system of claim 11, wherein the computer program code is further operable to perform the operations of, at least one of:

if a free space level of the at least one storage volume is below a free space threshold, setting the compression threshold value to increase compression of the payload data; and

if the free space level of the at least one storage volume is at or above a free space threshold, setting the compression threshold value to decrease compression of the payload data.

13. The system of claim 8, wherein the computer program code is further operable to perform the operation of, based upon one or more operating conditions of the storage system, adjusting a size of the first portion of the payload data.

14. A computer program product including a non-transitory computer readable storage medium having computer program code encoded thereon that when executed on a processor of a computer causes the computer to execute an input/output (I/O) request received by a storage system having at least one storage volume, the computer program product comprising:

computer program code for receiving the input/output (I/O) request, the I/O request having associated payload data;

computer program code for performing the I/O request with early prediction compression by;

compressing a first portion of the payload data; and

determining whether one or more remaining portions of the I/O request should be processed in a compressed manner or an uncompressed manner based, at least in part, upon the results of compressing the first portion of the payload data;

wherein if a utilization level of the one or more processors is below a processor utilization threshold, setting a compression threshold value to increase compression of the payload data; and

if the utilization level of the one or more processors is at or above a processor utilization threshold, setting the compression threshold value to decrease compression of the payload data; and

computer program code for performing the I/O request to the at least one storage volume with the payload data uncompressed if an achieved compression ratio of the first portion of the payload data has not reached a compression threshold value/wherein the I/O request comprises a request to write data to the at least one storage volume and wherein determining one or more block sizes of the at least one storage volume and a size of payload data associated with the I/O request further comprises, if the size of the payload data associated with the I/O request is greater than a largest of the one or more block sizes of the at least one storage volume;

segmenting the payload data associated with the I/O request into two or more payload data segments, each payload data segment having a size associated with the largest of the one or more block sizes; and

performing the I/O request with early prediction compression for each of the two or more payload data segments.

15. The computer program product of claim 14, further comprising:

computer program code for adjusting the compression threshold value based upon one or more operating conditions of the storage system;

computer program code for setting the compression threshold value to increase compression of the payload data if a free space level of the at least one storage volume is below a free space threshold; and

computer program code for setting the compression threshold value to decrease compression of the payload data if the free space level of the at least one storage volume is at or above a free space threshold.