Data integrity and acceleration in compressed storage environments in combination with software defined native RAID

• US 10,152,235 B2
• Filed: 11/21/2017
• Issued: 12/11/2018
• Est. Priority Date: 12/07/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Rueger, Erik, Russell, Lance W., Schmitt, Christof, Snellgrove, Thomas A.
• Primary Examiner(s): Bryan, Jason B
• Application Number:
  US15/819,687
• Publication Number:
  US 20180095672A1
• Time in Patent Office: 385 Days
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0661 Format or protocol conversion arrangements
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A mechanism is provided in a data processing system for data integrity and acceleration in compressed storage environments in combination with software defined native redundant array of independent disks (RAID). The mechanism receives a data portion to write to storage and divides the data portion into a plurality of chunks. The mechanism performs real-time compression on a given chunk within the plurality of chunks and determines a compression rate for the given chunk. The mechanism determines a RAID level for the given chunk based on a value of the compression rate and stores the given chunk based on the determined RAID level.

Claims

1. A method, in a data processing system, for data integrity and acceleration in compressed storage environments in combination with software defined native redundant array of independent disks (RAID), the method comprising:

receiving, by a data handling module, a compressed chunk and a compression rate for the compressed chunk from a real-time compression engine, wherein the real-time compression engine performs real-time compression on a plurality of chunks to be written to storage;

determining, by the data handling module, a RAID level for the compressed chunk based on a value of the compression rate; and

storing, by the data handling module, the compressed chunk based on the determined RAID level, wherein storing the compressed chunk comprises migrating the compressed chunk from previous storage pool to a new storage pool.

2. The method of claim 1, wherein determining the RAID level for the compressed chunk comprises comparing the value of the compression rate to at least one threshold, wherein the at least one threshold is mapped to corresponding RAID levels.

3. The method of claim 2, wherein values of the compression rate less than a first threshold are mapped to RAID 5, wherein values of the compression rate greater than the first threshold and less than a second threshold are mapped to RAID 6, wherein values of the compression rate greater than the second threshold and less than a third threshold are mapped to RAID 10, and wherein values of the compression rate greater than the third threshold are mapped to RAID 1.

4. The method of claim 1, further comprising determining a performance level for the compressed chunk based on the value of the compression rate, wherein storing the compressed chunk comprises storing the compressed chunk based on the determined RAID) level and the determined performance level.

5. The method of claim 4, wherein determining the performance level for the compressed chunk comprises comparing the value of the compression rate to at least one threshold, wherein the at least one threshold is mapped to corresponding RAID levels.

6. The method of claim 5, wherein values of the compression rate less than a first threshold are mapped to a low performance pool of storage, wherein values of the compression rate greater than the first threshold and less than a second threshold are mapped to a medium performance pool of storage, and wherein values of the compression rate greater than the second threshold are mapped to a high performance pool of storage.

7. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to:

receive, by a data handling module, a compressed chunk and a compression rate for the compressed chunk from the real-time compression engine, wherein the real-time compression engine performs real-time compression on a plurality of chunks to be written to storage;

determine, by the data handling module, a RAID level for the compressed chunk based on a value of the compression rate; and

store, by the data handling module, the compressed chunk based on the determined RAID level, wherein storing the compressed chunk comprises migrating the compressed chunk from a previous storage pool to a new storage pool.

8. The computer program product of claim 7, wherein determining the RAID level for the compressed chunk comprises comparing the value of the compression rate to at least one threshold, wherein the at least one threshold are mapped to corresponding RAID levels.

9. The computer program product of claim 8, wherein values of the compression rate less than a first threshold are mapped to RAID 5, wherein values of the compression rate greater than the first threshold and less than a second threshold are mapped to RAID 6, wherein values of the compression rate greater than the second threshold and less than a third threshold are mapped to RAID 10, and wherein values of the compression rate greater than the third threshold are mapped to RAID 1.

10. The computer program product of claim 7, further comprising determining a performance level for the compressed chunk based on the value of the compression rate, wherein storing the compressed chunk comprises storing the compressed chunk based on the determined RAID level and the determined performance level.

11. The computer program product of claim 10, wherein determining the performance level for the compressed chunk comprises comparing the value of the compression rate to at least one threshold, wherein the at least one threshold are mapped to corresponding RAID levels.

12. The computer program product of claim 11, wherein values of the compression rate less than a first threshold are mapped to a low performance pool of storage, wherein values of the compression rate greater than the first threshold and less than a second threshold are mapped to a medium performance pool of storage, and wherein values of the compression rate greater than the second threshold are mapped to a high performance pool of storage.

13. An apparatus comprising:

a processor; and

a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to;

receive, by a data handling module, a compressed chunk and a compression rate for the compressed chunk from the real-time compression engine, wherein the real-time compression engine performs real-time compression on a plurality of chunks to be written to storage;

deterimine, by the data handling module, a RAID level for the compressed chunk based on a value of the compression rate; and

store, by the data handling module, the given chunk based on the determined RAID level, wherein storing the compressed chunk comprises migrating the compressed chunk from a previous storage pool.

14. The apparatus of claim 13, wherein determining the RAID level for the compressed chunk comprises comparing the value of the compression rate to at least one threshold, wherein the at least one threshold are mapped to corresponding RAID levels.

15. The apparatus of claim 14, wherein values of the compression rate less than a first threshold are mapped to RAID 5, wherein values of the compression rate greater than the first threshold and less than a second threshold are mapped to RAID 6, wherein values of the compression rate greater than the second threshold and less than a third threshold are mapped to RAID 10, and wherein values of the compression rate greater than the third threshold are mapped to RAID 1.

16. The apparatus of claim 13, further comprising determining a performance level for the compressed chunk based on the value of the compression rate, wherein storing the compressed chunk comprises storing the compressed chunk based on the determined RAID level and the determined performance level.

17. The apparatus of claim 16, wherein determining the performance level for the compressed chunk comprises comparing the value of the compression rate to at least one threshold, wherein the at least one threshold are mapped to corresponding RAID levels.

18. The apparatus of claim 17, wherein values of the compression rate less than a first threshold are mapped to a low performance pool of storage, wherein values of the compression rate greater than the first threshold and less than a second threshold are mapped to a medium performance pool of storage, and wherein values of the compression rate greater than the second threshold are mapped to a high performance pool of storage.