Systems and methods for predicting compressibility of data

• US 9,946,464 B2
• Filed: 06/16/2017
• Issued: 04/17/2018
• Est. Priority Date: 04/16/2015
• Status: Active Grant

• Current Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Original Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Inventors: Huang, Wei, Pillay, Sanjay Ramakrishna, Subbarao, Sanjay
• Primary Examiner(s): Cardwell, Eric
• Application Number:
  US15/625,970
• Publication Number:
  US 20170285966A1
• Time in Patent Office: 305 Days
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0625 Power saving in storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0673 Single storage device
• CPC Class Codes: G06F 3/0679 Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Systems and methods for predicting the compressibility of data in a flash storage device are provided. One such method involves extracting byte intervals from the block of data, each of the byte intervals consisting of a preselected number of bytes, performing a hash function to map the byte intervals into a plurality of bins, the plurality of bins comprising one bin for each possible value of the byte intervals, incrementing a hit count each time more than one of the byte intervals is mapped into a single bin of the plurality of bins, and determining whether to compress the block of data based on a comparison of a ratio of the hit count to a total number of the byte intervals and a preselected threshold. This method may be implemented in hardware to ensure fast and efficient execution.

Claims

1. A method for predicting a compressibility of a block of data, comprising:

extracting byte intervals from the block of data, each of the byte intervals consisting of a preselected number of bytes;

performing a hash function to map the byte intervals into a plurality of bins, the plurality of bins comprising one bin for each possible value of the byte intervals;

incrementing a hit count each time more than one of the byte intervals is mapped into a single bin of the plurality of bins; and

determining whether to compress the block of data based on a comparison of a ratio of the hit count to a total number of the byte intervals and a preselected threshold.

2. The method of claim 1, wherein the preselected number of bytes for the byte intervals is two bytes.

3. The method of claim 1, wherein the performing the hash function to map the byte intervals into the plurality of bins comprises performing the hash function using less than a total number of bits in the preselected number of bytes.

4. The method of claim 1, further comprising:

if the ratio of the hit count to the total number of the byte intervals is greater than the preselected threshold, compressing the data block.

5. The method of claim 1, further comprising:

if the ratio of the hit count to the total number of the byte intervals is less than the preselected threshold, determining not to compress the data block.

6. The method of claim 1, wherein the block of data is a block in a flash storage device.

7. The method of claim 1, wherein the plurality of bins consists of one bin for each possible value of the byte intervals.

8. The method of claim 1, wherein the extracting byte intervals from the block of data comprises:

setting the plurality of bins to zero;

setting the hit count to zero; and

extracting byte intervals from the block of data.

9. The method of claim 8:

wherein the performing the hash function to map the byte intervals into the plurality of bins comprises;

setting, if a current bin of the plurality of bins mapped to a current byte interval of the byte intervals is not set to one, the current bin to one; and

wherein the incrementing the hit count each time more than one of the byte intervals is mapped into the single bin of the plurality of bins comprises;

incrementing, if the current bin mapped to the current byte interval is set to one, the hit count.

10. A system for predicting a compressibility of a block of data, comprising:

an extractor configured to extract byte intervals from the block of data, each of the byte intervals consisting of a preselected number of bytes;

a hash configured to map the byte intervals into a plurality of bins, the plurality of bins comprising one bin for each possible value of the byte intervals;

a counter configured to increment a hit count each time more than one of the byte intervals is mapped into a single bin of the plurality of bins; and

a compression determiner configured to determine whether to compress the block of data based on a comparison of a ratio of the hit count to a total number of the byte intervals and a preselected threshold.

11. The system of claim 10, wherein the preselected number of bytes for the byte intervals is two bytes.

12. The system of claim 10, wherein the hash maps the byte intervals into the plurality of bins using less than a total number of bits in the preselected number of bytes.

13. The system of claim 10, further comprising:

a compressor configured to compress the data block if the ratio of the hit count to the total number of the byte intervals is greater than the preselected threshold.

14. The system of claim 10, further comprising:

a compressor configured not to compress the data block if the ratio of the hit count to the total number of the byte intervals is less than the preselected threshold.

15. The system of claim 10, wherein the block of data is a block in a flash storage device.

16. The system of claim 10, wherein the plurality of bins consists of one bin for each possible value of the byte intervals.

17. The system of claim 10:

wherein the plurality of bins is initially set to zero; and

wherein the hit count is initially set to zero.

18. The system of claim 17:

wherein the system is configured to set, if a current bin of the plurality of bins mapped to a current byte interval of the byte intervals is not set to one, the current bin to one; and

wherein the counter is configured to increment, if the current bin mapped to the current byte interval is set to one, the hit count.