System and methods for accelerated data storage and retrieval

• US 10,019,458 B2
• Filed: 07/08/2015
• Issued: 07/10/2018
• Est. Priority Date: 03/11/1999
• Status: Expired due to Fees

• Current Assignee: N/A
• Original Assignee: N/A
• Inventors: Fallon, James J.
• Primary Examiner(s): Tran, Philip B
• Application Number:
  US14/794,201
• Publication Number:
  US 20160162505A1
• Time in Patent Office: 1,098 Days
• Field of Search: 709231, 709247
• CPC Class Codes: G06F 16/1744 using compression, e.g. sparse files
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/843 on film
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

Systems and methods for providing accelerated data storage and retrieval utilizing lossless data compression and decompression. A data storage accelerator includes one or a plurality of high speed data compression encoders that are configured to compress data. The compressed data is subsequently stored in a target memory or other storage device whose input data storage bandwidth is lower than the original input data stream bandwidth. Similarly, a data retrieval accelerator includes one or a plurality of high speed data decompression decoders that are configured to decompress data at a rate equivalent to or faster than the input data stream from the target memory or storage device. The decompressed data is then output at rate data that is greater than the output rate from the target memory or data storage device.

Claims

1. A system for accelerating data storage, comprising:

a memory device; and

one or more processors coupled to the memory device, wherein the one or more processors are configured to;

analyze a first data block to determine a parameter of the first data block;

apply a first encoder associated with the determined parameter of the first data block to create a first encoded data block, wherein the first encoder utilizes a lossless dictionary compression technique;

analyze a second data block to determine a parameter of the second data block;

apply a second encoder associated with the determined parameter of the second data block to create a second encoded data block, wherein the second encoder utilizes a lossless compression technique different than the lossless dictionary compression technique; and

store the first and second encoded data blocks on the memory device, wherein encoding and storage of the first encoded data block occur faster than the first data block is able to be stored on the memory device in unencoded form.

2. The system of claim 1, wherein encoding and storage of the first encoded data block and the second encoded data block occur faster than the first and second data blocks are able to be stored together on the memory device in unencoded form.

3. The system of claim 1, wherein the analysis of the first data block excludes analysis based solely on reading a descriptor.

4. The system of claim 3, wherein the analysis of the second data block excludes analysis based solely on reading a descriptor.

5. The system of claim 1, wherein the one or more processors are further configured to select the second encoder from a plurality of encoders.

6. The system of claim 1, wherein the one or more processors are further configured to write a descriptor to the memory device and the descriptor indicates the lossless compression technique used to encode the second data block.

7. The system of claim 1, wherein the one or more processors are further configured to store a descriptor on the memory device indicative of the lossless compression technique used to encode the second data block such that the descriptor is capable of being utilized to decode at least a portion of the second encoded data block.

8. The system of claim 1, wherein the first encoded data block includes a reference to the unencoded first data block.

9. A method for accelerating data storage comprising:

analyzing a first data block to determine a parameter of the first data block;

applying a first encoder associated with the determined parameter of the first data block to create a first encoded data block, wherein the first encoder utilizes a lossless dictionary compression technique;

analyzing a second data block to determine a parameter of the second data block;

applying a second encoder associated with the determined parameter of the second data block to create a second encoded data block, wherein the second encoder utilizes a lossless compression technique different than the lossless dictionary compression technique; and

storing the first and second encoded data blocks on a memory device, wherein encoding and storage of the first encoded data block occur faster than the first data block is able to be stored on the memory device in unencoded form.

10. The method of claim 9, wherein encoding and storage of the first and second encoded data blocks occur faster than the first and second data blocks are able to be stored together on the memory device in unencoded form.

11. The method of claim 9, wherein the analyzing of the first data block excludes analysis based solely on reading a descriptor.

12. The method of claim 11, wherein the analyzing of the second data block excludes analysis based solely on reading a descriptor.

13. The method of claim 9, further comprising selecting the second encoder from a plurality of encoders.

14. The method of claim 9, further comprising writing a descriptor to the memory device, wherein the descriptor indicates the lossless compression technique used to encode the second data block.

15. The method of claim 9, further comprising storing a descriptor on the memory device indicative of the lossless compression technique used to encode the second data block such that the descriptor is capable of being utilized to decode at least a portion of the second encoded data block.

16. The method of claim 9, wherein the first encoded data block includes a reference to the unencoded first data block.

17. A computer-readable storage device having instructions stored thereon, execution of which by at least one processor, causes the at least one processor to perform operations comprising:

analyzing a first data block to determine a parameter of the first data block;

applying a first encoder associated with the determined parameter of the first data block to create a first encoded data block, wherein the first encoder utilizes a lossless dictionary compression technique;

analyzing a second data block to determine a parameter of the second data block;

applying a second encoder associated with the determined parameter of the second data block to create a second encoded data block, wherein the second encoder utilizes a lossless compression technique different than the lossless dictionary compression technique; and

storing the first and second encoded data blocks on a memory device,

wherein encoding and storage of the first encoded data block occur faster than the first data block is able to be stored on the memory device in unencoded form.

18. The storage device of claim 17, wherein encoding and storage of the first and second encoded data blocks occur faster than the first and second data blocks are able to be stored together on the memory device in unencoded form.

19. The storage device of claim 17, wherein the analyzing of the first data block excludes analysis based solely on reading a descriptor.

20. The storage device of claim 19, wherein the analyzing of the second data block excludes analysis based solely on reading a descriptor.

21. The storage device of claim 17, wherein the operations further comprise selecting the second encoder from a plurality of encoders.

22. The storage device of claim 17, wherein the first encoded data block includes a reference to the unencoded first data block.