Content independent data compression method and system

• US 7,378,992 B2
• Filed: 04/08/2006
• Issued: 05/27/2008
• Est. Priority Date: 12/11/1998
• Status: Expired due to Term

• Current Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Original Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Inventors: Fallon, James J.
• Primary Examiner(s): Nguyen, Linh V
• Application Number:
  US11/400,533
• Publication Number:
  US 20060181442A1
• Time in Patent Office: 780 Days
• Field of Search: 341/50, 341/51, 341/67, 341/75, 341/79
• US Class Current: 341/51
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H03M 7/30 Compression speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
• CPC Class Codes: H03M 7/3059 Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression
• CPC Class Codes: H03M 7/3088 employing the use of a dictionary, e.g. LZ78
• CPC Class Codes: H03M 7/40 Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
• CPC Class Codes: H03M 7/4006 Conversion to or from arithmetic code
• CPC Class Codes: H04L 65/70 Media network packetisation

Abstract

Systems and methods for providing fast and efficient data compression using a combination of content independent data compression and content dependent data compression. In one aspect, a method for compressing data comprises the steps of: analyzing a data block of an input data stream to identify a data type of the data block, the input data stream comprising a plurality of disparate data types; performing content dependent data compression on the data block, if the data type of the data block is identified; performing content independent data compression on the data block, if the data type of the data block is not identified.

Claims

1. A method comprising:

receiving a data block;

determining whether or not a data type is identified for said data block;

compressing, if said data type is identified, said data block with at least one encoder associated to said data type to provide a compressed data block;

compressing, if said data type is not identified, said data block with at least one encoder associated to a non-identifiable data type to provide said compressed data block; and

storing said compressed data block.

2. The method of claim 1, further comprising buffering said data block after said receiving of said data block and before said compressing of said data block.

3. The method of claim 1, further comprising transmitting a data compression type descriptor, indicative of the compression utilized to provide said compressed data block, with said compressed data block.

4. The method of claim 1, wherein said compressing, if a data type is not identified, occurs in real-time.

5. The method of claim 1, wherein the size of said data block is fixed.

6. The method of claim 1, wherein the size of said data block is variable.

7. The method of claim 1, wherein said at least one encoder associated with said data type is lossless.

8. The method of claim 1, wherein said at least one encoder associated to said non-identifiable data type is lossless.

9. The method of claim 1, wherein said at least one encoder associated with said data type is provided as a software module.

10. The method of claim 1, wherein at least one of said least one encoder associated with said data type is operable to be user-disabled.

11. A method comprising:

receiving a data block;

determining whether or not a data type is identified for said data block;

compressing, if said data type is identified, said data block with at least one encoder associated to said data type to provide a compressed data block;

compressing, if said data type is not identified, said data block with at least one encoder associated to a non-identifiable data type to provide said compressed data block;

storing said compressed data block;

transmitting a data compression type descriptor, indicative of the, compression utilized to provide said compressed data block, with said compressed data block;

receiving said compressed data block and said data compression type descriptor; and

decompressing said compressed data block based on said data compression type descriptor.

12. A method comprising:

receiving a first data block;

associating at least one encoder to each one of several data types;

identifying a first data type of said first data block;

compressing, if said first data type is the same as one of said several data types, said data block with said at least one encoder associated to said one of said several data types that is the same as said first data type to provide a compressed data block; and

compressing, if said first data type is not the same as one of said several data types, said data block with a default encoder to provide said compressed data block.

13. The method of claim 12, further comprising outputting said compressed data block with a data compression type descriptor indicative of the type of compression utilized to provide said compressed data block.

14. The method of claim 12, further comprising buffering said data block after said reception of said data block and before said compression of said data block.

15. The method of claim 12, wherein said default encoder is a lossless encoder.

16. The method of claim 12, wherein the size of said data block is fixed.

17. The method of claim 12, wherein the size of said data block is variable.

18. The method of claim 12, wherein said at least one encoder is provided as a software module.

19. The method of claim 12, wherein at least one of said least one encoder is operable to be user-disabled.

20. A method comprising:

receiving a first data block;

associating at least one encoder to each one of several data types;

identifying a first data type of said first data block;

compressing, if said first data type is the same as one of said several data types, said data block with said at least one encoder associated to said one of said several data types that is the same as said first data type to provide a compressed data block;

compressing, if said first data type is not the same as one of said several data types, said data block with a default encoder to provide said compressed data block;

transmitting a data compression type descriptor, indicative of the compression utilized to provide said compressed data block, with said compressed data block;

receiving said compressed data block and said data compression type descriptor; and

decompressing said compressed data block based on said data compression type descriptor.

21. A method comprising:

associating a first encoder to a first data type;

associating a second encoder to a second data type;

receiving a data block;

determining a data type of said data block;

compressing said data block with said first encoder if said data type is the same as said first data type;

compressing said data block with said second encoder if said data type is the same as said second data type; and

compressing said data block with a third encoder if said data type cannot be identified.

22. The method of claim 21, further comprising:

associating a fourth encoder to a third data type;

compressing said data block with said fourth encoder if said data type is the same as said first data type.

23. The method of claim 21, further comprising compressing said data block with a fourth encoder if said data type is the same as said first data type.

24. The method of claim 21, wherein the size of said data block is fixed.

25. The method of claim 21, wherein the size of said data block is variable.

26. The method of claim 21, wherein said first encoder is provided as a software module.

27. The method of claim 21, wherein said first encoder is operable to be user-disabled.

28. A method comprising:

associating at least one of several first encoders to each one of several data types;

associating at least one second encoder to a non-identifiable data type;

receiving a data block from an input stream of data;

determining whether a data type is identified for said data block;

compressing, if a data type is identified as being associated to said at least one of several first encoders, said data block with said at least one of several first encoders associated to said data type to provide a compressed data block;

compressing, if a data type is not identified, said data block with said at least one second encoder to provide said compressed data block; and

transmitting said compressed data block with a data compression type descriptor indicative of the compression utilized to provide said compressed data block.

29. The method of claim 28, wherein said at least one of said several first encoders is operable to be user-disabled.

30. The method of claim 28, wherein the size of said data block is fixed.

31. The method of claim 28, wherein the size of said data block is variable.

32. The method of claim 28, wherein said at least one of said several first encoders is provided as a software module.

33. A method comprising:

providing several compression techniques;

receiving a data block;

determining whether or not to compress said data block and, if said data block is to be compressed, determining which one of said several compression techniques to utilize to compress said data block and compressing said data block with said determined one of said several compression techniques to provide a compressed data block;

providing a data compression type descriptor with said compressed data block, wherein said data compression type descriptor is either indicative of said determination not to compress or said determined one of said several compression techniques; and

transmitting said data compression type descriptor with said compressed data block.

34. The method of claim 33, wherein the size of said data block is fixed.

35. The method of claim 33, wherein the size of said data block is variable.

36. The method of claim 33, wherein said determined one of said several compression techniques is provided as a software module.

37. A method comprising:

processing a data stream, having a plurality of data blocks, on a first system, wherein said processing comprises;

transmitting a first one of said plurality of data blocks of said data stream in compressed form with a first descriptor associated with a first compression technique, wherein said first one of said plurality of data blocks was identified as a first type of data and said first compression technique is associated with said first type of data;

transmitting a second compressed one of said plurality of data blocks with a second descriptor associated with a second compression technique, wherein said second one of said plurality of data blocks was not identified as having a data type; and

transmitting an third one of said plurality of data blocks in received form with a third descriptor indicative of no compression technique.

38. The method of claim 37, wherein said received form is an uncompressed form.

39. The method of claim 37, wherein said received form is a compressed form.

40. The method of claim 37, wherein the size of each one of said plurality of data blocks is fixed.

41. The method of claim 37, wherein said first compression technique comprises compression with a plurality of encoders.

42. The method of claim 37, wherein the size of each one of said plurality of data blocks is variable.

43. The method of claim 37, further comprising receiving said first, second, and third ones of said plurality of data blocks on a second system.

44. The method of claim 37, further comprising receiving said first, second, and third ones of said plurality of data blocks on a second system and decompressing said first, second, and third ones of said plurality of data blocks on said second system.

45. The method of claim 37, further comprising receiving said first, second, and third ones of said plurality of data blocks on a second system and decompressing said first one of said plurality of data blocks based on said first descriptor on said second system, decompressing said second one of said plurality of data blocks based on said second descriptor on said second system, and decompressing said third one of said plurality of data blocks based on said third descriptor on said second system.