Systems and methods for data compression

• US 10,284,225 B2
• Filed: 12/11/2017
• Issued: 05/07/2019
• Est. Priority Date: 10/03/2000
• Status: Expired due to Fees

• Current Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Original Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Inventors: Fallon, James J., Pickel, Paul F., McErlain, Stephen J., Melone, II, Carlton J.
• Primary Examiner(s): Jeanglaude, Jean B
• Application Number:
  US15/837,718
• Publication Number:
  US 20180234108A1
• Time in Patent Office: 512 Days
• Field of Search: 341 50, 341 51
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G06Q 40/10 Tax strategies
• CPC Class Codes: G06T 9/005 Statistical coding, e.g. Huffman, run length coding
• CPC Class Codes: H03M 7/30 Compression speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
• CPC Class Codes: H03M 7/3059 Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression
• CPC Class Codes: H03M 7/4006 Conversion to or from arithmetic code
• CPC Class Codes: H04L 12/1895 for short real-time information, e.g. alarms, notifications, alerts, updates
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H10K 50/80 Constructional details

Abstract

The transmission of broadcast data, such as financial data and news feeds, is accelerated over a communication channel using data compression and decompression to provide secure transmission and transparent multiplication of communication bandwidth, as well as reduce the latency. Broadcast data may include packets having fields. Encoders associated with particular fields may be selected to compress those particular fields.

Claims

1. A system for compressing data in data blocks comprising:

one or more memory devices;

first and second lossless encoders configured to utilize different lossless compression techniques; and

one or more processors configured to;

analyze a data block to determine a parameter, attribute, or value of the data block without only reading a descriptor or data token associated with the data block,

select the first lossless encoder when the first lossless encoder is associated with the determined parameter, attribute, or value, and the second lossless encoder when the first lossless encoder is not associated with the determined first parameter, attribute, or value, wherein the selected first lossless encoder can compress data in the data block to produce a compressed data block or the selected second lossless encoder can compress data in the data block to produce a compressed data block, and

initiate transmission of the compressed data block in one or more data packets, the one or more data packets including control information and the compressed data block; and

wherein the time taken to compress the data block with the first or second lossless encoder and transmit the compressed data block is less than the time to transmit the data block in uncompressed form.

2. The system of claim 1, wherein the first lossless encoder utilizes a form of mathematical analysis.

3. The system of claim 1, wherein the second lossless encoder utilizes a form of mathematical analysis.

4. The system of claim 1, wherein the first lossless encoder utilizes a form of dictionary compression.

5. The system of claim 1, wherein the second lossless encoder utilizes a form of dictionary compression.

6. The system of claim 1, wherein the first lossless encoder utilizes a form of Lempel-Ziv compression.

7. The system of claim 1, wherein the second lossless encoder utilizes a form of Lempel-Ziv compression.

8. The system of claim 1, wherein the first lossless encoder utilizes a state machine.

9. The system of claim 8, wherein the state machine is a global state machine.

10. The system of claim 8, wherein the state machine is a local state machine.

11. The system of claim 1, wherein the first lossless encoder utilizes both local and global state machines.

12. The system of claim 1, wherein the second lossless encoder utilizes a state machine.

13. The system of claim 12, wherein the state machine is a global state machine.

14. The system of claim 12, wherein the state machine is a local state machine.

15. The system of claim 1, wherein the second lossless encoder utilizes both local and global state machines.

16. The system of claim 1, wherein the first and second lossless encoders utilize state machines.

17. The system of claim 1, wherein the one or more processors are configured to initiate transmission of the one or more data packets utilizing a Transmission Control Protocol/Internet Protocol (TCP/IP) protocol.

18. The system of claim 17, wherein the one or more processors are configured to sequence the compressed data block with one or more additional compressed data blocks each compressed by the first or second lossless encoder to produce a sequence of aggregated compressed data blocks and to initiate transmission of the sequence of aggregated data blocks in the one or more data packets.

19. The system of claim 1, further comprising:

a decoder that receives the transmitted one or more data packets having a compressed data block and decompresses the compressed data block, and

an additional memory device to store the decompressed data block, wherein the time to compress, transmit, decompress, and store is less than the time of transmitting the data block in uncompressed form.

20. The system of claim 1, wherein the one more data packets include one or more sync points.

21. The system of claim 1, wherein the one or more memory devices store the compressed data block and an uncompressed form of the data in the compressed data block.

22. The system of claim 1, wherein the one or more memory devices store the compressed data block, and wherein the one or more memory devices store an uncompressed form of the data in the compressed data block prior to transmission of the compressed data block.

23. A system for compressing data in first and second data blocks comprising:

one or more memory devices;

first and second lossless encoders configured to utilize different lossless compression techniques;

one or more processors configured to;

analyze the first and second data blocks to determine a parameter, attribute, or value of the respective data block without only reading a descriptor or data token associated with the respective data block,

select the first lossless encoder when the first lossless encoder is associated with the determined parameter, attribute, or value, and the second lossless encoder when the first lossless encoder is not associated with the determined first parameter, attribute, or value, wherein the first lossless encoder is selected for the first data block and the second lossless encoder is selected for the second data block, and the selected first and second lossless encoders compress the data in the first and second data blocks to produce first and compressed data blocks, and

initiate transmission of one or more data packets having control information and the first and second compressed data blocks; and

a decoder that receives the first and second compressed data blocks in the transmitted one or more data packets and decompresses the received first and second compressed data blocks,

wherein the time of the compressing, transmitting and decompressing the first and second compressed data blocks is less than the time of transmitting the first and second data blocks in uncompressed form.

24. The system of claim 23, wherein the one or more processors are further configured to sequence the first and second compressed data blocks with one or more additional compressed data blocks each compressed by the first or second lossless encoder to produce a sequence of aggregated compressed data blocks and to initiate transmission of the sequence of aggregated data blocks in the one or more data packets.

25. A system for compressing data in first and second data blocks comprising:

one or more memory devices;

first and second lossless encoders configured to utilize different lossless compression techniques; and

one or more processors configured to;

analyze the first and second data blocks to determine a parameter, attribute, or value of the data block without only reading a descriptor or data token associated with the data block,

select the first lossless encoder when the first lossless encoder is associated with the determined parameter, attribute, or value, and the second lossless encoder when the first lossless encoder is not associated with the determined first parameter, attribute, or value,

wherein the selected lossless encoders compress the data in the first and second data blocks to produce a first compressed data block and a second compressed data block, and

initiate transmission of one or more data packets having control information and the first and second compressed data blocks;

wherein the time taken to compress the first and second data block with the selected lossless encoders and to transmit the compressed first and second data blocks is less than the time to transmit the first and second data blocks in uncompressed form.

26. The system of claim 25, wherein the one or more processors are further configured to sequence the first and second compressed data blocks with one or more additional compressed data blocks each compressed by the first or second lossless encoder to produce a sequence of aggregated compressed data blocks and to initiate transmission of the sequence of aggregated data blocks in the one or more data packets.