System and method for data feed acceleration and encryption

• US 9,143,546 B2
• Filed: 10/03/2001
• Issued: 09/22/2015
• Est. Priority Date: 10/03/2000
• Status: Expired due to Fees

• Current Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Original Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Inventors: Fallon, James J., Pickel, Paul F., McErlain, Stephen J.
• Primary Examiner(s): Malek, Leila
• Application Number:
  US09/969,987
• Publication Number:
  US 20020080871A1
• Time in Patent Office: 5,102 Days
• Field of Search: 375/240, 382/239, 382/244, 382/246, 709/247, 341/106, 341/65, 710/68, 707/693, 707/999.101
• US Class Current: 1/1
• CPC Class Codes: H04L 12/1895 for short real-time information, e.g. alarms, notifications, alerts, updates
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC

Abstract

Systems and methods for providing accelerated transmission of broadcast data, such as financial data and news feeds, over a communication channel using data compression and decompression to provide secure transmission and transparent multiplication of communication bandwidth, as well as reduce the latency associated with data transmission of conventional systems.

Claims

1. A method of compressing a plurality of data blocks of one or more financial data blocks in sequence to be sent over a network in compressed data packets making up a financial data stream in a broadcast feed using a data compression engine to generate a plurality of compressed data packets, comprising:

providing a global state machine having a plurality of global states, the global states storing data used to compress data blocks for a respective data packet based on a priori knowledge of the financial data stream covering multiple data packets;

providing an adaptive local state machine having a plurality of local states, the local states storing data used to compress data blocks for a respective data packet based on knowledge of one or more data blocks being compressed in generating the respective data packet, wherein the local states are reset when a message with a different beginning is detected to allow the broadcast feed to be picked up for decompression at a synchronization point;

compressing the plurality of data blocks utilizing a compression algorithm of the data compression engine and data from local states of the local state machine and global states of the global state machine; and

transmitting the compressed data blocks in compressed data packets in the financial data stream over a communication channel.

2. The method of claim 1, wherein the financial data stream is broadcast to a plurality of client systems.

3. The method of claim 2, wherein the compressed data packets are User Datagram Protocol (UDP) data packets.

4. The method of claim 1, further comprising including a plurality of synchronization points in the compressed data packets for initiating decompressing the compressed data packets.

5. The method of claim 1, wherein compressing the plurality of data blocks further comprises packet independent data compression such that the data blocks for a packet are compressed independently of data in other packets.

6. The method of claim 1, further comprising compressing one or more additional data blocks in the data stream utilizing content independent data compression.

7. The method of claim 1, wherein the method of compressing a plurality of data blocks is performed in real-time.

8. A method of decompressing a plurality of compressed data packets in one or more financial data blocks in sequence received over a network in compressed data packets making up a financial data stream in a broadcast feed using a data decompression engine implemented on at least one processor, the method comprising:

providing a global state machine having a plurality of global states, the global states storing data to decompress a compressed data packet based on a priori knowledge of the financial data stream covering multiple data packets;

providing an adaptive local state machine having a plurality of local states, the local states storing data to decompress a compressed data packet based on knowledge of one or more data blocks being decompressed from the compressed data packet, wherein the local states are reset when a message with a different beginning is detected to allow the broadcast feed to be picked up for decompression at a synchronization point;

receiving the plurality of compressed data packets in the financial data stream over a communication channel; and

decompressing the plurality of compressed data packets utilizing a decompression algorithm of the data decompression engine implemented on at least one processor and data from local states of the local state machine and global states of the global state machine.

9. The method of claim 8, wherein the financial data stream is broadcast to a plurality of client systems.

10. The method of claim 9, wherein the plurality of compressed data packets are User Datagram Protocol (UDP) data packets.

11. The method of claim 8, wherein decompressing the plurality of compressed data packets further comprises packet independent data decompression such that the data blocks for a packet are decompressed independently of data in other packets.

12. The method of claim 8, further comprising decompressing additional compressed data packets in the data stream utilizing content independent data decompression.

13. The method of claim 8, wherein the method of decompressing a plurality of compressed data packets is performed in real-time.

14. A method of decompressing a plurality of compressed data packets in one or more financial data blocks in sequence received over a network in compressed data packets making up a financial data stream in a broadcast feed using a data decompression engine implemented on at least one processor, wherein the financial data stream includes a plurality of messages, the method comprising:

providing a global state machine having a plurality of global states, the global states storing data to decompress a compressed data packet based on a priori knowledge of the financial data stream covering multiple data packets;

providing an adaptive local state machine having a plurality of local states, the local states storing data to decompress a compressed data packet based on knowledge of one or more data blocks being decompressed from the compressed data packet, wherein at the occurrence of a beginning of each message a plurality of local states are reset in decompression such that local states newly obtained after the respective beginning of each message are the local states constructed and used in decompressing a data block after the respective beginning of each message to allow the broadcast feed to be picked up for decompression at the respective beginning of each message;

receiving the plurality of compressed data packets in the financial data stream over a communication channel; and

decompressing the plurality of compressed data packets utilizing a decompression algorithm of the data decompression engine implemented on at least one processor and data from local states of the local state machine and global states of the global state machine.