METHODS FOR ENCODING AND DECODING DATA

• US 20140022100A1
• Filed: 09/24/2013
• Published: 01/23/2014
• Est. Priority Date: 10/03/2000
• Status: Active Grant

• Current Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Original Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Inventors: FALLON, James J., Pickel, Paul F., McErlain, Stephen J., Melone, 2nd, Carlton J.
• Granted Patent: US 8,723,701 B2
• Time in Patent Office: Days
• US Class Current: 341/87
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G06Q 40/10 Tax strategies
• CPC Class Codes: G06T 9/005 Statistical coding, e.g. Huffman, run length coding
• CPC Class Codes: H03M 7/30 Compression speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
• CPC Class Codes: H03M 7/3059 Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression
• CPC Class Codes: H03M 7/4006 Conversion to or from arithmetic code
• CPC Class Codes: H04L 12/1895 for short real-time information, e.g. alarms, notifications, alerts, updates
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H10K 50/80 Constructional details

Abstract

The transmission of broadcast data, such as financial data and news feeds, is accelerated over a communication channel using data compression and decompression to provide secure transmission and transparent multiplication of communication bandwidth, as well as reduce the latency. Broadcast data may include packets having fields. Encoders associated with particular fields may be selected to compress those particular fields.

Claims

1. A method for compressing data, wherein one or more types of encoding are applied to one or more data blocks containing financial data, with packet independent data encoding being performed, at least in part, based on data residing within data fields in the one or more data blocks, the method comprising:

recognizing at least one of any characteristic, attribute, or parameter of the data residing within the data field in the one or more data blocks;

selecting an encoder associated with the at least one of the characteristic, attribute, or parameter of the data field;

encoding data in the data field utilizing the selected encoder; and

associating a recognizable data token with the encoded data, the recognizable data token being capable of identifying the selected encoder.

2. The method of claim 1, wherein the recognizable data token is associated with one or more encoded data blocks.

3. The method of claim 1, wherein the recognizable data token is associated with a payload portion of a data packet.

4. The method of claim 1, wherein the recognizable data token is appended to an encoded data block.

5. The method of claim 1, wherein the selecting the encoder associated with the recognized any characteristic, attribute, or parameter of the data residing within the data field is based on a packet type of a data packet.

6. The method of claim 1, further comprising:

utilizing numerical difference encoding to encode relative numeric values.

7. The method of claim 1, further comprising:

utilizing difference encoding based on an absolute value of a calculated difference between values within a data packet.

8. The method of claim 1, wherein the data in the data block includes time data, the method further comprising:

encoding the time data based on a difference between a previous time data and the time data.

9. The method of claim 1, further comprising utilizing difference encoding to encode a message sequence number.

10. The method of claim 1, wherein the data block includes messages, and wherein the step of encoding the data further comprises:

encoding a date in an encoded data packet only once when all messages in the encoded data packet have the same date.

11. The method of claim 1, wherein the encoding occurs in real-time.

12. The method of claim 1, further comprising:

transmitting the encoded data over a communication channel.

13. The method of claim 1, wherein the encoded data is broadcasted over at least one communication channel.

14. The method of claim 12, wherein the transmitting utilizes one or more User Datagram Protocol (UDP) packets.

26. The method of claim 1, further comprising:

transmitting the encoded data over a communications channel utilizing Transmission Control Protocol/Internet Protocol (TCP/IP).

27. The method of claim 1, wherein the encoded data is broadcasted over a communications channel utilizing User Datagram Protocol (UDP).

15. A method for compressing data, wherein one or more types of encoding are applied to a payload portion of one or more data packets transmitted in sequence, the transmission occurring from one of an internal or external source, the internal or external source being distinct from an encoder performing the compression, the one or more types of encoding comprising packet independent data encoding being performed, at least in part, based on one or more identifiable data fields within the one or more data packets, the method comprising:

recognizing at least one of any characteristic, attribute, or parameter of the data residing within at least one of the one or more identifiable data fields;

selecting an encoder associated with the recognized characteristic, attribute, or parameter of the data;

encoding the data with the selected encoder to provide encoded data.

16. The method of claim 15, wherein the payload portion of the one or more data packets contain financial information.

17. The method of claim 15, wherein any recognizable data token is associated with one or more encoded data fields.

18. The method of claim 15, wherein any recognizable data token is associated with a payload portion of a data packet.

19. The method of claim 15, wherein any recognizable data token is appended to an encoded data packet.

20. The method of claim 15, wherein the selecting the encoder associated with the recognized any characteristic, attribute, or parameter of the data residing within the one or more identifiable data fields is based on a packet type of a data packet.

21. The method of claim 15, further comprising:

utilizing numerical difference encoding to encode relative numeric values.

22. The method of claim 15, wherein the data within the one or more identifiable data fields includes time data, the method further comprising:

encoding the time data based on a difference between a previous time data and the time data.

23. The method of claim 15, further comprising:

utilizing difference encoding to encode a message sequence number.

24. The method of claim 15, wherein the one or more data packets include messages, and wherein the encoding the data further comprises:

placing an encoded date in an encoded data packet only when all messages in the encoded data packet have the same date.

25. The method of claim 15, wherein the encoding occurs in real-time.

28. A method for processing data residing within data fields of data packets, comprising:

recognizing at least one of any characteristic, attribute, or parameter of the data field by analyzing the content of the data field;

selecting an appropriate encoder associated with the recognized characteristic, attribute, or parameter;

performing packet independent compression of the data field using the selected encoder to create encoded data; and

broadcasting the encoded data through a plurality of communication channels.

29. The method of claim 28, further comprising:

associating any recognizable data token with a compressed data field within the encoded data, the recognized data token being capable of identifying the selected encoder to facilitate selection of an appropriate decoder for decompression of the encoded data.

30. The method of claim 28, wherein the encoding occurs in real-time.