Methods for encoding and decoding data

• US 8,723,701 B2
• Filed: 09/24/2013
• Issued: 05/13/2014
• Est. Priority Date: 10/03/2000
• Status: Expired due to Fees

• Current Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Original Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Inventors: Pickel, Paul F., McErlain, Stephen J., Melone, II, Carlton J., Fallon, James J.
• Primary Examiner(s): JEANGLAUDE, JEAN BRUNER
• Application Number:
  US14/035,716
• Publication Number:
  US 20140022100A1
• Time in Patent Office: 231 Days
• Field of Search: 341/50, 341/51, 370/355, 380/212, 709/238, 358/400, 345/419, 714/752
• US Class Current: 341/51
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G06Q 40/10 Tax strategies
• CPC Class Codes: G06T 9/005 Statistical coding, e.g. Huffman, run length coding
• CPC Class Codes: H03M 7/30 Compression speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
• CPC Class Codes: H03M 7/3059 Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression
• CPC Class Codes: H03M 7/4006 Conversion to or from arithmetic code
• CPC Class Codes: H04L 12/1895 for short real-time information, e.g. alarms, notifications, alerts, updates
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H10K 50/80 Constructional details

Abstract

The transmission of broadcast data, such as financial data and news feeds, is accelerated over a communication channel using data compression and decompression to provide secure transmission and transparent multiplication of communication bandwidth, as well as reduce the latency. Broadcast data may include packets having fields. Encoders associated with particular fields may be selected to compress those particular fields.

Claims

1. A method for compressing data, wherein one or more types of compression are applied to one or more data blocks of a data packet containing financial data, with packet independent data compression being performed, at least in part, based on data residing within data fields in the one or more data blocks, the method comprising:

analyzing at least one of any characteristic, attribute, or parameter of the data residing within the data fields in the one or more data blocks, wherein the analyzing of the data within the data fields excludes analyzing based on a descriptor that is indicative of the any characteristic, attribute, or parameter of the data residing within the data fields;

selecting an encoder associated with the at least one of the characteristic, attribute, or parameter of the data field;

compressing data in the data field utilizing the selected encoder; and

associating a recognizable data token with the compressed data, the recognizable data token being capable of identifying the selected encoder;

wherein the data packet comprises a header containing control information followed by the data fields of the data packet.

2. The method of claim 1, wherein the recognizable data token is associated with the compressed data.

3. The method of claim 1, wherein the recognizable data token is associated with the data field of the data packet.

4. The method of claim 1, wherein the recognizable data token is appended to the compressed data.

5. The method of claim 1, wherein the selecting the encoder associated with the analyzed at least one of any characteristic, attribute, or parameter of the data residing within the data fields is based on a packet type of the data packet.

6. The method of claim 1, farther comprising:

utilizing numerical difference encoding to compress relative numeric values.

7. The method of claim 1, further comprising:

utilizing difference compression based on an absolute value of a calculated difference between values within the data packet.

8. The method of claim 1, wherein the data in the data block includes time data, the method further comprising:

compressing the time data based on a difference between a previous time data and the time data.

9. The method of claim 1, further comprising utilizing difference compression to compress a message sequence number.

10. The method of claim 1, wherein the data block includes messages, and wherein the step of compressing the data further comprises:

compressing a date in a compressed data packet only once when all messages in the compressed data packet have the same date.

11. The method of claim 1, wherein the compressing occurs in real-time.

12. The method of claim 1, further comprising:

transmitting the compressed data over a communication channel.

13. The method of claim 1, wherein the compressed data is broadcasted over at least one communication channel.

14. The method of claim 12, wherein the transmitting utilizes one or more User Datagram Protocol (UDP) packets.

26. The method of claim 1, further comprising:

transmitting the compressed data over a communications channel utilizing Transmission Control Protocol/Internet Protocol (TCP/IP).

27. The method of claim 1, wherein the compressed data is broadcasted over a communications channel utilizing User Datagram Protocol (UDP).

15. A method for compressing data, wherein one or more types of compression are applied to a payload portion of one or more data packets transmitted in sequence, wherein a data packet from among the one or more data packets comprises a header containing control information followed by one or more data fields of the data packet, the transmission occurring from one of an internal or external source, the internal or external source being distinct from an encoder performing the compression, the one or more types of compression comprising packet independent data compression being performed, at least in part, based on one or more identifiable data fields within the one or more data packets, the method comprising:

analyzing at least one of any characteristic, attribute, or parameter of the data residing within at least one of the one or more identifiable data fields, wherein the analyzing of the data with the at least one data field excludes analyzing based on a descriptor that is indicative of the any characteristic, attribute, or parameter of the data residing within the at least one data field;

selecting an encoder associated with the recognized characteristic, attribute, or parameter of the data;

compressing the data with the selected encoder to provide compressed data.

16. The method of claim 15, wherein the payload portion of the data packet contains financial information.

17. The method of claim 15, wherein any recognizable data token is associated with one or more compressed data fields.

18. The method of claim 15, wherein any recognizable data token is associated with a payload portion of the data packet.

19. The method of claim 15, wherein any recognizable data token is appended to the compressed data.

20. The method of claim 15, wherein the selecting the encoder associated with the recognized any characteristic, attribute, or parameter of the data residing within the one or more identifiable data fields is based on a packet type of the data packet.

21. The method of claim 15, further comprising:

utilizing numerical difference encoding to compress relative numeric values.

22. The method of claim 15, wherein the data within the one or more identifiable data fields includes time data, the method further comprising:

compressing the time data based on a difference between a previous time data and the time data.

23. The method of claim 15, further comprising:

utilizing difference compression to compress a message sequence number.

24. The method of claim 15, wherein the data packet includes messages, and wherein the compressing the data further comprises:

placing a compressed date in the data packet only when all messages in the data packet have the same date.

25. The method of claim 15, wherein the compressing occurs in real-time.

28. A method for processing data residing within a data field, comprising:

analyzing at least one of any characteristic, attribute, or parameter of the data field by analyzing the content of the data field, wherein the analyzing of data within the data field excludes analyzing based on a descriptor that is indicative of the at least one of the any characteristic, attribute, or parameter of the data field;

selecting an appropriate encoder associated with the analyzed characteristic, attribute, or parameter;

performing packet independent compression of the data field using the selected encoder to create compressed data, wherein a data packet associated with the data field comprises a header containing control information followed by the data field of the data packet; and

broadcasting the compressed data through a plurality of communication channels.

29. The method of claim 28, further comprising:

associating any recognizable data token with the compressed data field within the compressed data, the recognized data token being capable of identifying the selected encoder to facilitate selection of an appropriate decoder for decompression of the compressed data.

30. The method of claim 28, wherein the compressing occurs in real-time.