METHODS FOR ENCODING AND DECODING DATA

• US 20140022099A1
• Filed: 09/24/2013
• Published: 01/23/2014
• Est. Priority Date: 10/03/2000
• Status: Active Grant

• Current Assignee: Realtime Data LLC (Realtime Data Compression Systems, Inc.)
• Original Assignee: Realtime Data LLC Data LLC
• Inventors: FALLON, James J., Pickel, Paul F., McErlain, Stephen J., Melone, 2nd, Carlton J.
• Granted Patent: US 8,717,204 B2
• Time in Patent Office: Days
• US Class Current: 341/87
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G06Q 40/10 Tax strategies
• CPC Class Codes: G06T 9/005 Statistical coding, e.g. Huffman, run length coding
• CPC Class Codes: H03M 7/30 Compression speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
• CPC Class Codes: H03M 7/3059 Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression
• CPC Class Codes: H03M 7/4006 Conversion to or from arithmetic code
• CPC Class Codes: H04L 12/1895 for short real-time information, e.g. alarms, notifications, alerts, updates
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H10K 50/80 Constructional details

Abstract

The transmission of broadcast data, such as financial data and news feeds, is accelerated over a communication channel using data compression and decompression to provide secure transmission and transparent multiplication of communication bandwidth, as well as reduce the latency. Broadcast data may include packets having fields. Encoders associated with particular fields may be selected to compress those particular fields.

Claims

1. A method for processing data, the data residing in a data field, comprising:

recognizing any characteristic, attribute, or parameter of the data;

selecting an encoder associated with the recognized characteristic, attribute, or parameter of the data;

compressing the data with the selected encoder to create compressed data wherein the compressing achieves a compression ratio of over 10;

1 on the data; and

broadcasting the compressed data to a plurality of clients.

2. The method of claim 1, wherein the compressing and broadcasting occur over a time period which is less than a time to broadcast the data in uncompressed form.

3. The method of claim 1, further comprising:

decompressing the compressed data, and wherein the compressing, the broadcasting, and the decompressing occur over a time period which is less than the time to broadcast the data in uncompressed form.

4. The method of claim 1, wherein multiple messages are contained in a data packet.

5. The method of claim 1, wherein the data comprises financial data transmitted in sequence.

6. The method of claim 1, wherein the data field includes stock information.

7. The method of claim 1, wherein the data field includes options information.

8. The method of claim 1, wherein the compressing is lossy.

9. The method of claim 1, wherein the broadcasting comprises:

broadcasting the compressed data utilizing a User Datagram Protocol (UDP).

10. The method of claim 1, wherein the compressing is performed on a server and wherein the compressed data is broadcast from the server.

11. A method for processing data the data residing in data fields, comprising:

recognizing any characteristic, attribute, or parameter of the data;

selecting an encoder associated with the recognized characteristic, attribute, or parameter of the data;

compressing the data with the selected encoder utilizing at least one state machine to provide compressed data having a compression ratio of over 4;

1; and

point-to-point transmitting the compressed data to a client,

wherein the compressing and the transmitting occur over a period of time which is less than a time to transmit the data in an uncompressed form.

12. The method of claim 11, further comprising:

decompressing the compressed data at the client, and

wherein the compressing, the transmitting, and the decompressing occur over a period of time which is less than a time to transmit the data in uncompressed form.

13. The method of claim 11, wherein the data packet that includes the data fields also includes multiple messages.

14. The method of claim 11, wherein the compressed data is transmitted as part of one or more data blocks of financial data transmitted in sequence.

15. The method of claim 11, wherein the data field includes stock information.

16. The method of claim 11, wherein the data field includes options information.

17. The method of claim 11, wherein the compressing is lossy.

18. The method of claim 11, wherein the transmitting comprises:

transmitting the data utilizing a User Diagram Protocol (UDP).

19. The method of claim 11, wherein the compressing is performed on a server, and wherein the compressed data is transmitted from the server.

20. A method for processing data, the data residing in data fields, comprising:

selecting an encoder associated with a data field from among a plurality of data fields in a packet of one or more data blocks of financial data in sequence, the selecting being performed at least in part by utilizing a list indicative of data fields and their associated encoders;

encoding data in each data field from among the plurality of data fields to provide one or more encoded data blocks of financial data, wherein the size of encoded data in each data field from among the plurality of data fields is at least one-fourth the size of the data before the encoding; and

broadcasting the encoded one or more data blocks in sequence to a plurality of clients, wherein the encoding and the broadcasting occur over a period of time which is less than a time to broadcast the data in each data field from among the plurality of data fields in an unencoded form.

21. The method of claim 20, wherein the encoded one or more data blocks of financial data include date information.

22. The method of claim 20, wherein the encoded one or more data blocks of financial data include sequence information.

23. The method of claim 20, wherein the encoded one or more data blocks of financial data include multiple messages.

24. The method of claim 20, wherein the encoded one or more data blocks of financial data transmitted in sequence include stock information.

25. The method of claim 20, wherein the encoded one or more data blocks of financial data transmitted in sequence include options information.

26. The method of claim 20, wherein the encoding comprises:

lossless encoding the data in each data field from among the plurality of data fields.

27. The method of claim 20, wherein the broadcasting comprises:

broadcasting the encoded one or more data blocks in sequence utilizing a User Datagram Protocol (UDP)

28. The method of claim 20, wherein the encoding is performed on a server, and wherein the encoded one or more data blocks in sequence is transmitted from the server.