System and Method for Dynamically Managing Message Flow

• US 20100023645A1
• Filed: 07/28/2008
• Published: 01/28/2010
• Est. Priority Date: 07/28/2008
• Status: Active Grant

• Current Assignee: Trading Technologies International, Inc.
• Original Assignee: Trading Technologies International, Inc.
• Inventors: Mittal, Bharat, Foygel, Alexander V., Duquette, Douglas R.
• Granted Patent: US 7,844,726 B2
• Time in Patent Office: Days
• US Class Current: 709/232
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/28 in relation to timing considerations
• CPC Class Codes: H04L 47/29 using a combination of thresholds
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

System and method for dynamically managing message flow. According to the example embodiments, an intermediary network device or a client device dynamically manages the flow of messages received from an electronic exchange by analyzing the client device'"'"'s capabilities, such as CPU utilization. Based on a percentage of total CPU utilization, the level of throttling is dynamically adjusted, such that if the percentage of CPU utilization, or load, increases, then throttling is increased from a lower level to a higher level. Similarly, if the percentage of CPU utilization decreases significantly enough, then throttling is decreased to a lower level.

Claims

1. A method for managing message flow in an electronic trading system, the method comprising:

defining a plurality of levels of throttling to be used on a plurality of incoming electronic messages received at a client device from an electronic exchange, wherein each level of throttling of the plurality of levels of throttling determines a different hold time, and wherein the plurality of incoming electronic messages comprises market information from the electronic exchange;

determining a first measurement of a resource utilization of the client device;

selecting a first level of throttling from the plurality of levels of throttling based on the first measurement of the resource utilization;

receiving one or more incoming messages and temporarily holding the market information in a data structure from the one or more incoming messages according to a first hold time of the first level of throttling; and

releasing the market information from the one or more incoming messages to be further processed and displayed by the client device when the first hold time expires according to the first level of the throttling.

2. The method of claim 1, further comprising the step of defining the resource utilization as a central processing unit (“

CPU”

) utilization of the client device.

3. The method of claim 1, further comprising the step of defining the first measurement as a percentage of the resource utilization.

4. The method of claim 1, further comprising:

determining a second measurement of the resource utilization of the client device;

selecting a second level of throttling from the plurality of levels of throttling based on the second measurement of the resource utilization;

receiving one or more incoming messages and temporarily holding the market information in a data structure from the one or more incoming messages according to a second hold time of the second level of throttling; and

releasing the market information from the one or more incoming messages to be further processed and displayed by the client device when the second hold time expires according to the second level of the throttling.

5. The method of claim 1, further comprising the step of defining the resource utilization as a central processing unit (“

CPU”

) utilization of the client device, wherein the client device comprises a plurality of CPUs, and wherein determining the first measurement of the CPU utilization of the client device comprises;

determining a busiest CPU utilization of the plurality of CPU processors; and

determining the first measurement of the CPU utilization based only on the busiest CPU utilization.

6. The method of claim 1, further comprising the step of defining the resource utilization as a central processing unit (“

CPU”

) utilization of the client device, wherein the client device comprises a plurality of CPU processors, and wherein determining the first measurement of the CPU utilization of the client device comprises;

calculating a total CPU utilization for the plurality of CPU processors, wherein calculating the total CPU utilization is accomplished by summing each individual CPU utilization of the plurality of CPU processors and then dividing by a number of the plurality of CPUs; and

determining the first measurement of the CPU utilization based only on the total CPU utilization.

7. The method of claim 1, further comprising the step of defining the resource utilization as a central processing unit (“

CPU”

) utilization of the client device, wherein the client device comprises a plurality of CPU processors, and wherein determining the first measurement of the CPU utilization of the client device comprises;

calculating a total CPU utilization for the plurality of CPU processors, wherein calculating the total CPU utilization is accomplished by summing each individual CPU utilization of the plurality of CPU processors and then dividing by a number of the plurality of CPUs;

determining a busiest CPU utilization of the plurality of CPU processors;

defining a first weight to associate with the total CPU utilization and defining a second weight to associate with the busiest CPU utilization;

calculating a weighted average CPU utilization using the following relationship;

(first weight×

total CPU utilization)+(second weight×

busiest CPU utilization); and

determining the first measurement of the CPU utilization based on the weighted average CPU utilization.

8. The method of claim 1, further comprising receiving a high priority incoming message corresponding to an inside market price and passing the high priority incoming message through to be processed and displayed by the client device without temporarily holding the high priority incoming message in the data structure according to the first hold time of the first level of throttling.

9. The method of claim 1, wherein the inside market price comprises a highest bid price and a lowest ask price currently available in the market.

10. The method of claim 1, wherein the client device comprises one or more computer devices that operate remotely from the electronic exchange.

11. The method of claim 1, wherein the plurality of levels of throttling comprise a level of throttling that has a hold time of zero seconds.

12. The method of claim 1, wherein the plurality of levels of throttling comprise a level of throttling that has a hold time greater than zero seconds.

13. The method of claim 1, further comprising defining a plurality of ranges of resource utilization, and using the plurality of ranges to determine the first level of throttling by comparing the first measurement of the resource utilization to the plurality of ranges.

14. The method of claim 13, further comprising dynamically adjusting to a different level of throttling when another measurement of the resource utilization falls within a different range of resource utilization.

15. The method of claim 13, further comprising dynamically adjusting to a lower level of throttling when another measurement of the resource utilization stays within a same range of resource utilization for a period of time.

16. The method of claim 13, further comprising dynamically adjusting to a highest level of throttling when another measurement of the resource utilization goes above a highest range of resource utilization.

17. The method of claim 1, wherein a low level of throttling corresponds to a shorter hold time than a high level of throttling.

18. The method of claim 1, wherein the resource utilization is based on an amount of incoming messages received from the electronic exchange.

19. A method for managing message flow in an electronic trading system, the method comprising:

defining a plurality of levels of throttling to be used on a plurality of incoming electronic messages received at a client device from an electronic exchange, wherein each level of throttling of the plurality of levels of throttling determines a different hold time, and wherein the plurality of incoming electronic messages comprises market information from the electronic exchange;

determining a first measurement of a resource utilization of the client device;

selecting a first level of throttling from the plurality of levels of throttling based on the first measurement of the resource utilization;

defining a first and second condition, wherein the first and second condition are used to determine a level of throttling to apply to the plurality of incoming electronic messages received at the client device, and wherein the first and second condition are user-defined;

detecting the first condition at the client device and dynamically adjusting to a highest level of throttling;

receiving one or more incoming messages and temporarily holding the market information in a data structure; and

detecting a second condition and releasing the market information from the one or more incoming messages to be further processed and displayed by the client device.

20. A computer readable medium having program code recorded thereon for execution on a computer for managing message flow, comprising:

a first program code for defining a plurality of levels of throttling to be used on a plurality of incoming electronic messages received at a client device from an electronic exchange, wherein each level of throttling of the plurality of levels of throttling determines a different hold time, and wherein the plurality of incoming electronic messages comprises market information from the electronic exchange;

a second program code for determining a first measurement of a resource utilization of the client device;

a third program code for selecting a first level of throttling from the plurality of levels of throttling based on the first measurement of the resource utilization;

a fourth program code for receiving one or more incoming messages and temporarily holding the market information in a data structure from the one or more incoming messages according to a first hold time of the first level of throttling; and

a fifth program code for releasing the market information from the one or more incoming messages to be further processed and displayed by the client device when the first hold time expires according to the first level of the throttling.