Method and system for processing financial data objects carried on broadcast data streams and delivering information to subscribing clients

• US 8,209,402 B1
• Filed: 01/20/2010
• Issued: 06/26/2012
• Est. Priority Date: 08/04/2000
• Status: Expired due to Term

• Current Assignee: Goldman Sachs & Co. LLC (Goldman Sachs Group Incorporated)
• Original Assignee: Goldman Sachs & Company (Goldman Sachs Group Incorporated)
• Inventors: Smith, Andrew J. R., Thomas, Deane, Cowan, Randy
• Primary Examiner(s): BAYARD, DJENANE M
• Application Number:
  US12/690,893
• Time in Patent Office: 888 Days
• Field of Search: 709/219, 709/223, 709/224, 709/227
• US Class Current: 709/219
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange

Abstract

A system for delivering data objects containing data subject to periodic updates to a plurality of clients is disclosed and which is configured to connect to at least one input data stream which carries a specific type of data objects, such as objects related to financial product offerings, and also establish a communication session with various clients. Each client has an associated profile which indicates data stream to which the client has subscribed and further contains rules related to how data in the streams should be treated. When an object is received on a data stream, a local data cache is updated and the rules specified by clients subscribing to that data stream are executed to determine whether information about the object should be forward to the various subscribing client. In a particular configuration, the data channels are provided by one or more information managers which pre-process raw data from source data providers, format and type the data, and broadcast it on appropriate channels in substantially real time.

Claims

1. A processor-implemented method for delivering data objects containing data subject to periodic updates to a plurality of clients via a data communication network, the method comprising:

connecting to at least one input data stream, each input data stream carrying a respective type of data objects and each object comprising a key which uniquely identifies the respective data object'"'"'s type;

establishing a communication session with at least one client, each client having an associated profile comprising data indicating data stream subscriptions and at least one object rule associated with the subscribed data streams;

receiving on a particular input data stream a current state for a specific data object;

updating via a processor an object pool cache to reflect the current state of the specific data object, wherein the updating comprises;

(i) transmitting differences between a first old object and a first new object if the first new object has a same key as the first old object in the object pool cache, and

(ii) deleting a second old object and storing and transmitting a second new object in a different type if the second old object has a different type and has a same key as the second new object in the object pool cache; and

for each respective client subscribed to the particular input data stream, evaluating from the client profile associated with the respective client the object rules associated with the particular input data stream against the specific data object and transmitting the current state of the specific data object to the respective client in response to a positive evaluation.

2. The method of claim 1, further comprising:

after connecting to the at least one data stream, initializing the object pool cache with an initial state of data objects carried on the connected at least one data stream; and

after a communication session is established with a particular client, delivering to the particular client a snapshot of the data objects in a current state in the object pool cache associated with the data stream subscriptions in the profile associated with the particular client, wherein the snapshot of the data objects is stored at the particular client and subsequently revised with differential data.

3. The method of claim 1, further comprising:

monitoring the performance of communication with each connected client; and

dynamically adjusting the rate at which client events are transmitted to one or more of the respective clients in response to the monitored performance.

4. The method of claim 1, wherein the data objects carried on the input data streams comprise differential data objects.

5. The method of claim 1, further comprising:

in response to detecting that a particular client in a communication session has subscribed to a new input data stream not in a set of connected input data streams, connecting to the new input data stream.

6. The method of claim 1, further comprising:

placing a state event in a client event queue, wherein the state event is placed in a specified client event queue dedicated to each respective client to which the client event will be transmitted;

identifying state events to be transmitted to the respective client which are related to a common data object;

aggregating the identified state events to thereby reduce the number of state events in the queue; and

transmitting a client event related to the current state of the specific data object, the client event being derived from at least one state event extracted from the client event queue, to the respective client.

7. The method of claim 1, wherein the monitoring the performance of communication with each connected client comprises determining network transmission time and a client processing time for received client events.

8. The method of claim 1, wherein the data objects comprise information related to financial product offerings,

the method further comprising:

retrieving an initial state of data objects carried on the connected at least one data stream from the object storage pool associated with the information manager broadcasting the data stream; and

initializing the object pool cache with the retrieved initial states.

9. A system for delivering data objects containing data subject to periodic updates to a plurality of clients via a data communication network, the system comprising processor implemented components:

a client session manager component;

at least one object state manager component having an associated object pool cache; and

at least one client session;

the client session manager component being configured to;

receive initial access communications from a client;

load a client profile associated with the client and comprising data indicating data stream subscriptions and at least one object rule associated with the subscribed data streams;

each object state manager component being configured to;

connect to at least one input data stream, each input data stream carrying information related to a respective type of data objects and each object comprising a key which uniquely identifies the respective data object'"'"'s type;

receive on the input data streams changes to states of data objects; and

upon receipt of a state change for a specific data object on a particular data stream, update the associated object pool cache to reflect the changed current state of the specific data object and generate an object event directed to client sessions for clients subscribed to the particular data stream indicating a state change has occurred with regard to the specific data object, wherein the update is configured to;

(i) transmit differences between a first old object and a first new object if the first new object has a same key as the first old object in the object pool cache, and

(ii) delete a second old object and storing and transmitting a second new object in a different type if the second old object has a different type and has a same key as the second new object in the object pool cache;

each client session being configured to;

in response to the receipt of an object event, evaluate the object rules associated with the particular input data stream from the respective client profile against the specific data object change noticed by the object event, and

transmit the current state of the specific data object to the respective client in response to a positive evaluation.

10. The system of claim 9, wherein each client profile comprises at least one client folder, each client folder comprising data indicating at least one subscribed data stream and containing object rules associated with the subscribed data stream;

and

the client session being configured to evaluate the object rules associated with the particular input data stream for each folder in the client profile indicating a subscription to that stream.

11. The system of claim 9, further comprising a state dispatch module configured to:

receive requests for the current state of a set of data objects from a requestor;

obtain current state information for the data objects in the set; and

return the current state information to the requestor.

12. The system of claim 9, wherein the object state manager further comprises an update queue, the object state manager being further configured to place current states received from an input data stream on the update queue during a pendency of a request and apply the queued current states to data in an object cache after cache initialization is complete.

13. The system of claim 11, wherein the state dispatch module is connected to at least one offer pool maintained by a transmitter of the data streams received object state managers and configured to obtain current state information from an appropriate offer pool.

14. The system of claim 9, wherein the data objects carried on the input data streams comprise differential data objects.

15. The system of claim 9, wherein the client session manager is further configured to in response to detecting that a particular client in a communication session has subscribed to a new input data stream not presently connected to one of the at least one object state managers, activate a new object state manager to support the new input data stream.

16. The system of claim 9 further comprising at least one information manager receiving raw object data streams from at least one content provider and generating the input data streams.

17. The system of claim 16, wherein each information manager further comprises a structured object pool containing a current state of the data objects carried on the input data streams, the object events on the input data streams representing differential changes to the state of particular data objects.

18. The system of claim 9, further comprising a delivery manager, wherein the delivery manager further comprises:

a client event queue for containing events to be transmitted to the respective client;

a client queue manager configured to place received client evens on a client event queue; and

a push module configured to retrieve state events from the client event queue and send a client event derived from the state event to the respective client.

19. The system of claim 18, wherein the queue manager is further configured to:

identify a queued event related to a data object common to a received state event; and

initiate an aggregation of the state event and identified queued event.

20. A system for processing information related to financial product offerings and delivering real-time offer updates to a plurality of clients via a data communication network, the information being included in data objects carried on at least one input data stream and representing changes in state of particular product offerings, the data streams being transmitted by at least one information manager component having a respective offer pool containing current states of the product offerings, the system comprising processor-implemented components:

at least one object state manager component, each object state manager component connected to a respective data input stream, comprising an associated object cache and subscriber data indicating subscribers to the respective data input stream relating to a respective type of data objects and each object comprising a key which uniquely identifies the respective data object'"'"'s type, and configured to;

receive a data object on the connected input data stream related to a specific product offering,

update the state of the specific product offering in associated object pool cache in accordance with the state changed indicated in the received data object, wherein the update is configured to;

(i) transmit differences between a first old object and a first new object if the first new object has a same key as the first old object in the object pool cache, and

(ii) delete a second old object and storing and transmitting a second new object in a different type if the second old object has a different type and has a same key as the second new object in the object pool cache;

generate an object event directed to subscribers of the respective data input stream indicating the state change for the specific product offering in accordance with the subscriber data;

a plurality of client session module components, each client session module component being in communication with a respective client and configured to;

receive object events generated by object state manager components connected to an input data stream to which the respective client has subscribed,

upon receiving an object event, evaluate client object rules against the object event, the object rules selected in accordance with the particular data stream associated with the object event, and

generate a state event from the object event indicating the changed state of the specific data object to the respective client in response to a positive evaluation;

a plurality of delivery manager components, each delivery manager component being associated with a respective client session module and configured to;

receive state events generated by the associated client session module, and

send client events derived from the received state events to the respective client; and

a client session manager component having access to a plurality of client profiles, each client profile containing data stream subscription information and related client object rules, the client manager component configured to;

receive an initial communication from a new client;

associate the new client with a new client session module;

retrieve the client profile associated with the new client;

identify a set of data stream subscriptions indicated in the client profile; and

add the new client session module to the subscription data for each object state manager component connected to an input data stream to which the new client is subscribed, wherein a snapshot of the data objects in a current state in the object pool cache associated with the data stream subscriptions in the profile associated with the particular client is delivered to the particular client and the snapshot of the data objects is stored at the particular client and subsequently revised with differential data.