Method and System for Processing Raw Financial Data Streams to Produce and Distribute Structured and Validated Product Offering Data to Subscribing Clients

• US 20110219099A1
• Filed: 04/14/2011
• Published: 09/08/2011
• Est. Priority Date: 08/04/2000
• Status: Active Grant

• Current Assignee: Goldman Sachs & Co. LLC (Goldman Sachs Group Incorporated)
• Original Assignee: Goldman Sachs & Company (Goldman Sachs Group Incorporated)
• Inventors: Smith, Andrew J.R., Cowan, Randy, Thomas, Deane
• Granted Patent: US 8,069,264 B2
• Time in Patent Office: Days
• US Class Current: 709/219
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G06Q 40/06 Asset management; Financial planning or analysis

Abstract

A method and system is disclosed for processing information provided from various content providers in the form objects having states subject to periodic updates. Formatted information indicating a current state of the objects are delivered to subscribing clients in substantially real-time. An information manager module is configured to receiving raw data objects from the content providers, format the information, and broadcast current state information on various broadcast data stream. A client manager module supports multiple client communication sessions and connects to at least one broadcast data stream. Current state information received on a broadcast data stream is processed and transmitted to specific clients in accordance with processing rules specified in the client profiles.

Claims

1-34. -34. (canceled)

35. A system for processing raw data streams carrying a plurality of raw data objects containing information related to financial product offerings and subject to periodic updates, and for delivering substantially real-time offer updates to a plurality of clients via a data communication network, the system comprising:

at least one information manager connected to the raw data streams and providing at least one broadcast data stream as output; and

at least one client manager receiving at least one broadcast data stream as input and transmitting the offer updates to the plurality of clients;

the information manager comprising;

(a) a translator configured to receive the raw data objects as input and generate raw events comprising a set of name-value pairs derived from data in the raw data objects;

(b) a processing database having object typing and formatting rules stored therein;

(c) an offer processor connected to the processing database and configured to, in response to the receipt of a raw event;

determine an object type associated with the raw event; and

generate an external event containing a formatted data object derived from the contents of the received raw event in accordance with the formatting rules;

an object storage pool configured to store a plurality of formatted data objects therein;

(d) an offer pool manager connected to the object storage pool and configured to, upon receipt of an external event;

determine if a prior version of the formatted data object is present in an object storage pool;

if a prior version is present in the object storage pool;

determine a data differential between the formatted data object and the prior version,

update the prior version of the formatted data object to correspond with the generated formatted data object, and

broadcast the data differential on a broadcast data stream;

otherwise, if no prior version is present in the object storage pool;

provide the formatted data object to the connected client manager, and

store the formatted data object in the object storage pool;

the client manager comprising;

(a) at least one object state manager, each object state manager connected to a respective broadcast data stream, comprising an associated object cache and subscriber data indicating subscribers to the respective data input stream, and configured to;

receive a data object on the connected input data stream related to a specific product offering, update the state of the specific product offering in associated object pool cache in accordance with the state changed indicated in the received data object, and generate an object event directed to subscribers of the respective data input stream indicating the state change for the specific product offering in accordance with the subscriber data;

(b) a plurality of client session modules, each client session module being in communication with a respective client and configured to;

receive object events generated by object state managers connected to an broadcast data stream to which the respective client has subscribed, upon receiving an object event, evaluate client object rules against the object event, the object rules selected in accordance with the particular broadcast data stream associated with the object event, and generate a state event from the object event indicating the changed state of the specific data object to the respective client in response to a positive evaluation;

(c) a plurality of delivery managers, each delivery manager being associated with a respective client session module and configured to;

receive state events generated by the associated client session module, and

send client events derived from the received state events to the respective client; and

(d) a client session manager having access to a plurality of client profiles, each client profile containing data stream subscription information and related client object rules, the client manager configured to;

receive an initial communication from a new client;

associate the new client with a new client session module;

retrieve the client profile associated with the new client;

identify a set of data stream subscriptions indicated in the client profile; and

add the new client session module to the subscription data for each object state manager connected to an input data stream to which the new client is subscribed.

36. The system of claim 35, wherein the offer pool manager is configured to select the broadcast data stream from a plurality of broadcast channels in accordance with the object type.

37. The system of claim 35, wherein the offer processor is configured to apply specific formatting rules in accordance with the determined object type.

38. The system of claim 35, the processing database further having object validation conditions stored therein;

the offer processor being further configured to validate the contents of the raw data object in accordance with selected validation conditions.

39. The system of claim 35, wherein the object typing and formatting rules are stored in a tree format;

the tree having a root node and at least one descendant stream nodes, each stream node being associated with a specific raw data stream;

each stream node further having at least one type leaf node descending therefrom, each type leaf node being associated with a specific object type carried by the raw data stream associated with the respective stream node;

each type leaf node having at least one associated object typing rule for identifying objects of the type associated with the respective type leaf node.

40. The system of claim 39, wherein each type leaf node further has at least one associated formatting rule.

41. The system of claim 35, wherein each delivery manager comprises:

a client event queue for containing events to be transmitted to the respective client;

a queue manager configured to place events on the queue in accordance with received state events; and

a push module configured to retrieve events from the client event queue and send appropriate client events to the respective client.

42. The system of claim 41, wherein at least one of the client session and the push module are configured to monitor the performance characteristics for communications with the respective client and dynamically determine a rate at which client events should be transmitted in response to the monitored characteristics;

the push module being configured to send client events to the respective client at the dynamically determined rate.

43. The system of claim 42 wherein the performance characteristics comprise network transmission time and a client processing speed time for received client events.

46. The system of claim 35, further comprising:

a state dispatch module in communication with the information manager and the object caches associated with the object state managers and configured to receive a state data request as input from a requester, retrieve the current states of particular product offerings in accordance with the request, and return the current states to the requestor.

47. The system of claim 46, wherein the object state manager is further configured to, upon first connecting to the respective broadcast data stream, send a request to the state dispatch module to obtain the current states of product offerings carried on the respective broadcast data stream, the obtained currents states being used to initialize the associated object cache.

48. The system of claim 46, wherein the client manager is further configured to send a request to the state dispatch module to obtain the current states of product offerings carried on broadcast data streams to which the new client is subscribed and initiate the return of at least a portion of the obtained current states to the new client.

49. The system of claim 35, wherein the client manager is further configured to:

identify an unconnected broadcast data stream specified in the client profile associated with the new client; and

initiate a connection to the unconnected data stream from a new object state manager.