System and method for message processing and routing

• US 9,258,351 B2
• Filed: 05/31/2013
• Issued: 02/09/2016
• Est. Priority Date: 05/01/2003
• Status: Active Grant

• Current Assignee: Goldman Sachs & Company (Goldman Sachs Group Incorporated)
• Original Assignee: Goldman Sachs & Company (Goldman Sachs Group Incorporated)
• Inventors: Reed, Carl J., Marzo, Michael R., Kanayama, Tomozumi, Krasheninnikov, Konstantin, Beguin, Julien George
• Primary Examiner(s): Walsh, John B
• Application Number:
  US13/906,446
• Publication Number:
  US 20130346547A1
• Time in Patent Office: 984 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/63 Routing a service request depending on the request content or context
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A message routing system that allows applications at either end of the system to run as-is without modification. The system functions in a multithreaded environment and is capable of handling complex routing rules and message transformation. It is also capable of learning and executing new routing rules and message transformations in formats previously unrecognized by the system. The system enables precise and reliable logging of messages throughout processing and supports publication of enterprise-wide broadcast messages. The system further preferably employs cooperating inbound and outbound transport processes for consuming, routing, processing, safely storing and publishing messages in batches of logical units of work to ensure that the logical units of work are not lost in system transactions. The system also preferably utilizes a replay server for preserving and replaying messages that might otherwise fail to reach their intended destinations.

Claims

1. A computerized message routing system comprising:

a plurality of disparate messaging subsystems having different transaction management protocols, wherein the disparate messaging subsystems include a publisher configured to publish messages under general subjects using different transports;

a router configured to run (i) a consumer process that includes multiple consumer threads, (ii) a publisher process that includes multiple publisher threads configured to publish messages from the router, and (iii) an application configured to execute multiple routing rules on inbound messages received from the publisher, wherein the application is also configured to determine a set of specific subjects for each of the inbound messages, the router configured to publish outbound messages to consumers in accordance with one or more subscriptions based on the specific subjects and the general subjects; and

a library having multiple introspection routines configured to be dynamically loaded by the router;

wherein the application is further configured to determine a message type.

2. The computerized message routing system of claim 1, wherein each of the multiple consumer threads is configured to receive messages relating to one of the general subjects.

3. The computerized message routing system of claim 1, wherein the routing system is configured to add additional consumer threads to the multiple consumer threads based on a performance of the router.

4. The computerized message routing system of claim 1, wherein the router is configured to dynamically load one of the introspection routines that contains logic for handling the message type determined by the application.

5. The computerized message routing system of claim 1, further comprising:

a server configured to replay the messages on demand.

6. The computerized message routing system of claim 1, wherein the router is configured to dynamically determine the multiple routing rules.

7. A method for operating a computerized message routing system, the method comprising:

receiving, from a publisher, a message associated with a general subject;

determining a message type of the message;

consuming, via one of a plurality of consumer threads running on a router, the message from the publisher;

dynamically loading, on the router, a selected one of a plurality of introspection routines from a library based on the message type, the selected introspection routine containing logic for handling the message type;

determining a set of specific subjects for the message using the selected introspection routine; and

publishing the message to a set of consumers in accordance with one or more subscriptions based on the specific subjects and the general subject.

8. The method of claim 7, wherein publishing the message to the set of consumers includes transforming the message into a format previously unrecognized by the computerized message routing system.

9. The method of claim 7, further comprising receiving from the consumers a desired format.

10. The method of claim 9, wherein publishing the message to the set of consumers includes transforming the message into the desired format.

11. The method of claim 7, further comprising receiving the one or more subscriptions from the set of consumers.

12. The method of claim 7, wherein the message is received from the publisher using one of a plurality of transports.

13. The method of claim 7, wherein the plurality of consumer threads is dynamically adjusted based on a performance of the router.

14. A non-transitory computer-readable storage medium containing a set of instructions to cause one or more processors to:

receive, from a publisher, a message associated with a general subject;

consume, via one of a plurality of consumer threads running on the one or more processors, the message from the publisher;

determine a set of specific subjects for the message;

publish the message to a set of consumers in accordance with one or more subscriptions based on the specific subjects and the general subject; and

add or remove a consumer thread from the plurality of consumer threads based on one or more performance metrics.

15. The non-transitory computer-readable storage medium of claim 14, wherein the set of instructions further causes the one or more processors to receive from the consumers a desired format and transform the message into the desired format.

16. A non-transitory computer-readable storage medium containing instructions that cause one or more processors to:

receive, from a publisher, a message associated with a general subject;

determine a message type of the message;

consume, via one of a plurality of consumer threads, the message from the publisher;

dynamically load a selected one of a plurality of introspection routines from a library based on the message type, the selected introspection routine containing logic for handling the message type;

determine a set of specific subjects for the message using the selected introspection routine; and

publish the message to a set of consumers in accordance with one or more subscriptions based on the specific subjects and the general subject.

17. The non-transitory computer-readable storage medium of claim 16, wherein the instructions that cause the one or more processors to publish the message to the set of consumers includes:

instructions that cause the one or more processors to transform the message into a format previously unrecognized by the one or more processors.

18. The non-transitory computer-readable storage medium of claim 16, further containing instructions that cause the one or more processors to:

receive from the consumers a desired format; and

transform the message into the desired format.

19. The non-transitory computer-readable storage medium of claim 16, further containing instructions that cause the one or more processors to receive the one or more subscriptions from the set of consumers.

20. A non-transitory computer-readable storage medium containing a set of instructions to cause one or more processors to:

receive, at a first instance of a router from a publisher, a message associated with a general subject;

consume, via one of a plurality of consumer threads running on the one or more processors, the message from the publisher;

determine a set of specific subjects for the message;

publish the message to a set of consumers in accordance with one or more subscriptions based on the specific subjects and the general subject; and

monitor a measure of thread management overhead and create a second instance of the router when the measure exceeds a threshold.